The google.com/bot in apache access.log are dangerous?
by usodiario from LinuxQuestions.org on (#4YS1V)
Debian 10 - Apache - MariaDB - PHP7.3
Hi, I am learning a little about servers and I am worried about the security.
1. I would like to know what these messages mean:
2. Are they dangerous?
3. Because there are .txt files. html .pdf ...?
4. Is it necessary to make a block?
5. Can they be locked automatically with fail2ban?
Code:/var/log/apache2/access.log
66.249.79.94 - - [01/Feb/2020:19:45:08 +0000] "GET /robots.txt HTTP/1.1" 404 397 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
85.238.98.220 - - [01/Feb/2020:19:47:07 +0000] "GET / HTTP/1.1" 200 10940 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601$
66.249.79.213 - - [01/Feb/2020:19:47:11 +0000] "GET /robots.txt HTTP/1.1" 404 397 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.79.215 - - [01/Feb/2020:19:47:12 +0000] "GET /wlqhjiparjqbk.html HTTP/1.1" 404 397 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.79.68 - - [01/Feb/2020:19:54:36 +0000] "GET /manual/es/mod/mod_proxy_hcheck.html HTTP/1.1" 200 5306 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (K$
66.249.79.94 - - [01/Feb/2020:19:54:39 +0000] "GET /manual/style/css/prettify.css HTTP/1.1" 200 1427 "http://138.68.0.30/manual/es/mod/mod_proxy_hcheck.html" "Mozilla/5.0 (Linux; Android 6.0.$
178.236.114.175 - - [01/Feb/2020:19:57:25 +0000] "GET / HTTP/1.1" 200 10940 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36"
144.217.130.102 - - [01/Feb/2020:20:03:54 +0000] "GET //wp2/wp-login.php HTTP/1.1" 404 360 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:62.0) Gecko/20100101 Firefox/62.0"
66.249.79.68 - - [01/Feb/2020:20:04:04 +0000] "GET /manual/zh-cn/vhosts/examples.html HTTP/1.1" 200 6440 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHT$
Apache error.log is normal
Thanks
Hi, I am learning a little about servers and I am worried about the security.
1. I would like to know what these messages mean:
2. Are they dangerous?
3. Because there are .txt files. html .pdf ...?
4. Is it necessary to make a block?
5. Can they be locked automatically with fail2ban?
Code:/var/log/apache2/access.log
66.249.79.94 - - [01/Feb/2020:19:45:08 +0000] "GET /robots.txt HTTP/1.1" 404 397 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
85.238.98.220 - - [01/Feb/2020:19:47:07 +0000] "GET / HTTP/1.1" 200 10940 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/601.7.7 (KHTML, like Gecko) Version/9.1.2 Safari/601$
66.249.79.213 - - [01/Feb/2020:19:47:11 +0000] "GET /robots.txt HTTP/1.1" 404 397 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.79.215 - - [01/Feb/2020:19:47:12 +0000] "GET /wlqhjiparjqbk.html HTTP/1.1" 404 397 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.79.68 - - [01/Feb/2020:19:54:36 +0000] "GET /manual/es/mod/mod_proxy_hcheck.html HTTP/1.1" 200 5306 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (K$
66.249.79.94 - - [01/Feb/2020:19:54:39 +0000] "GET /manual/style/css/prettify.css HTTP/1.1" 200 1427 "http://138.68.0.30/manual/es/mod/mod_proxy_hcheck.html" "Mozilla/5.0 (Linux; Android 6.0.$
178.236.114.175 - - [01/Feb/2020:19:57:25 +0000] "GET / HTTP/1.1" 200 10940 "-" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36"
144.217.130.102 - - [01/Feb/2020:20:03:54 +0000] "GET //wp2/wp-login.php HTTP/1.1" 404 360 "-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:62.0) Gecko/20100101 Firefox/62.0"
66.249.79.68 - - [01/Feb/2020:20:04:04 +0000] "GET /manual/zh-cn/vhosts/examples.html HTTP/1.1" 200 6440 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHT$
Apache error.log is normal
Thanks