Nginx correct settings for disabling robots
by newbie14 from LinuxQuestions.org on (#572CD)
Hi,
I have my daily logwatch which I view. In that I see logs on robots was logged in.
Below is the content of my robots.txt.
Quote:
Next here is my nginx.conf where I try to block this robots.
Quote:
Or I also google some put deny all ? What is the most correct method to do this settings?
I have my daily logwatch which I view. In that I see logs on robots was logged in.
Below is the content of my robots.txt.
Quote:
| User-agent: * Disallow: / |
Quote:
| location = /robots.txt { add_header Content-Type text/plain; return 200 "User-agent: *\nDisallow: /\n"; } |