Robots.txt disallow all with nginx
Last updated
Was this helpful?
Last updated
Was this helpful?
If you’re managing an environment similar to a production and want to keep bots from indexing traffic, it’s customary to add a robots.txt file at the root of your website to . Instead of creating a two-line plain text file, you can do this with only nginx:
Add this into your configuration management as determined by environment, or add it by hand, and no longer worry if Google might start broadcasting your dev site to the world.