- Using the CLI
- In the Console
To not restrict indexers on your production environment, run the following command:
How it’s done
When the Hide from search engines is activated, search engines are turned away from environments by including aX-Robots-Tag header:
upsun.site domains, and it’s automatically off for production environments with a custom domain.
Alternative method
You can also send instructions to search engine indexers using arobots.txt file.
Your app can serve this as a static file from its disk or as a dynamic response from its passthru.
Control either with the location section of your app configuration.
If your robots.txt file includes instructions to ignore a page,
search engine indexers may ignore it even if you have configured Upsun to not send the header.