Noindex Module

This module adds <meta name="robots" content="noindex"> to white-listed paths to prevent the content from being indexed by search engines.

Note that the same functionality is not achieved by disallowing a path in robots.txt.

For further information on what this meta tag does and why using this technique is better than disallowing a node in 'robots.txt' see the following articles:

• https://developers.google.com/search/docs/advanced/robots/intro
• https://developers.google.com/search/docs/advanced/crawling/block-indexing

The goal of this project is to deliver only this functionality and stay simple, small, and secure. For other modules with a longer list of features see the "Similar modules" section below.

Requirements

None.

Installation & Setup

1. Install and enable the module.
2. Configure the white-listed paths at /admin/config/search/noindex

Troubleshooting

You can check the source code of your pages in a web browser to see if the meta tag was inserted correctly. Please give the search engines some time to delist your pages from the search results.

The robots.txt at the root of your domain must not contain the paths you specified, since this would block search engine crawlers from reaching the code that contains the meta tag.

Similar Modules

Metatag - Extensive module that provides a large number of meta tags and configuration options.