CR LEAKS
Administrative
Step 1 :
One misconception that we see often is the use of robots.txt for noindexing of content
Step 2 :
Disallowing search engines to crawl a specific directory on your site does not mean search engines will not index it. The best practice for this case is to use the meta robot tags
Step 3 :
For example, a forum owner would like Google not to index any of their XenForo member’s pages. This can be achieved by placing the following meta tag right before the closing </head> tag inside of the member_view template
Step 4 :
One misconception that we see often is the use of robots.txt for noindexing of content
Step 2 :
Disallowing search engines to crawl a specific directory on your site does not mean search engines will not index it. The best practice for this case is to use the meta robot tags
Step 3 :
For example, a forum owner would like Google not to index any of their XenForo member’s pages. This can be achieved by placing the following meta tag right before the closing </head> tag inside of the member_view template
Step 4 :
