XenForo XenForo Robots.txt Guide – How to Use It

CR LEAKS · 2024-08-03T10:54:06+00:00

Step 1 : Having a robots.txt is extremely important for your XenForo forum. It tells search engines which pages to crawl and which pages to skip. This is your chance to build out a proper structure for the robots.txt file so that it will exclude non-important pages Step 2 : When you install XenForo onto your hosting server, robots.txt is not be included in the package. However, creating one takes less than 30 seconds Step 3 : Here is our recommended robots.txt file for XenForo User-agent: * Disallow: /find-new/ Disallow: /account/ Disallow: /login/ Disallow: /admin.php Disallow: /search/ Disallow: /whats-new/ Allow: / Sitemap: https://domain.com/sitemap.xml

Thread starter CR LEAKS
Start date Aug 3, 2024

CR LEAKS

Administrative

Aug 3, 2024

Step 1 :

Please, Log in or Register to view quote content!

Step 2 :

Please, Log in or Register to view quote content!

Step 3 :

Please, Log in or Register to view quote content!

Code:

Please, Log in or Register to view codes content!

You must log in or register to reply here.

Facebook X (Twitter) Reddit Pinterest Tumblr WhatsApp Email Link

Forums
Forums

4,485Threads

10,411Messages

39,628Members

cecelia_roseLatest member

This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.

Accept Learn more…

Top