Understanding robots.txt and sitemap.xml files
  • 20 May 2022
  • 1 Minute to read

Understanding robots.txt and sitemap.xml files


All Members Portals include two files that are used for search engine referencing.

Neither robots.txt or sitemap.xml can be edited.

robots.txt

The robots.txt file lets search engines know which pages of your Members Portal are accessible to the public. You can access your Members Portal robots.txt file using any browser. All you need to do is add /robots.txt at the end of your Members Portal domain.

For example, if your Members Portal domain is coworking.com, you can access your portal's robot.txt file by adding coworking.com/robots.txt in any browser tab's URL.

sitemap.xml

The sitmap.xml file lets search engines know how each page of your Members Portal can be accessed by providing the structure of the site. You can access your Members Portal sitemap.xml file using any browser. All you need to do is add /sitemap.xml at the end of your Members Portal domain.

For example, if your Members Portal domain is coworking.com, you can access your portal's robot.txt file by adding coworking.com/sitemap.xml in any browser tab's URL.