Knowledge Base Article

Aurora SEO: Regulate content crawling by search engines using robots.txt

When you publish content in the community, search engines (web robots or web crawlers) crawl these newly published pages to discover and gather information from them. After crawling the content, th...

Updated 5 months ago

Version 5.0

Advisor

12 months ago

tyw Thx. I wasn't aware that it's for Aurora because I was seraching for that topic and have entered this article by clicking on the search result without further investigation.