 |  |
 | Where results make sense |
|
 |  |
factbot and robots.txtfactbot is a search engine bot used to index pages on your site. If you see this factbot mentioned as the agent in your server logs, it means that your site is being evaluated for inclusion in FactBites.What is FactBites? We like to say it's a cross between a search engine and an encyclopedia. It provides full sentence results, rather than excerpts like other search engines. factbot adheres to the Robots.txt Exclusion Standard. This means that factbot first checks for permission to download pages from your site by downloading a file called robots.txt. To block factbot from your server, include the following lines in robots.txt:
User-agent: factbot Disallow: /If you have any questions or difficulties, please contact us. |
Try your search on: Qwika (all wikis)