SiteMindBot

SiteMindBot is the SiteMind web crawler. It reads a website's own public pages so the SiteMind AI assistant can answer that business's visitor questions, on the business's behalf.

What it is

An automated reader that builds a question-and-answer knowledge base from a site's public pages.

When it runs

Only on sites whose owner installed SiteMind and asked us to read their site.

Contact

Questions about the crawler go to support@sitemind.bot.

The user-agent it sends

SiteMindBot identifies itself with this exact user-agent string:

SiteMindBot/1.0 (+https://sitemind.bot/bot)

The +https://sitemind.bot/bot part of that string links back to this page, so anyone reviewing their traffic can look up what the crawler is.

Why SiteMindBot visited your site

The site uses SiteMind, and its owner asked us to read it.
SiteMindBot reads only public pages — the same pages any visitor can open.
It uses what it reads to build that site's question-and-answer knowledge base.
It does not submit forms, make purchases, or take any action on the site.

How to allow SiteMindBot

Allow the user-agent SiteMindBot at your host, server, or firewall.
If your security tool challenges unknown bots, add SiteMindBot to its allow list.

If you are a SiteMind customer and need steps for your specific host, open the Help section in your SiteMind dashboard for host-specific instructions.

How to block SiteMindBot

Block the user-agent SiteMindBot at your host, server, or firewall.
If you block it, the SiteMind assistant on that site will not get new content from those pages.

Contact us

Questions about SiteMindBot go to support@sitemind.bot.

SiteMindBot at a glance

It reads only public pages on sites whose owner installed SiteMind.

It identifies itself as SiteMindBot/1.0 (+https://sitemind.bot/bot).

Allow or block the user-agent at your host or firewall. Need help? Email support@sitemind.bot.