Trust

SearchedlyBot

SearchedlyBot is the crawler Searchedly uses to check how websites appear to AI assistants, at the request of the site's owner or as part of public research.

How to recognize it

Every request carries this user agent:

SearchedlyBot/1.0 (+https://searchedly.com/bot)

How it behaves

It reads and obeys robots.txt, including Crawl-delay.
It makes at most 1 request per second to a site, one at a time.
It only fetches publicly available pages. It never logs in, submits forms or bypasses paywalls.
It only connects to public internet addresses.
If a Crawl-delay is longer than 30 seconds, it reads fewer pages rather than ignoring it.
When a page shows its content only with JavaScript, it may load that page in a headless browser, under the same rules. It never runs anything on your servers beyond loading the page.
Pages marked noai (a robots meta tag or an X-Robots-Tag header) are never sent to an AI model. Only facts from structured data, such as your page title, are kept.
Content it fetches is not used to train AI models.

How to limit or block it

Add a rule for SearchedlyBot to your robots.txt. To block it everywhere:

User-agent: SearchedlyBot
Disallow: /

To slow it down instead:

User-agent: SearchedlyBot
Crawl-delay: 10

To let it read your pages but keep them away from AI models, add this to a page's head:

<meta name="robots" content="noai">

Changes take effect the next time it reads your robots.txt, normally within 24 hours.

Contact

If you believe SearchedlyBot is misbehaving, email abuse@searchedly.com with the URL, time and IP address, and we'll investigate. See also our Acceptable Use Policy.