Free Shopify tool
AI Crawler & Technical SEO Checker
Inspect robots.txt access for common AI search and user agents, plus your sitemap and basic page response.
What the crawler check tells you
AI providers use different user agents for search, user-requested retrieval, and model training. This tool evaluates access to the submitted public URL according to the site's robots.txt rules. An allowed result means the rule does not block that URL; it does not prove that the provider has indexed it.
What is llms.txt?
llms.txt is a proposed convention for publishing a concise Markdown guide to a site. It is optional and is not a documented requirement for inclusion in ChatGPT, Claude, Perplexity, Google, or Bing AI search results.
Frequently asked questions
Does an allowed crawler guarantee an AI citation?
No. robots.txt access only removes one retrieval barrier. The service still decides whether to crawl, index, cite, or recommend the page.
Is llms.txt required for AI search visibility?
No major AI search provider currently documents llms.txt as a requirement. Treat it as an optional summary, not a replacement for public pages, sitemaps, or internal links.
Provider documentation
See how Dropstore interprets observations in its measurement methodology.