LLMs.txt Checker

An llms.txt checker looks for a /llms.txt file on a domain and tests it against the proposal: a Markdown title, a short summary and sections of links. llms.txt is a proposal, not an official standard, and major AI search products have not confirmed they use it.

This tool fetches the address you enter once, from our server, and reports what a crawler would receive. The URL is not stored; only a short-lived rate-limit counter is kept. Results show the page at the moment of the check and can differ from what a logged-in browser or a bot with different headers sees.

How to read the result and act on it

Read the result in two parts: whether the file exists at /llms.txt, and whether it follows the proposed shape. A passing file has a Markdown H1 title, a short blockquote summary and sections with lists of links, each link with a brief description. If the file is missing, decide whether you want one before creating it. If it exists but fails, fix the structure: add the title, write a one or two sentence summary and group links under clear headings. Make sure each link points to a live, canonical page. Keep the file short and useful, and update it when key pages change.

Common mistakes to avoid

Do not expect llms.txt to change your visibility. It is a proposal, and major AI search products have not confirmed they use it, so treat it as a low-cost extra rather than a priority above content and crawl access. Another mistake is listing every URL on the site, which defeats the purpose of a curated guide. Avoid links to redirected, blocked or noindexed pages. Do not confuse it with robots.txt: llms.txt does not allow or disallow anything. People also publish it with the wrong content type or in a subfolder, so check it loads at the root as plain text or Markdown.

Does llms.txt improve AI visibility?

There is no confirmed evidence that major AI search products use it for ranking or citation. Treat it as low-cost housekeeping.

What goes in llms.txt?

A Markdown title, a one-line summary and curated links to your most useful pages, grouped under headings.

Who created the llms.txt proposal?

The llms.txt proposal was published in 2024 by Jeremy Howard of Answer.AI. It suggests a Markdown file at the site root that gives language models a curated overview and links. It remains a community proposal and is not an official web standard.

Should I add llms.txt to my website?

It is optional. If you have documentation or a clear set of key pages, a short file is cheap to make and can help tools that read it. Do not expect search gains, and put effort into content quality and crawl access first.

• LLMs.txt Generator: Create an llms.txt file so AI engines can find and cite your best content.
• AI Crawler Access Checker: Check whether your robots.txt allows or blocks Googlebot, GPTBot, ClaudeBot, PerplexityBot and other AI crawlers.
• AI Search Readiness Checklist: Score your site against a practical AEO / GEO checklist for AI Overviews, AI Mode and answer engines.

Browse all 9 free ai & geo tools, or see the full free SEO toolbox. If you would rather have this handled for you, take a look at our AEO and AI search services and the results from real projects.