llms.txt is the emerging standard for telling AI engines what your site is about — a curated, plain-text map they can actually read. Generate a spec-correct file in a minute, or validate the one you have.
Same tool as a zero-dependency CLI — build an llms.txt straight from your sitemap, or validate one in CI so it can't silently rot.
pip install llms-txt-kit llms-txt generate --from-sitemap yoursite.com \ --name "Your Site" --description "What you do." -o llms.txt llms-txt validate yoursite.com --strict
Open source, MIT licensed — github.com/SEMPITEHQ/llms-txt-kit
Upload it to your site root so it's reachable at yoursite.com/llms.txt — exactly like robots.txt. Plain text, UTF-8.
It's an emerging standard: adoption among AI crawlers is growing and publishing one costs nothing. It also forces the useful exercise of writing a machine-readable summary of your business — which pays off across all AI surfaces.
robots.txt says where crawlers may go. llms.txt says what your site means — a curated summary plus your most important links, written for language models.