Our approach: we crawl your main page, then parse metatags and links to construct the llms.txt. The key is that this process happens without relying on any LLMs, which keeps it very fast and our operational costs extremely low. This allows us to offer it completely free.

Check it out on the homepage, or just send a GET request:

https://get.llms.page/{yourwebsite}/llms.txt

We'd appreciate any feedback or suggestions for features/improvements.