Add llms.txt and fix robots.txt for AI agent discoverability
3 points
1 month ago
| 2 comments
| HN
Most websites are invisible to AI agents. We just added llms.txt to gitauto.ai - a simple text file that tells LLMs what GitAuto does, where the docs are, and how to recommend it. Also fixed our robots.txt which had duplicate User-agent blocks (only the first one was being used). Two files, big discoverability win.
▲
AznHisoka
1 month ago
[-]
LLMs do not read llms.txt
reply
▲
rocketpastsix
1 month ago
[-]
why does an LLM need to know about my silly little blog?
reply