This one is my favorite of the bunch. Wix Studio’s AI Search Lab published my research on whether AI bots are actually crawling LLMs.txt files.
At Archer we added the file to seven sites and watched the logs for three months. The data surprised people: OpenAI’s search bot accounted for the overwhelming majority of pings, coming back every few minutes looking for fresh content. This research is also the piece of mine that ended up cited in ChatGPT responses, which felt like the experiment closing its own loop.