@elshid @Codeberg @evan yes, absolutely agree - as long as LLM scraper bots don't follow simple rules (like following robots.txt files) and act not like a destruction swarm on services, I'm not sorry for LLM users not finding the information.
I've seen LLM-bot swarms hitting forges and the only way to get the forges running for the intended audience was blocking . Sad thing is the scrapers then try to circumvent the blocks aggressively, even dropping their IDs so the blocking gets more complicated again. It's an arms race, and legit users of LLMs are not in the focus of any of the racing parties.