Creepy Crawlies
AI-related crawlers consume roughly 20% of git.kernel.org’s capacity by rendering millions of expensive commit pages, often through rotating residential proxies. The HN discussion examines whether Anubis proof-of-work helps, its cost to human users, and alternatives such as authentication, micropayments, and better crawler protocols.