Tool en

Show HN: AI-drop project – drop traffic fast from misbehaving crawlers (AGPL)

Source: Show HN · Added Friday, November 13, 2026

Hello! All started with 4 million requests / day on rocketgit.com (AGPL git hosting). Instead of thousands. Enough is enough! Presentation (8 pages): https://rocketgit.com/user/catalinux/ai-drop/artefacts/downl... So, I built AI-drop free-software project (AGPL) to block this kind of crawlers. rocketgit.com has a very restrictive robots.txt (only around 10 pages are allowed). But the crawlers are not respecting it. So, who is not respecting it will be blocked. Limiting by IP or user-agent is not working anymore. The crawlers are using millions of IPs and it takes days to reuse an IP. And they

Open the original Discover more

Frequently Asked Questions

What is Show HN: AI-drop project – drop traffic fast from misbehaving crawlers (AGPL)?

Show HN: AI-drop project – drop traffic fast from misbehaving crawlers (AGPL) is a tool discovery curated from Show HN. Hello! All started with 4 million requests / day on rocketgit.com (AGPL git hosting). Instead of thousands. Enough is enough! Presentation (8 pages)…

How can I access or experience this?

You can experience this content directly on its original host (Show HN) by clicking the "Open Original" button.

Where does this content come from?

Curated from Show HN by the OnSuggest team to surface the most interesting and serendipitous content on the web.

All Developer tools discoveries →