yeah, we had a bunch of them crawling out git repositories in a very aggressive ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		PaulDavisThe1st on July 21, 2024 \| parent \| context \| favorite \| on: The data that powers AI is disappearing fast yeah, we had a bunch of them crawling out git repositories in a very aggressive way, repeating the crawl within a few days, etc. etc. 403 to the lot of them, regardless of the bot's purpose.

aitchnyu on July 23, 2024 [–]

Whats the deal with (Amazon) bots crawling private Gitlabs aggressively?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact