this post was submitted on 21 Mar 2025
155 points (98.7% liked)

Linux

6583 readers
320 users here now

A community for everything relating to the GNU/Linux operating system

Also check out:

Original icon base courtesy of [email protected] and The GIMP

founded 2 years ago
MODERATORS
 

LLM scrapers are taking down FOSS projects' infrastructure, and it's getting worse.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 23 points 17 hours ago (2 children)

the solution here is to require logins. thems the breaks unfortunately. it'll eventually pass as the novelty wears off.

[–] [email protected] 6 points 14 hours ago (2 children)

Alternative: require a proof of work calculation.

[–] [email protected] 0 points 4 hours ago

Make them mine a BTC block in the Browser!


^Sorry, I'm low in blood and full of mosquito vomit. That's probably making me think weird stuff.^

[–] [email protected] 2 points 11 hours ago (1 children)

This is exactly what we need to do. You'd think that a FOSS WAF exists out there somewhere that can do this

[–] [email protected] 2 points 11 hours ago (2 children)

There is. That screenshot you see in the article is a picture of a brand new one, Anubis

[–] [email protected] 3 points 10 hours ago

Yeah I realised that after posting. I think we need a better one to deal with the cases of letting legitimate users in easier though

[–] [email protected] 1 points 9 hours ago

It kind of sucks but it is the best we have for the moment

[–] [email protected] 9 points 17 hours ago (2 children)

Next you'll have to invest in preventing automated signups

[–] [email protected] 2 points 11 hours ago

not really, just tie it with 2fa SMS style and the hurdle is large enough most companies won't bother.

[–] [email protected] 4 points 16 hours ago (1 children)

Signups in most platforms are quite hard. Straight up give your phone and do SMS verification, or at least give email and to register that email you will have to provide phone anyway. Captchas nowadays became so hard that even humans struggle with them and it often takes multiple attempts to get it right.

[–] [email protected] 2 points 7 hours ago (1 children)

provide phone number to look at this foss project's website, not too sure about that

[–] [email protected] 2 points 3 hours ago

Honestly if any site demands my phone number it can get fucked.