this post was submitted on 10 Jul 2025
45 points (95.9% liked)

Asklemmy

49406 readers
513 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 6 years ago
MODERATORS
 

Almost every website and services are getting scraped at alarming rate, are Lemmy servers facing this issue?

Please share mitigations you've seen applied to this.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 27 points 5 days ago (7 children)

I think lemmy content is scraped too, just how the whole web is beeing scraped. I do not have any proof for it though.

I have seen a user add a like anti-commercial AI license as a footer for every comment he writes lol

[โ€“] [email protected] 14 points 5 days ago (2 children)

It is, I saw claudebot and gptbot scraping my instance, made a post about it on fuckai, but i have blocked all these bots now and my instance is a lot faster.

[โ€“] [email protected] 8 points 5 days ago (1 children)

Out of curiosity, I am not familiar with the stack that runs the behind the scenes at all for lemmy. Are you blocking IP ranges or something else?

[โ€“] [email protected] 7 points 5 days ago

I use this nginx extension, it has a lot of rules, they mix IP, user agent, etc, to block a response it seems. Like adblocking rules, but for bots.

load more comments (4 replies)