Lemmy.ca Support / Questions

507 readers

5 users here now

Support / Questions specific to lemmy.ca.

For support / questions related to the lemmy software itself, go to [email protected]

founded 4 years ago

MODERATORS

Should we block OpenAI from scrapping the server? (platform.openai.com)

submitted 2 years ago by mp3 to c/lemmy_ca_support

21 comments fedilink hide all child comments

Right now, robots.txt on lemmy.ca is configured this way

User-Agent: *
  Disallow: /login
  Disallow: /login_reset
  Disallow: /settings
  Disallow: /create_community
  Disallow: /create_post
  Disallow: /create_private_message
  Disallow: /inbox
  Disallow: /setup
  Disallow: /admin
  Disallow: /password_change
  Disallow: /search/
  Disallow: /modlog

Would it be a good idea privacy-wise to deny GPTBot from scrapping content from the server?

User-agent: GPTBot
Disallow: /

Thanks!

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 2 years ago (1 children)

Just out of curiosity, why is everyone so up in arms about this? I mean sure it's just another corp but any other reasons?

[–] corsicanguppy 6 points 2 years ago (1 children)

Server load spent on a bot scraping our contributions to be used to make money.

There's so much there that it's gonna offend someone.

[–] [email protected] 1 points 2 years ago

Wouldn't it just be scraped once (per company)? That doesn't sound like such a problem.