Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

59194 readers

900 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others

Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):

🏴‍☠️ Other communities

Torrenting/P2P:

Gaming:

💰 Please help cover server costs.


Ko-fi	Liberapay

founded 2 years ago

MODERATORS

[email protected]

156

Copyright lawsuits against Meta and OpenAI mention shadow libraries, including Library Genesis, as sources of training data (archive.md)

submitted 2 years ago by [email protected] to c/[email protected]

19 comments fedilink hide all child comments

cross-posted from: https://lemmy.world/post/1330512

Below are direct quotes from the filings.

OpenAI

As noted in Paragraph 32, supra, the OpenAI Books2 dataset can be estimated to contain about 294,000 titles. The only “internet-based books corpora” that have ever offered that much material are notorious “shadow library” websites like Library Genesis (aka LibGen), Z-Library (aka B-4ok), Sci-Hub, and Bibliotik. The books aggregated by these websites have also been available in bulk via torrent systems. These flagrantly illegal shadow libraries have long been of interest to the AI-training community: for instance, an AI training dataset published in December 2020 by EleutherAI called “Books3” includes a recreation of the Bibliotik collection and contains nearly 200,000 books. On information and belief, the OpenAI Books2 dataset includes books copied from these “shadow libraries,” because those are the most sources of trainable books most similar in nature and size to OpenAI’s description of Books2.

Meta

Bibliotik is one of a number of notorious “shadow library” websites that also includes Library Genesis (aka LibGen), Z-Library (aka B-ok), and Sci-Hub. The books and other materials aggregated by these websites have also been available in bulk via torrent systems. These shadow libraries have long been of interest to the AI-training community because of the large quantity of copyrighted material they host. For that reason, these shadow libraries are also flagrantly illegal.

This article from Ars Tecnica covers a few more details. Filings are viewable at the law firm's site here.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 54 points 2 years ago (11 children)

Shadow libraries is such a metal name. Information should be free ya fucks. Eat shit.

[–] [email protected] -4 points 2 years ago (7 children)

You really think people would spend a lifetime writing books if they couldn't make money from it?

Things which are free have no value, both economic and societal. Even when we pirate stuff, at least our society encourages creative labour.

[–] [email protected] 17 points 2 years ago (1 children)

I can see economic, but what do you mean by no societal value?

Free access allows people to participate in culture and society that otherwise couldn't. That seems like a positive.

[–] [email protected] 13 points 2 years ago

Not even economic. There's all of the textbooks on LibGen. Having access to those means even poor people can get a shot at learning with expensive textbooks. Having easier access to education means the population can be more productive and work in high impact fields.

load more comments (5 replies)

load more comments (8 replies)