Futurology

2038 readers

41 users here now

founded 2 years ago

MODERATORS

[email protected]

189

AI Companies Running Out of Training Data After Burning Through Entire Internet (futurism.com)

submitted 10 months ago by [email protected] to c/[email protected]

52 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 4 points 10 months ago* (last edited 10 months ago)

Well, it's established wisdom that the dataset size needs to scale with the number of model parameters. Quadratically, IIRC. If you don't have that much data the training basically won't work; it will overfit or just not progress.

permalink
fedilink
source
parent