this post was submitted on 06 Dec 2023
11 points (86.7% liked)

AI

4756 readers
7 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 4 years ago
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] -3 points 1 year ago (4 children)

The main argument behind the article is that only Big AI can afford to pay for licensed materials to train their AI, so this will hurt the small developers.

Does small/indie AI even exist? I was under the impression that it requires massive amounts of processing power to even run these AI.

[โ€“] [email protected] 1 points 1 year ago

It's possible to run small AIs on gaming PCs. For Stable Diffusion and small LLMs (7, maybe 13B), a GPU with 4GB (or even 2GB?) VRAM is sufficient. A high-end gaming PC can also be used to modify them (ie make LoRas, etc.). Cloud computing is quite affordable, too.

Stable Diffusion, which had such an impact, reportedly cost only 600k USD to train. It should be possible to make a new one for a fraction of that today. Training MPT-7B cost MosaicML reportedly 200k USD. Far from hobbyist money, but not big business, either.

load more comments (3 replies)