this post was submitted on 27 Jan 2025
48 points (90.0% liked)
World News
573 readers
470 users here now
Rules:
- Be a decent person
- No spam
- Add the byline, or write a line or two in the body about the article.
Other communities of interest:
founded 4 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
it does not take an entire nvidia datacenter to serve one customer. the largest model appears to run on a high end rig.
The largest model, the only one that beats GPT is like 700gb.
It’s not running on a high end rig, it’s running on a server.