320
DeepSeek's AI breakthrough bypasses industry-standard CUDA, uses assembly-like PTX programming instead
(www.tomshardware.com)
this post was submitted on 28 Jan 2025
320 points (96.2% liked)
Technology
61227 readers
5263 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
What is amazing in this case is that they achieved spending a fraction of the inference cost that OpenAI is paying.
Plus they are a lot cheaper too. But I am pretty sure that the American government will ban them in no time, citing national security concerns, etc.
Nevertheless, I think we need more open source models.
Not to mention that NVIDIA also needs to be brought to earth.
Even if they get banned, any startup could replicate their work if it is truly open source. The best thing about their solution is that it breaks the CUDA monopoly that NVDA has enjoyed. Buy your puts when NVDA bounces because that stock is GOING DOWN. There’s no world where a company that makes GPU’s is worth more than both Apple and Microsoft. It’s inevitable.
Never forget kids the market can stay irrational much longer than you can stay solvent.
True. Thats why I tend to make small plays instead of being an absolute degenerate gambler.
It’s written in nvidia instruction set PTX which is part of CUDA ecosystem.
Hardly going to affect nvidia
I wish that was true, but this doesn't threaten any monopoly
~~It certainly does.~~
~~Until last week, you absolutely NEEDED an NVidia GPU equipped with CUDA to run all AI models.~~
~~Today, that is simply not true. (watch the video at the end of this comment)~~
~~I watched this video and my initial reaction to this news was validated and then some: this video made me even more bearish on NVDA.~~
Edit: corrected and redacted.
mate, that means they are using PTX directly. If anything, they are more dependent to NVIDIA and the CUDA platform than anyone else.
to simplify: they are bypassing the CUDA API, not the NVIDIA instruction set architecture and not CUDA as a platform.
Ahh. Thanks for this insight.
also not true
Thanks for the corrections.