This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
The "1 trillion" never existed in the first place. It was all hype by a bunch of Tech-Bros, huffing each other's farts.
Almost like yet again the tech industry is run by lemming CEOs chasing the latest moss to eat.
The best part is that it's open source and available for download
So can I have a private version of it that doesn't tell everyone about me and my questions?
I asked it about Tiananmen Square, it told me it can't answer that because it can only respond with "harmless" responses.
Yes the online model has those filters. Some one tried it with one of the downloaded models and it answers just fine
You misspelled "lies". Or were you trying to type "psyops tool"??
When running locally, it works just fine without filters
I tried the smaller models and it's not fine. It's hard coded.
Yes but your server can't handle the biggest LLM.
The economy rests on a fucking chatbot. This future sucks.
On the brightside, the clear fragility and lack of direct connection to real productive forces shows the instability of the present system.
This just shows how speculative the whole AI obsession has been. Wildly unstable and subject to huge shifts since its value isn't based on anything solid.
Wow, China just fucked up the Techbros more than the Democratic or Republican party ever has or ever will. Well played.
Nvidia’s most advanced chips, H100s, have been banned from export to China since September 2022 by US sanctions. Nvidia then developed the less powerful H800 chips for the Chinese market, although they were also banned from export to China last October.
I love how in the US they talk about meritocracy, competition being good, blablabla... but they rig the game from the beginning. And even so, people find a way to be better. Fascinating.
You're watching an empire in decline. It's words stopped matching its actions decades ago.
Don't forget about the tariffs too! The US economy is actually a joke that can't compete on the world stage anymore except by wielding their enormous capital from a handful of tech billionaires.
So if the Chinese version is so efficient, and is open source, then couldn't openAI and anthropic run the same on their huge hardware and get enormous capacity out of it?
OpenAI could use less hardware to get similar performance if they used the Chinese version, but they already have enough hardware to run their model.
Theoretically the best move for them would be to train their own, larger model using the same technique (as to still fully utilize their hardware) but this is easier said than done.
One of those rare lucid moments by the stock market? Is this the market correction that everyone knew was coming, or is some famous techbro going to technobabble some more about AI overlords and they return to their fantasy values?
It's quite lucid. The new thing uses a fraction of compute compared to the old thing for the same results, so Nvidia cards for example are going to be in way less demand. That being said Nvidia stock was way too high surfing on the AI hype for the last like 2 years, and despite it plunging it's not even back to normal.
Hello darkness my old friend
It’s knowledge isn’t updated.
It doesn’t know current events, so this isn’t a big gotcha moment
We will have true AI once it is capable of answering “I don’t know” instead of making things up
Emergence of DeepSeek raises doubts about sustainability of western artificial intelligence boom
Is the "emergence of DeepSeek" really what raised doubts? Are we really sure there haven't been lots of doubts raised previous to this? Doubts raised by intelligent people who know what they're talking about?
No surprise. American companies are chasing fantasies of general intelligence rather than optimizing for today's reality.
That, and they are just brute forcing the problem. Neural nets have been around for ever but it's only been the last 5 or so years they could do anything. There's been little to no real breakthrough innovation as they just keep throwing more processing power at it with more inputs, more layers, more nodes, more links, more CUDA.
And their chasing a general AI is just the short sighted nature of them wanting to replace workers with something they don't have to pay and won't argue about it's rights.
Remember to cancel your Microsoft 365 subscription to kick them while they're down
Good. LLM AIs are overhyped, overused garbage. If China putting one out is what it takes to hack the legs out from under its proliferation, then I'll take it.
The funny thing is, this was unveiled a while ago and I guess investors only just noticed it.
Text below, for those trying to avoid Twitter:
Most people probably don't realize how bad news China's Deepseek is for OpenAI.
They've come up with a model that matches and even exceeds OpenAI's latest model o1 on various benchmarks, and they're charging just 3% of the price.
It's essentially as if someone had released a mobile on par with the iPhone but was selling it for $30 instead of $1000. It's this dramatic.
What's more, they're releasing it open-source so you even have the option - which OpenAI doesn't offer - of not using their API at all and running the model for "free" yourself.
If you're an OpenAI customer today you're obviously going to start asking yourself some questions, like "wait, why exactly should I be paying 30X more?". This is pretty transformational stuff, it fundamentally challenges the economics of the market.
It also potentially enables plenty of AI applications that were just completely unaffordable before. Say for instance that you want to build a service that helps people summarize books (random example). In AI parlance the average book is roughly 120,000 tokens (since a "token" is about 3/4 of a word and the average book is roughly 90,000 words). At OpenAI's prices, processing a single book would cost almost $2 since they change $15 per 1 million token. Deepseek's API however would cost only $0.07, which means your service can process about 30 books for $2 vs just 1 book with OpenAI: suddenly your book summarizing service is economically viable.
Or say you want to build a service that analyzes codebases for security vulnerabilities. A typical enterprise codebase might be 1 million lines of code, or roughly 4 million tokens. That would cost $60 with OpenAI versus just $2.20 with DeepSeek. At OpenAI's prices, doing daily security scans would cost $21,900 per year per codebase; with DeepSeek it's $803.
So basically it looks like the game has changed. All thanks to a Chinese company that just demonstrated how U.S. tech restrictions can backfire spectacularly - by forcing them to build more efficient solutions that they're now sharing with the world at 3% of OpenAI's prices. As the saying goes, sometimes pressure creates diamonds.
Last edited 4:23 PM · Jan 21, 2025 · 932.3K Views
Wait. You mean every major tech company going all-in on "AI" was a bad idea. I, for one, am shocked at this revelation.