AI

4294 readers

26 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

Cutting-edge Chinese “reasoning” model rivals OpenAI o1—and it’s free to download (arstechnica.com)

submitted 1 week ago by [email protected] to c/[email protected]

27 comments fedilink hide all child comments

Cross-post da: https://lemm.ee/post/53289064

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 4 points 1 week ago (6 children)

You still need an expensive hardware to run it. Unless myceliumwebserver project will start

[–] [email protected] 5 points 1 week ago* (last edited 1 week ago) (4 children)

I'm testing 14B Qwen DeepSeek R1 through ollama and it's impressive. I would think I could switch most of my current usage of chatgpt to this one (not alot I should admit though). Hardware is amd 7950x3d with nvidia 3070 ti. Not the cheapest hardware but not the most expensive either. It's of course not as good as the full model on deepseek.com but I can run it truly locally, right now.

[–] [email protected] 2 points 1 week ago (3 children)

How much vram does your TI pack? Is that the standard 8gb ddr6?

I will because I'm surprised and impressed that a 14b model runs smoothly.

Thanks for the insights!

[–] [email protected] 2 points 1 day ago

i dont even have a GPU and the 14b model runs at an acceptable speed. but yes, faster and bigger would be nice.. or knowing how to distill the biggest one, cuz I only use it for something very specific.

load more comments (2 replies)

load more comments (3 replies)