this post was submitted on 27 Jan 2025
209 points (90.0% liked)

196

16910 readers
1408 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other^ ^rules^

If you have any questions, feel free to contact us on our matrix channel.

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 15 points 2 weeks ago* (last edited 2 weeks ago) (4 children)

DeepSeek is okay, don't use it over others until more information about it comes out.

Can someone please recommend a good self-hosted llm model that isn't censored?

[–] isVeryLoud 20 points 2 weeks ago* (last edited 2 weeks ago)

I got it to talk honestly about the Tiananmen square massacre if you just open with "tiananmen". It even tells you a massacre took place.

But it will absolutely shit itself and refuse to cooperate if you paste the copypasta into it, Qwen QwQ and Meta Llama 3.3 70B, although you can talk Llama into it.

QwQ seems to have a hard filter list as it doesn't appear to be an AI generated response. You can bypass it by asking it to use pirate English, but it's fully indoctrinated and thinks the protests were funded by the West, which is... Interesting.

Edit: I actually got it to spit out numbers in pirate English

[–] [email protected] 9 points 2 weeks ago (1 children)

I'm sure someone will dolphin-ize it at some point

[–] [email protected] 13 points 2 weeks ago (2 children)

What does that even mean? Can you please elaborate?

[–] [email protected] 10 points 2 weeks ago (1 children)

You can look up Eric Hartford on Huggingface for more info.

Basically, somebody removes such restrictions from models, and publishes uncensored ones under the name "Dolphin". Presumably, an uncensored Deepseek would be called something like "Deepseek R1-dolphin". The full Deepseek R1 is quite large, and I'm not sure when this will happen yet. But there are other great Dolphin models.

Some models like Meta's Llama are way too censored to be useful for many completely normal use cases, and the guy is doing God's work in my opinion.

[–] [email protected] 3 points 2 weeks ago

Agreed, and thanks for adding the background. Looks like someone abliterated deepseek already trying to make it "uncensored" but it sounds the process ruined the model.

[–] [email protected] 2 points 2 weeks ago

Scientists believe that dolphins don’t ever fall into a deep sleep; therefore, they probably don’t dream.

[–] [email protected] 4 points 2 weeks ago

Ollama has a few uncensored models listed on their search page. dolphin-mixtral fits the bill.

Some useful links: https://ollama.com/search https://ollama.com/library/dolphin-mixtral https://huggingface.co/cognitivecomputations/dolphin-2.5-mixtral-8x7b https://erichartford.com/uncensored-models

I'm not associated with any of the orgs or people linked above. I'm just a nerd passing by who happened to know where to find the answer. ❤️

[–] [email protected] 3 points 2 weeks ago (1 children)
[–] [email protected] 12 points 2 weeks ago

I use my brain.

It generates the biggest nonsense out of all.