AI

4533 readers

30 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 4 years ago

Orca: The Model Few Saw Coming (youtu.be)

submitted 2 years ago by copacetic@discuss.tchncs.de to c/artificial_intel@lemmy.ml

2 comments fedilink hide all child comments

Video about this paper. Impressive results close to GPT4 but with a much smaller model. The interesting note in the paper is:

We are working with our legal team to publicly release a diff of the model weights in accordance with LLaMA’s release policy to be published at https://aka.ms/orca-lm

you are viewing a single comment's thread
view the rest of the comments

[–] rastilin@kbin.social 1 points 2 years ago

Very impressive. Yeah, ChatGPT4 is an absolute beast, but it's impressive to see how well Orca stacks up against it in the harder trials.

One of the best things about ChatGPT4 is that it has general knowledge, which I think a lot of the open source models don't represent properly in their training sets. It's not just about language processing, it's about context awareness. Hopefully Orca as an open source model can bring context to the table.