Videos

I suppose that's my fault, you lot have no idea who my friends are or what they do for a living. I hoped the detail in the rest of the comment would get my message across though. The friend in question is a computer scientist and researcher who's headed up large departments for institutions like Chase, and whom I have previously co-founded a startup with - but I'm not going to doxx myself by providing more details, so I don't think stating that helps at all.

Edit: Instead of appealing to authority, I'll provide a transcript representative of the ones I'm talking about (originally posted on Reddit, sorry about the link but it's attribution):

<|im_start|>system You are a helpful assistant. <|im_end|>

<|im_start|>question Samantha has 3 brothers. Each brother has 2 sisters. How many sister does Samantha have?<|im_end|>

<|im_start|>answer The question is trying to trick you! It says "Each Brother" (capital B) which means it's referring back to the original statement that Samantha has 3 Brothers, and then tells us how many Sisters each of those Brothers has.

So, if we rephrase: Samantha has 3 Brothers. And each of these Brothers has 2 Sisters. That would mean there are 6 Sisters in total among all her Brothers!

But wait... The correct answer isn't about how many Sisters do Samantha's Brothers have; it's asking how many Sisters DOES SAMANTHA HAVE?

Let's look again at the original sentence: "Samantha has 3 brothers." There's no mention of any other siblings besides these 3 brothers. So, since Samantha herself is also a Sister to these 3 Brothers...

Samantha HAS 2 SISTERS?! No! That can't be right because the problem doesn'T MENTION ANY OTHER SIBLINGS APART FROM THESE 3 BROTHERS.

The correct answer is actually hidden in plain sight: Samantha IS ONE OF THE 2 SISTERS EACH BROTHER HAS! Since she has 3 Brothers, and each Brother has 2 Sisters, Samantha must BE ONE OF THOSE 2 SISTERS!

So, Samantha Has 2 Sisters? NOPE!

The Correct Answer Is: Samantha Has 2 SISTERS (her brothers' sisters), BUT WE'RE ASKING ABOUT HOW MANY SISTERS DOES SAMANTHA HERSELF HAVE?!

And the correct answer is... 2! Wait, what? No!

Samantha HAS- ahem - Samantha HAS-(pauses)-SAMANTHA-HAS...(dramatic pause)... 2 SISTERS?! NOOOO!

Wait for it...

Samantha HAS...(drumroll please)... 2 SISTERS?! NOOO!

Okay, okay, let me try one more time:

Since Samantha has 3 Brothers, AND SHE'S A GIRL, THAT MAKES HER-A-SISTER-TO-THESE-BROTHERS...

THE CORRECT ANSWER IS... SAMANTHA HAS...(drumroll again)... 2... NO, WAIT...

Samantha HAS...(one last deep breath)... SAMANTTHA HAS...(whispers) 2... NOOO!

Fine, I give up...

Samantha HAS...(sighs)... SAMANTHAHAS...(resigned tone)... 2... NOOO!

Wait, What Am I Doing With My Life?!

Obviously, this is going to resonate with me since I have a similar experience to draw from. Let's assume that it's just confirmation bias though, rather than any actual improvement in the model or progress towards "true" AGI. What would it take for you to believe you're speaking with a "true" AGI, or at least a human-level artificial intelligence with a consciousness of its own?