this post was submitted on 06 Jan 2025
488 points (98.8% liked)

196

16910 readers
1293 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other^ ^rules^

If you have any questions, feel free to contact us on our matrix channel.

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 7 points 1 month ago (1 children)

OK, I am dumb. Can you explain what that is?

[–] [email protected] 25 points 1 month ago (1 children)

I'm not OP, but my guess is they're referring to the Intel math bug that some i5's had. I'm struggling to track it down, but it's basically an issue with doing long division where the floating point math would produce a very wrong result.

You can see more here at least for the bug/issue that existed in the 90's here

[–] [email protected] 9 points 1 month ago (1 children)

I’m not actually, just that a binary integer that overflows at 60 couldn’t exist, hence the 5.907 whatever bit length

[–] [email protected] 5 points 1 month ago (1 children)

oh, that's actually clever. And I'm saying that as a software engineer. I missed that possibility :)

[–] [email protected] 4 points 1 month ago

I should have phrased it differently, like “Ah yes, the well known 5.9068905956 bit integer.” But thanks