Weird float problem

For general discussion related FlowStone
deraudrl
Posts: 239
Joined: Thu Nov 28, 2019 9:12 pm
Location: SoCal

Re: Weird float problem

Post by deraudrl »

If what I said in the last post didn't make sense, go here:
https://www.h-schmidt.net/FloatConverter/IEEE754.html
and type in the values you were mentioning (0.99999994, 0.99999996, and 0.99999998):
the first two give the same bit pattern in FP32, the third gives the same bit pattern as 1.0.
I keep a pair of oven mitts next to my computer so I don't get a concussion from slapping my forehead while I'm reading the responses to my questions.
Post Reply