02-11-2020 08:41 AM
wiebe@CARYA wrote:
That online IEEE-754 converter seems to use singles (hex value is 0x44044000). Although that doesn't seem significant here.
Correct, but if a SGL can do "529" then a DBL should definitely be up to the task.
02-11-2020 08:47 AM
@Intaris wrote:
wiebe@CARYA wrote:
That online IEEE-754 converter seems to use singles (hex value is 0x44044000). Although that doesn't seem significant here.
Correct, but if a SGL can do "529" then a DBL should definitely be up to the task.
Yes, and I tried sgl, dbl and ext, but they all have the same result.