Is it possible to set the precision for the subtraction operator?

[TCPlomp]

LabVIEW 8.5 (8.2?) has fixed points datatypes. Never touched them, but they might work.

Ton

[GerdW]

Hi TonP & TonH,

FXP only handles upto 64 bits, thus giving a valid range of upto 1.8E+19 (and an accuracy of 1).
You only get 64 bits with no exponent component at all!

Either you handle IEEE specifications correctly or you have to use some other arbitrary precision format (as mentioned before) for this kind of calculation...


Message Edited by GerdW on 07-25-2008 07:59 PM