User | Kudos |
---|---|
6 | |
5 | |
2 | |
2 | |
2 |
I am probably the only one to be using Extended precision numbers considering the feedback on these requests:
but so be it.
One other area where LabVIEW ignores extended precision is wire values in debug mode. To illustrate what I am talking about, consider this snapshot of a debugging session:
The result of my modified Bessel calculation (that reminds me I haven't suggested to implement special function calculation in extended mode...) returns a perfectly valid extended precision number, such as 5.03E+418, but LabVIEW doesn't recognise this as a valid value and returns an "Inf" value (which would be the correct reaction if the wire could only display double precision floating point values).
This wire is connected to the logarithm primitive, which happens to be polymorphic and hence accepts the extended type. The result is the correct logarithm of 5.03E+418, i.e. 964.15.
On the face of it though, it appears that the output of my VI is +Inf, and that LV went wahoo and estimated an arbitrary value of log(Inf)...
My code actually stores such values in shift registers, so when I debug problems with the code, I have 3 or 4 wires carrying an "Inf" value, which, when I am trying to understand the reason of overflow problem, is not exactly helpful.
Suggestion: display Extended Precision wire values correctly in debug mode.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
This was addressed with a bug fix in LabVIEW 2020 SP1.