LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

Problem: More Low Digits in String to Float conversion

The "From Exponential/Fract/Eng" String Function yields numbers
with 1% accuracy, i.e. 2 digits after the decimal point
How can I get more digits after the decimal point?
0 Kudos
Message 1 of 3
(2,740 Views)
The string conversion function is more accurate than two decimal places. Your numeric indicator may be set to display only two digits. On your front panel, right-click on the numeric indicator, goto Format & Precision and enter the desired number of Digits of Precision.
Message 2 of 3
(2,740 Views)
Al S is correct. They do have more precision than that. I am attaching a very small example in which the string displays six digits of precision.
J.R. Allen
0 Kudos
Message 3 of 3
(2,740 Views)