LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

scan from string with %g - result not accurate

I am trying to use the "Scan from String" VI to convert a string into a number.  I am using "%g" as the format specifier.  The conversion is only grabbing the first six significant digits, yet I need it grab all significant digits.  Is there a real limitation here?  What could I do to solve this issue?

 

I have attached a simple VI to demonstrate what I'm seeing.

 

Thanks,

Joel

0 Kudos
Message 1 of 3
(3,152 Views)
It is because the display format for your numeric indicator is set for 6 significant digits.  Adjust the display format for the indicator and you will see that the other digits are there.
Message 2 of 3
(3,142 Views)
Hey thanks!  I didn't realize I had to change the display format of the indicator coming off the function.  Duhhhhh.
0 Kudos
Message 3 of 3
(3,128 Views)