LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

I need to display an array of doubles on a table and I am loosing my percision

Hello,

I need to display an array of doubles on a table but I am losing my decimal precision. I am converting the array to a string in order to display it on the table with a number to decimal function. This is where I lose my precision since that control converts the double into an integer and then into the string. What control do I need to use instead of that in order to preserve my decimal precision all the way to the table? I have attached my VI. Thanks in advance!
Gregory Osenbach
0 Kudos
Message 1 of 4
(2,733 Views)
I don't understand why you're using the number to decimal instead of number to fractional. The purpose of number to decimal is to create an integer string from any type of input. The purpose of number to fractional is to create a floating point string.
Message 2 of 4
(2,733 Views)
Replace your "number to decimal string" with "number to fractional string" and then you can specify the digits of precision you want.
Message 3 of 4
(2,733 Views)
Thank you both for the quick response. Its just the info I needed!
Gregory Osenbach
0 Kudos
Message 4 of 4
(2,733 Views)