LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

format and precision

Hi,

 

I am using LabVIEW to do some calculation. Since the number of digit of the input will affect my result so much, I want to fix the numeric control to 4 significant digits. When I right-click on the numeric control, there is an option to change the format and precision. Does anyone know can this function really change the precision of a number? Or this is only for display?

 

Thanks
0 Kudos
Message 1 of 2
(2,326 Views)

HI,

That formatting is only for display.

One way to do what you want is multiply your value by 10000 then round it to the nearest integer and then divide tha result by the same 10000.

Hope this helps,

Paulo

Message 2 of 2
(2,322 Views)