LabVIEW

cancel
Showing results for 
Search instead for 
Did you mean: 

Constants not equal? - Brain Teaser

So i'm plotting some data to an XY graph and expect to see a straight line but I don't. I copy the data from my VI and paste it into a "sandbox" so to speak just to play around. Check out the attached VI. Why does the left most graph not plot a straight line? Something tells me this has to be something with the display format and in fact these contants are not equal but I can't quite figure it out.

 

This is LV2010sp1.

 

Thanks,
Craig

Download All
0 Kudos
Message 1 of 6
(4,226 Views)

Changing it by adding a 1 and removing it, thus only updating the number causes it to be equal on my computer. I have no idea why though.

/Y 

G# - Award winning reference based OOP for LV, for free! - Qestit VIPM GitHub

Qestit Systems
Certified-LabVIEW-Developer
0 Kudos
Message 2 of 6
(4,217 Views)

Display a few more (e.g. 20) decimal digits and you see the difference.

Subtract the two clusters and you see that the difference is about 1.7E-14, but not always exactly the same.

Where does the data come from?

0 Kudos
Message 3 of 6
(4,204 Views)

Why doesn't the constant autosize to show the full number?

 

/Y 

G# - Award winning reference based OOP for LV, for free! - Qestit VIPM GitHub

Qestit Systems
Certified-LabVIEW-Developer
0 Kudos
Message 4 of 6
(4,181 Views)

Hi Yamaeda,

 

why should the indicator do so? You have to set the display format to the desired value...

Best regards,
GerdW


using LV2016/2019/2021 on Win10/11+cRIO, TestStand2016/2019
0 Kudos
Message 5 of 6
(4,175 Views)

Does somebody owe me another nickel in my retirement fund.?

 

That's two nickels this week. Pretty soon I won't need to win the lottery.

0 Kudos
Message 6 of 6
(4,149 Views)