04-03-2012 12:16 AM
So i'm plotting some data to an XY graph and expect to see a straight line but I don't. I copy the data from my VI and paste it into a "sandbox" so to speak just to play around. Check out the attached VI. Why does the left most graph not plot a straight line? Something tells me this has to be something with the display format and in fact these contants are not equal but I can't quite figure it out.
This is LV2010sp1.
Thanks,
Craig
04-03-2012 12:53 AM
Changing it by adding a 1 and removing it, thus only updating the number causes it to be equal on my computer. I have no idea why though.
/Y
04-03-2012 01:49 AM
Display a few more (e.g. 20) decimal digits and you see the difference.
Subtract the two clusters and you see that the difference is about 1.7E-14, but not always exactly the same.
Where does the data come from?
04-03-2012 05:21 AM
Why doesn't the constant autosize to show the full number?
/Y
04-03-2012 05:43 AM
04-03-2012 08:03 AM
Does somebody owe me another nickel in my retirement fund.?
That's two nickels this week. Pretty soon I won't need to win the lottery.