11-11-2011 10:19 AM
I am using a high accuracy DVM with 6 and 1/2 digits of precision for a reason, because I need the accuracy, so why is this .vi rounding off my numbers to 3 decimal points?
Solved! Go to Solution.
11-11-2011 10:25 AM - edited 11-11-2011 10:25 AM
Write to Spreadsheet defaults to 3 places. Right click the Format terminal and create a constant. Change the 3 to desired # of decimal places.
11-11-2011 10:26 AM
Turn on context help and hover over that function.
You will see there is an input at the top called format, and its default value is %.3f.
You need to wire in another format such as %.6f.