Measure

cancel
Showing results for 
Search instead for 
Did you mean: 

MEASURE storing number in EXCEL incorrectly

I tried to get through on the phone but I got cut off during one transfer so I decided to try using email.

My "Contact #" is 1327267
The "Service #" for this call is 433131

My problem is that the instrument sends the number 3.606e+3 to the computer but MEASURE stores the number 459 in an EXCEL cell.

I have attached the commands used in MEASURE to capture the data from the instrument so you can see what I am doing.

When the instrument receives the command D4 it returns a string such as 0000,111,3.672e+3,3756,0.0012. Measure then stores these values in the cells D6 through H6. What is stored for the previous string is 0000, 111, 4.663E+02, 0.0012. For some reason the number 3.672e+3 does not get stored corr
ectly. This is not the only place I have this problem. If you look at the attached closely you can see the same error with the "D6" command. I do not believe it is the format of the number because I get this format for the cells B2 through B202. I know the instrument is sending the number 3.672e+3 because when I test with HyperTerminal I get the a string of numbers that matches the display on the back of the instrument.

You can reply to me with email or you can call my direct line at (203) 578-3720. I work from 7:30AM to 5:00PM EST.

I look forward to hearing from you,
John Tulk
Voltarc Technologies
400 Captain Neville Drive
Waterbury, Connecticut 06705
(203) 575-3480
john.tulk@voltarc.com
0 Kudos
Message 1 of 3
(7,194 Views)
Hello John,

My first thought when I look at the problem is that somehow you are overflowing what Excel can handle, since it displays the same number twice in both D4 and D6. Can you try and change the cell format in Excel to see if you get something more readable.

Also, can you tell me what version of Excel you are using so that we may be able to reproduce your results here.

Regards,
Jeff
National Instruments
0 Kudos
Message 2 of 3
(7,194 Views)
Thanks for the reply Jeff,
I am using EXCEL 97 SR-2 under WINDOWS NT. I have tried changing the format of the EXCEL cell but all that does is change the look of the number, it has no effect on the value in the cell.

Thanks,
John
0 Kudos
Message 3 of 3
(7,194 Views)