Problem with Excel file import

[David_Lin]

Hi,

I am trying the DIAdem 10 Eval and I want to import Excel files with huge amount of data. One file has text headers as

index    x          y

1          0.58    7.22

2          0.55    6.33

3          0.77    8.34

.......................

and another one doesn't have the text headers. Both have three columns and more than 100K rows of data. But I failed to load any of them. The error is "Cannot open Excel file". Any idea what's wrong?

Thank you very much!

David

[Ingo_Schumacher]

Hi David,
actually, this should not be a problem at all. Nevertheless, there is one thing that could be the reason for this error: If the file is opened by Excel itself at the same time you are trying to import it with DIAdem. You always have to close the Excel file first.

If this in not the reason, please give me some additional information - as Excel version, operating system.
Maybe you can attatch a short xls file that I could use to reproduce the issue.
Regards.

[David_Lin]

Hi, Ingo,

It is not the reason. This xls file is generated by another application and it has so many lines that Excel can only show part of it. If I copy the displayed part and save it in another xls file, DIAdem can open it without problem. And the file is too big, more than 60M, and I don't think I can attach it.  Any suggestion?

Best regards,

David

[Brad_Turpin]

Hi David,

I have a thought, but I don't know if it will work-- that is to read the Excel file out using the ADO data base connection that Microsoft provides for Excel files.  There is, in fact, already a DataPlugin on www.ni.com/dataplugins which does this for both Excel and Access files.  I'm attaching the DataPlugin below.  You just need to detach the *.uri file to your hard drive, then double-click on it with Windows Explorer to register the DataPlugin (you'll get a short "registration succeeded" dialog).

Then in DIAdem-NAVIGATOR right-click on the bloated Excel file and select "Open with..." from the context menu.  Then select the "ADO" DataPlugin to use in the loading process.  The DataPlugin expects the first line of the Excel file to either contain the name of each column/channel or to contain the first value of each column/channel.

I'm cautiously optimistic that this will work,

Brad Turpin

DIAdem Product Support Engineer

National Instruments

[David_Lin]

Hi,

Unfortunately, ADO didn't work either. It seems hope is fading to open this xls file. MS Excel 2003 can open this file but can only display part of the result, which means this xls file is a valid Excel file. Is there any other possible solutions?

Thanks a lot!

David

[AndreasH_Ha]

David,

probably the only way to make progress is to look at the file. Would it be possible for you to copy it to the ftp site?

Andreas

[David_Lin]

Hi,

I have uploaded the file Data_David.xls to the ftp incoming folder. Please check it out.

Thank you very much!

David

[Hans_Beckers]

Hi David,

if Your data have more than 65k rows, you have to chose an other data file format for your application. Microsoft Excel files are restricted to 65k rows. For example you can write a comma separated ascii file which can be read directly into DIAdem.

Hans

[David_Lin]

Is the 65K row limit also applicable to DIAdem? I remember DIAdem claims to handle a huge number of data and I suppose it also inlcude support for much larger xls file. Actually I have said in my first post that the file contains over 100K rows.

[Hans_Beckers]

Hi,
sorry, not DIAdem ist restricted to 64k Rows but excel is. The DIAdem excel reader has to import  excel files. If there are more than 64k rows you have an excel like file but no excel file. DIAdem  is able to read files up to 2 billion values in one channel, but excel files are restricted to 64k Rows. At our dataplugin web site: www.ni.com/dataplugins you can fill out a form to ask for a plugin to read your data files if you are able to describe the format of the files. It might be, that we can help you.

Hans