csv error

[jbrandim]

We're using Diadem 9.1, and we tried to export a dataset to CSV format. 

It fails.  Here is the error seen in the log file:

**** DIAdem-STARTED Version: 9.1 on 8/31/2007 at 9:00:55 AM ********************
1    **** Error registered on 8/31/2007 at 9:01:33 AM [Message file:GLOBERR / Text area:1 / Text number:6290]
     Cannot save the "C:\hdf\FM10001.csv" file with the storage mode "CSV"!
     
     Refer to log file.
     Cannot store complete internal data in the file "C:\hdf\FM10001.csv" with the format CSV.

Any ideas?

[Brad_Turpin]

Hi Jeff,

This looks quite similar to a warning message that you get by default in DIAdem any time you export your Data Portal channels to a file format which does not store channel structure or custom properties.  When you do this interactively, you get a warning dialog, and on the warning dialog is a checkbox for avoiding the dialog in the future.  So I'm wondering if what you got in the log file below was a full-fledged error or just a warning.  Did you check to see if the CSV file was created after the "error" occured?

Does the same error occur if you export to CSV interactively?  If so, please send us a screen shot of the error dialog as well as a TDM or TDMS file export of the data you were trying to export to CSV.

Regards,
Brad Turpin
DIAdem Product Support Engineer

[jbrandim]

It's a full blown error.  The csv file IS created, but it's empty.

Screen capture of the error dialog, and an example source

file sent to your email.

[anne]

Hi

Did you find a solution fot this? I'm getting the error for Diadem 9.1, 10.1 and 11.

My file has 14 channels, and about 2 million data points. When i deleted the number of rows to around 50,000 it works. Also when i save just 1 or 2 channels with 2 million poionts it works. Is the export to csv feature limited by the file size?

Anne

[AndreasK]

As far as I remember DIAdem 9.1 had a bug that it was not possible to save CSV or TDMS file if a DataSetComment was set.
This was solved in higher versions. So workaround would be to delete the DataSetComments before saving to CSV.

Greetings
Andreas

[AndreasK]

Additional comment to Anne

The CSV export in DIAdem is memory consuming.
So the limitation in file size is given by the amount of memory available
for export.

If you are doing the CSV export to access part of the Data using Excel you can
directly access the tdm fies using the Excel Addin:

Excel:
http://zone.ni.com/devzone/cda/epd/p/id/2944
OpenOffice:
http://zone.ni.com/devzone/cda/epd/p/id/5951

Greetings Andreas

[Brad_Turpin]

Hi Anne,

I have not tried this, but my guess is that it will work with large data files.  Instead of using the CSV file exporter, use the below attached VBScript which exports the data to a DAT file, then re-writes the associated ASC file to include whatever header info you want.  It is my belief that the DAT export will support data files in excess of your available RAM.

Brad Turpin
DIAdem Product Support Engineer
National Instruments

[anne]

Andreas/Brad

Thanks for the information.

It was running out of memory. I cleared up my C drive and it worked.

Thanks

Anne