I cannot save a file composed of several concatenated .csv files.

[chac_gun]

Hi, I just started using DIAdem fairly recently and have been enjoying it, that is until now.  Normally, I would get a .csv file and generate a report based on a template that I created.  When my test was finished, I used a script given to me by someone at work and concatenated the data.  The concatenate works fine but when I try to save the TDM file, I get the followoing error:

 Error while executing "DataFileSave(FiledDlgFileName, FilDlgFilter)" command

Error type: ACCESS VIOLATION

Error address: 00029028

Module name:dacasr.dll

Shortly after this, DIAdem crashes adn I have to begin the concatinating process once more.

It is a generally large file that I am composing.  I have about 400 channels logging at 1.5 secs for a total of about 150 hrs.  I am wondering if it has something to do with memory allocated.  My system is running with Windows XP Professional with an Intel Core 2 Duo 2 GHz processor and 2GB of Ram.  I am thinking that if this is good enough to run the scripts, then it should be good enough to save the info.

Thanks,

Alan

[AndreasK]

Hello Alan,

Could you commit the work flow like I understood it.

1. Open a bunch of CSV files

2. Concate the channels of the retrieved groups

3. Save the result to TDM file (not to CSV)

Greetings from sunny Aachen

Andreas

[chac_gun]

Hello Andreas,

I can open the CSV files (there are 24 of them in this case) but I can't load them into DIAdem when they are open.  I therefore have to close Excel and then concatenate the channels.  Sometimes I get an error and sometimes it runs just fine.  The resulting file is then displayed and I can run other scripts (calculations mostly dealing with conversions) and even generate a report.  When I try to save the TDM file, I get the above error.

I have tried closing other programs but it still won't save.  I am on a company laptop so I don't have admin rights so I can't tune the performance on it either or even turn off some background tasks.  The file isn't gigantic but it is large (all the CSV files add up to less than 1.5 gigs of data) but I am still leaning on a memory issue.

If I can save the files as a CSV, that would work out too since a lot of co-workers don't know or have DIAdem.  I could then just import the one concatenated CSV file.

Thank you from cold, windy, and rainy Indiana,

Alan

[Brad_Turpin]

Hi Alan,

When I do the math on your 400 data channels sampled over 150 hrs, and assuming that each value is stored to disk as an 8 byte DBL, I get that the target TDM file should be just over 1GB.  This is not unduly large, and your computer has plenty of RAM, so I'm surprised.  I assume the total concatenated time is 150 hrs, not each file, right?

Could you send over one of these CSV files and the DataPlugin you're using to read them, plus the VBScript you're using to concatenate the files?  I'd like to test this on my computer and see if I can reproduce it or find any likely spots to clean up in the VBScript code.

Brad Turpin
DIAdem Product Support Engineer
National Instruments

[AndreasK]

Hello Alan,

sounds curious.

150hr with 1.5s  = 810000 values per channel

does not sound like much even if there are 400 of them.

What might help is changing the swapping behavior of DIAdem.

Menu: Settings->General

Press: Data Area

and set Swap out data to different values.

How is it set on your machine?

Greetings from good old Germany

Andreas