Questions on Saving and mining data with Labview and DIAdem

[pen]

Hi,

I am sampling two signals at 200k sampling rate. I am trying to save the data on harddisk and analyzing the data using DIAdem.

If I save the data using mesurement file format .tdm and .lvm, the file size will be about 4 Gigabytes for only 10 mins' acquisition. It is very slow to process it.

I used the software Clampex and pCLAMP(Axon Instruments) before. At the same 200k sampling rate and also acquiring two signals, these programs save the data as .atf format and the size is only 400 MB for 10 mins' acquisition.

I wonder if there is also a good way to handle this situation using Labview and DIAdem, and how to do it?

[JonathanN]

Hi pen,

If you are acquiring that much data, you may want to look at the Write to Measurement File Express VI that can write to a .tdm file. Inside the Express VI configuration dialog box, there is an option to save to multiple files based on segments, time, file size, etc. This would allow you to split up your data into smaller chunks. Either way, DIAdem will have no problem reading in that TDM file. It is just a matter of storing your data in the most efficient manner in LabVIEW before sending it on to DIAdem.

Hope this helps!

Best Regards,

[pen]

Hi, Jonathan:

I tried the TDM binary file format. The file size is 800 MB per min acquisition and it will take a long time to just open these files. For my application, I have to take data for several hours. I am looking for a way to reduce the size of files.

Is there any other type of file format that can reduce the size significantly and can be handled easily?

   

[JonathanN]

Hi pen,

You are going to have to split up your TDM files into lots of individual TDM files. You can easily use the Write to Measurement File Express VI and split up the TDM files based off of segments or possibly file size. Then bring these TDM files into DIADem and use the example scripts on this link to combine all the different TDM files. Just split them up based off your appropriate file size.

Best Regards,