12-19-2004 01:56 PM
12-19-2004 03:27 PM
12-19-2004 08:28 PM
12-20-2004 07:13 AM
12-20-2004
08:12 AM
- last edited on
10-19-2025
01:50 PM
by
Content Cleaner
I would strongly second Ben's suggestion to divide and conquer. If you have not already done so, you might want to check out the tutorial on Managing Large Data Sets in LabVIEW. You can either search for it by name or try this link.
I don't often push people to non-ASCII save formats, but putting about 45 million data points into an ASCII file is going to be very slow and cumbersome, not to mention inefficient. You need a binary solution. If you have some time, I would suggest you check out HDF5. It is fast, multi-platform, efficient, hierarchical, and has native data compression. On the minus side, it is not thread-safe (on Windows, it is on Linux) and very low level (so somewhat user unfriendly). There is an unsupported Windows LabVIEW solution on the DevZone here. It does not support 3D data sets, but a minor modification on one of the save routines will do that for you (take the save 2D routines and change the dimensionality to 3, then change the input arrays to 3D). NI has been using HDF5 on shipping products for about four years.
If you don't have time, stream your data to disk as binary using the LabVIEW file primitives. Make sure you record your data format so you can open the files at a later time (this is an advantage of HDF5, it is self-describing, so you can always find the format).
Good luck.
12-20-2004 08:17 AM
12-20-2004 07:58 PM
12-20-2004 09:22 PM
12-21-2004 08:48 AM
12-21-2004 08:51 AM