Incremental reading of large TDMS files using npTDMS

[phyac]

We are acquiring data from multiple hardware components and streaming to TDMS. Typically we are acquiring at ~ 100 Mb / s so things get big quickly. So far we can incrementally read in data using Labview and Matlab. So we can read in frame n and loop over n. No success with python. The npTDMS lib has a function to read in, but it seems to attempt to read in the entire file which is always significantly larger than the available RAM.

Has anyone come across a way to incrementally read in TDMS using python?

[cbutcher]

I haven't tried this, and I doubt it's the best way, but the TDMS file format is well documented.

The details can be found here: TDMS File Format Internal Structure, and an overview (with marketing blah): The NI TDMS File Format.

If you can't get whatever Python library is available to work, you could manually read the binary data file according to the formatting instructions...