I'm about to start on the development of a new, more efficient and flexible way to log data from some ultrasonic sensors. The sensors produce 1 measurement every second, in addition there are always 2-10 other dynamic input parameters that I want to log together with that (I32 or Double). Today I do this by writing minute averages in a binary file. There is often tens of sensors and they log data for years so I split the data into one file per sensor per month.
However - in many cases it would be great to not use minute averaging, but rather use e.g. regression based logging e.g., or use variable logging frequency depending on some event definitions...etc. to get better time resolution without producing too much data (currently 600KB/sensor
/month, and still make reading the data back and display it simple and fast...(people access the data via a client-server interface).
I know lot's of these things (including the neat use of databases...)are available in the SCADA version of LabVIEW, however that is a bit too expensive (lot's of users...) and over the top. Instead I want to develop a solution myself, however - if anyone out there already have made a similar logging llb, have ideas, suggestions or parts that can be used I would greatly appreciate it:-)