03-02-2022 08:33 AM
Hello,
I´m trying to selectivly load some channels from csv Files and Append this Data to each other. I have about 50-100 data files with ~2000 channels each an i just need about 20 of them. Futhermore i want all of the data (the 20 channels that i need) in one File, so that i can make observations across a wide range of time. I tryed to use the following code to do this:
If FileDlgShow(astrPfad(0), "Datalogs,*.STELOG", "Dateiauswahl", true) = "IDOk" then
For iCount = 0 To ubound(FileDlgNameList)
Call DataFileLoadsel (FileDlgNameList(iCount), "STELOG_DataPlugin_V0-1-1", "[1]/[1,140,375,382,383,385,387,403,404,405,435,436,438,439,440,441,442,443,444,445,446,447,449,466,467,499,501,505,506,517,519,710,877,892,893,1321,1322,1500,1561,1602,1603,1788,1821]", "Append")
next
End If
It loads data from the first file, then trys to load data from the second file and then fails with the message "Appending to internal data failed". I tryed to manualy append certain channels and the button is grayed out. Does anyone know how to do this?
03-09-2022 02:49 AM
Hi KAlbers
It is not possible to append data with the command DataFileLoadSel. But you can load all channels selective in separate channel groups, concatenate them with the command ChnConcatenateChannels and delete the concatenated channels.
Greetings
Walter
09-09-2022 03:27 AM - edited 09-09-2022 03:35 AM
Well, I am not completely sure about this.
I got this to work with an empty data portal when loading using the datafinder to determine the files.
here is how it is done in this script:
Set oImportParams = Navigator.Settings.CreateImportParameter("Append")
oImportParams.AppendCheckGroupName = eAppendCheckGroupNameEqual
oImportParams.BulkDataLoadingMode = eBulkDataLoadingOnFirstAccess
oImportParams.LoadReturnMode = eLoadReturnGroupElements
set oList = dataFileLoadSel(file, plugin, "[2, 3, 4]/*", oImportParams)
Other than that I do not get it to work when the data portal contains already channels. But maybe there is a way with special settings for groups or the data portal.
Edit:
I forgot to mention that by default I convert (and store) all csv and such data to TDMS before I deal with them for data analysis since I have to deal with loads of files (20k+) for specific projects. and TDMS loads faster and can make a better use of the datafinder (i.e. additional meta data)