Importing IFiles

[Pushrod]

I'm importing 249MB IFiles into Diadem using the NI plugin, and it takes about 10 minutes per file.  Once I have re-saved the file as a TDM I can re-import it much more quickly (a few seconds).  Is this typical, or do I need more RAM?  Maybe something else?

Thanks!

[ChaisePotato]

How is data stored within these IFile file types? Are they binary or human readable? When a TDM file is loaded into DIAdem, the entire file itself is not read but only the corresponding index file which explains the fast loading times.

[Walter_Rick]

Hi Pushrod,

do you use the latest version of the DataPlugin?

Please check on: http://www.ni.com/example/25045/en/

Greetings

Walter

[Pushrod]

I am using the latest version of the plugin (downloaded on 5/12/2017).

Makes sense why TDM would be faster, thanks.

[Walter_Rick]

I load a TDM file with a size of 1.2 GBytes in less than 5 s. (Settings for the loading behavior is “Always load bulk data”.)

A binary file which is 5 times smaller should not take minutes for loading, even if it is not a TDM file.

Is it possible to copy the iFile data to out NI FTP server (only NI employees have access to this FTP).

ftp://ftp.ni.com/incoming

Greetings

Walter

[Pushrod]

Changed the bulk data setting as suggested.  I timed the file load at 11:35 after that.

ifile is uploaded as Data.zip.

[Brad_Turpin]

Hi Pushrod,

I downloaded your 80MB Data.zip file, and was able to unzip the 263MB Data.885 file inside it.  When I load that file with the publicly downloadable "AVL_IFILE" DataPlugin, it loads in just 5.2 seconds.  Here's the VBScript I was using to do the timing:

Call Data.Root.Clear
DataFilePath = "D:\NICS\Discussion Forums\Pushrod\Data.885"
Call StopwatchReset(1)
Call DataFileLoad(DataFilePath, "AVL_IFILE")
Call StopwatchPause(1)
LogFileWrite "Load Time = " & str(Stopwatch(1), "d.d") & " sec"

How much available RAM do you have just prior to loading the data file?

Brad Turpin

DIAdem Product Support Engineer
National Instruments

[Pushrod]

My PC has 16GB RAM.  When I start to open the file the performance monitors indicate that I have ~3GB of memory occupied.  However, just below that in the physical memory box it indicates that I have less than 1GB free (sorry for the poor description:  I'm not a very savy user).

I have 23 GB free on my hard drive.

[Walter_Rick]

I can confirm Brad's tests and did the it also (with his script).

With DIAdem 2015 - 32 bit the import takes 15.8 sec.

With DIAdem 2015 - 64 bit the import takes 5.7 sec.

Please can you check whether you only have installed the C++ DataPlugin for AVL-iFiles.

Greetings

Walter