Why do I have to manually reindex before searching?

[Brad_Turpin]

Hi testing,

You could be creating a race condition if the number of data files in that folder are large enough that the DataFinder can't (re-)index them all before it is being asked to do something else.  One question I would have is if those blue hourglass files ever get indexed (say the next morning)?  How many data files are in a standard folder you're telling the DataFinder to (re-)index?

Another point to remember is that the NAVIGATOR tree view does NOT refresh automatically.  You need to click on the "Refresh" icon or hit <F5> manually to see if any of the blue hourglasses have converted to a happier icon.

How long does it take to index one of these data files?

Are new data files being added to existing Search Areas while this VBScript is being run?  Or are already indexed data files being deleted or edited within Search Areas while this VBScript is being run?

Brad Turpin

DIAdem Product Support Engineer

National Instruments

[testingHotAir]

It does appear that the index completes after some hours.  The folders I'm indexing currently have between 300 and 1000 tdms files in them.

Ah I didn't realize the trick about refreshing the navigator tree.  Though I noticed the problem more because files that I knew were there didn't return in search.

Indexing an individual file takes less than a 2 count; average file size is around 2 MB.

No files are moving while the script is running: the index command is the last line in the script.  Depending on how long it takes to finish I may start doing something else outside the script.  Is there any way to get feedback on the progress that task is making?

Thanks

[Brad_Turpin]

Hi testing,

You can do two things to get feedback on the DataFinder's indexing process.  You could execute a DataFinder query with the condition (File.indexStatus<>"eIndexedSuccess") and check how many files come back in the Search Results (remember to set the max return count > 200).  Or, you could ask the DataFinder for its current data base statistics, which will have the number of successfully indexed Files/Groups/Channels as well as the disk footprint of the DataFinder.

Brad Turpin

DIAdem Product Support Engineer

National Instruments

[usac]

Hi testing,

although Brads option 1 can give you an idea of how many files need to be indexed (status = eIndexNotYet) , I would not recommend this one because periodically running a query will slow down the indexing performance.

Some replies earlier you posted how you manually force reindexing of the folder.  Did you try to set the the third (Reindex) parameter to FALSE? In contrast to the observer no file events are used to determine new/changed files. This should save a lot of time for indexing your data folder:

Call Navigator.ConnectDataFinder("My DataFinder").Indexer.IndexFolder("I:\Test Engineering\Test Data\Processed Data",FALSE,TRUE)