Can Diadem help with data logged to a database using Teststand?

[david_jenkinson]

Hello,
We are using a Labview/Teststand/Vision on our test platforms.  We have recently begun experimenting with logging results to database using Teststands build-in database logging capability.  We've managed to become familiar with adding a table for data we want to retrieve, and generally we can see how we can get the data we want INTO the database.  Our next step now is to figure out what the hot application or front-end that makes it easy to RETRIEVE the data we want.  We want access to the data in a way which enables us to flexibly query the data we want to query quickly and intuitively.  Data we want to retrieve may be:

What is the performace history of a test over several makes or models of UUT, for comparison?
How did a particular test perform over time on a particular UUT, or a set of UUT?

Or a million other mixes/matches of data we may want to retrieve or have been requested to retrieve.  We were pointed to DIAdem as a possible solution.  Can it do these queries, and save the queries for future use?  Is it comparative to any other database reporting front end out there, in that is performs data mining on a database based on queries?  Can the proprietary TDM format be exported, in the case we may need to transfer some or all of the data to another in house database format?

We are trying to find if Access will fit our needs, but it seems a bit clunky in the query/reporting departement with our limited experiments, also we have been told that Access database format may not be the best option for storage of large amounts of data, not sure if there is any truth to that or not.

Is there anyone out there using Teststand to log, and Diadem to mine the data, and what are your impressions?  Do you see it working in our test scenario?

Thank you for any comments

David Jenkinson

[Brad_Turpin]

Hi David,

Let me try to answer your questions in order.

1) Yes, DIAdem can execute any SQL query and retrieve the results into channels in the Data Portal for further analysis and reporting
2) Yes, any SQL query can be saved and recalled for later re-use.  An SQL query is just ASCII text, after all.
3) The TDM format was created by NI but is open to external users.  There is a file format description and a C++ API available.
4) If you are using the built-in TestStand data base logging features, then you will be logging to a 3rd party data base such as Oracle or Access, and there will be no need to export TDM files.
5) If you prefer to use TDM or ATML file export from TestStand, then you could leverage the DIAdem DataFinder data base, instead of (or in addition to) using a 3rd party data base such as Oracle or Access.
6) It is well known and absolutely true that Access data bases struggle to perform well when they get big.  If you have lots of little *.mdb files this is not a problem, but if you have an enormous *.mdb file, you are asking for lots of headaches.

The simplest approach would be to log TDM or ATML files from TestStand and simply use the DIAdem DataFinder data base, or perhaps the DataFinder Server Edition, to grant you relational query access to your data.  In this case there would be no effort needed to develop an SQL query interface or SQL query file format, as these already ship with DIAdem for the DataFinder.  Further, the DataFinder is extremely flexible when it comes to adding new measurements and is self-configuring and self-maintaining.

If you prefer to choose a 3rd party data base for your data storage, then you would need to develop an SQL query interface in DIAdem consisting of VBScripts and custom SUDialogs, and you would need to create your own SQL query file format in order to re-use previous queries in a future DIAdem session.  This is not a big deal, and I can send you examples of this for the TestStand default data base.  NI will also support you through the creation of your own custom DIAdem interfaces for your particular 3rd party data base.  You would, however, be on your own when it comes to creating the initial data base schema, expanding that schema as you needed to add new measurements, and maintaing that data base (which would probably involve working with your IT department).

Hope that Helps,
Brad Turpin
DIAdem Product Support Engineer
National Instruments

[mrbean]

Brad,

You said, "The simplest approach would be to log TDM or ATML files from TestStand and simply use the DIAdem DataFinder data base, or perhaps the DataFinder Server Edition, to grant you relational query access to your data".

I'm wondering how this would be implemented.  I asked a similar question in another thread.  What I'm wondering is, can ALL the data be placed into an ATML format from within the LabVIEW tests themselves, outside of TestStand, so as to allow DIAdem to open/datamine the file after the test?  From what I've seen, the few XML VIs available in LabVIEW (string pallette) have some serious limitations.

LabVIEW converts data to an established XML schema. Currently, you cannot create customized schemas, and you cannot control how LabVIEW tags each piece of data.

The predefined XML schema that LabVIEW uses is LVXMLSchema.xsd located in the labview\vi.lib\Utility directory.

[AEDavid]

Hi Mr. Bean,

You can make a product suggestion at http://sine.ni.com/apps/utf8/nicc.call_me for a LabVIEW toolkit handling ATML.

Your best bet is to write an ATML report from TestStand.  Is there a limitation with this for your application?

Here is more information about TestStand and ATML Reports.

[david_jenkinson]

Brad,
Thanks for your comments.

In reference to your comment "The simplest approach would be to log TDM or ATML files from TestStand and simply use the DIAdem DataFinder data base":

1.  Will the option to log to TDM or ATML appear in the Database Options/DataLink/DataBase management system pull down menu once we install DIAdem? 

2. If not, how would we choose to log to TDM or ATML? 

3. Would this log file be in addition to, or instead of, .mdb file already logged? (Whose filename is also specified in Database Options/DataLink/ tab)


Thanks

[AEDavid]

Hi David,

Even without DIAdem installed, you can configure TestStand to log to ATML by going to Configure >> Report Options:

Also, you can log to TDM in your code modules.  The ATML log would be in addition to any Database logging you configure.

Message Edited by AEDavid on 05-22-2007 10:12 AM