The disadvantage of using a standalone application produced in whatever language is that you have all you eggs in one basket. You will spend much of your time developing report engines, sequence engines, error handling etc, as well as the code that you need to drive your UUT and associated test equipment.
Using TestStand will allow you to concentrate your development on just the test code to drive your UUT and / or test equipment.
For example (very simply), if you produce a function in CVI / LabView / ActiveX / (VB DLL) to read a port, and a function to set a port on your control cards. You could then create a series of sequence steps to control your UUT. If you want to change the behaviour of the very simple test above, you only have to modify the sequence and don�t even have to open your main coding environment. (This has its own benefits).
Put quite simply TestStand allows you to create better more stable drivers for your UUT / test equipment without the overhead of the items I mentioned below.
I have said this when I first started using NI�s TestStand that its main downfall is its power, in that there is not much you can�t do with it, so keeping control of developers (when developing sequences) is a much of a problem for us as we had with C programmers and LabView programmers developing in there own style.
We have deployed TestStand in 4 countries world wide and almost no C, C++, or LabView is required to generate tests now. We all have the same User Interfaces, report formats, database access etc, and we all test completely different products. We have a single team responsible for the upkeep of TestStand and its drivers, and we let individual sites create and manage their sequences. More stable code and code reuse has cut our development times down to weeks instead of months.
Yes there is some initial up front work where it appears that you are achieving no results, but its worth it in the end.
If you have the underlying code to control your Test Stands then you are more than 75% there already. Why spend time developing reporting tools, sequence engine (Big development area), when you can change or provide an interface to your already generated code and control it from TestStand.
Please contact me directly if you want any more information,
Regards
Chris