Numeric Limit Test to automatically round Data Source based on Numeric Format

[JICR]

Is it just me or it would make sense if TestStand automatically round to nearest value based on "Numeric Format" chosen.

If I have %.3f shown, limit is 9.000, Comparison type is LE (<=). Data source is 9.00049, the test should Pass, no?

The workaround I know is to do something like : Value = Round(1000*Value,4)/1000. But this behaviour should be implicit I think.

Any advice, comments?

Cheers

[Captain_Jack]

Hi JICR,

I agree and think that this would be a very good option that could be set for an individual Numeric Limit step to pre-round or not as needed. To see if others agree, and get the attention of NI TestStand development team, I'd suggest you post this to the Idea Exchange forum for TestStand: https://forums.ni.com/t5/NI-TestStand-Idea-Exchange/idb-p/teststandideas

There you'll find out if others think this is a good idea (I know I do, and have added similar code to the process model or sequence callbacks to handle this scenario).

Hope this helps!

-Jack

[Captain_Jack]

Hi JICR,

You asked for suggestions as well as comments, and I forgot to include this link with what may be a more robust option for rounding that you can use: How-to-round-a-result-before-reported

Hope this helps.

-Jack