Hi,
Real numbers (e.g. dbl) can not be set to all numbers exactly. this is
because the resolution of the dbl is limited (32 bits). So the very small
deficiencies can not be avoided.
To avoid numbers like -2.78E-17 being displayed, select the
format&precision, and use floating point notation.
Regards,
Wiebe.
"Warren Massey" wrote in message
news:5065000000080000007AEC0000-1079395200000@exchange.ni.com...
> Is there a known problem with the slider control?
>
> I have one (attached) that is setup to coerce to the nearest 0.1 and
> the coercion works on the positive side of zero on the slider but not
> on the negative side.
>
> There is also very tiny positive number (+1.94E-16) to be found on
> what appears to be the negative side of the zero point
as the slider
> slides.