Home
Community
Discussion Forums
Most Active Software Boards
LabVIEW
Topic
LabVIEW
Register
·
Login
·
Help
Community
Category
Board
Documents
Users
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
Search instead for
Did you mean:
Topic Options
Subscribe to RSS Feed
Mark Topic as New
Mark Topic as Read
Float this Topic for Current User
Bookmark
Subscribe
Mute
Printer Friendly Page
All Forum Topics
Previous Topic
Next Topic
rounding question
rounding question
mrbean
Active Participant
04-19-2010
07:08 PM
Options
Mark as New
Bookmark
Subscribe
Mute
Subscribe to RSS Feed
Permalink
Print
Report to a Moderator
In this experimental VI, I do a number of conversions, etc. I'm wondering why, when I input 327.63 as my numeric, I see 327.62 at the end of my concatenated string.
multipleConv.vi 11 KB
0
Kudos
Message
1
of 4
(2,636 Views)
Reply
Re: rounding question
altenbach
Knight of NI
04-19-2010
07:26 PM
Options
Mark as New
Bookmark
Subscribe
Mute
Subscribe to RSS Feed
Permalink
Print
Report to a Moderator
You are throwing away data by retaining only 3 elements with the array subset operation. To get the right result, you need a length of four. Try it.
LabVIEW Champion
.
0
Kudos
Message
2
of 4
(2,631 Views)
Reply
Re: rounding question
altenbach
Knight of NI
04-19-2010
07:33 PM
Options
Mark as New
Bookmark
Subscribe
Mute
Subscribe to RSS Feed
Permalink
Print
Report to a Moderator
In particular, you are left with 327.625, which according to the
bankers rounding
is rounded to the even number, or 327.62 in this case.
LabVIEW Champion
.
0
Kudos
Message
3
of 4
(2,627 Views)
Reply
Re: rounding question
mrbean
Active Participant
Author
04-20-2010
06:56 AM
Options
Mark as New
Bookmark
Subscribe
Mute
Subscribe to RSS Feed
Permalink
Print
Report to a Moderator
I think I confused the ArraySubset with another utility where you provide the first/last indexes into the array. Thanks.
0
Kudos
Message
4
of 4
(2,591 Views)
Reply
All Forum Topics
Previous Topic
Next Topic