How to overcome for loop memory limitations?

[n1olan]

I have some csv files, they have a range of around 50k-100k rows and 15 columns. I needed to filter data specific to one of the columns and only show them results, however in my for loop I just get not enough memory notifications.. I had to resort back to filtering in excel and then saving the results into a separate file.... this is not ideal for my application.

Is there another way to do this in labview without a for loop?

I need something like this, if column 15 = 1 then show only the rows with that information into an array... I can then use that array for other means later on.

[GerdW]

Hi nolan,

---

@n1olan wrote:

Is there another way to do this in labview without a for loop?

---

Why get rid of the FOR loop? It's the best you can get!!!

Instead of reading the whole file at once you should read lines/rows in a FOR loop.

Use a conditional output tunnel to only output the lines/rows of interest!

[altenbach]

First of all, if you are cross-posting from reddit, you absolutely must include a link to the original discussion to avoid duplication of efforts.

A FOR loop is one of the most efficient tools in LabVIEW and it is not clear why you try to blame it for your error message.

If you can read the CSV file without memory problem it is hard to imagine that your FOR loop code that does the filtering will run out of memory unless you are doing it wrong. So keep the FOR loop, but improve your filtering code. Once you show us how you are doing it, we can offer improvements.

What is the datatype of the 2D array? is it DBL? String? I32?

What kind of filtering?

[Yamaeda]

Since the name is different and the Reddit user have several posts there i assume this is a bot.

[GerdW]

Hi,

before I answered I googled for the message text, but didn't found anything (especially no Reddit entry).

Usually I mark such messages/threads as crosspost and notify moderators because of "possible SPAM"…

[altenbach]

Sometimes it will take a while until new reddit posts show up in searches, and this was only a few hours old. Still there was some obvious "post smell" here from the beginning... 😄

[Yamaeda]

---

@GerdW wrote:

Hi,

before I answered I googled for the message text, but didn't found anything (especially no Reddit entry).

Usually I mark such messages/threads as crosspost and notify moderators because of "possible SPAM"…

---

I usually just check the front page for that very reason.