How to read binary file more quickly ?

[mmm21]

Hello, I have a big database to be read in Labview. This DB size is 200×120,000.

When I try to read all of file at once, we need to wait.

So, I would like to create a program to read the DB per 10,000 rows. When I put "next" button, next 10,000 rows will be read.

I think I should use "count " of "read binary file", but I don't know how to use it.

Please support me.

[altenbach]

If it is a binary file, why are you reading it as a 2D array of strings? That's not a typical datatype for binary files.

Your picture does not make it clear at all how things are connected to your subVI.

Could you attach your actual VI and typical (but much smaller) sample file?

In any case, you can specify how much to read each time. You just need to use a suitable loop. It will know where to continue reading at the next iteration.

[mmm21]

Pardon, I am a beginner of labview and programming. I might mistake the word.

I just would like to read the file of the 2D array string per 10000 row.

Please find the attached.

[altenbach]

A binary file is just a long string of characters. There is no concept of rows.

(A "row" assumes a formatted and readable text file with some characters designating row and column delimiters. You don't have that!)

You can read it as a string of course, but maybe you can tell us what the binary data represents. What are you going to do with it once it is read?

I any case, your file is not a flat binary file, but seems to have some structure (e.g. there are some readable strings and header type information). What software generated this file and is the file structure documented?

[mmm21]

I would like to create the simple database by labview. Users will search the word per each columns, then they can see the filtered database on the front panel. The file I have attached before was generated by labview with the «create binary file ». The file structure is not documented, since that is created by myself for the purpose of publishing in the internet.

[drjdpowell]

You should consider using a SQLite file rather then trying to make a simple database yourself.   A bit of a task to learn SQL, but then tasks like this become easy.

[altenbach]

---

@mmm21 wrote:

The file I have attached before was generated by labview with the «create binary file ». The file structure is not documented, since that is created by myself for the purpose of publishing in the internet.

---

Well, if you created the binary file with LabVIEW, the "structure" for reading it is exactly the same as the structure you used to write it. So yes, it is "documented", at least for you. 🙂

I don't understand the usefulness of publishing something on the internet if nobody can read it. Can you explain?

[mmm21]

I have already tried SQLite library in my labview, but the time to read into lab view has not be shorted. Is there any clue to solve my problem ?

[mmm21]

Well I mean I just don’t want to upload our real data on the internet so that every body can see it. It is confidential data. 

Do you mean I need to Do I need to use SQLite or some other database tool for documented ?  

[drjdpowell · Accepted solution]

The point of using SQLite is to only pull into LabVIEW the filtered bit that you are displaying to the user, not everything.