topic Re: Instability in pattern matching in Machine Vision

Instability in pattern matching

FM82 — Fri, 06 Jun 2014 08:51:19 GMT

Hi, i need some advice on this. I use Imaq pattern matching to check the components of a pcb board. Presence and orientation of components. I am close enough to complete the program and i'm testing it on my table with natural, but not direct, light.

By now i have obtained good, but not stable, results. From time to time i get a collapse on the matching score, even to zero. Without moving the board under my camera. So i think that the problem is the natural light and his minimum changing during the testing. Reading the documentation from NI i found that the pattern matching should be resistant to light changing in the ambient, so i dont really understand the problem.
Should i not to trust the pattern matching and using it only on stable lighting condition? Or maybe there are some problems in the code?

Re: Instability in pattern matching

muks — Fri, 06 Jun 2014 10:08:20 GMT

Please make the lighitng stable. You will not get repeatable results in pattern matching and for that matter you will find difficulty in all image processing functions

Re: Instability in pattern matching

FM82 — Fri, 06 Jun 2014 11:59:09 GMT

Thank you very much, i already had a strongly suspect that the problem is the non stable lighting conditions. Evidently even when the human eye cannot catch the difference, the pattern matching function can.

muks ha scritto:

Please make the lighitng stable. You will not get repeatable results in pattern matching and for that matter you will find difficulty in all image processing functions

Re: Instability in pattern matching

muks — Fri, 06 Jun 2014 12:55:50 GMT

One technique that you can try is use a very high intensity lighting and operate the camera in mimum aperture which will make the ambient lighting have no affect in your system

Re: Instability in pattern matching

FM82 — Fri, 06 Jun 2014 13:19:22 GMT

Good idea, thank you.

Re: Instability in pattern matching

Klemen — Fri, 06 Jun 2014 18:19:08 GMT

Hello,

lighting is very important, but based on what you said, I am not sure that your current matching fails because of the lighting variation.

Normalized cross-correlation is invariant to uniform lighting changes, but not to non-uniform, such as local reflections for example (it is also not invariant to scale changes and occlusions) . You've said that you cannot visually see the difference between the positive and the false/no match, so I fail to see how the pattern match fails. I have found the Vision Pattern Matching really stable and roboust in various conditions. Are you sure there is no error in your code?

What seems strange to me is that you have the PCB board positioned on the same spot and the matching fails at one time and gives a positive match at the other... This should not happen using the natural lighting, since I don't belive that the intensity variation is non-uniform to such a degree that it would interfere with the correlation score calculation.

Anyway (regardless of the above), try to use constant lighting when finising your application, so you don't need to re-learn the template descriptors. This will also give more accurate results.

P.s.: You can post the part of the code that does the matching here, and we can take a look at it. Disregard this, if the lighting is really the issue (I would be suprised that it is in your case!)

P.p.s: The type and the direction of the lighting varies from apllication to application. You need to select the most suitable for your application. I will not go into details, but there are a lot of guidlines online. This one is pretty good:A Practical Guide to Machine Vision Lighting - Graftek Imaging.

Best regards,

Re: Instability in pattern matching

muks — Sat, 07 Jun 2014 07:15:04 GMT

I feel this is definetly because of irregular lighting and i personally feel pattern matching is not "very" stable too.

Re: Instability in pattern matching

Klemen — Sat, 07 Jun 2014 10:08:46 GMT

Hello,

it seems that you hava a valid (and probably the correct) point...

What seems strange to me is this part from the first post:

"From time to time i get a collapse on the matching score, even to zero. Without moving the board under my camera. So i think that the problem is the natural light and his minimum changing during the testing."

The board is not being moved and there is minimal change in light. I have seen pattern matching performing correctly with rotation, shift and quite moderate intensity variation (it failed when trying to match reflective material subjected to motion due to reflectivity shifts). But I am really speculating here, since I do not know what is the object and what is the lighting in this case.

Some images of matches/non-matches should be more instructive in order to test the behaviour of the application.

Also, if there are problems with the intensity based matching, one could try geometric based matching.

Best regards,

Re: Instability in pattern matching

muks — Sat, 07 Jun 2014 10:30:39 GMT

Some images of matches/non-matches should be more instructive in order to test the behaviour of the application.

Very valid

Rif.: Instability in pattern matching

FM82 — Mon, 09 Jun 2014 08:12:47 GMT

I think i found the problem, or maybe the bigger one. First of all i have some fiducials on the board and i must find it to recalculate the relative position between the searching area and the board. The first time i had tryed to adapt the searching area and the "template matching function" to the rotated board by using the "rotation invariant" searching. Now i have modified this and i first rotate the image and make it perpendicular again and then use the pattern matching function but in his "shift invariant" form. I hope i explained what i mean.

Do you think this can be the problem?

Rif.: Instability in pattern matching

muks — Mon, 09 Jun 2014 08:22:58 GMT

Can you post a few images?

Rif.: Instability in pattern matching

FM82 — Mon, 09 Jun 2014 08:30:42 GMT

I'm trying to get a fail so i can post the "good" and the "bad".

Rif.: Instability in pattern matching

muks — Mon, 09 Jun 2014 08:35:05 GMT

@FM82 wrote:

I'm trying to get a fail so i can post the "good" and the "bad".

Also post the fiducials as the camera sees it.

Rif.: Instability in pattern matching

FM82 — Mon, 09 Jun 2014 09:02:14 GMT

Here it is. i'm sorry for the patch but i need to hide the client's name. Here you can see the fiducials and the areas of search with the relative components. This is a good image. After the modification that i explained before i had done 100 runs but i could not get a single "fail", instead i have obtained a pretty costant match score.

Rif.: Instability in pattern matching

muks — Mon, 09 Jun 2014 10:03:49 GMT

and what is your reference in this image?

Rif.: Instability in pattern matching

FM82 — Mon, 09 Jun 2014 10:27:42 GMT

Sorry i did'nt get it, do you mean the fiducials?

Rif.: Instability in pattern matching

muks — Mon, 09 Jun 2014 10:41:34 GMT

yes

Rif.: Instability in pattern matching

FM82 — Mon, 09 Jun 2014 11:36:58 GMT

The three points that you can find in the upper left corner, in the lower left and in the upper right.

This one:

Rif.: Instability in pattern matching

muks — Mon, 09 Jun 2014 12:49:34 GMT

I honestly feel is the image is good. I feel if you are taking the fiduals reference corerctly the application should work correctly and ofcource with uniform lighting.

Rif.: Instability in pattern matching

FM82 — Mon, 09 Jun 2014 13:06:19 GMT

I already checked the fiducials and i can exclude that they are the problem. Honestly last week there had been some cloudy days with the sun that come and gone from time to time. So i think that the principal problem is my inexperience with the pattern matching function and the working mechanism behind the result, so i expect something that i couldn't really achieve due the terrible conditions that i experienced last week.
Today is a really sunny day and it seem that the code is working pretty well. I work really close to a window so i take all the changing in lighting. I know that this are terrible conditions to work with, when talking about image analysis, but i thought that if i can make a software that can work under this circumstances when i will put all the stuff inside a closed dome i will be sure that everything will work very well.