The IMAQ Vision concepts manual is only to give a brief summary of how each operation is performed, not a detailed analysis with the algorithms. But, the circle detection states that it uses the Danielsson function. This is a typical approach to the circle detection problem. Try searching the web for some more detailed explanation of how the Danielsson function works and its relation to circle detection in image processing.
Hope this helps,
Jack Arnold
National Instruments