Hi
What do you mean by improve the resolution on your FFT? This is going to be dependent on resolution and bit depth of your camera.
I would also suggest re-posting this on the Machine Vision forum, as there will be a greater chance of someone being more knowledgeable on this there.
Mike