This sounds to me like either a miswired cable or a configuration problem with the instrument. Make sure your cable is properly wired, determine if it requires hardware flow control and verify that the instrument is configured to use the interface you want to use. (Many instruments require you to select an interface if there are two or more types present).
Make sure you are really using the COM port you think you are and that it is actually working. You can build a loopback plug to test a serial port, there are a number of places online with instructions to do this. You would then use hyperterminal or something like it to check the port. Finally, verify that the communication parameters (baud rate, etc.) on the PC and the instrument match.
Martin Fredrickson
Test Engineer
Northrop Grumman
Advanced Systems and Products
San Diego, CA 92128