I interpret your statement to mean "after execution", i.e., after your program has stopped. The buttons will stay depressed, regardless of mechanical action, if you're in the stopped state - you're editing the front panel, not executing the program anymore. This is normal behavior.
You can use RESET ALL TO INITIAL VALUES to pop them all back out, but you really shouldn't operate the buttons when stopped unless you're intending to change text or colors of the depressed condition of the buttons.