Yes, it seems that for the last three patterns, "remove terminal" is greyed out.
My guess is that there is no valid pattern with one less terminal. You can probably disconnect the unneeded terminals, and change to the next lower valid pattern.
A few spare terminals have never hurt anything, just leave them in place.
😉