It all boils down to what you want to remove. So with what option are you trying to dissolve the cap? If you select the face and remove only face, it works, the cap goes away. Same for dissolving edges or vertices, it works as it is supposed to, it gets rid of the whole cylinder except the bottom part, since the top depends on the top vertices. So the behavior will change depending on what you dissolve.
