Yes, I can see how that would be very annoying.
However, that is not the normal behavior. What Blender version are you using? Looks like a 2.9…. version, but I’ve tested a few different versions and this doesn’t happen…(couldn’t try 2.93.0, because I deleted that and now have a 2.93.1 Maybe it was a bug that they already fixed?)
