Nothing wrong there, it’s just how the viewport behaves. There is a kind of planar limit, a a screen space of sorts where you pivot around that needs to be reset as you move about. I just use the numpad period key to center around my selection all the time.
