Sometimes what happens to me is that I hide parts of the mesh in edit mode. So I see them in object mode, but when I got into edit mode, all those vertices are hidden, meaning I must have hit H at some point. So maybe that part that you are trying to get rid of is hidden when you go into edit mode and you just have to ALT+H it?
