@duerer I have no idea how Limited Dissolve calculates what to dissolve. F9 gives some options and it somehow uses a max. Angle, but I do not know what angles that are…
You could also use Knife Project and then Delete the Face. That gives other connections, but none of these solutions give you control over where the Connecting Edges go (at least not that I could figure out):
To be honest, I rarely use Limited Dissolve, because I do a lot of Subsurf Modeling.