@monaloren Thanks for the tip. For me a complete restart for blender was the solution :/.
I managed to bake the normal maps now. Unfortunately the cage part has a lot of rainbow going on in the normal map. Not sure how to handle that problem. Though the outcome is not so disastrous as I was expecting it.
I am trying to tackle the cavity maps from now on.

