I added the holes with the Boolean Modifier and in Simple Mode it works, at least when I set the Overlap Threshold to 0. Since it was a problem with the default threshold I tried using the exact solver for the boolean modifier and the holes just disappeared:

It’s not a problem right now, but I would like to understand what I am doing wrong so I can do it right when I actually need the exact boolean modifier for something.