Modifier stacks work from the top down, the order in which they are organized matters.
Your bevel is not working because it gets processed before the booleans do. You’ll need to move the bevel modifier below the booleans for it to have a chance to affect the holes.
