@williamatics I assume you’ve already turned on Auto-Smooth.
Some things I would try:
Try moving your Bevel modifier up above your Boolean in the stack.
Barring that, I would try creating a second object from your Boolean object and using it as a shrinkwrap target for that object. If shrinkwrapping the whole object doesn’t work try shrinkwrapping only certain loops of vertices. You may have to give your shrinkwrap object its own Bevel modifier, especially if you followed my first suggestion.
Try setting your Bevel modifier to Weight. This will require you to manually go through and set all your edges to an edge bevel weight of 1, but since your Boolean-created wedge shouldn’t have any weight assigned to it, the Bevel modifier shouldn’t affect it.
I don’t know if any of these will end up fixing the problem but they’re the steps I would take first.