I tested it in 3.5.1 and in 3.4.1 and Cavity stays on in both versions.
Try Load Factory Settings. If the problem persists, it’s not caused by an Addon.Then you should look at your Graphics driver (is it up to date? Or maybe you need to go back a driver version). But an Addon interfering sounds the most likely to me.
