Hi Louis @Looish5 ,
Personally, I find this more worrying:

Anyway, you can try to enable Harden Normals in your Bevel Modifier, under Shading. And you can also try to slightly reduce the threshold angle in the Auto Smooth…
There might actually be something wrong with your model, but I’d need to see your .blend file, in order to be able to troublshoot.
(If you want, you can upload it to Dropbox, GoogleDrive, or any filesharing system and post a link here, then we can have a look at what’s causing this.)