Hi Miichal,
I don’t get any spikes with your settings (only changed the HDRI, because it wasn’t included and used a Normal Map Node):

Probably a GPU issue. There has been a version of Blender, where the GPU Subdivision had a bug; try disabling that:

If that doesn’t help, try CPU Rendering.
Maybe you need to update your driver.