Aha! If you’re using a PNG you need to switch the texture node to non-color data. For 32 bit EXR’s, you can leave it on sRGB as you had it. I’d recommend baking it to a 32-bit image (hit that box when creating the image) and saving it as a full float EXR instead of a PNG.
I know it’s kinda confusing, but that’s the only way to get it to look right!