That is probably due to your Color Management settings.
Filmic (this is my understanding, do not quote me on this to Troy Sobotka!) makes the brightest value of the Image 1 and compresses everything else ‘down’, so, if you make the brightest pixel brighter, the whole image will become darker…Setting it to the highest contrast will increase this even more.