C will constrain the movement to the direction you are already going.
So if you have moved your mouse sideways, even just a fraction, prior to pressing C then sideways it is constrained to.
You should see a yellow direction line when in edge slide, make sure that line is in the direction you want to slide before pressing C.
