If you can’t rotate the object, then you should rotate the background image.
This has not always been possible but it can be done in 2.79+ and even in some older versions of Blender. Don’t know exactly what the first version was that had a rotation for the background images…