I don’t think you can alter one side of the mirror, by definition it will mirror things. It’s like one side doesn’t even exist, like an actual reflection would. As Martin says, you’d have to apply the modifier and then modify the other side. You can Shift + D to duplicate and leave a copy in case you wanted to go back.