It could be that the pivot point wasn’t in the exact center when scaling, or that the walls are slightly different distances from the center. To fix this you could select only one side (the front or the back) of the side wall and snap that instead of snapping it all at the same time.
