I would use Planes set to Box as ‘floor’ and ‘sides’ and use a Convex Hull for the coin. In both cases leave the Collision Margin unchecked:

That should give a more stable result.
(You have your Margin set really high, which is part of the problem, but simply reducing that won’t solve it.)
I hope this helps you, I am no expert on Blender Physics;)