@Tamunathor, Spikey has a good suggestion,
However, first I would adjust the friction and bounciness to see if that helps.
Under collision of the rigid body properties there is a shape setting, switching this to mesh will probably work better for what you trying to achieve.
