Yes, Adrian is right, it is the Collision Distance, but that is also influenced by the fact tht you forgot to Apply the Scale. (Be aware, that Applying the Scale now, will at least mess up your Solidify Distance.)
Apart from some other tweaking, you might want to try and enable Dynamic Mesh:
