Yes,
Don’t use Passive for things that need to react to physics.
Also, with simple shapes, like a sphere and ‘cubes’, there is no need to use Mesh as Collision Shape, not even Convex Hull if you can use Sphere and Box, because they are much easier/faster to calculate.
Physics are not easy in 3D, as you’ve noticed.