If it breaks when you disable clamp overlap, you either have double vertices or the scale is incorrect.
Try merge by distance again, then increase the distance in the adjust last operation panel, little by little, but not too high.
The scale in the sidebar should be 1.000 in the X, Y and Z channels.