I ended up solving the mystery! I had somehow inadvertently added duplicate vertices to my fins, which was probably confusing the solidify modifier.
I solved this by selecting all of the vertices of the fins and using the “Merge Vertices > By Distance” command. This removed the duplicate vertices and then the modifier results started looking correct again.
