I’m not sure I can provide an precise answer to a problem I didn’t fully grasped but if It can help:
CTRL+Scale and rotation everything before you parent and keys.
You said to start with the dougie, from the graph seems the ball should be first – saying this, I’m not sure to grasp your needs so I write in case it can help.