Oh, I see…
You mean something like this:
I think what you want should be possible, but I don’t know (yet) how to do that (with the Particle System…should be doable with Geometry Nodes).
But you can CTRL+J the leaves to the trea, making it one Object, like I did in the example above.