It could be a number of things. Check the normals on you emitter. Check if any objects have collision enabled. What are the friction and damping values? Do you have any physics applied to the particles? If you can’t find anything maybe upload a link to the blend and see if someone can help you troubleshoot.
After some extensive troubleshooting, I discovered that some of the particles experienced more drag or something, causing them to get ejected downward at a slower rate. I don’t know how to fix that, though. Here’s the blend file in case you want to help: http://pasteall.org/blend/index.php?id=52680
In Edit Mode subdivide your ‘rocket’/firework, in Object Mode with the firework selected go to Object > Quick Effects > Quick Explode. Adjust the settings, especially the Outward Velocity: