My baking UV Looks bulky

This was a strange one to fix. The checker-like effect you see is what happens when UV islands are layered on top of each other. I could confirm this was the case with your file. However, I couldn’t figure out why your bracket mesh was operating as if it had layered UVs.

So what I did was select that bracket mesh and exported with File > Export > Wavefront (.obj). Be sure to enabled “selection only” and “include UVs”:

Then import (File > Import > Wavefront (.obj)) that obj file back into your scene, enabling the “Keep Vert Order” option. This serves to “refresh” your mesh. It’s kind of a last resort for me if my mesh is doing funky things, like this.

Whenever I imported the mesh, reran the dirty vertex color operation, and baked to the texture it worked fine: