Not sure if this has been suggested yet , but I am in a rush and just wanted to add this in
Why not make it mandatory to put a small critique in when you grade a submission ? You could set a minimum character count and that way everyone who grades them will have to say something about the submission to help out. This includes myself as I try to grade excercises when I can but I am terrible at just pressing the red or green button and moving on without writing anything – a habit I am working to change.
Just a thought but surely it will be fairly easy to implement and even if less people vote, it will have a bigger impact on helping the submitter I would say.