Yes, you’ve run into why people just fake it when it comes to rendering, the cost of waiting for the image to clear up is too high sometimes. I bet there are complex node set ups in materials that let you have all the goodies of glass while avoiding the noise, maybe a little search on the Blender Market can yield good results. Also have you tried cranking up the samples or noise threshold? Maybe it clears up sooner than you think, do a little math of time per frame and perhaps the rendering waiting time is doable? Also you could try a different light setup where you avoid the noise on the glass?
