Oh, that sounds terribly annoying!
I do not know how to make that Setting permanent, if it’s possible at all.
This never happened to me, though. Must have something to do with how you name your Images, so in my tests, Name.1001.PNG opens as UDIM, but Name.01001.PNG opens as Single Image. Maybe you can Batch Rename them?