I used to do the same, but a few months ago I changed to doing the top frame of everything, every time. On frames that I think might drop down I clean them as normal, doing the top frame, then after I've done the windows next to them I give them a quick rinse again just under the top frame.
I'm not going to say I get perfect results every time, ( no one can say that) but I never get complaints, and on the windows that I also clean the insides of the outsides come up great, and my own windows look great doing that too.