I've started advertising in a magazine which covers my areas, (but also an additional area, which i'm not familiar with).
I'm getting calls from this 'new area' but they've all been crap! So it's not just you!
Mostly, I can spot the problems, when I go and quote and I always charge more for a first clean, sometimes even just £10 more, just to see their reaction!
As for your living arrangements, you have to make the best of it. Try getting up early 5am (I bet no-one else is up and about), get a couple of hours of quiet time. My girlfriends house is on an ex council estate with terraced houses and flats etc. Big guys with dogs, big women with dogs...and tatoos etc etc. Over the years, i've got to talk to them and they're not so bad. Occasionally, I may clean the odd windows in the street if they ask, in exchange for a cuppa. Everyone now says hello and smiles and i've never had a single problem with the van. In fact one of the guys from the flats knocked on my door when he saw kids messing about with my van. Just try and relax with it and be thankful you're not homeless.