We had a similar situation with one house where the backs could only be accessed by next door’s garden (they had a right of access)
Needless to say, the idiot bloke next door didn’t like that, and every time we went he’d come out and complain about the hoses being a trip hazard, the water spilling onto his property etc etc.
I prevaricated for a while, because on the one hand, the idiot neighbour had no right to go on like that, but on the other hand I couldn’t be bothered with the hassle.
Anyway, after about 3 lots of idiot bloke coming out hassling us. eventually I told the customer (who rented the house out as a holiday let) that I wouldn’t be doing it anymore because it was more trouble than it was worth dealing with an abusive idiot.
She was a bit annoyed and said she’d have a word with him and see if she can ask him to be reasonable. I said well you can if you want, but I’m still not doing it, sorry, and that was the end of that.
Now, I will never ever take on a job that requires the use of a right of access, or could potentially upset neighbours (eg an upstairs flat).
And I will certainly never tolerate another idiot, especially now that I employ a worker, we have a zero tolerance policy with abuse, and customers will get dropped the second anything goes awry, even if it’s not their fault.
Customers are easy to replace. Good employees, on the other hand, are like gold dust.