I suspect it's black leeching from the window, I would tfr the frame and scrub like anything until the water runs clear that should solve the issue, as for stucco, it's a bitch to clean, best results would be tfr on a hand brush and gently rub, alternatives are black streak remover and pink stuff, the latter is a paste so don't use too much
Darran