When Plaster gets wet it should just rub or with a sill cloth
should being a nice word there
plaster thats gonna be a trickly one, i suppose you will have to get it wet , but its not going to wip off if it set,
get the worst of with a plastic scraper, then try some wire woll, im not sure if this will scrath the glass, but deff not a green scouring pad