I've had the "Gosh, you were quick!" thing loads of times....going back 25 years when I was trad!!
I remember ripping around a dormer bungalow property in 15 minutes (she timed me) and when I knocked on the door asking for my £3.75 she also exclaimed, "do you always earn £15.00 an hour? I think that's disgusting!"
At the time I really didn't know how to answer her, and as the years passed I was always a bit flummoxed as to how to reply without appearing rude
Most of the time of course it is just their interpretation of how long it took and not how long it
'really' took.
Now I just go along the route others have mentioned on here, higher running costs, high investment and so on, or say thank you for noticing and tell them it has taken me years to get that fast!
I will also tell them my prices are competitive and my work is top notch...seems to work for me anyway
Ian