if doing domestic then i would say its ok but not on commercial, a few years ago a very good commercial client made a polite remark about wearing shorts, something on the lines of - i understand the need to wear shorts but i have clients coming here and it doesnt look very proffessional, most clients wont tell you, i perssoneely thought we looked allright and if it came from someone else a may not have took too much notice,