If one of your competitors does spend all morning clicking onto your site they can, what will happen is your allowance will be used up for the day, and you will only return on google the next day, what google will do is send you a message letting you know that click fraud has happened, they will then credit back your account. But that does not help when your web site does not show for most of the day.