I made the punching balls guy mine years ago too, in fact, he's named after me, which I consider an honor, even though it's slightly retarded considering what the smiley is doing.
Just think of a bee buzzing by your ear. You try to swat at him but you don't really want to hit him for fear of being stung. You just want him to go away. It's that annoyance where you don't have many choices. It is tempting you. You can either attack and try to kill it or you can just get up and move away.