Hello Sriv,
If the said employee has been around for 3 years, and the top boss knows about it but still no one is practically able to do anything, I am not sure you have all the facts right.
On what basis is this guy so brazen in his attitude despite the top boss meeting him?
Frankly, I don't think it's just a matter of counseling/rebukes here anymore. This guy is simply feeling indispensable, as you mentioned in reply to Srividya's posting. Try to figure out why and on what grounds - to begin with, assume the reason you mentioned is not the only one. Only when you do this - maybe discreetly if necessary and possible - will you be able to arrive at some viable and practical solution to this problem.
There's a strong possibility that he has some info (either related to the company or the boss at the personal level) that could hurt the company/boss if revealed (in small companies, this is very much possible and true also, because most employees handle multiple tasks). You haven't mentioned if his attitude was this way right from the beginning. If he was okay earlier and his attitude changed in the recent past, then this could be a more sure possibility. Just check it out from this angle.
If you don't find anything from this angle, only then can you greatly conclude that the only reason for his attitude is what you mentioned.
After this point, suggest discussing with your boss to check what all activities he handles and identify the best possible person who can take over (you may not be able to identify a perfect replacement - else your boss may have done it long back) - without this guy's feedback or handover formalities (if he does it well and good, but I don't think he will - going by what you mentioned).
And then just plainly ask him to go - give his paycheck and whatever you need to give as per rules. I suggest don't give him a chance to get into any argument regarding such matters - forget about the notice period, etc. And don't give any scope for him to visit your office again - unless you people want to see him again :-)
Sometimes from the HR point of view, we need to decide if "maximizing the gains" is important or "minimizing the losses" is more important - something that the stock/share market experts are aware of pretty well.
The choice is yours.
All the best.
Regards,
TS