Your post does not make sense from the accounting and legal standpoint. Probably it's a question of using words that make sense to you but not to others. You have leased/rented out your business. Well, that is not possible. There is no such concept. You have perhaps rented out your office/shop. You cannot rent out your business as such. If someone is running your business for you, then you have a management/commission arrangement with him. In that case, you will be actually liable for everything, and the payment should be made by or on your behalf.
If, on the other hand, the person is running the business in his own name, then you have sold your business to him. You may have received no lump sum consideration, or you may have a royalty from the business, but the business probably no longer belongs to you. The answer can be given only after seeing the agreement. Probably a key point is: if you want the business back, can he refuse to give it back? Or if he stops paying you "rent," can he continue to operate the business, or can you stop him? (Note, I am not talking about rent for the premises.)
The answer to your question depends on the above.
If you still own the business, with someone running it, the agreement of who is liable is only restricted between yourself. The government and statutory authorities only recognize you as liable. The payment of statutory dues also must be made strictly in your name.
If you no longer own the business, then you can close all the registrations, except any tax registrations in your personal name that apply even otherwise.
Regards