If the resignation is accepted, say so. A relieving letter is ethically to be issued after the notice period & as and when he is relieved. If you have any difficulties as explained, simply issue a letter stating that 'his resignation has been accepted as on ........date.' Or endorse the same on his copy of the resignation letter and close the matter.
26th March 2019 From India, Bangalore