Dear Friend,
This case is a rare case, and might be happen with all the organization in the world, hence I believe that HR is the business partner, and consequently there are some question in my mind, who did the long list , and who approved the short listed candidates, what is your recruitment policy and procedure, what type of grantee your takings from new joiner, since the nurture of your organization is a for profit organization and mostly in financial insistute , a strong reference letter will be obtain from the staff member. After evulating all the pros and case of the case, I'm sure you will be in a good position to take decision, or even in my point of view your organization should make a tight policy for recruitment rather than to stop your salary.
Pls let me know if I can be any assist in future.