Let me be pragmatic here. If a company hired an HR team with a strength of four employees, does that actually mean it wants to expand its operations, which in turn requires hiring and managing resources? So, don't just look at today. Your objective and focus should always be proactive. You need to start framing and implementing policies right away so that everything will be in line when needed.
So, do not look back. Start on a proactive basis. All the best.