Hello Kiran,
I am not sure if this situation can be addressed properly on an open forum like this, since quite a few aspects that you may not like to be out in the open could need to be discussed.
But to put it in a nutshell and very generically, always look for emotional and mental compatibility before you get into the age factor, not whether you like his face or he likes yours. Age has nothing to do with emotional/mental maturity. I know of persons about your age, but with the maturity level of 40+ years - got to do a lot with their life experiences. I have also seen persons who are above 50 years but with the maturity level of 20s. And gender too has nothing to do with this.
Did you ever give this a thought: why do the elders suggest the woman to be of a lesser age than the man for marriage? Nature has made women mature (not just physically) much earlier than men. Without getting into the 'why' of it, this leads to the situation where a woman of, say, 20 years usually ends up having the emotional and mental maturity level of a 24-25 years man. But remember there are exceptions for this too, like for every rule - depends on the life's experiences of that person.
So try to recollect your past interaction with him and don't focus on what he said/did, but focus on how he said/did whatever he said/did and please use your logical part of the brain to make a good guess on the why part (meaning why he could have said/did whatever he said/did) - I have seen many people - male and female - do the right things for the wrong reasons... in a normal situation that could be okay, but in situations like yours, it could be a royal invitation for future disaster.
Another way to get an indication would be the use of Horoscope matching. I have found this gives a good idea of the possible problem areas, and then you can decide. Like for example, suppose the man has a tendency (based on Horoscope readings) to spend excessively, the match would be compatible only if the woman has a thrifty temperament... so on and so forth. In this, your choice of the right astrologer will be critical - just as your doctor's choice when you are ill. If the one doctor turns out to be a half-baked guy, you don't blame the whole lot of them, right?
Just remember that the key is to evaluate the issue through all the means available and then do the balancing act - no method is final - just as however well you prepare for an exam, there will always be a chance you might not score well... but by preparing well you are just reducing the chances of getting low scores. All of them need to be used to get the final picture, and then the decision has to be yours.
Hope this is of use to you.
Regards and all the best,
TS