A four-year age difference might seem like a big deal just because you are so young. Just think, a 15-year-old dating an 11-year-old - that sounds really weird. But, if it's a 30-year-old dating a 34-year-old, no one would think anything of it. It's weird how that works, isn't it?
This is only my opinion - as odd as it might seem to date someone who's four years younger than you, you need to ask yourself just how much you care about this guy. If it's just a little crush, then it would probably be best not to pursue him, because crushes will fade with time. But if you tihnk that you really care a lot about him, perhaps even if you are able to say that you love him, then you can at least give it a shot. If things feel really awkward, then maybe it will be time to move on, but if you both are happy together, then don't worry about what anyone else may think of you - real love knows no boundaries.
You'll never know if you don't try - remember, a life without risks is no life at all. Good luck to you guys as you decide what path you're going to take.