Is 5 years a big difference between possible lovers?

I met a guy at a training camp. He has 20 years and I have almoust 15. First I tought he looks good, but I stopped any "love" thinking from my head knowing our age. But then we were good friends, and then we started to get closer and closer. We were lying till 12 o'clock in a bed arms in arm and talking with friends. Once we slept together but with clothes and NO KISSES just huggings and slow talkings and we didn't talk about anything of beeing together. I think maybe he wsa scared about my age. After the camp I felt empty, lonely for a while. Now I'm better, because I talk with him on SMS, but I'm afriad of the next amp. What will happen? Should I let the relationship to go further? I mean I didn't even kiss him! Also some coaches were angry when they saw us holding hands once, they sad I'm too little, but there was in a way nothing. What should I do????