Cool enough for the girl?

Just met this girl i know she likes me and i like her but the problem is in my old school i was really badly bullied and when walkin around town stuff even a year after i left sometime people hurl abuse at me and stuff what girl would want to go out with a guy like that as soon as she realises everyone thinks i am loser it would be tko coz she is really popular at her school.... i have same problem wid college i am popular there but when people ask me if i wanna go in to town an stuff i worry an say no sometimes coz i don't want them to think i am a loser....