Should I go for it? Or forget about him?

My friend Matt is 17 and a junior, and I'm 15 and a freshman. He is my best friend and I really like him and my ex, Austin told me Matt likes me, too. He's really cute and sweet and funny, but he's a pretty well known dealer. My friend told me she'd kill me if I got into that stuff, but I won't. I don't know what to do, I want to date him, but don't want people mad at me and telling me I'm gonna start doing drugs cause of him. I told everybody I would do nothing more than smoke pot, not even drink, but I'm not gonna quit smokin. Also qny help if I'm 5' 4 and he's 5' 1? I don't like being the taller one, and not by 3 inches!