We're together but we're NOT together?

Hi I really need someone’s advice… ok so here’s the problem I moved to Denver this fall for school and up until about two and a half months ago no one really took an interest in me.. then I met this guy. He’s a little older…..ok so we started talking and hanging out and then we started making things physical and he told me before hand that he didn’t sleep with anyone unless he was dating them…with that being said I kinda of umed a relationship was where he wanted to take this but recently he stopped wanting to hang around me…he started telling me just really shitty things (like, your fat, and you have a lot of things you need you work on appearance wise) and the other night we went out and while I was at the bathroom he was hugged up with some guy…No, this was not a friend hug… and I didn’t mention it to him but this week I asked what it was that we were doing and he told me that we WERE but we WEREN’T together. I just don’t understand what he means and he won’t tell me… because we do everything else couples do besides say we’re together…and this might be desperation talking but I really like him and I can’t understand what it is he’s doing