Whay does it seem like everybody wants to diagnose me except for my doctor

I don't act crazy, but rumors and gossip flys like birds about me that I'm a sad case and I just cracked. It's completly untrue. If Im happy or content I'm just manic and I need to slow down. If I'm enthusiastic about sometinhg or very productive I'm sick. If I want to stay in all day and just read I 'm severly depressesd. It seems if I wasn't crazy already I will be becuase of all the gossip about me. There seems to be no way to counteract it. It seems to ruin my life. A lot more than my my mood swings ever did. can anyone relate