Offensive Langauge

Words by themselves don't usually upset me, nor phrases. It's the tone and inflection behind the words that I find offensive.
As someone with Aspergers, I have struggled constantly to decipher the meaning behind peoples words. Are they merely joking, or are they trying to be mean? Am I the butt of a joke or is it all in good fun?
I can't tell the difference when people speak. I don't know if they are angry at me or because of something else. I don't know how to pick out subtle sarcasm. I don't take jokes like everyone else.
I struggle everyday that I have to interact with people. Because I can never tell what the implication behind their words are.
I've gotten upset when people make jokes about my family or art. I get upset when my father says barbed comments that he claims to be 'jokes'. 
I automatically find language offensive because I don't know the difference. All I know is to be angry because I'm upset. I'm upset because I don't know when people are mean or having fun.
Words don't make me mad, it's the meaning behind them that do.