If you want to be vegetarian, thats fine.
But, dont tell me what to do.
Imagine saying to someone, If you dont want to beat your dog, thats fine. But, dont tell me not to beat mine.
While we are entitled to believe what we like, we are not entitled to treat those weaker than us however we like. If we are responsible for harming others, people have every right to ask that we stop.
Follow up questions:
Isn't it wrong for vegetarians to act as if they are better than others and try to convert people?
Do you want to make eating meat illegal?