Simply: "I've been told I'm rude." Beat. "Not often, though. People usually don't want to piss you off if you're scary enough. Even if you're a prick."
Other options:
no subject
Simply: "I've been told I'm rude." Beat. "Not often, though. People usually don't want to piss you off if you're scary enough. Even if you're a prick."