Mycroft: “Not at all. Maybe he just doesn’t mind being different. Doesn’t necessarily have to be isolated.” Sherlock: “Exactly […] He’s different. So what. Why would he mind? Quite right. Why would anyone mind?”
Mycroft: “Why do you hate him?” Sherlock: “Because he attacks people who are different and preys on their secrets. Why don’t you?”
“Different.” Two exchanges between the brothers, from The Empty Hearse and His Last Vow.