I think you bring up an interesting question. As you, say it's not good to dislike someone for being "special", but if someone acts in a negative way, should you treat them differently than you would a "normal" person? If you would normally dislike the person based on their behavior only, how much slack should you give them if that behavior may be the result of a condition beyond their control?
Personally, I think it is important to consider the situation carefully and avoid quick judgements. If the individual has significant developmental impairment, they may not be aware of the effect their behavior has on other people and may not be able to quickly adapt to different social situations. Social behavior is complex and often times contradictory. Just as a young child might behave inappropriately without realizing or fully understanding the consequences, so might an individual with mental impairment. On the other hand, some children are very much aware of the way their behavior affects other people ... and use that knowledge to manipulate or annoy. Intent is pretty darn important. It wouldn't be right to blame him for being offensive if his intent was positive but his unique limitations prevented him from expressing himself appropriately.
I've known a few people who could be described as "special" and they were all interesting and complicated people who often struggled with meeting and interacting with new people because they couldn't fit in to the narrow band of behavior that is considered "normal". One of them was a guy with Torette's - it didn't affect his speech very much, but he had a VERY distracting facial twitch that made even a brief conversation with a new person pretty uncomfortable for everyone involved. He couldn't stop the annoying facial expressions and he didn't want to immediately tell ever person he met "Yes I have a medical condition. No, it is not contagious." It was always interesting to see how long it took for someone to ask about the constant twitching ...
Generally, I think it is better to err on the side of forgiveness and compassion, rather than assuming the worst. If you are willing to give him a chance and get to know him a little better, you might learn that he is a decent guy with some weird behavioral ticks that are off-putting to strangers. Or you might confirm that he is a loud annoying jerk with a crappy sense of humor. There's no way to know for sure unless you give him a chance. And then when you explain why you dislike him, it won't be due to his special needs and related behaviors, it will be due to knowing and disliking him as an individual.
Personally, I think it is important to consider the situation carefully and avoid quick judgements. If the individual has significant developmental impairment, they may not be aware of the effect their behavior has on other people and may not be able to quickly adapt to different social situations. Social behavior is complex and often times contradictory. Just as a young child might behave inappropriately without realizing or fully understanding the consequences, so might an individual with mental impairment. On the other hand, some children are very much aware of the way their behavior affects other people ... and use that knowledge to manipulate or annoy. Intent is pretty darn important. It wouldn't be right to blame him for being offensive if his intent was positive but his unique limitations prevented him from expressing himself appropriately.
I've known a few people who could be described as "special" and they were all interesting and complicated people who often struggled with meeting and interacting with new people because they couldn't fit in to the narrow band of behavior that is considered "normal". One of them was a guy with Torette's - it didn't affect his speech very much, but he had a VERY distracting facial twitch that made even a brief conversation with a new person pretty uncomfortable for everyone involved. He couldn't stop the annoying facial expressions and he didn't want to immediately tell ever person he met "Yes I have a medical condition. No, it is not contagious." It was always interesting to see how long it took for someone to ask about the constant twitching ...
Generally, I think it is better to err on the side of forgiveness and compassion, rather than assuming the worst. If you are willing to give him a chance and get to know him a little better, you might learn that he is a decent guy with some weird behavioral ticks that are off-putting to strangers. Or you might confirm that he is a loud annoying jerk with a crappy sense of humor. There's no way to know for sure unless you give him a chance. And then when you explain why you dislike him, it won't be due to his special needs and related behaviors, it will be due to knowing and disliking him as an individual.