I don't think I look especially shocking. I'm short, like "little person" short, and my spine is severely curved. I've got big years, too … Barack Obama big … though it's hard to say how much of a factor they are. I'm funny-looking, but not extremely so. Most of the time when I meet someone, they don't skip a beat. Once in awhile, I meet someone for the first time and I can just tell that my appearance has thrown them. They meet me, and internally they're saying, "Whoa, what?" Most people kind of blink, maybe stutter a moment, and move on. Just a little brain fart.
A few people really get stuck. Maybe they have questions about what they are seeing and they just can't let go. Maybe they're afraid they'll say something insensitive. They might be thinking a little too intensely about whether the tone of their voice or their handshake is appropriate ... or wondering what IS appropriate for someone like me. For me, the biggest "tell" is a slight physical reserve, a withdrawing into their own space, combined with a distracted, choppy, or stunted flow of conversation. It's really noticeable when I've heard the person speak very fluently, professionally, or charmingly to others, and with me they blather, hesitate, or freeze for just a few more seconds than is comfortable for either of us. I almost never see hostility. They smile and say the correct things, but either they are trying to limit the interaction, or they are only devoting half of their mind to the conversation. The other half is thinking "What's the deal with him?", and "I hope he doesn't notice how nervous I am." The phrase "deer in the headlights" might have been invented from this experience.
Like I said, it doesn't happen often. But when it does happen, it's the closest thing to pure "ableism" I experience. I can't say I'm exactly hurt by it, but it is a reminder. "Oh yeah, I'm different. I almost forgot!" It reminds me that there are probably a lot of times when I think an interaction is about one thing, when for the other person, it's about that thing AND it's about meeting a weird person they can't help looking at and wondering about ... and feeling uncomfortable about looking at and wondering about.
Ableism is a distraction for both sides, I guess.