This is so true. I also can't imagine Robin and Charles Bateman. Or Jed towering over Gibbony would have felt wrong somehow. I wonder if there are reasons for this. Like, TPTB know that the actors will never play it exactly the same, so let's shift the character a bit.
I'm also fascinated by the characters the DON'T try to recast.