Why do left-handed hitters have a "hole" in their swing?

I keep hearing about a particular location (thigh-high, inside) that is very difficult for a left-handed hitter to make contact with. Is this real, or just hyperbole? If it exists, why don't right-handed hitters have the same hole, mirrored?