What I think we fear is rapid, pronounced, and uncontrollable changes to ourselves, and because of this we have a form of personality inertia - something that resists rapid change.