Worse.

No, you didn't hurt my self-esteem--I still think of myself just as highly as before.

You've done worse than that--you've killed my faith in everyone else.