I was not angry when I should be and people pick it on me, use me for their own merits.

Three Types of Anger -- A Former Therapist Explores

I think this is it, my healthy anger defense mechanism was not working properly... because my anger was dangerous even to myself. 

And people pick it on me. 

people means climbers.