"Stress generally comes from too concerned about external factors and the opinions of others"

Nah.
So don't listen to people who want to bring you down.
Just put on some headphones and say you don't hear anything...
:)