I am afraid this is exactly the case, as - I suppose - it is for most of the people. I guess you live and, at some point, you just learn how not to stress yourself out, especially in your private life, more than it is needed. Otherwise, you'd be stressed out 24/7 and nobody can live this way...