When we are with our own-self, we feel our heart is safer than with being others around. There is no danger of getting hurt. There is no fear that we will feel shameful, somebody will call us bad person, somebody will consider us selfish, we are short tempered or we can't do anything right. There are no heart breaks in our own environment. Nobody will ditch us as nobody is around. We are with ourselves so no chance of emotional damage.