It is not failure or weakness to walk away from something or someone that doesn't raise you up in your life. That is called self-respect, or self-love. Our lives are like gardens: they will flower and bloom with nourishment, but we must also tend to the weeds. Love and respect yourself enough to let go of that which doesn't bring you happiness, joy, and peace.