If someone is bringing you down, cut them out of your life. Its that simple.