Stop Forgetting Training, Retain It!