Learn to Let Go of Goals in Time