However, previous online KD methods did not treat the labels accordingly after different enhancements of the samples. Vanilla continual learning. Some of the methods proposed in the previous section (TENT, PL, BN) can be extended to this scenario, without particular modifications apart from the specific model the adaptation procedure starts from at each step. This…