Anti-forgetting representation learning method reduces the weight aggregation interference on model memory and augments the representation performance.