Computer Vision , AI

[One-page summary] ENERGY-BASED MODELS FOR CONTINUAL LEARNING (CoLLAs 2022) by Li et al 본문

Paper_review[short]

[One-page summary] ENERGY-BASED MODELS FOR CONTINUAL LEARNING (CoLLAs 2022) by Li et al

Elune001 2023. 4. 18. 18:44

Summary:  Adopts energy-based method models classifier to continual learning to solve class incremental problem

 

Approach highlight

    ○ Energy-based model for classifier: take class y and data x and as input and output is their energy value 

Energy-based model for classifier

    ○Energy-based models loss function makes minimize energy of positive pair and maximize energy of negative pair

EBM loss function

Main Results

 Discussion

    ○ Computational cost: computational cost of prediction is proportional to the number of labels

    ○ Still has low performance compared to iCaRL with a replay and still low performance when increasing the number of tasks

 

 

EBM classifier: y(판별하고 싶은 class들)과 x(입력)를 입력으로 받아 Energy-based classifier에 넣어서 가장 낮은 에너지 준위가 나오는 y가 해당 x의 클래스