일 | 월 | 화 | 수 | 목 | 금 | 토 |
---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | ||
6 | 7 | 8 | 9 | 10 | 11 | 12 |
13 | 14 | 15 | 16 | 17 | 18 | 19 |
20 | 21 | 22 | 23 | 24 | 25 | 26 |
27 | 28 | 29 | 30 | 31 |
- 베이지안 정리
- mmcv
- Face Alignment
- learning to prompt
- Continual Learning
- Markov transition matrix
- Class Incremental
- PnP algorithm
- VQ-diffusion
- Discrete diffusion
- L2P
- requires_grad
- Facial Landmark Localization
- VQ-VAE
- state_dict()
- Img2pose
- ENERGY-BASED MODELS FOR CONTINUAL LEARNING
- timm
- DualPrompt
- CVPR2022
- Mask-and-replace diffusion strategy
- Face Pose Estimation
- prompt learning
- Vector Quantized Diffusion Model for Text-to-Image Synthesis
- img2pose: Face Alignment and Detection via 6DoF
- Mask diffusion
- Energy-based model
- learning to prompt for continual learning
- Class Incremental Learning
- CIL
- Today
- Total
Computer Vision , AI
[One-page summary] ENERGY-BASED MODELS FOR CONTINUAL LEARNING (CoLLAs 2022) by Li et al 본문
[One-page summary] ENERGY-BASED MODELS FOR CONTINUAL LEARNING (CoLLAs 2022) by Li et al
Elune001 2023. 4. 18. 18:44● Summary: Adopts energy-based method models classifier to continual learning to solve class incremental problem
●Approach highlight
○ Energy-based model for classifier: take class y and data x and as input and output is their energy value
○Energy-based models loss function makes minimize energy of positive pair and maximize energy of negative pair
● Main Results
● Discussion
○ Computational cost: computational cost of prediction is proportional to the number of labels
○ Still has low performance compared to iCaRL with a replay and still low performance when increasing the number of tasks
EBM classifier: y(판별하고 싶은 class들)과 x(입력)를 입력으로 받아 Energy-based classifier에 넣어서 가장 낮은 에너지 준위가 나오는 y가 해당 x의 클래스