Notice
Recent Posts
Recent Comments
Link
일 | 월 | 화 | 수 | 목 | 금 | 토 |
---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | ||
6 | 7 | 8 | 9 | 10 | 11 | 12 |
13 | 14 | 15 | 16 | 17 | 18 | 19 |
20 | 21 | 22 | 23 | 24 | 25 | 26 |
27 | 28 | 29 | 30 | 31 |
Tags
- Energy-based model
- Img2pose
- Mask diffusion
- Vector Quantized Diffusion Model for Text-to-Image Synthesis
- Continual Learning
- VQ-VAE
- Face Alignment
- ENERGY-BASED MODELS FOR CONTINUAL LEARNING
- 베이지안 정리
- requires_grad
- Mask-and-replace diffusion strategy
- state_dict()
- DualPrompt
- learning to prompt
- timm
- Discrete diffusion
- CIL
- learning to prompt for continual learning
- L2P
- Facial Landmark Localization
- Markov transition matrix
- Class Incremental Learning
- mmcv
- Class Incremental
- VQ-diffusion
- CVPR2022
- prompt learning
- Face Pose Estimation
- PnP algorithm
- img2pose: Face Alignment and Detection via 6DoF
Archives
- Today
- Total
Computer Vision , AI
[One-page summary] Zero1 to 3: Zero shot One Image to 3D Object by Liu et al. 본문
Paper_review[short]
[One-page summary] Zero1 to 3: Zero shot One Image to 3D Object by Liu et al.
Elune001 2024. 1. 16. 00:24● Summary:Diffusion model for NeRF
● Approach highlight
-
Viewpoint-conditioned translation image translation model using a conditional latent diffusion model ˆXR,T=f(x,R,T)
-
Score Jacobian Chaining (SJC) for 3d representation:
-
randomly sample viewpoints
-
perform volumetric rendering
-
perturb the resulting images with Gaussian noise ϵ
-
denoise them by applying the Unet $ϵ_{θ}$ conditioned on the input image, posed CLIP embedding and timestep
-

● Main Results



● Discussion
- In fig6 the model doesn't seem to work well with multiple objects. I think that the reason the viewpoint synthesis diffusion model is trained on a single object. (Domain shift problem of diffusion model)