Diffusion Models
02 Apr 2024A diffusion model is a parametrized Markov chain trained using variational inference to
generate sample images from noise.
What is variational inference? Approximate guessing. Variational inference is the process of
using an approximate posterior distribution instead of a complex true data distribution.
To ensure the approximations KL, divergence between the 2 distributions are minimized.
Minimizing KL divergence is equal to maximizing ELBO and vice versa.
Denoising diffusion models have 2 processes:
- Forward diffusion process
- Reverse denoising process
Each of the intermediate step is a latent variable.
References:
- Thermodynamics inspired original paper