Lumiere

Lumiere is a text-to-video diffusion model designed for synthesizing videos that portray realistic, diverse and coherent motion. It accomplishes this by generating the entire temporal duration of the video at once, through a single pass in the model. This is in contrast to existing video models which synthesize distant keyframes followed by temporal super-resolution.

Let me know if you would like to learn more about text-to-video diffusion models!