6 ms·
Packing Input Frame Context in Next-Frame Prediction Models for Video Generation
- vikrantrathore 1y agoFramePack Diffuse thousands of frames at full fps-30 with 13B models using 6GB laptop GPU memory. Finetune 13B video model at batch size 64 on a single 8xA100/H100 node for personal/lab experiments. Personal RTX 4090 generates at speed 2.5 seconds/frame (unoptimized) or 1.5 seconds/frame (teacache). No timestep distillation. Video diffusion, but feels like image diffusion. Paper link: https://lllyasviel.github.io/frame_pack_gitpage/pack.pdf https://lllyasviel.github.io/frame_pack_gitpage/pack.pdf Website link: https://lllyasviel.github.io/frame_pack_gitpage/ https://lllyasviel.github.io/frame_pack_gitpage/
- dragonwriter 1y agoDupe of: https://news.ycombinator.com/item?id=43736193 https://news.ycombinator.com/item?id=43736193