Here's a kit of 8 cool open-source Audio2Video Diffusion projects.

share link

by shweta10 dot icon Updated: Mar 9, 2024

technology logo
technology logo

Guide Kit Guide Kit ย 

Here's a kit of 8 cool open-source Audio2Video Diffusion projects. 

Python doticonstar image 823 doticonVersion:0.6.0doticon
License: Permissive (MIT)

Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

Support
    Quality
      Security
        License
          Reuse

            video-diffusion-pytorchby lucidrains

            Python doticon star image 823 doticonVersion:0.6.0doticon License: Permissive (MIT)

            Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch
            Support
              Quality
                Security
                  License
                    Reuse
                      Python doticonstar image 3183 doticonVersion:v0.8.1doticon
                      License: Permissive (Apache-2.0)

                      Create ๐Ÿ”ฅ videos with Stable Diffusion by exploring the latent space and morphing between text prompts

                      Support
                        Quality
                          Security
                            License
                              Reuse

                                stable-diffusion-videosby nateraw

                                Python doticon star image 3183 doticonVersion:v0.8.1doticon License: Permissive (Apache-2.0)

                                Create ๐Ÿ”ฅ videos with Stable Diffusion by exploring the latent space and morphing between text prompts
                                Support
                                  Quality
                                    Security
                                      License
                                        Reuse

                                          diffusersby huggingface

                                          Python doticonstar image 15705 doticonVersion:v0.17.1doticon
                                          License: Permissive (Apache-2.0)

                                          ๐Ÿค— Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

                                          Support
                                            Quality
                                              Security
                                                License
                                                  Reuse

                                                    diffusersby huggingface

                                                    Python doticon star image 15705 doticonVersion:v0.17.1doticon License: Permissive (Apache-2.0)

                                                    ๐Ÿค— Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
                                                    Support
                                                      Quality
                                                        Security
                                                          License
                                                            Reuse

                                                              Tune-A-Videoby showlab

                                                              Python doticonstar image 3317 doticonVersion:Currentdoticon
                                                              License: Permissive (Apache-2.0)

                                                              Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

                                                              Support
                                                                Quality
                                                                  Security
                                                                    License
                                                                      Reuse

                                                                        Tune-A-Videoby showlab

                                                                        Python doticon star image 3317 doticonVersion:Currentdoticon License: Permissive (Apache-2.0)

                                                                        Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
                                                                        Support
                                                                          Quality
                                                                            Security
                                                                              License
                                                                                Reuse

                                                                                  peftby huggingface

                                                                                  Python doticonstar image 7047 doticonVersion:v0.3.0doticon
                                                                                  License: Permissive (Apache-2.0)

                                                                                  ๐Ÿค— PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

                                                                                  Support
                                                                                    Quality
                                                                                      Security
                                                                                        License
                                                                                          Reuse

                                                                                            peftby huggingface

                                                                                            Python doticon star image 7047 doticonVersion:v0.3.0doticon License: Permissive (Apache-2.0)

                                                                                            ๐Ÿค— PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
                                                                                            Support
                                                                                              Quality
                                                                                                Security
                                                                                                  License
                                                                                                    Reuse

                                                                                                      stable-diffusion-webuiby AUTOMATIC1111

                                                                                                      Python doticonstar image 83844 doticonVersion:v1.4.0-RCdoticon
                                                                                                      License: Strong Copyleft (AGPL-3.0)

                                                                                                      Stable Diffusion web UI

                                                                                                      Support
                                                                                                        Quality
                                                                                                          Security
                                                                                                            License
                                                                                                              Reuse

                                                                                                                stable-diffusion-webuiby AUTOMATIC1111

                                                                                                                Python doticon star image 83844 doticonVersion:v1.4.0-RCdoticon License: Strong Copyleft (AGPL-3.0)

                                                                                                                Stable Diffusion web UI
                                                                                                                Support
                                                                                                                  Quality
                                                                                                                    Security
                                                                                                                      License
                                                                                                                        Reuse

                                                                                                                          TATSby SongweiGe

                                                                                                                          Python doticonstar image 153 doticonVersion:Currentdoticon
                                                                                                                          License: Permissive (MIT)

                                                                                                                          Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)

                                                                                                                          Support
                                                                                                                            Quality
                                                                                                                              Security
                                                                                                                                License
                                                                                                                                  Reuse

                                                                                                                                    TATSby SongweiGe

                                                                                                                                    Python doticon star image 153 doticonVersion:Currentdoticon License: Permissive (MIT)

                                                                                                                                    Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)
                                                                                                                                    Support
                                                                                                                                      Quality
                                                                                                                                        Security
                                                                                                                                          License
                                                                                                                                            Reuse

                                                                                                                                              VIDEOconvertorby vasusen-code

                                                                                                                                              Python doticonstar image 215 doticonVersion:Currentdoticon
                                                                                                                                              License: Strong Copyleft (GPL-3.0)

                                                                                                                                              A stable and Fast telegram video convertor bot which can encode into different libs and resolution, compress videos, convert video into audio and other video formats, rename with thumbnail support, generate screenshot and trim videos.

                                                                                                                                              Support
                                                                                                                                                Quality
                                                                                                                                                  Security
                                                                                                                                                    License
                                                                                                                                                      Reuse

                                                                                                                                                        VIDEOconvertorby vasusen-code

                                                                                                                                                        Python doticon star image 215 doticonVersion:Currentdoticon License: Strong Copyleft (GPL-3.0)

                                                                                                                                                        A stable and Fast telegram video convertor bot which can encode into different libs and resolution, compress videos, convert video into audio and other video formats, rename with thumbnail support, generate screenshot and trim videos.
                                                                                                                                                        Support
                                                                                                                                                          Quality
                                                                                                                                                            Security
                                                                                                                                                              License
                                                                                                                                                                Reuse

                                                                                                                                                                  See similar Kits and Libraries