Generative AI for Art

share link

by Ashok Balasubramanian dot icon Updated: Sep 6, 2022

technology logo
technology logo

Guide Kit Guide Kit  

AI-generated artwork wins the top prize in a U.S. art competition! Jason Allen's "Théâtre D'opéra Spatial" or 'Space Opera Theater' won the top prize at the Colorado State Fair's fine art competition in the "digital arts/digitally-manipulated photography" category. While the category allowed digital art, this issue has ignited fierce debate on A.I. generated content. We have all been accustomed to chatbots talking to us in natural language or text editors used in blogs. Creativity is the hallmark of human evolution! The ability to create art is one of the defining characteristics of evolution. The past generation of automation technologies went after repetitive manual tasks and wasn't seen as much of a threat. Generative A.I. technologies promise higher-level cognitive task capabilities such as writing, coding, video, and art. So naturally, this will usher in industrial revolution scale debates on the balance of using A.I. vs human economic value add. The other dimension that is also playing out is copyright. There are at least three parties involved in making A.I. art. The millions of images and their authors, the model's technology provider, and the user who generated the art. In August, a U.S. appeals court affirmed that an artificial intelligence system could not be an inventor under United States patent law, noting that the inventor must be a natural person. Authors of licenses such as CreativeML Open RAIL-M claim no rights on user-generated outputs. Though the product created by the engine is not patentable, it is unique. How unique can derivative work be, and can it be considered innovative? That is the maturity curve that generative A.I. has to scale. After all, we humans learn from instruction, infer from different sources and then reflect those in our innovation! While this journey evolves, here are interesting open source libraries that will help you generate art using A.I.

imagen-pytorchby lucidrains

Python doticonstar image 6980 doticonVersion:1.25.4doticon
License: Permissive (MIT)

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

Support
    Quality
      Security
        License
          Reuse

            imagen-pytorchby lucidrains

            Python doticon star image 6980 doticonVersion:1.25.4doticon License: Permissive (MIT)

            Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
            Support
              Quality
                Security
                  License
                    Reuse

                      deep-dazeby lucidrains

                      Python doticonstar image 4394 doticonVersion:0.11.1doticon
                      License: Permissive (MIT)

                      Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

                      Support
                        Quality
                          Security
                            License
                              Reuse

                                deep-dazeby lucidrains

                                Python doticon star image 4394 doticonVersion:0.11.1doticon License: Permissive (MIT)

                                Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
                                Support
                                  Quality
                                    Security
                                      License
                                        Reuse
                                          Jupyter Notebook doticonstar image 56084 doticonVersion:Currentdoticon
                                          License: Others (Non-SPDX)

                                          A latent text-to-image diffusion model

                                          Support
                                            Quality
                                              Security
                                                License
                                                  Reuse

                                                    stable-diffusionby CompVis

                                                    Jupyter Notebook doticon star image 56084 doticonVersion:Currentdoticon License: Others (Non-SPDX)

                                                    A latent text-to-image diffusion model
                                                    Support
                                                      Quality
                                                        Security
                                                          License
                                                            Reuse

                                                              glide-text2imby openai

                                                              Python doticonstar image 3204 doticonVersion:Currentdoticon
                                                              License: Permissive (MIT)

                                                              GLIDE: a diffusion-based text-conditional image synthesis model

                                                              Support
                                                                Quality
                                                                  Security
                                                                    License
                                                                      Reuse

                                                                        glide-text2imby openai

                                                                        Python doticon star image 3204 doticonVersion:Currentdoticon License: Permissive (MIT)

                                                                        GLIDE: a diffusion-based text-conditional image synthesis model
                                                                        Support
                                                                          Quality
                                                                            Security
                                                                              License
                                                                                Reuse

                                                                                  DALLE2-pytorchby lucidrains

                                                                                  Python doticonstar image 9802 doticonVersion:1.14.2doticon
                                                                                  License: Permissive (MIT)

                                                                                  Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

                                                                                  Support
                                                                                    Quality
                                                                                      Security
                                                                                        License
                                                                                          Reuse

                                                                                            DALLE2-pytorchby lucidrains

                                                                                            Python doticon star image 9802 doticonVersion:1.14.2doticon License: Permissive (MIT)

                                                                                            Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
                                                                                            Support
                                                                                              Quality
                                                                                                Security
                                                                                                  License
                                                                                                    Reuse

                                                                                                      dalle-miniby borisdayma

                                                                                                      Python doticonstar image 14174 doticonVersion:v0.1.1doticon
                                                                                                      License: Permissive (Apache-2.0)

                                                                                                      DALL·E Mini - Generate images from a text prompt

                                                                                                      Support
                                                                                                        Quality
                                                                                                          Security
                                                                                                            License
                                                                                                              Reuse

                                                                                                                dalle-miniby borisdayma

                                                                                                                Python doticon star image 14174 doticonVersion:v0.1.1doticon License: Permissive (Apache-2.0)

                                                                                                                DALL·E Mini - Generate images from a text prompt
                                                                                                                Support
                                                                                                                  Quality
                                                                                                                    Security
                                                                                                                      License
                                                                                                                        Reuse

                                                                                                                          aphantasiaby eps696

                                                                                                                          Python doticonstar image 721 doticonVersion:v2.5doticon
                                                                                                                          License: Permissive (MIT)

                                                                                                                          CLIP + FFT/DWT/RGB = text to image/video

                                                                                                                          Support
                                                                                                                            Quality
                                                                                                                              Security
                                                                                                                                License
                                                                                                                                  Reuse

                                                                                                                                    aphantasiaby eps696

                                                                                                                                    Python doticon star image 721 doticonVersion:v2.5doticon License: Permissive (MIT)

                                                                                                                                    CLIP + FFT/DWT/RGB = text to image/video
                                                                                                                                    Support
                                                                                                                                      Quality
                                                                                                                                        Security
                                                                                                                                          License
                                                                                                                                            Reuse

                                                                                                                                              disco-diffusionby alembics

                                                                                                                                              Jupyter Notebook doticonstar image 7261 doticonVersion:v5.4.0doticon
                                                                                                                                              License: Others (Non-SPDX)

                                                                                                                                              Support
                                                                                                                                                Quality
                                                                                                                                                  Security
                                                                                                                                                    License
                                                                                                                                                      Reuse

                                                                                                                                                        disco-diffusionby alembics

                                                                                                                                                        Jupyter Notebook doticon star image 7261 doticonVersion:v5.4.0doticon License: Others (Non-SPDX)

                                                                                                                                                        Support
                                                                                                                                                          Quality
                                                                                                                                                            Security
                                                                                                                                                              License
                                                                                                                                                                Reuse