atlury / awesome-generative-deep-art

A curated list of generative deep learning tools, works, models, etc. for artistic uses

Generative Deep Art

A curated list of Generative Deep Art projects, tools, artworks, and models

• Generative Deep Art
  • The Generative AI Area: history and maps
  • Prompt Engineering | Prompt Design | Prompt Craft
    • For text-to-text
    • For text-to-image
  • Stable Diffusion Inbox
    • Stable Diffusion Deployed Web Tools
    • Web UI for Stable Diffusion via Google Colab
    • References Collection about Stable Diffusion
  • Textual Inversion
  • DreamBooth
  • Deforum
  • Creative Uses of Generative AI Tools
  • Courses and Educational Materials
  • Exploring Images Databases
  • Discussions and Philosophy
    • Critical Views about Generative AI
    • Promptism
  • Image Synthesis
    • Collections
    • DALL-E 2
    • Latent Diffusion
    • GLIDE
    • VQGAN+CLIP
    • Text-to-image Google Colab Notebooks (Multiple Models)
  • Image Upscaling
  • Image Restoration
  • Online Tools and Applications
  • Inbox
  • Text-to-video
  • Inbox: Text-to-speech (TTS) tools
  • Inbox: Music and Audio projects
  • Inbox: Text and Natural Language Processing
    • OpenAI GPT-3
  • Papers and references for reading and understanding
  • Interesting Instagram Accounts, Posts and Reels
  • Interesting Youtube Channels
  • Interesting GitHub Repositories
  • Artists and Artworks
  • Galleries
  • Latent Space Explorarion
  • Related Awesome Lists
  • Improving Google Colab experience
  • Inbox for Related References
  • Tools for Batch Image Processing
  • Contribute
  • License

The Generative AI Area: history and maps

• [🔥🔥🔥] AI Depot - Discover New AI Tools: collection of AI tools organized by tags and presented in a card format
• AI exploded on the scene at the end of 2022 / Twitter: categories for analyzing tools of Generative AI
• [🔥🔥🔥] Generative AI Database: a database in Notion with types, models, sectors, URLs, and APIs
• [🔥🔥🔥] Mapping the Generative AI landscape | Antler
• [🔥🔥🔥] AI Timeline: A history of text-to-image ML models by Fabian Mosele
• AI-Generated Art: From Text to Images & Beyond Examples
• 1 week of Stable Diffusion | multimodal.art

Prompt Engineering | Prompt Design | Prompt Craft

For text-to-text

• How to write an effective GPT-3 prompt | Zapier: a list of 6 GPT-3 tips for getting the desired output
• The Art of ChatGPT Prompting: A Guide to Crafting Clear and Effective Prompts: e-book by Fatih Kadir Akın (@fkadev)

For text-to-image

• Prompt Box: "organize and save your AI prompts"
• Midjourney artist reference - Google Sheets
• Stable Diffusion Prompt Book — Stability.Ai: prompt book for Stable Diffusion v2.0 and v2.1 released by Stability.AI
• The Ultimate Stable Diffusion Prompt Guide by PromptHero
• CLIP Interrogator - a Hugging Face Space by pharma: image-to-text tool to figure out what a good prompt might be to create new images like an existing one
• [🔥🔥🔥] Prompt book for data lovers II ❤️ - Google Slides: An open source exploration on text-to-image and data visualization
• some9000/StylePile: A helper script for AUTOMATIC1111/stable-diffusion-webui. Basically a mix and match to quickly get different results without wasting a lot of time writing prompts.
• Artists To Study | All images generated with Google Colab TPUs + CompVis/stable-diffusion-v1-4 + Huggingface Diffusers: a systematic study of artists' styles made by @camenduru
• CLIP retrieval for laion5B: CLIP retrieval using Laion5B. "It works by converting the text query to a CLIP embedding , then using that embedding to query a knn index of clip image embedddings".
• rom1504/clip-retrieval: Easily compute CLIP embeddings and build a CLIP retrieval system with them
• PromptDesign | Reddit: Reddit community for "the art of communicating with natural language models"
• Prompt Engineering and Zero-Shot/Few-Shot Learning [Guide] - inovex GmbH: prompt engineering for text generation
• clip-interrogator.ipynb - Colaboratory: a tool for image-to-prompt
• Useful Prompt Engineering tools and resources | Reddit
• PromptHero: Search the best prompts for Stable Diffusion, DALL-E and Midjourney
• promptoMANIA: AI art community with prompt generator
• Lexica: search over 10M+ Stable Diffusion images and prompts
• list of artists for SD v1.4 A-C / D-I / J-N / O-Z
• succinctly/text2image-prompt-generator · Hugging Face: a GPT-2 model fine-tuned on the succinctly/midjourney-prompts dataset, which contains 250k text prompts that users issued to the Midjourney text-to-image service over a month period
• The Prompter | vicc | Substack: a newsletter about news, tips and thoughts around prompt engineering
• (19) Nikhil Agrawal 📌 on Twitter: 11 AI Images Prompt websites to level up the image quality
• Phraser: a tool that support prompt creation
• PromptBase | Prompt Marketplace: PromptBase is a marketplace for DALL·E, Midjourney & GPT-3 prompts, where people can sell prompts and make money from their prompt crafting skills.
• Professional AI whisperers have launched a marketplace for DALL-E prompts - The Verge
• Visual Prompt Builder: simple deck of illustrated card to combine modifiers for prompt building
• Prompt Engineering Template - Google Sheets: spreadsheet with lists of modifiers for prompt building and a lot of interesting links for reference
• Prompt Engineering: From Words to Art - Saxifrage Blog
• DALL·Ery GALL·Ery Resources: DALL·E 2 and AI art prompt resources & tools to inspire beautiful images
• [2204.13988] A Taxonomy of Prompt Modifiers for Text-To-Image Generation
• List of Aesthetics | Aesthetics Wiki | Fandom
• Artist Directory (Volcano Comparison) | AI Art Creation Wiki | Fandom
• The DALL·E 2 Prompt Book – DALL·Ery GALL·Ery
• DALL·Ery GALL·Ery: A guide to OpenAI's DALL·E – prompts, projects, examples, and tips
• (2) MASSIVE 💥 DALL-E 2 ANIME ⚡︎ KEYWORDS + MODIFIERS LIST ★ : haaaaven: image prompt modifier collection by haaaaven
• DrawBench: a list of prompts the Google Imagen is organizing as a benchmark
• CLIP Prompt Engineering for Generative Art - matthewmcateer.me: list of styles tested with Quick CLIP Guided Diffusion
• Adobe should make a boring app for prompt engineers (Interconnected)
• [2206.00169] Discovering the Hidden Vocabulary of DALLE-2
• When SD just doesn't understand the prompt no matter how hard I try | Reddit
• It's very interesting how some prompts have very defined output but other specific ones are not | Reddit

Stable Diffusion Inbox

• Stable Diffusion KLMC2 Animation.ipynb forked: fork by @DigThatData
• Stable Diffusion KLMC2 Animation.ipynb: notebook by @RiversHaveWings to generate animation based on scripted prompts using a technique called KLMC2 discretization of underdamped Langevin dynamics
• DETEXTIFY: A Python library to remove unwanted pseudo-text from images generated by your favorite generative AI models (Stable Diffusion, Midjourney, DALL·E)
• InvokeAI: Stable Diffusion Toolkit and application that runs Windows, Mac and Linux machines, and on GPU cards with as little as 4 GB or RAM
• Stability.ai REST API Documentation: service provided by Stability.ai. DreamStudio authentication required to access this REST API
• [🔥🔥🔥] SD GUIDE FOR ARTISTS AND NON-ARTISTS - Google Docs: a Google Docs with in-depth tips, tricks, tutorials and more related to Stable Diffusion
• [NEWS]Canva Adds a Free and Unlimited AI Text-to-Image Generator | PetaPixel
• prompthero/midjourney-v4-diffusion · Hugging Face: Stable Diffusion fine tuned on Midjourney v4 images, by PromptHero
• The Illustrated Stable Diffusion: explained by Jay Alammar (Visualizing machine learning one concept at a time)
• Img To Music a Hugging Face Space by fffiloni
• Atlas KREA Stable Diffusion: An explorable map of KREA AI's Stable Diffusion Search Engine
• TheLastBen/fast-stable-diffusion: fast-stable-diffusion, +25-50% speed increase + memory efficient + DreamBooth
• NovelAI Improvements on Stable Diffusion | by NovelAI | Oct, 2022 | Medium
• ashawkey/stable-dreamfusion: A pytorch implementation of text-to-3D dreamfusion, powered by stable diffusion.
• [🔥🔥🔥] JoePenna/Dreambooth-Stable-Diffusion: Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion (tweaks focused on training faces)
• [🔥🔥🔥] DreamBooth: fine tuning text-to-image diffusion models for subject-driven generation
• [🔥] Arki's Stable Diffusion Guides
• examples/stable-diffusion-finetuning at main · LambdaLabsML/examples: Fine Tuning Stable Diffusion
• lkwq007/stablediffusion-infinity: Outpainting with Stable Diffusion on an infinite canvas
• [🔥🔥🔥] ML News Stable Diffusion Takes Over! (Open Source AI Art) by Yannic Kilcher - YouTube: video with examples, updates, and discussion about the impact of Stable Diffusion
• Diffusion Models in Vision: A Survey | DeepAI: paper about the diffusion techniques which also discuss the relation with other generative deep learning models
• ThereforeGames/txt2mask: Automatically create masks for Stable Diffusion inpainting using natural language
• basujindal/stable-diffusion: Optimized Stable Diffusion modified to run on lower GPU VRAM
• Stable WarpFusion v0.5 (restricted to patreons): conditioning video frames with Stable Diffusion by @devdef
• nateraw/stable-diffusion-videos: Create videos with Stable Diffusion by exploring the latent space and morphing between text prompts

Stable Diffusion Deployed Web Tools

• dreamlike.art: image generator based on Stable Diffusion with fine-tuned models such as Dreamlike Photoreal 2.0. Users receive 1 credit per hour up to 50 credits
• AITWO.CO: a AI-powered design platform with multiple features
• aiimagegenerator.org: free AI art generator that supports Stable Diffusion txt2img and img2img generation, drawing and inpainting
• Playground AI: frontend for Stable Diffusion with 1000 image generations per day
• Astria: tailor-made AI image generation
• drawanyone: generate drawings based on five input images
• DiffusionBee: stable diffusion GUI App
• getimg.ai: Generate photo-realistic images from text using Stable Diffusion
• Enstil: Fast, open, AI-generated images
• Dezgo - Text-to-Image AI generator
• Baseten: Stable Diffusion Demo
• DreamStudio: Frontend for Stable Diffusion API by Stability.ai
• Pollinations - pollinations/stable-diffusion-private
• tencentarc/gfpgan – Run with an API on Replicate
• andreasjansson/stable-diffusion-wip – Run with an API on Replicate
• stability-ai/stable-diffusion – Run with an API on Replicate
• Osmosis.Studio : web-based content-aware collaborative design tool for generating AI ads that sell real products
• Artistic.wtf: stable diffusion GUI App

Web UI for Stable Diffusion via Google Colab

• camenduru/stable-diffusion-webui-colab: collection of stable diffusion webui colab for different checkpoints
• StableDiffusion_WebUI_Simplified.ipynb: versão em português do notebook para rodar a Web UI do Stable Diffusion no Google Colab de graça
• GitHub - AUTOMATIC1111/stable-diffusion-webui: Stable Diffusion web UI: expanded Stable Diffusion web UI
• GitHub - sd-webui/stable-diffusion-webui: Stable Diffusion web UI
• Stable_Diffusion_WebUi_Simplified.ipynb - Colaboratory

References Collection about Stable Diffusion

• GitHub - awesome-stable-diffusion/awesome-stable-diffusion: Curated list of resources for the Stable Diffusion AI Model
• Stable Diffusion General Updates Posted by u/ImeniSottoITreni | Reddit: a general update on all the "most important" news/repos available
• List of Stable Diffusion systems | Reddit
• Stable Diffusion Akashic Records | Maks-s/sd-akashic: A compendium of information regarding Stable Diffusion (SD)
• 1 week of Stable Diffusion | multimodal.art
• Voldy Guide: detailed beginners guide for Stable Diffusion
• Dreamer's Guide to Getting Started w/ Stable Diffusion! | Reddit
• A collection of sites using Stable Diffusion (and other handy links) | Reddit

Textual Inversion

• rinongal/textual_inversion: repo contains the official code, data and sample inversions of Textual Inversion paper
• 2208.01618 An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion: paper that describes the Textual Inversion technique
• sd-concepts-library (Stable Diffusion concepts library): Stable Diffusion Textual Inversion Concepts Library - browse through objects and styles taught by the community to Stable Diffusion and use them in your prompts!

DreamBooth

• AI Profile Pictures: paid service for generating profile pictures using AI
• Training Stable Diffusion with Dreambooth using Diffusers: experiments to analyze the effect of different settings in Dreambooth
• fast-DreamBooth.ipynb - Colaboratory: train custom concepts from input images with this simplified DreamBooth colab
• (1166) Como Criar Artes Incríveis com o seu Próprio Rosto Usando o Dreambooth! DE FORMA FÁCIL E DE GRAÇA! - YouTube: tutorial in Portuguese on how to train DreamBooth with your own face

Deforum

• Deforum Stable Diffusion Animation - v5 Math Functions - Demo and Test - YouTube
• Deforum Stable Diffusion: generating videos from scripted prompts
• (5) Deforum notebook v0.5 for Stable Diffusion animations is out! Now with math automation, perspective flips, prompt weights, video masking and waifus! : StableDiffusion

Creative Uses of Generative AI Tools

• De-painting historical photographs | Reddit
• img2img animation with hands | Reddit
• VID 2 VID user script | Reddit
• Seamless textures AI generator for Blender by Antonio Freyre | Twitter
• "Shattered" by Ronny Khalil | Twitter: using warp fusion to generate a shattered glass effect
• Acid Dance by aiplague | Twitter
• [Fused video by @remi_molettee](https://twitter.com/remi_molettee/status/1568245586494738432)
• Animation with Dall-e + AE | Reddit: Patent drawing of an electronic device that ...
• You Describe & AI Photoshops Faces For You [StyleCLIP] - YouTube
• Experimental Films + Machine Learning Week 7 Part 1 (Aphantasia with OpenAI CLIP) - YouTube
• GitHub - Sanster/lama-cleaner: Image inpainting tool powered by SOTA AI Model

Courses and Educational Materials

• Welcome to the 🤗 Deep Reinforcement Learning Course: a Hugging Face Course on Deep Reinforcement Learning
• Crash course in AI art generation by PromptHero: paid ($99) course focused on prompt engineering
• Visual intuition for diffusion models and AI art. #stablediffusionart #aiart #aiartwork #aiartcommunity
• The Illustrated Stable Diffusion by Jay Alammar: "gentle introduction [on] how Stable Diffusion works"
• [🔥]johnowhitaker/tglcourse: The Generative Landscape - a course on generative modelling (currently unfinished)
• Words are Images | BustBright - Machine Learning Art: 7-week Online class starting October 24th, 2022 by Derrick Schultz
• Grokking Stable Diffusion.ipynb - Colaboratory - Part 1: notebook by @johnowhitaker exploring Stable Diffusion details
• Grokking Stable Diffusion: Textual Inversion.ipynb - Colaboratory - Part 2: sequel to Grokking Stable Diffusion by @johnowhitaker that focus on Text Inversion
• GitHub - johnowhitaker/aiaiart: Course content and resources for the AIAIART course
• Implementation/tutorial of stable diffusion with side-by-side notes by labml.ai | Twitter

Exploring Images Databases

• Have I Been Trained?: tool for searching 5.8 billion images used to train popular AI art models
• laion-aesthetic-6pls: exploring 12 million of the 2.3 billion images used to train Stable Diffusion's image generator

Discussions and Philosophy

• AI Data Laundering - Waxy.org: How Academic and Nonprofit Researchers Shield Tech Companies from Accountability
• [🔥🔥🔥] (1232) The End of Art: An Argument Against Image AIs - YouTube: video essay by Steven Zapata
• [🔥🔥🔥] The End of Art: An Argument Against Image AIs (Public) - Google Docs: transcript of the video essay by Steven Zapata
• [🔥🔥🔥] Generative AI: A Creative New World | Sequoia Capital US/Europe: report by Sequoia Capital about the possible applications of Generative AI
• Synthetic Creativity - by Cavin - Deep Markets
• Our Vision for the Future of Synthetic Media | by Victor Riparbelli | Medium
• Deep Else: A Critical Framework for AI Art
• How Photography Became An Art Form | Aaron Hertzmann’s blog
• Text Is the Universal Interface - Scale
• This artist is dominating AI-generated art. And he’s not happy about it. | MIT Technology Review
• The REAL fight over AI art: StableDiffusion | Reddit
• Rutkowski battling AI art overlord | Reddit
• Instead of mining cryptocoins with GPUs, are we now mining art? | Reddit
• Using AI to create art is NOT art! | Reddit : ArtistLounge
• Appreciating the Poetic Misunderstandings of A.I. Art | The New Yorker

Critical Views about Generative AI

• The Dark Risk of Large Language Models | WIRED UK
• ChatGPT, DALL-E 2 and the collapse of the creative process
• Forecasting Potential Misuses of Language Models for Disinformation Campaigns—and How to Reduce Risk
• The Dark Side of AI Art: 4 Potential Issues With the Growing Trend
• Armed With ChatGPT, Cybercriminals Build Malware And Plot Fake Girl Bots
• ChatGPT And The Mass Production Of Office Work - Farsight
• The Danger Of ChatGPT Nobody Talks About | by Jacob Ferus | Dec, 2022 | Medium
• Mind Control in the Metaverse. If we’ve learned anything about… | by Louis Rosenberg | Predict | Dec, 2022 | Medium
• The Brilliance and Weirdness of ChatGPT - The New York Times
• Como o texto gerado por Inteligência Artificial está envenenando a Internet - MIT Technology Review
• O ChatGPT é o momento “Jurassic Park” da inteligência artificial - NeoFeed
• Por favor, mais racionalidade e menos frenesi em relação ao chatGPT (Parte 1 de 2) | by Cezar Taurion | Dec, 2022 | Medium
• E se estivermos usando uma IA pseudocientífica? - Diogo Cortiz
• As limitações da sensação tecnológica de 2023: o ChatGPT | IAgora? | Época NEGÓCIOS

Promptism

• promptism | Reddit: Promptism is an art movement whose creators apply machine learning models trained with contrastive language-image pre-training (CLIP) techniques for image generation
• The Promptist Manifesto – deeplearn.art

Image Synthesis

• Muse: Text-To-Image Generation via Masked Generative Transformers
• openai/point-e: OpenAI's point cloud diffusion for 3D model synthesis
• [arxiv/2211.11319] VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Models
• CHARL-E: Run Stable Diffusion on your M1 Mac
• Parrot Zone: a database of image synthesis references
• Image Synth Link List: a collection of links organized by the collective parrot zone
• [🔥] altryne/awesome-ai-art-image-synthesis: A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools.
• [🔥🔥🔥] Ai generative art tools: a massive list of shared Google Colab notebooks and tools organized by @pharampsychotic
• Introduction — PyTTI-Tools
• pyttitools-PYTTI.ipynb - Colaboratory
• pixray/pixray: Pixray is an image generation system
• pixray/pixray_notebooks: pixray demo notebooks
• dribnet/pixray-text2image – Run with an API on Replicate
• sberbank-ai/ru-dalle: Generate images from texts. In Russian.
• Pyttipanna: visual interface for Pytti by @_staus. Pytti is created by @sportsracer48

Collections

• AI art resources | Unlimited Dream Co.: collection of AI art software, guides, inspiration, tools and other useful resources.
• AI Library: catalog of AI tools and neural networks for creators
• Post Reddit - MachineLearning: List of sites/programs/projects that use OpenAI's CLIP neural network for steering image/video creation to match a text description
• Top 41 AI Art Generators: Make AI Art, Paintings & More (2021 GUIDE) — AIArtists.org
• 10 Best AI Art Generators (2022) - Unite.AI
• Get started with making AI art in 2022 – deeplearn.art
• Text-to-Image Summary – Part 1 | Softology's Blog
• [🔥🔥] Hitchhiker's Guide To The Latent Space: Community Notebook Document: great collection of interesting notebooks
• Machine learning for arts
• [🔥] dvschultz/ml-art-colabs: A list of Machine Learning Art Colabs

DALL-E 2

• lucidrains/DALLE2-pytorch: Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
• DALL-E 2’s Failures Are the Most Interesting Thing About It - IEEE Spectrum: paper by Eliza Strickland
• DALL·E 2: OpenAI system, evolution of the DALL-E launched in Jan 2021, that can create realistic images and art from a description in natural language.

Latent Diffusion

• LatentVision_rynmurdock.ipynb - Colaboratory
• Latent_Diffusion_with_LAION_400M.ipynb - Colaboratory

GLIDE

• "GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models", Nichol et al 2021 (OpenAI's DALL-E successor: 5b-parameter diffusion models + noise-aware CLIP) : MediaSynthesis
• OpenAI paper: "GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models". Code and a smaller filtered model (300 million parameters vs 3.5 billion parameters in the paper) are available. : bigsleep

VQGAN+CLIP

• VQ-GAN | Paper Explanation - YouTube: explanation video about VQGAN with didactic visualizations
• VQGAN+CLIP — How does it work?. The synthetic imagery (“GAN Art”) scene… | by Alexa Steinbrück | Aug, 2021 | Medium
• Introduction to VQGAN+CLIP - 🟧Sourceful
• How to use VQGAN+CLIP to generate images from a text prompt —tutorial for beginners | NightCafe Creator
• VQGAN + CLIP Keyword Modifier Comparison - NightCafe Creator
• ~200 CLIP+VQGAN keywords tested on 4 subjects : bigsleep
• AI Generated Art Scene Explodes as Hackers Create Groundbreaking New Tools CLIP+VQ-GAN | VICE
• VQGAN+CLIP (with pooling): Generate images from text prompts with VQGAN and CLIP (z+quantize method)
• ~200 CLIP+VQGAN keywords on 4 subjects, by @kingdomakrillic  - Imgur
• Experimentando o VQGAN+CLIP: gerador de imagens a partir de textos - YouTube Filipe Calegario

Text-to-image Google Colab Notebooks (Multiple Models)

• VQGAN + CLIP + Gumbel
• OpenAI DVAE+CLIP
• Text2Image VQGAN
• Improved Multi Perceptor VQGAN + CLIP
• Latent Majesty Diffusion v1.3
• CLIP Guided Decision Transformer
• CLIP Guided Diffusion
• GLIDE
• PixelDirect
• CLIP Guided Diffusion Secondary Model Method
• Zoetrope
• Quick CLIP Guided Diffusion
• MSE Regulized VQGAN+CLIP
• CLIPRGB ImStack
• CLIP Guided Diffusion v4
• Simplified Google Colab Interface for the above models: series of interface simplification made by EAR+CIn Research project

Image Upscaling

• Model Database - Upscale Wiki: list of models for upscaling images
• Gigapixel AI: paid AI image upscaler delivering enhanced detail and resolution

Image Restoration

• TencentARC/GFPGAN: GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration

Online Tools and Applications

• AnimalAI: custom AI-generated animal portraits (profits are directed to various wildlife conservation organizations)
• starryai: AI Art Generator App - AI Art Maker
• ProsePainter: an interactive tool to "paint with words." It incorporates guidable text-to-image generation into a traditional digital painting interface
• ProsePainter: Image + Sketching Interface + CLIP! - YouTube
• Cocreator AI: creative computer agent (in wait list)
• Runway ML: AI video creation suite
• Hotpot.ai - Hotpot.ai: set of AI Tools to post-process images
• Toonify yourself by Justin Pinkney: turn a human face into a cartoon
• deepart.io: a online tool for applying style transfer
• Artbreeder: web-based tool to generate images by breeding existing images
• Ostagram.ru: image style transfer plataform
• cleanup.pictures: remove objects, people, text and defects from any picture for free
• remove.bg: remove background from images
• Quick, Draw!: Can a neural network learn to recognize doodling? A game to help NL by adding users drawing

Inbox

• Scenario AI: AI-generated game assets
• Imagen: Google's Text-to-Image Diffusion Models
• Make-A-Scene: Meta's creative control for AI image generation
• Stable Diffusion: Stability.Ai's text-to-image model that is a breakthrough in speed and quality meaning that it can run on consumer GPUs
• LAION: Large-scale Artificial Intelligence Open Network
• CLIPasso: Semantically-Aware Object Sketching
• (9) AK on Twitter: "DreamFusion: Text-to-3D using 2D Diffusion paper: https://t.co/euVCkNPzB0 abs: https://t.co/FO7nqjLrQA project page: https://t.co/BTvt1WQqIi DeepDream on a pretrained 2D diffusion model enables text-to-3D synthesis https://t.co/20zIElXJDN" / Twitter
• DeCoDe Lab: CREATIVEGAN - Editing Generative Adversarial Networks for Creative Design Synthesis
• yuval-alaluf/stylegan3-editing: Official Implementation of "Third Time's the Charm? Image and Video Editing with StyleGAN3" https://arxiv.org/abs/2201.13433
• autonomousvision/projected_gan: [NeurIPS'21] Projected GANs Converge Faster
• These Bored Apes Do Not Exist: GAN to NFT Pipeline | Medium
• apple/ml-no-token-left-behind: PyTorch Implementation of No Token Left Behind: Explainability-Aided Image Classification and Generation
• baowenbo/DAIN: Depth-Aware Video Frame Interpolation (CVPR 2019)
• Dain-App 1.0 [Nvidia Only] by GRisk: Depth-Aware Video Frame Interpolation (CVPR 2019)
• Lucid Lyrics - AI Assisted Art: AI-Assisted Lyrical Interpretations by Walter Arnold
• disco-diffusion/Local_Disco_Diffusion_v4_1.ipynb at main · Midgraph/disco-diffusion
• Audio to keyframe string: this tool is used to generate strings for the keyframes of AI animation notebooks, such as this VQGAN+CLIP Animations notebook, using the volume of audio tracks.
• [🔥🔥] Pollinations.AI: a frontend hosting a set of curated notebooks that allow creating and experimenting with generative art. Their objective is to facilitate the creation and translation of multiple forms of human expressions.
• [🔥] hive/notebooks at main · pollinations/hive: collection of notebooks used by Pollinations.AI
• ouhenio/StyleGAN3-CLIP-notebooks: A collection of Jupyter notebooks to play with NVIDIA's StyleGAN3 and OpenAI's CLIP for a text-based guided image generation.
• k-l-lambda/stylegan-web: A web porting for NVlabs' StyleGAN.
• [🔥🚀] S2ML Image Generator: evolution of the first VQGAN+CLIP Google Colab notebook by Katherine Crownson maintained by Justin Bennington
• [🔥] Create Variations on Images With Looking Glass 1.1 (ru-DALLE) - YouTube | Artificial Images
• [🔥🚀] Looking Glass 1.1 (ru-DALLE): Making ruDALL-E fine tuning quick and painless. Copyright (C) 2021 Bearsharktopus Studios
• [🔍] NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion (ML Research Paper Explained) - YouTube | Yannic Kilcher
• [🔥] yuval-alaluf/hyperstyle: Official Implementation for "HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing" https://arxiv.org/abs/2111.15666
• [🔥] Vadim Epstein’s Aphantasia library: CLIP + FFT/DWT/RGB = text to image/video
• mikaelalafriz/lucid-sonic-dreams: syncs GAN-generated visuals to music
• aakashjhawar/AvatarGAN: Generate Cartoon Images using Generative Adversarial Network
• Greg Surma - Portfolio
• crowsonkb (Katherine Crowson): who wrote the tutorial of VQGAN+CLIP
• [🔥] dvschultz/stylegan3: Forked by Schultz from Stylegan3
• Alias-Free Generative Adversarial Networks (StyleGAN3): NVidia official StyleGAN3 release page
• [🚀] StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators
• Let's Talk Energy Usage of Generative Machine Learning
• StyleGAN: Use machine learning to generate and customize realistic images | by Jamshed Khan | Heartbeat
• Audio-reactive Latent Interpolations with StyleGAN
• DALL·E: Creating Images from Text
• Alien Dreams: An Emerging Art Scene - ML@B Blog
• DeepStory: A tale of co-creation between man & machine
• SofGAN: A GAN Face Generator That Offers Greater Control - Unite.AI
• DALL-E mini: DALL·E mini is an AI model that generates images from any prompt you give!
• DALL-E mini GitHub
• DALL-E mini Project Report
• CLIPIT PixelDraw - Colaboratory
• CLIP Guided Diffusion HQ 512x512.ipynb - Colaboratory
• Smooth Transitioning Between Position / Rotation / Zoom and Text Inputs by Keyframing Parameters: A Proof of Concept [15,000 Frames] : deepdream
• justinpinkney/awesome-pretrained-stylegan2: A collection of pre-trained StyleGAN 2 models to download
• Image Super-Resolution
• neural-dream Alternatives and Similar Photos & Graphics Apps | AlternativeTo
• Real GANs in AI | Hacker Noon: deep dive into what the generative models are, the recent developments in the field, and the usage of GANs in business
• CoG 21: Adversarial Reinforcement Learning for Procedural Content Generation
• GANshare | Towards Data Science: Creating and Curating Art with AI
• GitHub Repositories of Hugging Face
• AgaMiko/pixel_character_generator: Generating retro pixel game characters with Generative Adversarial Networks. Dataset "TinyHero" included.

Text-to-video

• THUDM/CogVideo: Text-to-video generation

Inbox: Text-to-speech (TTS) tools

• Play.ht: "AI voice generator and realistic text to speech online"
• Murf AI | AI Voice Generator: versatile text to tpeech software
• [🔥] Eleven Labs Beta: a TTS service that adds emotion to the generated voice
• neonbjb/tortoise-tts: "A multi-voice TTS system trained with an emphasis on quality"
• Studio D-ID: create video with still images synced with text-to-speech tool [#avatar]
• Synthesia: AI Video Generation Platform [#avatar]
• Speech Studio - Microsoft Azure: Microsoft's cloud cognitive services

Inbox: Music and Audio projects

• [🔥🔥🔥] Riffusion: an app for real-time music generation with stable diffusion
• Harmonai's Dance Diffusion: Open-Source AI Audio Generation Tool For Music Producers – Weights & Biases
• Dance Diffusion: the Hugging Face Space by harmonai
• MubertAI/Mubert-Text-to-Music: a simple notebook demonstrating prompt-based music generation via Mubert API
• DDSP-VST: Neural Audio Synthesis for All
• LOVO AI: AI Voiceover & Text to Speech Platform with human-like voices
• AIVA: The AI composing emotional soundtrack music
• Jukebox: "a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artist styles"
• Magenta: Music and Art Generation with Machine Intelligence
• magenta/magenta: Magenta's official GitHub repository
• AI Image to sound [Melobytes.com]
• archinetai/audio-diffusion-pytorch: Audio generation using diffusion models, in PyTorch

Inbox: Text and Natural Language Processing

• [🔥] 104 Growth Hacking Swipe (ChatGPT): set of ChatGPT prompts for design, products and marketing
• SlidesAI: "create presentation slides with AI in minutes"
• Rationale: decision-making tool powered by the latest GPT and in-context learning
• DetangleAI: AI-generated summaries of provided legal docs
• acheong08's list / Awesome ChatGPT: list of wrappers for accessing ChatGPT in platform such as Discord, Telegram, and languages such as Python, JS.
• [🔥🔥🔥] Awesome ChatGPT Prompts: repo that includes curated ChatGPT prompts to obtain better results from ChatGPT
• ("Publicly announced ChatGPT variants and competitors: a thread" / Twitter: a Twitter thread by @goodside with alternatives to ChatGPT
• [🔥🔥🔥] Awesome ChatGPT Prompts: a repo that includes curated ChatGPT prompts
• GPT-2 Output Detector: tool that estimate is a given text is real or generated by GPT
• HyperWrite: a personal writing assistant with suggestions and sentence completions
• Inside language models (from GPT-3 to PaLM) – Dr Alan D. Thompson – Life Architect
• bigscience/bloom · Hugging Face: getting started with BLOOM
• BLOOM: open-source 176-billion-parameter model aims to democratize large-language models
• Top 10 GPT-3 Powered Applications to Know in 2022
• Google AI Blog: Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance
• Riku.AI | The vault for your A.I. creations
• First look - Riku.ai - inference platform Mar/2022 - J1, GPT-3, Fairseq-13B, GPT-NeoX-20B, Cohere-XL - YouTube
• Rytr: Rytr is an AI writing assistant that helps creating content
• Charisma: Charisma is a platform for creating interactive stories with believable virtual characters
• Authors A.I.: AI-powered text analysis
• DeepMind says its new language model can beat others 25 times its size | MIT Technology Review
• Integrated AI: How to talk to AI for free using nine platforms (Megatron, GPT-3, GPT-J, Wudao, J1..) - YouTube by Dr Alan D. Thompson. The following references came from this video description
• InferKit
• CopyHat
• Emerson on iOS
• Jurassic-1
• EleutherAI | GPT-J-6B
• AIx
• Wudao
• Emerson on Telegram

OpenAI GPT-3

• GPT-3 playground
• Fine-tuning GPT-3: how to customize a model for OpenAI's GPT-3

Papers and references for reading and understanding

• AI Reading List - Google Docs: reading list organized by Jack Soslow (@JackSoslow)
• Aman's AI Journal • Papers List: set of seminal AI/ML papers curated by Aman Chadha
• Casual GAN Papers Reading Club: Community knowledge base for Casual GAN Papers
• Casual GAN Papers: Easy to read summaries of popular AI papers
• The Illustrated VQGAN: illustrated explanation on how VQGAN works
• CLIP: Connecting Text and Images: OpenAI's explanation on how CLIP works
• VQGAN+CLIP — How does it work?. The synthetic imagery (“GAN Art”) scene… | by Alexa Steinbrück | Medium
• The Methods Corpus | Papers With Code
• https://ieeexplore.ieee.org/abstract/document/9043519: A State-of-the-Art Review on Image Synthesis With Generative Adversarial Networks
• Utilizando redes adversárias generativas (GANs) como agente de apoio à inspiração para artistas: Trabalho de Graduação de Cláudio Carvalho no Centro de Informática - UFPE
• GAN Lab: Play with Generative Adversarial Networks in Your Browser!
• [PDF] Music2Video: Automatic Generation of Music Video with fusion of audio and text | Semantic Scholar
• [PDF] Active Divergence with Generative Deep Learning - A Survey and Taxonomy | Semantic Scholar
• [PDF] Automating Generative Deep Learning for Artistic Purposes: Challenges and Opportunities | Semantic Scholar

Interesting Instagram Accounts, Posts and Reels

• science on Instagram: “Human evolution generated by AI Stable Diffusion”
• Deep Music Visualizer
• Lucid Sonic Dreams (@lucidsonicdreams)

Interesting Youtube Channels

• Artificial Images: Demos and explanations to make art using machine learning
• Glenn Marshall Neural Art
• How to Generate Art - Intro to Deep Learning #8

Interesting GitHub Repositories

• dvschultz: Derrick Schultz's GitHub
• dvschultz/ml-art-colabs: collection of Google Colab Notebooks for ML Arts

Artists and Artworks

• [🔥] Creep - YouTube by Glenn Marshall Neural Art: how did they translated the images using VQGAN+CLIP? How did they seamlessly wander on the latent space?
• (19) INFINITEYAY✨ on Twitter: "✨35 Artists Using AI With Under 1000 Followers That You Need To Follow Today✨ -- All these artists are fantastic and deserve way more followers. In no particular order here's my first list. More to come. Enjoy! 👇 #AIart #art #stablediffusion #midjourney #dalle2 #AI https://t.co/CTyq1dfsTs" / Twitter
• Computer Vision Art Gallery : CVPR 2021: artworks dealing with computer vision technologies
• Confluence: a generative art project by Devi Parikh on BrainDrops.
• Learning to See – Memo Akten | Mehmet Selim Akten | The Mega Super Awesome Visuals Company
• Neural Zoo | Sofia Crespo
• KRЯRL DЯAWINGS: Runway ML -- 3rd "Model" (based on long poses)
• Frea Buckler ~ Artist: obras usadas para criar essa rede (19) derrick has started yet another project on Twitter: "Just sent @buntworthy a demo StyleGAN model I trained / Twitter
• (Non-)Human
• Authentic Digital Art - Unknown Departure | SuperRare
• A Selection of Machine Learning Art Inspiration
• Top 25 AI Artists of 2021 (Photos, Profiles & History of AI Art)- AIArtists.org: AIArtists.org showcases leading artists using Artificial Intelligence, tools to make AI Art, and a timeline of AI Art History.
• Helena Sarin – Artist Profile (Photos, Videos, Exhibitions) — AIArtists.org
• Images Generated By AI Machines (@images_ai) / Twitter
• https://www.instagram.com/refikanadol/
• The Steampunk Circus Human Machine Collaboration - Video, Sound and Stories with AI / YouTube

Galleries

• AICAN
• Ganvas Studio - Neural Network Paintings
• Syn Feather Sweater / STRELITZIA – HATRA E STORE

Latent Space Explorarion

• Latent Space Exploration with StyleGAN2

Related Awesome Lists

• [🔥🔥🔥] jonathandinu/awesome-ai-art: "A list of AI Art courses, tools, libraries, people, and places"
• margaretmz/awesome-ai-art-design: An awesome list: AI for art and design.
• toxtli/awesome-machine-learning-jupyter-notebooks-for-colab: A curated list of Machine Learning and Deep Learning tutorials in Jupyter Notebook format ready to run in Google Colaboratory
• chaosreactor/awesome-generative-ai: An awesome list of low- and no-code generative AI resources
• steven2358/awesome-generative-ai: A curated list of modern Generative Artificial Intelligence projects and services
• amrzv/awesome-colab-notebooks: Collection of google colaboratory notebooks for fast and easy experiments

Improving Google Colab experience

• 7 ways to load external data into Google Colab | by B. Chen | Towards Data Science
• 10 tricks for a better Google Colab experience | by Cyprien NIELLY | Towards Data Science
• Quickly share ML WebApps from Google Colab using ngrok for Free | by AbdulMajedRaja RS | Towards Data Science
• Jupyter Widgets for Interactivity in Google Colab: notebook with examples of using Jupyter Widgets in Colab, allowing interactive inputs
• Jupyter Widgets official documentation

Inbox for Related References

• The Art of PNG Glitch
• HashLips/hashlips_art_engine: tool used to create multiple different instances of artworks based on provided layers

Tools for Batch Image Processing

BIRME: Bulk Image Resizing Made Easy 2.0 (Online & Free)

Contribute

Contributions welcome! Read the contribution guidelines first.

License

To the extent possible under law, Filipe Calegario has waived all copyright and related or neighboring rights to this work.