text-to-video

There are 116 repositories under text-to-video topic.

• lucidrains / imagen-pytorch

  Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

  artificial-intelligencedeep-learningimagination-machinetext-to-imagetext-to-video
  Language:Python 7815

• AILab-CVC / VideoCrafter

  VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

  image-to-videotext-to-videovideo-generation
  Language:Python 4128

• promptslab / Awesome-Prompt-Engineering

  This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

  chatgptchatgpt-apideep-learningfew-shot-learninggptgpt-3machine-learningopenaipromptprompt-based-learningprompt-engineeringprompt-generatorprompt-learningprompt-toolkitprompt-tuningpromptengineeringtext-to-imagetext-to-speechtext-to-video
  Language:Python 3283

• YangLing0818 / Diffusion-Models-Papers-Survey-Taxonomy

  Diffusion model papers, survey, and taxonomy

  diffusion-modelssurveystable-diffusiontext-to-imagetext-to-3dtext-to-video
  2703

• showlab / Awesome-Video-Diffusion

  A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

  awesomediffusion-modelsvideo-editingvideo-generationvideo-understandingvideo-restorationtext-to-motiontext-to-video
  2529

• lucidrains / make-a-video-pytorch

  Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

  artificial-intelligenceattention-mechanismsaxial-convolutionsdeep-learningtext-to-video
  Language:Python 1849
• Stable-Diffusion

  FurkanGozukara / Stable-Diffusion

  Stable Diffusion, SDXL, LoRA Training, DreamBooth Training, Automatic1111 Web UI, DeepFake, Deep Fakes, TTS, Animation, Text To Video, Tutorials, Guides, Lectures, Courses, ComfyUI, Google Colab, RunPod, NoteBooks, ControlNet, TTS, Voice Cloning, AI, AI News, ML, ML News, News, Tech, Tech News, Kohya LoRA, Kandinsky 2, DeepFloyd IF, Midjourney

  ai-artcodingcomputer-visiondeep-learningdeepfakedeepfakesdreambootheducationguideguideshow-tolearningmachine-learningprogrammingstable-diffusiontext-to-imagetext-to-videottstutorialtutorials
  Language:Jupyter Notebook 1788

• omerbt / TokenFlow

  Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)

  iclr2024stable-diffusiontext-to-imagetext-to-videotokenflowvideo-editing
  Language:Python 1475

• camenduru / text-to-video-synthesis-colab

  Text To Video Synthesis Colab

  colabcolab-notebookcolaboratoryt2vtext-to-video
  Language:Jupyter Notebook 1397

• ChenHsing / Awesome-Video-Diffusion-Models

  [Arxiv] A Survey on Video Diffusion Models

  awesome-listtext-to-videovideo-diffusion-modelawesomevideo-editingsurveydiffusiondiffusion-modelsvideovideo-diffusion
  1366

• lucidrains / video-diffusion-pytorch

  Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

  artificial-intelligencedeep-learningddpmvideo-generationtext-to-video
  Language:Python 1137

• PKU-YuanGroup / MagicTime

  MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

  text-to-videovideo-generationdiffusion-modelstime-lapsetime-lapse-datasetopen-sora-planlong-video-generationmetamorphic-video-generation
  Language:Python 1124

• hotshotco / Hotshot-XL

  ✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

  aisdxltext-to-videotext-to-video-generationhotshothotshot-xltext-to-gif
  Language:Python 957
• aphantasia

  eps696 / aphantasia

  CLIP + FFT/DWT/RGB = text to image/video

  cliptext-to-imagetext-to-video
  Language:Python 771

• lucidrains / phenaki-pytorch

  Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

  artificial-intelligenceattention-mechanismsdeep-learningimagination-machinetext-to-videotransformers
  Language:Python 720

• showlab / MotionDirector

  MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

  diffusion-modelstext-to-motiontext-to-videotext-to-video-generationvideo-generationmotion-customization
  Language:Python 709

• ExponentialML / Text-To-Video-Finetuning

  Finetune ModelScope's Text To Video model using Diffusers 🧨

  diffusersstable-diffusiontext-to-videomodelscopedeep-learningdiffusion-modelspytorchtext2video
  Language:Python 624

• lucidrains / nuwa-pytorch

  Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

  artificial-intelligenceattention-mechanismdeep-learningtext-to-audiotext-to-videotransformers
  Language:Python 534

• jaketae / storyteller

  Multimodal AI Story Teller, built with Stable Diffusion, GPT, and neural text-to-speech

  gptimage-generationpytorchstable-diffusiontext-to-imagetext-to-speechtext-to-videovideo-generationddpmdiffusion-modelsnatural-language-generation
  Language:Python 474

• jianzhnie / awesome-text-to-video

  A Survey on Text-to-Video Generation/Synthesis.

  aigcimage-generationtext-to-imagetext-to-videovideo-generation
  472

• TianxingWu / FreeInit

  FreeInit: Bridging Initialization Gap in Video Diffusion Models

  aigctext-to-videovideo-diffusion-modelvideo-generation
  Language:Python 434

• Zhen-Dong / Magic-Me

  Codes for ID-Specific Video Customized Diffusion

  diffusion-modelspersonalized-generationvideo-diffusionvideo-editingvideo-generationimage-edittingimage-animationtext-to-video
  Language:Python 431
• Text2Video

  sibozhang / Text2Video

  ICASSP 2022: "Text2Video: text-driven talking-head video synthesis with phonetic dictionary".

  vid2vidvideoganmetaversedeep-learningavatarvirtual-humansaigcdigital-humanitiesgenerative-aispeech-synthesistext-to-videottstalkingtalking-face-generationtalking-headtalking-headsicassp
  Language:Python 410

• noahgsolomon / brainrot.js

  Learn about any topic in video form from your favorite personalities

  automatechatgptnextjspythonremotiontext-to-videotext-to-video-generationyoutubeshorts
  Language:TypeScript 379

• Vchitect / VBench

  [CVPR2024 Highlight] VBench - We Evaluate Video Generation

  aigcevaluation-kitgen-aistable-diffusiontext-to-videovideo-generationbenchmarkdataset
  Language:Python 299

• atfortes / Awesome-Controllable-Generation

  Papers and resources on Controllable Generation using Diffusion Models, including ControlNet, DreamBooth, T2I-Adapter, IP-Adapter.

  papersconsistency-modelscontrolnetcustomizationdall-ediffusion-modelsdreamboothlatent-diffusionmidjourneypersonalizationstable-diffusiontext-to-3dtext-to-imagetext-to-videodeep-generative-modelgenerative-aigenerative-artimage-synthesisip-adaptert2i-adapter
  282

• G-U-N / Gen-L-Video

  The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".

  diffusion-modelslong-video-generationstable-diffusiontext-to-videotext2videovideo-editingvideo-generation
  Language:Jupyter Notebook 262

• gyunggyung / AGI-Papers

  Papers and Book to look at when starting AGI 📚

  nlgllmnlpdialoguesentence-similarityefficientdistillationmultimodalsentence-embeddingsmultiple-tasksstable-diffusiontext-to-videottsall-to-all
  248

• songweige / TATS

  Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)

  pytorchtext-to-videovideo-generationvideo-manipulationvideo-synthesizeraudio-to-videolong-video-generation
  Language:Python 246

• RQ-Wu / LAMP

  Official implement code of LAMP: Learn a Motion Pattern by Few-Shot Tuning a Text-to-Image Diffusion Model (Few-shot-based text-to-video diffusion)

  aigcdiffusiondiffusion-modeldiffusion-modelsfew-shot-learningstable-diffusiontext-to-videovideo-editing
  Language:Python 225

• PaddlePaddle / PaddleMIX

  Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

  aigcstable-diffusionblip2clipminigpt4image-to-texttext-to-imageppdiffuserscontrolnetmultimodaleva-clipsd-xltext-to-videoditllavaqwen-vlsorastablevideodiffusion
  Language:Python 224

• lucidrains / lumiere-pytorch

  Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch

  artificial-intelligencedeep-learningdenoising-diffusiontext-to-video
  Language:Python 212

• snap-research / MMVID

  [CVPR 2022] Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning

  deep-learningvideo-generationmultimodal-learningtext-to-videomultimodal-video-generationtransformerbert
  Language:Python 187

• SoraFlows / SoraFlows

  The most powerful and modular Sora WebUI, api and backend with OpenAI's Sora Model. Collecting the highest quality prompts for Sora. using NextJs and Tailwind CSS

  gptllmsopen-aiopenaipromptsoratext-to-videotexttovideovideowebui
  Language:TypeScript 185

• artkulak / text2youtube

  🎥 Create youtube videos from a text prompt in seconds

  automationcontent-creationtext-to-videoyoutubeyoutube-automation
  Language:Python 183

• XavierCHEN34 / LivePhoto

  Official implementations for paper: LivePhoto: Real Image Animation with Text-guided Motion Control

  image-animationimage-to-videotext-to-videovideo-generation
  155