text-to-video

There are 119 repositories under text-to-video topic.

• lucidrains / imagen-pytorch

  Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

  artificial-intelligencedeep-learningimagination-machinetext-to-imagetext-to-video
  Language:Python 7871

• AILab-CVC / VideoCrafter

  VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models

  image-to-videotext-to-videovideo-generation
  Language:Python 4277

• promptslab / Awesome-Prompt-Engineering

  This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

  chatgptchatgpt-apifew-shot-learninggptgpt-3openaipromptpromptengineeringtext-to-imagetext-to-speechtext-to-videoprompt-engineeringprompt-generatorprompt-learningprompt-toolkitprompt-tuningprompt-based-learningdeep-learningmachine-learning
  Language:Python 3463

• YangLing0818 / Diffusion-Models-Papers-Survey-Taxonomy

  Diffusion model papers, survey, and taxonomy

  diffusion-modelsstable-diffusionsurveytext-to-3dtext-to-imagetext-to-video
  2791

• showlab / Awesome-Video-Diffusion

  A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

  awesomediffusion-modelsvideo-editingvideo-generationvideo-understandingvideo-restorationtext-to-motiontext-to-video
  2768
• Stable-Diffusion

  FurkanGozukara / Stable-Diffusion

  Stable Diffusion, SDXL, LoRA Training, DreamBooth Training, Automatic1111 Web UI, DeepFake, Deep Fakes, TTS, Animation, Text To Video, Tutorials, Guides, Lectures, Courses, ComfyUI, Google Colab, RunPod, NoteBooks, ControlNet, TTS, Voice Cloning, AI, AI News, ML, ML News, News, Tech, Tech News, Kohya LoRA, Kandinsky 2, DeepFloyd IF, Midjourney

  deepfakedeepfakesdreamboothguideguidesstable-diffusionttstutorialtutorialstext-to-videotext-to-imagemachine-learningeducationlearningdeep-learningcomputer-visionhow-toai-artcodingprogramming
  Language:Jupyter Notebook 1868

• lucidrains / make-a-video-pytorch

  Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

  artificial-intelligenceattention-mechanismsaxial-convolutionsdeep-learningtext-to-video
  Language:Python 1868

• omerbt / TokenFlow

  Official Pytorch Implementation for "TokenFlow: Consistent Diffusion Features for Consistent Video Editing" presenting "TokenFlow" (ICLR 2024)

  stable-diffusiontext-to-imagetext-to-videovideo-editingtokenflowiclr2024
  Language:Python 1509

• ChenHsing / Awesome-Video-Diffusion-Models

  [Arxiv] A Survey on Video Diffusion Models

  awesome-listtext-to-videovideo-diffusion-modelawesomevideo-editingsurveydiffusiondiffusion-modelsvideovideo-diffusion
  1502

• camenduru / text-to-video-synthesis-colab

  Text To Video Synthesis Colab

  colabcolab-notebookcolaboratoryt2vtext-to-video
  Language:Jupyter Notebook 1418

• PKU-YuanGroup / MagicTime

  MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

  text-to-videovideo-generationdiffusion-modelstime-lapsetime-lapse-datasetopen-sora-planlong-video-generationmetamorphic-video-generation
  Language:Python 1206

• lucidrains / video-diffusion-pytorch

  Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

  artificial-intelligenceddpmdeep-learningtext-to-videovideo-generation
  Language:Python 1176

• ShareGPT4Omni / ShareGPT4Video

  An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

  chatgptgptgpt-4vlarge-language-modelslarge-multimodal-modelslarge-vision-language-modelslarge-video-language-modelssoratext-to-video
  Language:Python 1112

• hotshotco / Hotshot-XL

  ✨ Hotshot-XL: State-of-the-art AI text-to-GIF model trained to work alongside Stable Diffusion XL

  aihotshothotshot-xlsdxltext-to-giftext-to-videotext-to-video-generation
  Language:Python 984
• aphantasia

  eps696 / aphantasia

  CLIP + FFT/DWT/RGB = text to image/video

  cliptext-to-imagetext-to-video
  Language:Python 772

• showlab / MotionDirector

  MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

  diffusion-modelsmotion-customizationtext-to-motiontext-to-videotext-to-video-generationvideo-generation
  Language:Python 737

• lucidrains / phenaki-pytorch

  Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

  artificial-intelligenceattention-mechanismsdeep-learningimagination-machinetext-to-videotransformers
  Language:Python 731

• ExponentialML / Text-To-Video-Finetuning

  Finetune ModelScope's Text To Video model using Diffusers 🧨

  diffusersstable-diffusiontext-to-videomodelscopedeep-learningdiffusion-modelspytorchtext2video
  Language:Python 637

• lucidrains / nuwa-pytorch

  Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

  artificial-intelligenceattention-mechanismdeep-learningtext-to-audiotext-to-videotransformers
  Language:Python 536

• jianzhnie / awesome-text-to-video

  A Survey on Text-to-Video Generation/Synthesis.

  aigcimage-generationtext-to-imagetext-to-videovideo-generation
  501

• jaketae / storyteller

  Multimodal AI Story Teller, built with Stable Diffusion, GPT, and neural text-to-speech

  gptimage-generationpytorchstable-diffusiontext-to-imagetext-to-speechtext-to-videovideo-generationddpmdiffusion-modelsnatural-language-generation
  Language:Python 482

• TianxingWu / FreeInit

  FreeInit: Bridging Initialization Gap in Video Diffusion Models

  aigctext-to-videovideo-diffusion-modelvideo-generation
  Language:Python 443

• Zhen-Dong / Magic-Me

  Codes for ID-Specific Video Customized Diffusion

  diffusion-modelspersonalized-generationvideo-diffusionvideo-editingvideo-generationimage-edittingimage-animationtext-to-video
  Language:Python 441

• noahgsolomon / brainrot.js

  Text to video generator in the brainrot form. Learn about any topic from your favorite personalities.

  automatechatgptnextjspythonremotiontext-to-videotext-to-video-generationyoutubeshorts
  Language:TypeScript 424
• Text2Video

  sibozhang / Text2Video

  ICASSP 2022: "Text2Video: text-driven talking-head video synthesis with phonetic dictionary".

  vid2vidvideoganmetaversedeep-learningavatarvirtual-humansaigcdigital-humanitiesgenerative-aispeech-synthesistext-to-videottstalkingtalking-face-generationtalking-headtalking-headsicassp
  Language:Python 413

• Vchitect / VBench

  [CVPR2024 Highlight] VBench - We Evaluate Video Generation

  aigcevaluation-kitgen-aistable-diffusiontext-to-videovideo-generationbenchmarkdataset
  Language:Python 364

• atfortes / Awesome-Controllable-Generation

  Papers and resources on Controllable Generation using Diffusion Models, including ControlNet, DreamBooth, T2I-Adapter, IP-Adapter.

  consistency-modelscontrolnetcustomizationdall-edeep-generative-modeldiffusion-modelsdreamboothgenerative-aigenerative-artimage-synthesisip-adapterlatent-diffusionmidjourneypaperspersonalizationstable-diffusiont2i-adaptertext-to-3dtext-to-imagetext-to-video
  298

• G-U-N / Gen-L-Video

  The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".

  diffusion-modelslong-video-generationstable-diffusiontext-to-videotext2videovideo-editingvideo-generation
  Language:Jupyter Notebook 269

• gyunggyung / AGI-Papers

  Papers and Book to look at when starting AGI 📚

  nlgllmnlpdialoguesentence-similarityefficientdistillationmultimodalsentence-embeddingsmultiple-tasksstable-diffusiontext-to-videottsall-to-all
  256

• songweige / TATS

  Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV 2022)

  audio-to-videolong-video-generationpytorchtext-to-videovideo-generationvideo-manipulationvideo-synthesizer
  Language:Python 253

• PaddlePaddle / PaddleMIX

  Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

  aigcstable-diffusionblip2clipminigpt4image-to-texttext-to-imageppdiffuserscontrolnetmultimodaleva-clipsd-xltext-to-videoditllavaqwen-vlsorastablevideodiffusion
  Language:Python 238

• RQ-Wu / LAMP

  Official implement code of LAMP: Learn a Motion Pattern by Few-Shot Tuning a Text-to-Image Diffusion Model (Few-shot-based text-to-video diffusion)

  aigcdiffusiondiffusion-modeldiffusion-modelsfew-shot-learningstable-diffusiontext-to-videovideo-editing
  Language:Python 234

• lucidrains / lumiere-pytorch

  Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch

  artificial-intelligencedeep-learningdenoising-diffusiontext-to-video
  Language:Python 226

• artkulak / text2youtube

  🎥 Create youtube videos from a text prompt in seconds

  automationcontent-creationtext-to-videoyoutubeyoutube-automation
  Language:Python 202

• YingqingHe / Awesome-LLMs-meet-Multimodal-Generation

  🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

  aigclarge-language-modelslarge-vision-language-modelsmultimodal-generationmultimodal-large-language-modelsmultimodal-modelsmultimodalitytext-to-3dtext-to-audiotext-to-imagetext-to-musictext-to-soundtext-to-speechtext-to-video
  Language:HTML 201

• snap-research / MMVID

  [CVPR 2022] Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning

  bertdeep-learningmultimodal-learningmultimodal-video-generationtext-to-videotransformervideo-generation
  Language:Python 190