96k / PaddleGAN

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, wav2lip, picture repair, image editing, photo2cartoon, image style transfer, and so on.

English | 简体中文

PaddleGAN

PaddleGAN provides developers with high-performance implementation of classic and SOTA Generative Adversarial Networks, and supports developers to quickly build, train and deploy GANs for academic, entertainment and industrial usage.

GAN-Generative Adversarial Network, was praised by "the Father of Convolutional Networks" Yann LeCun (Yang Likun) as [One of the most interesting ideas in the field of computer science in the past decade]. It's the one research area in deep learning that AI researchers are most concerned about.

🎪 Hot Activities

• 🔥 2021.7.9-2021.9 🔥

  💙 AI Creation Camp 💙

  You can implement any abilities in PaddleGAN with Wechaty to create your own chat robot 🤖 !

  A plenty of gifts 🎁 waiting for you!

  💰First Prize: 30,000RMB

  🎮 Second Prize: PS5

  🕶 Third Prize: VR Glass

  🏵 Most Popular Prize: 3D Printer

  Still hezitating? Click here and sign up! https://aistudio.baidu.com/aistudio/competition/detail/98

• 2021.4.15~4.22

  GAN 7 Days Course Camp: Baidu Senior Research Developers help you learn the basic and advanced GAN knowledge in 7 days!

  Courses videos and related materials: https://aistudio.baidu.com/aistudio/course/introduce/16651

🚀 Recent Updates

• 😍 Boy or Girl？：StyleGAN V2 Face Editing-Changing genders！ 😍

  • Online Toturials
  

• 👩‍🚀 A Space Odyssey ：LapStyle image translation take you travel around the universe👨‍🚀

  • Online Toturials

    

• 🧙‍♂️ Latest Creative Project：create magic/dynamic profile for your student ID in Hogwarts 🧙‍♀️

  • Online Toturials

    

• 💞 Add Face Morphing function💞 : you can perfectly merge any two faces and make the new face get any facial expressions!

  • Tutorials: https://aistudio.baidu.com/aistudio/projectdetail/2254031

    

• Publish a new version of First Oder Motion model by having two impressive features:

  • High resolution 512x512
  • Face Enhancement
  • Tutorials: https://github.com/PaddlePaddle/PaddleGAN/blob/develop/docs/zh_CN/tutorials/motion_driving.md

• New image translation ability--transfer photo into oil painting style:

  • Complete tutorials for deployment: https://github.com/wzmsltw/PaintTransformer

    

Document Tutorial

Installation

• Environment dependence:
  • PaddlePaddle >= 2.1.0
  • Python >= 3.6
  • CUDA >= 10.1
• Full installation tutorial

Starter Tutorial

• Quick start
• Data Preparation
• Instruction of APIs
• Instruction of Config Files

Model Tutorial

• Pixel2Pixel
• CycleGAN
• LapStyle
• PSGAN
• First Order Motion Model
• FaceParsing
• AnimeGANv2
• U-GAT-IT
• Photo2Cartoon
• Wav2Lip
• Single Image Super Resolution(SISR)
• Video Super Resolution(VSR)
• StyleGAN2
• Pixel2Style2Pixel

Composite Application

• Video restore

Online Tutorial

You can run those projects in the AI Studio to learn how to use the models above:

Online Tutorial	link
Motion Driving-multi-personal "Mai-ha-hi"	Click and Try
Restore the video of Beijing hundreds years ago	Click and Try
Motion Driving-When "Su Daqiang" sings "unravel"	Click and Try

Examples

Face Morphing

Image Translation

Old video restore

Motion driving

Super resolution

Makeup shifter

Face cartoonization

Realistic face cartoonization

Photo animation

Lip-syncing

Changelog

• v0.1.0 (2020.11.02)
  • Release first version, supported models include Pixel2Pixel, CycleGAN, PSGAN. Supported applications include video frame interpolation, super resolution, colorize images and videos, image animation.
  • Modular design and friendly interface.

Community

Scan OR Code below to join [PaddleGAN QQ Group：1058398620], you can get offical technical support here and communicate with other developers/friends. Look forward to your participation!

PaddleGAN Special Interest Group（SIG）

It was first proposed and used by ACM（Association for Computing Machinery) in 1961. Top International open source organizations including Kubernates all adopt the form of SIGs, so that members with the same specific interests can share, learn knowledge and develop projects. These members do not need to be in the same country/region or the same organization, as long as they are like-minded, they can all study, work, and play together with the same goals~

PaddleGAN SIG is such a developer organization that brings together people who interested in GAN. There are frontline developers of PaddlePaddle, senior engineers from the world's top 500, and students from top universities at home and abroad.

We are continuing to recruit developers interested and capable to join us building this project and explore more useful and interesting applications together.

SIG contributions:

• zhen8838: contributed to AnimeGANv2.
• Jay9z: contributed to DCGAN and updated install docs, etc.
• HighCWu: contributed to c-DCGAN and WGAN. Support to use paddle.vision.datasets.
• hao-qiang & minivision-ai : contributed to the photo2cartoon project.

Contributing

Contributions and suggestions are highly welcomed. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring. When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA. Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA. For more, please reference contribution guidelines.

License

PaddleGAN is released under the Apache 2.0 license.