piaohe111 / style2paints

sketch + style = paints :art:

STYLE2PAINTS 2.1: the Best Anime Colorization AI!

First of all, why not spend 5 minutes to try it yourself!

WebAPP: PaintsTransfer

The AI can paint on a sketch according to a given specific color style.

The AI can create its own color style to paint on a sketch.

The AI can transfer illustrations' style.

Tutorial

Tutorial001(BiliBili)

Results with Hints

We are the most accurate anime colorization AI to obey your hints!

All results below are achieved with one reference image and some human hints.

Results without Hints

We are the most creative anime colorization AI without your hints!

All results below are achieved WITHOUT any reference image or human hints.

IMPORTANT: Here the only inputs is one sketch.

IMPORTANT: NO human hint and NO reference is involved!

Launch Server

you need a python 3.5/3.6 GPU environment with cuda.

pip install tensorflow_gpu
pip install keras
pip install bottle
pip install gevent
pip install h5py
pip install opencv-python
pip install scikit-image
git clone https://github.com/lllyasviel/style2paints.git

   (Then you need to download all models from our Google Drive and put these into 'server' folder.)    cd style2paints/server python server.py

Models

Currently, we reserve all rights about all these models.

We use Google Drive to upload models:

https://drive.google.com/open?id=1fWi4wmNj-xr-nCzuWMsN2rcm0249_Aem

Current model list of the 8 neural networks:

base_head.net
dull_head.net
gate_head.net
line_head.net
base_neck.net
clear_tail.net
noise_tail.net
base_reader.net

Training Datasets

1. The recommended training dataset of illustrations is the 400k images from nico-opendata

2. The recommended training sketches is from sketchKeras

Community

QQ Group ID: 184467946

Acknowledgements

Thanks a lot to TaiZan. This project could not be achieved without his great help.