coldgemini / Neural-Style-Transfer-Papers

:pencil2: Neural Style Transfer: A Review

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Neural-Style-Transfer-Papers :art:

Selected papers, corresponding codes and pre-trained models in our review paper "Neural Style Transfer: A Review"

If I missed your paper in this review, please email me or just pull a request here. I am more than happy to add it. Thanks!

News!

  • [Apr, 2018] We have released a new version of the paper with significant changes at: https://arxiv.org/pdf/1705.04058.pdf
    Appreciate the feedback!

  • [Feb, 2018] Update the Images (Images_neuralStyleTransferReview_v2) in the Materials. Add the results of Li et al.'s NIPS 2017 paper.

  • [Jan, 2018] Pre-trained models and all the content images, the style images, and the stylized results in the paper have been released.


Citation

If you find this repository useful for your research, please cite

@article{jing2017neural,
  title={Neural Style Transfer: A Review},
  author={Jing, Yongcheng and Yang, Yezhou and Feng, Zunlei and Ye, Jingwen and Yu, Yizhou and Song, Mingli},
  journal={arXiv preprint arXiv:1705.04058},
  year={2017}
}

Materials corresponding to Our Paper

Supplementary Materials

Pre-trained Models

Images (v2)

A Taxonomy of Current Methods

1. "Slow" Neural Methods Based On Online Image Optimization

1.1. Parametric "Slow" Neural Methods with Summary Statistics

[A Neural Algorithm of Artistic Style] [Paper] (First Neural Style Transfer Paper)

❇️ Code:

[Image Style Transfer Using Convolutional Neural Networks] [Paper] (CVPR 2016)

[Incorporating Long-range Consistency in CNN-based Texture Generation] [Paper] (ICLR 2017)

❇️ Code:

[Laplacian-Steered Neural Style Transfer] [Paper] (ACM MM 2017)

❇️ Code:

[Demystifying Neural Style Transfer] [Paper] (Theoretical Explanation) (IJCAI 2017)

❇️ Code:

[Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses] [Paper]

1.2. Non-parametric "Slow" Neural Methods with MRFs

[Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis] [Paper] (CVPR 2016)

❇️ Code:

2. "Fast" Neural Methods Based On Offline Model Optimization

2.1. Per-Style-Per-Model "Fast" Neural Methods

[Perceptual Losses for Real-Time Style Transfer and Super-Resolution] [Paper] (ECCV 2016)

❇️ Code:

❇️ Pre-trained Models:

[Texture Networks: Feed-forward Synthesis of Textures and Stylized Images] [Paper] (ICML 2016)

❇️ Code:

[Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks] [Paper] (ECCV 2016)

❇️ Code:

2.2. Multiple-Style-Per-Model "Fast" Neural Methods

[A Learned Representation for Artistic Style] [Paper] (ICLR 2017)

❇️ Code:

[Multi-style Generative Network for Real-time Transfer] [Paper]  (arXiv, 03/2017)

❇️ Code:

[Diversified Texture Synthesis With Feed-Forward Networks] [Paper] (CVPR 2017)

❇️ Code:

[StyleBank: An Explicit Representation for Neural Image Style Transfer] [Paper] (CVPR 2017)

2.3. Arbitrary-Style-Per-Model "Fast" Neural Methods

[Fast Patch-based Style Transfer of Arbitrary Style] [Paper]

❇️ Code:

[Exploring the Structure of a Real-time, Arbitrary Neural Artistic Stylization Network] [Paper] (BMVC 2017)

❇️ Code:

[Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization] [Paper] (ICCV 2017)

❇️ Code:

[Universal Style Transfer via Feature Transforms] [Paper] (NIPS 2017)

❇️ Code:

[Meta Networks for Neural Style Transfer] [Paper]

❇️ Code:

Improvements and Extensions

[Preserving Color in Neural Artistic Style Transfer] [Paper]

[Controlling Perceptual Factors in Neural Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

[Content-Aware Neural Style Transfer] [Paper]

[Towards Deep Style Transfer: A Content-Aware Perspective] [Paper] (BMVC 2016)

[Neural Doodle_Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork] [Paper]

[Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork] [Paper]

❇️ Code:

[The Contextual Loss for Image Transformation with Non-Aligned Data] [Paper]

❇️ Code:

[Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis] [Paper] (CVPR 2017)

❇️ Code:

[Instance Normalization:The Missing Ingredient for Fast Stylization] [Paper]

❇️ Code:

[Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

[Stroke Controllable Fast Style Transfer with Adaptive Receptive Fields] [Paper]

❇️ Code:

[Depth-Preserving Style Transfer] [Paper]

❇️ Code:

[Depth-Aware Neural Style Transfer] [Paper] (NPAR 2017)

[Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?] [Paper] (NPAR 2017)

[Pictory: Combining Neural Style Transfer and Image Filtering] [Paper] (ACM SIGGRAPH 2017 Appy Hour)

[Painting Style Transfer for Head Portraits Using Convolutional Neural Networks] [Paper] (SIGGRAPH 2016)

[Son of Zorn's Lemma Targeted Style Transfer Using Instance-aware Semantic Segmentation] [Paper] (ICASSP 2017)

[Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN] [Paper] (ACPR 2017)

[Artistic Style Transfer for Videos] [Paper] (GCPR 2016)

❇️ Code:

[DeepMovie: Using Optical Flow and Deep Neural Networks to Stylize Movies] [Paper]

[Characterizing and Improving Stability in Neural Style Transfer] [Paper]) (ICCV 2017)

[Coherent Online Video Style Transfer] [Paper] (ICCV 2017)

[Real-Time Neural Style Transfer for Videos] [Paper] (CVPR 2017)

[Deep Photo Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

[A Closed-form Solution to Photorealistic Image Stylization] [Paper]

❇️ Code:

[Decoder Network Over Lightweight Reconstructed Feature for Fast Semantic Style Transfer] [Paper] (ICCV 2017)

[Stereoscopic Neural Style Transfer] [Paper] (CVPR 2018)

[Awesome Typography: Statistics-based Text Effects Transfer] [Paper] (CVPR 2017)

❇️ Code:

[Neural Font Style Transfer] [Paper] (ICDAR 2017)

[Rewrite: Neural Style Transfer For Chinese Fonts] [Project]

[Separating Style and Content for Generalized Style Transfer] [Paper] (CVPR 2018)

[Visual Attribute Transfer through Deep Image Analogy] [Paper] (SIGGRAPH 2017)

❇️ Code:

[Fashion Style Generator] [Paper] (IJCAI 2017)

[Deep Painterly Harmonization] [Paper]

❇️ Code:

[Fast Face-Swap Using Convolutional Neural Networks] [Paper] (ICCV 2017)

Application

Prisma

Ostagram

❇️ Code:

Deep Forger

NeuralStyler

Style2Paints

❇️ Code:

Application Papers

[Bringing Impressionism to Life with Neural Style Transfer in Come Swim] [Paper]

[Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles] [Paper]

[ProsumerFX: Mobile Design of Image Stylization Components] [Paper]

[Pictory - Neural Style Transfer and Editing with coreML] [Paper]

[Tiny Transform Net for Mobile Image Stylization] [Paper] (ICMR 2017)

Blogs

[Caffe2Go][https://code.facebook.com/posts/196146247499076/delivering-real-time-ai-in-the-palm-of-your-hand/]

[Supercharging Style Transfer][https://research.googleblog.com/2016/10/supercharging-style-transfer.html]

[Issue of Layer Chosen Strategy][http://yongchengjing.com/pdf/Issue_layerChosenStrategy_neuralStyleTransfer.pdf]

[Picking an optimizer for Style Transfer][https://blog.slavv.com/picking-an-optimizer-for-style-transfer-86e7b8cba84b]

About

:pencil2: Neural Style Transfer: A Review