Log in first for optimal use of all functions!

Real-Time Patch-Based Stylization of Portraits Using Generative Adversarial Network (Unknown language)

In: ACM/EG Expressive Symposium   ;  33-42  ;  2019

How to get this title?

Check access
Download
Commercial Copyright fee: €14.50 Basic fee: €4.00 Total price: €18.50
Academic Copyright fee: €4.50 Basic fee: €2.00 Total price: €6.50

Export, share and cite

We present a learning-based style transfer algorithm for human portraits which significantly outperforms current state-of-the-art in computational overhead while still maintaining comparable visual quality. We show how to design a conditional generative adversarial network capable to reproduce the output of Fišer et al.'s patch-based method [FJS*17] that is slow to compute but can deliver state-of-the-art visual quality. Since the resulting end-to-end network can be evaluated quickly on current consumer GPUs, our solution enables first real-time high-quality style transfer to facial videos that runs at interactive frame rates. Moreover, in cases when the original algorithmic approach of Fišer et al. fails our network can provide a more visually pleasing result thanks to generalization. We demonstrate the practical utility of our approach on a variety of different styles and target subjects.

Table of contents conference proceedings

The tables of contents are generated automatically and are based on the data records of the individual contributions available in the index of the TIB portal. The display of the Tables of Contents may therefore be incomplete.

1
Non-Photorealistic Animation for Immersive Storytelling
Curtis, Cassidy J. / Dart, Kevin / Latzko, Theresa / Kahrs, John et al. | 2019
11
Video Motion Stylization by 2D Rigidification
Delanoy, Johanna / Bousseau, Adrien / Hertzmann, Aaron et al. | 2019
21
Learning from Multi-domain Artistic Images for Arbitrary Style Transfer
Xu, Zheng / Wilber, Michael / Fang, Chen / Hertzmann, Aaron / Jin, Hailin et al. | 2019
33
Real-Time Patch-Based Stylization of Portraits Using Generative Adversarial Network
Futschik, David / Chai, Menglei / Cao, Chen / Ma, Chongyang / Stoliar, Aleksei / Korolev, Sergey / Tulyakov, Sergey / Kučera, Michal / Sýkora, Daniel et al. | 2019
43
Enhancing Neural Style Transfer using Patch-Based Synthesis
Texler, Ondřej / Fišer, Jakub / Lukáč, Mike / Lu, Jingwan / Shechtman, Eli / Sýkora, Daniel et al. | 2019
51
Sketching and Layering Graffiti Primitives
Berio, Daniel / Asente, Paul / Echevarria, Jose / Leymarie, Frederic Fol et al. | 2019
61
Single Stroke Aerial Robot Light Painting
Ren, Kejia / Kry, Paul G. et al. | 2019
69
Generating Playful Palettes from Images
DiVerdi, Stephen / Lu, Jingwan / Echevarria, Jose / Shugrina, Maria et al. | 2019
79
Aesthetically-Oriented Atmospheric Scattering
Shen, Yang / Mallett, Ian / Shkurko, Konstantin et al. | 2019
87
Abstract Shape Synthesis From Linear Combinations of Clelia Curves
Putnam, Lance / Todd, Stephen / Latham, William et al. | 2019
101
Aesthetics of Curvature Bases for Sketches
Lippincott, Keith / Hatton, Ross L. / Grimm, Cindy et al. | 2019
111
Defining Hatching in Art
Philbrick, Greg / Kaplan, Craig S. et al. | 2019
123
Stipple Removal in Extreme-tone Regions
Azami, Rosa / Doyle, Lars / Mould, David et al. | 2019
133
Irregular Pebble Mosaics with Sub-Pebble Detail
Javid, Ali Sattari / Doyle, Lars / Mould, David et al. | 2019

How to get this title?

Check access
Download
Commercial Copyright fee: €14.50 Basic fee: €4.00 Total price: €18.50
Academic Copyright fee: €4.50 Basic fee: €2.00 Total price: €6.50

Export, share and cite

Feedback