Procedural Modeling of a Building from a Single Image (English)

In: Computer Graphics Forum   ;  37 ,  2  ;  415-429  ;  2018

How to get this document?

Download
Commercial Copyright fee: €35.20 Basic fee: €4.00 Total price: €39.20
Academic Copyright fee: €35.20 Basic fee: €2.00 Total price: €37.20

Creating a virtual city is demanded for computer games, movies, and urban planning, but it takes a lot of time to create numerous 3D building models. Procedural modeling has become popular in recent years to overcome this issue, but creating a grammar to get a desired output is difficult and time consuming even for expert users. In this paper, we present an interactive tool that allows users to automatically generate such a grammar from a single image of a building. The user selects a photograph and highlights the silhouette of the target building as input to our method. Our pipeline automatically generates the building components, from large‐scale building mass to fine‐scale windows and doors geometry. Each stage of our pipeline combines convolutional neural networks (CNNs) and optimization to select and parameterize procedural grammars that reproduce the building elements of the picture. In the first stage, our method jointly estimates camera parameters and building mass shape. Once known, the building mass enables the rectification of the façades, which are given as input to the second stage that recovers the façade layout. This layout allows us to extract individual windows and doors that are subsequently fed to the last stage of the pipeline that selects procedural grammars for windows and doors. Finally, the grammars are combined to generate a complete procedural building as output. We devise a common methodology to make each stage of this pipeline tractable. This methodology consists in simplifying the input image to match the visual appearance of synthetic training data, and in using optimization to refine the parameters estimated by CNNs. We used our method to generate a variety of procedural models of buildings from existing photographs.

Table of contents – Volume 37, Issue 2

Show all volumes and issues

The tables of contents are generated automatically and are based on the data records of the individual contributions available in the index of the TIB portal. The display of the Tables of Contents may therefore be incomplete.

1
Feature Curve Co‐Completion in Noisy Data
Gehre, Anne / Lim, Isaak / Kobbelt, Leif | 2018
13
Wavejets: A Local Frequency Framework for Shape Details Amplification
Béarzi, Yohann / Digne, Julie / Chaine, Raphaëlle | 2018
25
Repairing Inconsistent Curve Networks on Non‐parallel Cross‐sections
Huang, Z. Y. / Holloway, M. / Carr, N. / Ju, T. | 2018
37
ExpandNet: A Deep Convolutional Neural Network for High Dynamic Range Expansion from Low Dynamic Range Content
Marnerides, D. / Bashford‐Rogers, T. / Hatchett, J. / Debattista, K. | 2018
51
From Faces to Outdoor Light Probes
Calian, Dan A. / Lalonde, Jean‐François / Gotardo, Paulo / Simon, Tomas / Matthews, Iain / Mitchell, Kenny | 2018
63
Multiple Scattering in Inhomogeneous Participating Media Using Rao‐Blackwellization and Control Variates
Szirmay‐Kalos, László / Magdics, Milán / Sbert, Mateu | 2018
75
PCPNet Learning Local Shape Properties from Raw Point Clouds
Guerrero, Paul / Kleiman, Yanir / Ovsjanikov, Maks / Mitra, Niloy J. | 2018
87
PointProNets: Consolidation of Point Clouds with Convolutional Neural Networks
Roveri, Riccardo / Öztireli, A. Cengiz / Pandele, Ioana / Gross, Markus | 2018
101
Terrain Super‐resolution through Aerial Imagery and Fully Convolutional Networks
Argudo, O. / Chica, A. / Andujar, C. | 2018
111
A new microflake model with microscopic self‐shadowing for accurate volume downsampling
Loubet, Guillaume / Neyret, Fabrice | 2018
123
Real‐Time Rendering of Wave‐Optical Effects on Scratched Surfaces
Velinov, Z. / Werner, S. / Hullin, M. B. | 2018
135
A Versatile Parameterization for Measured Material Manifolds
Soler, Cyril / Subr, Kartic / Nowrouzezahrai, Derek | 2018
145
A Physically Consistent Implicit Viscosity Solver for SPH Fluids
Weiler, Marcel / Koschier, Dan / Brand, Magnus / Bender, Jan | 2018
157
Fast Fluid Simulations with Sparse Volumes on the GPU
Wu, Kui / Truong, Nghia / Yuksel, Cem / Hoetzlein, Rama | 2018
169
Extended Narrow Band FLIP for Liquid Simulations
Sato, T. / Wojtan, C. / Thuerey, N. / Igarashi, T. / Ando, R. | 2018
179
Improved Functional Mappings via Product Preservation
Nogneng, D. / Melzi, S. / Rodolà, E. / Castellani, U. / Bronstein, M. / Ovsjanikov, M. | 2018
191
Visual Attention for Rendered 3D Shapes
Lavoué, Guillaume / Cordier, Frédéric / Seo, Hyewon / Larabi, Mohamed‐Chaker | 2018
205
Watch to Edit: Video Retargeting using Gaze
Rachavarapu, Kranthi Kumar / Kumar, Moneish / Gandhi, Vineet / Subramanian, Ramanathan | 2018
217
GazeDirector: Fully Articulated Eye Gaze Redirection in Video
Wood, Erroll / Baltrušaitis, Tadas / Morency, Louis‐Philippe / Robinson, Peter / Bulling, Andreas | 2018
227
Efficient BVH‐based Collision Detection Scheme with Ordering and Restructuring
Wang, Xinlei / Tang, Min / Manocha, Dinesh / Tong, Ruofeng | 2018
239
Fast Penetration Volume for Rigid Bodies
Nirel, D. / Lischinski, D. | 2018
251
Packable Springs
Wolff, Katja / Poranne, Roi / Glauser, Oliver / Sorkine‐Hornung, Olga | 2018
263
String Art: Towards Computational Fabrication of String Images
Birsak, Michael / Rist, Florian / Wonka, Peter / Musialski, Przemyslaw | 2018
275
Watercolor Woodblock Printing with Image Analysis
Panotopoulou, A. / Paris, S. / Whiting, E. | 2018
287
Real‐time Locomotion Controller using an Inverted‐Pendulum‐based Abstract Model
Hwang, Jaepyung / Kim, Jongmin / Suh, Il Hong / Kwon, Taesoo | 2018
297
Self‐similarity Analysis for Motion Capture Cleaning
Aristidou, A. / Cohen‐Or, D. / Hodgins, J. K. / Shamir, A. | 2018
311
Aura Mesh: Motion Retargeting to Preserve the Spatial Relationships between Skinned Characters
Jin, Taeil / Kim, Meekyoung / Lee, Sung‐Hee | 2018
321
Flexible Live‐Wire: Image Segmentation with Floating Anchors
Summa, B. / Faraj, N. / Licorish, C. / Pascucci, V. | 2018
329
Semantic Segmentation for Line Drawing Vectorization Using Neural Networks
Kim, Byungsoo / Wang, Oliver / Öztireli, A. Cengiz / Gross, Markus | 2018
339
Sequences with Low‐Discrepancy Blue‐Noise 2‐D Projections
Perrier, Hélène / Coeurjolly, David / Xie, Feng / Pharr, Matt / Hanrahan, Pat / Ostromoukhov, Victor | 2018
355
Hair Modeling and Simulation by Style
Jung, Seunghwan / Lee, Sung‐Hee | 2018
365
Practical Radiometric Compensation for Projection Display on Textured Surfaces using a Multidimensional Model
Li, Yuqi / Majumder, Aditi / Gopi, M. / Wang, Chong / Zhao, Jieyu | 2018
377
Single‐image Tomography: 3D Volumes from 2D Cranial X‐Rays
Henzler, Phlipp / Rasche, Volker / Ropinski, Timo / Ritschel, Tobias | 2018
389
Deep Joint Design of Color Filter Arrays and Demosaicing
Henz, Bernardo / Gastal, Eduardo S. L. / Oliveira, Manuel M. | 2018
401
Example‐based Authoring of Procedural Modeling Programs with Structural and Continuous Variability
Ritchie, Daniel / Jobalia, Sarah / Thomas, Anna | 2018
415
Procedural Modeling of a Building from a Single Image
Nishida, Gen / Bousseau, Adrien / Aliaga, Daniel G. | 2018
431
Procedural Cloudscapes
Webanck, A. / Cortial, Y. / Guérin, E. / Galin, E. | 2018
443
Approximate Program Smoothing Using Mean‐Variance Statistics, with Application to Procedural Shader Bandlimiting
Yang, Y. / Barnes, C. | 2018
455
Fast Catmull‐Rom Spline Interpolation for High‐Quality Texture Sampling
Csébfalvi, Balázs | 2018
463
Parallel Reinsertion for Bounding Volume Hierarchy Optimization
Meister, D. / Bittner, J. | 2018
475
Motion Sickness Simulation Based on Sensorimotor Control
Hu, Chen‐Hui / Lin, Wen‐Chieh | 2018
485
Controllable Dendritic Crystal Simulation Using Orientation Field
Ren, Bo / Huang, Jiahui / Lin, Ming C. / Hu, Shi‐Min | 2018
497
Interactive Generation of Time‐evolving, Snow‐Covered Landscapes with Avalanches
Cordonnier, G. / Ecormier, P. / Galin, E. / Gain, J. / Benes, B. / Cani, M.‐P. | 2018
511
MIQP‐based Layout Design for Building Interiors
Wu, Wenming / Fan, Lubin / Liu, Ligang / Wonka, Peter | 2018
523
State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications
Zollhöfer, M. / Thies, J. / Garrido, P. / Bradley, D. / Beeler, T. / Pérez, P. / Stamminger, M. / Nießner, M. / Theobalt, C. | 2018
551
Monte Carlo Methods for Volumetric Light Transport Simulation
Novák, Jan / Georgiev, Iliyan / Hanika, Johannes / Jarosz, Wojciech | 2018
577
A Survey on Data‐driven Dictionary‐based Methods for 3D Modeling
Lescoat, Thibault / Ovsjanikov, Maks / Memari, Pooran / Thiery, Jean‐Marc / Boubekeur, Tamy | 2018
603
Functionality Representations and Applications for Shape Analysis
Hu, R. / Savva, M. / van Kaick, O. | 2018
625
State of the Art on 3D Reconstruction with RGB‐D Cameras
Zollhöfer, Michael / Stotko, Patrick / Görlitz, Andreas / Theobalt, Christian / Nießner, Matthias / Klein, Reinhard / Kolb, Andreas | 2018
653
Recent Advances in Projection Mapping Algorithms, Hardware and Applications
Grundhöfer, A. / Iwai, D. | 2018
i
Front Matter
| 2018