Interactive sketching of urban procedural models (English)

In: ACM transactions on graphics : TOG   ;  35 ,  4  ;  2016
  • ISSN:
  • Article (Journal)  /  Print

How to get this document?

D modeling remains a notoriously difficult task for novices despite significant research effort to provide intuitive and automated systems. We tackle this problem by combining the strengths of two popular domains: sketch-based modeling and procedural modeling. On the one hand, sketch-based modeling exploits our ability to draw but requires detailed, unambiguous drawings to achieve complex models. On the other hand, procedural modeling automates the creation of precise and detailed geometry but requires the tedious definition and parameterization of procedural models. Our system uses a collection of simple procedural grammars, called snippets, as building blocks to turn sketches into realistic 3D models. We use a machine learning approach to solve the inverse problem of finding the procedural model that best explains a user sketch. We use non-photorealistic rendering to generate artificial data for training convolutional neural networks capable of quickly recognizing the procedural rule intended by a sketch and estimating its parameters. We integrate our algorithm in a coarse-to-fine urban modeling system that allows users to create rich buildings by successively sketching the building mass, roof, facades, windows, and ornaments. A user study shows that by using our approach non-expert users can generate complex buildings in just a few minutes.

Table of contents – Volume 35, Issue 4

Show all volumes and issues

The tables of contents are generated automatically and are based on the data records of the individual contributions available in the index of the TIB portal. The display of the Tables of Contents may therefore be incomplete.

1
Painting style transfer for head portraits using convolutional neural networks
Selim, Ahmed / Elgharib, Mohamed / Doyle, Linda | 2016
1
Efficient GPU rendering of subdivision surfaces using adaptive quadtrees
Brainerd, Wade / Foley, Tim / Kraemer, Manuel / Moreton, Henry / Nießner, Matthias | 2016
1
Practical multispectral lighting reproduction
LeGendre, Chloe / Yu, Xueming / Liu, Dai / Busch, Jay / Jones, Andrew / Pattanaik, Sumanta / Debevec, Paul | 2016
1
Terrain-adaptive locomotion skills using deep reinforcement learning
Peng, Xue / Berseth, Glen / van de Panne, Michiel | 2016
1
Learning to simplify
Simo-Serra, Edgar / Iizuka, Satoshi / Sasaki, Kazuma / Ishikawa, Hiroshi | 2016
1
Beyond developable
Konaković, Mina / Crane, Keenan / Deng, Bailin / Bouaziz, Sofien / Piker, Daniel / Pauly, Mark | 2016
1
Procedural voronoi foams for additive manufacturing
Martínez, Jonàs / Dumas, Jérémie / Lefebvre, Sylvain | 2016
1
CofiFab
Song, Peng / Deng, Bailin / Wang, Ziqi / Dong, Zhichao / Li, Wei / Fu, Chi-Wing / Liu, Ligang | 2016
1
A compiler for 3D machine knitting
McCann, James / Albaugh, Lea / Narayanan, Vidya / Grow, April / Matusik, Wojciech / Mankoff, Jen / Hodgins, Jessica | 2016
1
ZoeMatrope
Miyashita, Leo / Ishihara, Kota / Watanabe, Yoshihiro / Ishikawa, Masatoshi | 2016
1
Sky is not the limit
Tsai, Yi-Hsuan / Shen, Xiaohui / Lin, Zhe / Sunkavalli, Kalyan / Yang, Ming-Hsuan | 2016
1
Rigel
Hegarty, James / Daly, Ross / DeVito, Zachary / Ragan-Kelley, Jonathan / Horowitz, Mark / Hanrahan, Pat | 2016
1
Computational design of reconfigurables
Garg, Akash / Jacobson, Alec / Grinspun, Eitan | 2016
1
Subdivision exterior calculus for geometry processing
de Goes, Fernando / Desbrun, Mathieu / Meyer, Mark / DeRose, Tony | 2016
1
Rich360
Lee, Jungjin / Kim, Bumki / Kim, Kyehyun / Kim, Younghui / Noh, Junyong | 2016
1
Schrödinger's smoke
Chern, Albert / Knöppel, Felix / Pinkall, Ulrich / Schröder, Peter / Weißmann, Steffen | 2016
1
Cinema 3D
Efrat, Netalee / Didyk, Piotr / Foshey, Mike / Matusik, Wojciech / Levin, Anat | 2016
1
Drucker-prager elastoplasticity for sand animation
Klár, Gergely / Gast, Theodore / Pradhana, Andre / Fu, Chuyuan / Schroeder, Craig / Jiang, Chenfanfu / Teran, Joseph | 2016
1
Perspective-aware manipulation of portrait photos
Fried, Ohad / Shechtman, Eli / Goldman, Dan / Finkelstein, Adam | 2016
1
Soli
Lien, Jaime / Gillian, Nicholas / Karagozler, M / Amihood, Patrick / Schwesig, Carsten / Olson, Erik / Raja, Hakim / Poupyrev, Ivan | 2016
1
Roto
Li, Wenbin / Viola, Fabio / Starck, Jonathan / Brostow, Gabriel / Campbell, Neill | 2016
1
Point registration via efficient convex relaxation
Maron, Haggai / Dym, Nadav / Kezurer, Itay / Kovalsky, Shahar / Lipman, Yaron | 2016
1
Efficient dynamic skinning with low-rank helper bone controllers
Mukai, Tomohiko / Kuriyama, Shigeru | 2016
1
Seamless visual sharing with color vision deficiencies
Shen, Wuyao / Mao, Xiangyu / Hu, Xinghong / Wong, Tien-Tsin | 2016
1
Computational network design from functional specifications
Peng, Chi-Han / Yang, Yong-Liang / Bao, Fan / Fink, Daniel / Yan, Dong-Ming / Wonka, Peter / Mitra, Niloy | 2016
1
Connected fermat spirals for layered fabrication
Zhao, Haisen / Gu, Fanglin / Huang, Qi-Xing / Garcia, Jorge / Chen, Yong / Tu, Changhe / Benes, Bedrich / Zhang, Hao / Cohen-Or, Daniel / Chen, Baoquan | 2016
1
All-hex meshing using closed-form induced polycube
Fang, Xianzhong / Xu, Weiwei / Bao, Hujun / Huang, Jin | 2016
1
Generalized non-reflecting boundaries for fluid re-simulation
Bojsen-Hansen, Morten / Wojtan, Chris | 2016
1
HexEx
Lyon, Max / Bommes, David / Kobbelt, Leif | 2016
1
Entropic metric alignment for correspondence problems
Solomon, Justin / Peyré, Gabriel / Kim, Vladimir / Sra, Suvrit | 2016
1
Crowd-driven mid-scale layout design
Feng, Tian / Yu, Lap-Fai / Yeung, Sai-Kit / Yin, KangKang / Zhou, Kun | 2016
1
Designing structurally-sound ornamental curve networks
Zehnder, Jonas / Coros, Stelian / Thomaszewski, Bernhard | 2016
1
Computational design of stable planar-rod structures
Miguel, Eder / Lepoutre, Mathias / Bickel, Bernd | 2016
1
AutoHair
Chai, Menglei / Shao, Tianjia / Wu, Hongzhi / Weng, Yanlin / Zhou, Kun | 2016
1
Computational imaging with multi-camera time-of-flight systems
Shrestha, Shikhar / Heide, Felix / Heidrich, Wolfgang / Wetzstein, Gordon | 2016
1
Accelerated quadratic proxy for geometric optimization
Kovalsky, Shahar / Galun, Meirav / Lipman, Yaron | 2016
1
Real-time facial animation with image-based dynamic avatars
Cao, Chen / Wu, Hongzhi / Weng, Yanlin / Shao, Tianjia / Zhou, Kun | 2016
1
Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences
Taylor, Jonathan / Bordeaux, Lucas / Cashman, Thomas / Corish, Bob / Keskin, Cem / Sharp, Toby / Soto, Eduardo / Sweeney, David / Valentin, Julien / Luff, Benjamin et al. | 2016
1
Task-based locomotion
Agrawal, Shailen / van de Panne, Michiel | 2016
1
Perceptual effect of shoulder motions on crowd animations
Hoyet, Ludovic / Olivier, Anne-Helene / Kulpa, Richard / Pettré, Julien | 2016
1
Learning how objects function via co-analysis of interactions
Hu, Ruizhen / van Kaick, Oliver / Wu, Bojian / Huang, Hui / Shamir, Ariel / Zhang, Hao | 2016
1
Interactive sketching of urban procedural models
Nishida, Gen / Garcia-Dorado, Ignacio / Aliaga, Daniel / Benes, Bedrich / Bousseau, Adrien | 2016
1
Multiphase SPH simulation for interactive fluids and solids
Yan, Xiao / Jiang, Yun-Tao / Li, Chen-Feng / Martin, Ralph / Hu, Shi-Min | 2016
1
Reflectance modeling by neural texture synthesis
Aittala, Miika / Aila, Timo / Lehtinen, Jaakko | 2016
1
Surface-only liquids
Da, Fang / Hahn, David / Batty, Christopher / Wojtan, Chris / Grinspun, Eitan | 2016
1
Bounded distortion harmonic shape interpolation
Chien, Edward / Chen, Renjie / Weber, Ofir | 2016
1
An interaction-aware, perceptual model for non-linear elastic objects
Piovarči, Michal / Levin, David / Rebello, Jason / Chen, Desai / Ďurikovič, Roman / Pfister, Hanspeter / Matusik, Wojciech / Didyk, Piotr | 2016
1
Fidelity vs. simplicity
Favreau, Jean-Dominique / Lafarge, Florent / Bousseau, Adrien | 2016
1
On the convexity and feasibility of the bounded distortion harmonic mapping problem
Levi, Zohar / Weber, Ofir | 2016
1
Unified motion planner for fishes with various swimming styles
Satoi, Daiki / Hagiwara, Mikihiro / Uemoto, Akira / Nakadai, Hisanao / Hoshino, Junichi | 2016
1
Generating dynamically feasible trajectories for quadrotor cameras
Roberts, Mike / Hanrahan, Pat | 2016
1
Time-varying weathering in texture space
Bellini, Rachele / Kleiman, Yanir / Cohen-Or, Daniel | 2016
1
Non-linear shape optimization using local subspace projections
Musialski, Przemyslaw / Hafner, Christian / Rist, Florian / Birsak, Michael / Wimmer, Michael / Kobbelt, Leif | 2016
1
Resolving fluid boundary layers with particle strength exchange and weak adaptivity
Zhang, Xinxin / Li, Minchen / Bridson, Robert | 2016
1
Automatically scheduling halide image processing pipelines
Mullapudi, Ravi / Adams, Andrew / Sharlet, Dillon / Ragan-Kelley, Jonathan / Fatahalian, Kayvon | 2016
1
Printing arbitrary meshes with a 5DOF wireframe printer
Wu, Rundong / Peng, Huaishu / Guimbretière, François / Marschner, Steve | 2016
1
Multi-scale label-map extraction for texture synthesis
Lockerman, Yitzchak / Sauvage, Basile / Allègre, Rémi / Dischler, Jean-Michel / Dorsey, Julie / Rushmeier, Holly | 2016
1
Fast approximations for boundary element based brittle fracture simulation
Hahn, David / Wojtan, Chris | 2016
1
Synthesis of filigrees for digital fabrication
Chen, Weikai / Zhang, Xiaolong / Xin, Shiqing / Xia, Yang / Lefebvre, Sylvain / Wang, Wenping | 2016
1
Tactile mesh saliency
Lau, Manfred / Dev, Kapil / Shi, Weiqi / Dorsey, Julie / Rushmeier, Holly | 2016
1
A semi-implicit material point method for the continuum simulation of granular materials
Daviet, Gilles / Bertails-Descoubes, Florence | 2016
1
A deep learning framework for character motion synthesis and editing
Holden, Daniel / Saito, Jun / Komura, Taku | 2016
1
Real-time rendering on a power budget
Wang, Rui / Yu, Bowen / Marco, Julio / Hu, Tianlei / Gutierrez, Diego / Bao, Hujun | 2016
1
Motion graphs for unstructured textured meshes
Prada, Fabián / Kazhdan, Misha / Chuang, Ming / Collet, Alvaro / Hoppe, Hugues | 2016
1
Shadow theatre
Won, Jungdam / Lee, Jehee | 2016
1
Position-normal distributions for efficient rendering of specular microstructure
Yan, Ling-Qi / Hašan, Miloš / Marschner, Steve / Ramamoorthi, Ravi | 2016
1
Additive light field displays
Lee, Seungjae / Jang, Changwon / Moon, Seokil / Cho, Jaebum / Lee, Byoungho | 2016
1
Artist-directed dynamics for 2D animation
Bai, Yunfei / Kaufman, Danny / Liu, C / Popović, Jovan | 2016
1
ProxImaL
Heide, Felix / Diamond, Steven / Nießner, Matthias / Ragan-Kelley, Jonathan / Heidrich, Wolfgang / Wetzstein, Gordon | 2016
1
Mapping virtual and physical reality
Sun, Qi / Wei, Li-Yi / Kaufman, Arie | 2016
1
Real-time polygonal-light shading with linearly transformed cosines
Heitz, Eric / Dupuy, Jonathan / Hill, Stephen / Neubelt, David | 2016
1
cSculpt
Calabrese, Claudio / Salvati, Gabriele / Tarini, Marco / Pellacini, Fabio | 2016
1
Live intrinsic video
Meka, Abhimitra / Zollhöfer, Michael / Richardt, Christian / Theobalt, Christian | 2016
1
Adjoint-driven Russian roulette and splitting in light transport simulation
Vorba, Jiří / Křivánek, Jaroslav | 2016
1
Physics-driven pattern adjustment for direct 3D garment editing
Bartle, Aric / Sheffer, Alla / Kim, Vladimir / Kaufman, Danny / Vining, Nicholas / Berthouzoz, Floraine | 2016
1
Volume-encoded UV-maps
Tarini, Marco | 2016
1
Real-time skeletal skinning with optimized centers of rotation
Le, Binh / Hodgins, Jessica | 2016
1
An anatomically-constrained local deformation model for monocular face capture
Wu, Chenglei / Bradley, Derek / Gross, Markus / Beeler, Thabo | 2016
1
PiGraphs
Savva, Manolis / Chang, Angel / Hanrahan, Pat / Fisher, Matthew / Nießner, Matthias | 2016
1
Adaptive polynomial rendering
Moon, Bochang / McDonagh, Steven / Mitchell, Kenny / Gross, Markus | 2016
1
PATEX
Guerrero, Paul / Bernstein, Gilbert / Li, Wilmot / Mitra, Niloy | 2016
1
Computational thermoforming
Schüller, Christian / Panozzo, Daniele / Grundhöfer, Anselm / Zimmer, Henning / Sorkine, Evgeni / Sorkine-Hornung, Olga | 2016
1
SketchiMo
Choi, Byungkuk / i Ribera, Roger / Lewis, J / Seol, Yeongho / Hong, Seokpyo / Eom, Haegwang / Jung, Sunjin / Noh, Junyong | 2016
1
StyLit
Fišer, Jakub / Jamriška, Ondřej / Lukáč, Michal / Shechtman, Eli / Asente, Paul / Lu, Jingwan / Sýkora, Daniel | 2016
1
Transfiguring portraits
Kemelmacher-Shlizerman, Ira | 2016
1
The diffractive achromat full spectrum computational imaging with diffractive optics
Peng, Yifan / Fu, Qiang / Heide, Felix / Heidrich, Wolfgang | 2016
1
Fitting procedural yarn models for realistic cloth rendering
Zhao, Shuang / Luan, Fujun / Bala, Kavita | 2016
1
Example-based plastic deformation of rigid bodies
Jones, Ben / Thuerey, Nils / Shinar, Tamar / Bargteil, Adam | 2016
1
Flow-guided warping for image-based shape manipulation
Vergne, Romain / Barla, Pascal / Bonneau, Georges-Pierre / Fleming, Roland | 2016
1
Multiple-scattering microfacet BSDFs with the Smith model
Heitz, Eric / Hanika, Johannes / d'Eon, Eugene / Dachsbacher, Carsten | 2016
1
G 1 non-uniform Catmull-Clark surfaces
Li, Xin / Finnigan, G / Sederberg, Thomas | 2016
1
Mesh arrangements for solid geometry
Zhou, Qingnan / Grinspun, Eitan / Zorin, Denis / Jacobson, Alec | 2016
1
The sketchy database
Sangkloy, Patsorn / Burnell, Nathan / Ham, Cusuh / Hays, James | 2016
1
Realtime 3D eye gaze animation using a single RGB camera
Wang, Congyi / Shi, Fuhao / Xia, Shihong / Chai, Jinxiang | 2016
1
Emulating displays with continuously varying frame rates
Templin, Krzysztof / Didyk, Piotr / Myszkowski, Karol / Seidel, Hans-Peter | 2016
1
Fusion4D
Dou, Mingsong / Khamis, Sameh / Degtyarev, Yury / Davidson, Philip / Fanello, Sean / Kowdle, Adarsh / Escolano, Sergio / Rhemann, Christoph / Kim, David / Taylor, Jonathan et al. | 2016
1
A system for rapid exploration of shader optimization choices
He, Yong / Foley, Tim / Fatahalian, Kayvon | 2016
1
Binary continuous image decomposition for multi-view display
Koutaki, Gou | 2016
1
GazeStereo3D
Kellnhofer, Petr / Didyk, Piotr / Myszkowski, Karol / Hefeeda, Mohamed / Seidel, Hans-Peter / Matusik, Wojciech | 2016
1
Rig animation with a tangible and modular input device
Glauser, Oliver / Ma, Wan-Chun / Panozzo, Daniele / Jacobson, Alec / Hilliges, Otmar / Sorkine-Hornung, Olga | 2016
1
Pose-space subspace dynamics
Xu, Hongyi / Barbič, Jernej | 2016
1
Automatic triage for a photo series
Chang, Huiwen / Yu, Fisher / Wang, Jue / Ashley, Douglas / Finkelstein, Adam | 2016
1
Wasserstein barycentric coordinates
Bonneel, Nicolas / Peyré, Gabriel / Cuturi, Marco | 2016
1
Multi-scale rendering of scratched materials using a structured SV-BRDF model
Raymond, Boris / Guennebaud, Gaël / Barla, Pascal | 2016
1
Erosion thickness on medial axes of 3D shapes
Yan, Yajie / Sykes, Kyle / Chambers, Erin / Letscher, David / Ju, Tao | 2016
1
Let there be color
Iizuka, Satoshi / Simo-Serra, Edgar / Ishikawa, Hiroshi | 2016
1
Globally optimal toon tracking
Zhu, Haichao / Liu, Xueting / Wong, Tien-Tsin / Heng, Pheng-Ann | 2016
1
Lightweight eye capture using a parametric model
Bérard, Pascal / Bradley, Derek / Gross, Markus / Beeler, Thabo | 2016
1
Fast and exact discrete geodesic computation based on triangle-oriented wavefront propagation
Qin, Yipeng / Han, Xiaoguang / Yu, Hongchuan / Yu, Yizhou / Zhang, Jianjun | 2016
1
Toward animating water with complex acoustic bubbles
Langlois, Timothy / Zheng, Changxi / James, Doug | 2016
1
Bijective maps from simplicial foliations
Campen, Marcel / Silva, Cláudio / Zorin, Denis | 2016
1
Spectral style transfer for human motion between independent actions
Yumer, M / Mitra, Niloy | 2016
1
Acoustic voxels
Li, Dingzeyu / Levin, David / Matusik, Wojciech / Zheng, Changxi | 2016
1
RAID
Guerrero, Paul / Mitra, Niloy / Wonka, Peter | 2016
1
Preserving geometry and topology for fluid flows with thin obstacles and narrow gaps
Azevedo, Vinicius / Batty, Christopher / Oliveira, Manuel | 2016
1
Modeling dense inflorescences
Owens, Andrew / Cieslak, Mikolaj / Hart, Jeremy / Classen-Bockhoff, Regine / Prusinkiewicz, Przemyslaw | 2016
1
Legible compact calligrams
Zou, Changqing / Cao, Junjie / Ranaweera, Warunika / Alhashim, Ibraheem / Tan, Ping / Sheffer, Alla / Zhang, Hao | 2016
1
JALI
Edwards, Pif / Landreth, Chris / Fiume, Eugene / Singh, Karan | 2016
1
Body talk
Streuber, Stephan / Quiros-Ramirez, M / Hill, Matthew / Hahn, Carina / Zuffi, Silvia / O'Toole, Alice / Black, Michael | 2016