Interactive sketching of urban procedural models (Englisch)

In: ACM transactions on graphics : TOG   ;  35 ,  4  ;  2016
  • ISSN:
  • Aufsatz (Zeitschrift)  /  Print

D modeling remains a notoriously difficult task for novices despite significant research effort to provide intuitive and automated systems. We tackle this problem by combining the strengths of two popular domains: sketch-based modeling and procedural modeling. On the one hand, sketch-based modeling exploits our ability to draw but requires detailed, unambiguous drawings to achieve complex models. On the other hand, procedural modeling automates the creation of precise and detailed geometry but requires the tedious definition and parameterization of procedural models. Our system uses a collection of simple procedural grammars, called snippets, as building blocks to turn sketches into realistic 3D models. We use a machine learning approach to solve the inverse problem of finding the procedural model that best explains a user sketch. We use non-photorealistic rendering to generate artificial data for training convolutional neural networks capable of quickly recognizing the procedural rule intended by a sketch and estimating its parameters. We integrate our algorithm in a coarse-to-fine urban modeling system that allows users to create rich buildings by successively sketching the building mass, roof, facades, windows, and ornaments. A user study shows that by using our approach non-expert users can generate complex buildings in just a few minutes.

Inhaltsverzeichnis – Band 35, Ausgabe 4

Zeige alle Jahrgänge und Ausgaben

Die Inhaltsverzeichnisse werden automatisch erzeugt und basieren auf den im Index des TIB-Portals verfügbaren Einzelnachweisen der enthaltenen Beiträge. Die Anzeige der Inhaltsverzeichnisse kann daher unvollständig oder lückenhaft sein.

1
Fidelity vs. simplicity
Favreau, Jean-Dominique / Lafarge, Florent / Bousseau, Adrien | 2016
1
Unified motion planner for fishes with various swimming styles
Satoi, Daiki / Hagiwara, Mikihiro / Uemoto, Akira / Nakadai, Hisanao / Hoshino, Junichi | 2016
1
On the convexity and feasibility of the bounded distortion harmonic mapping problem
Levi, Zohar / Weber, Ofir | 2016
1
Time-varying weathering in texture space
Bellini, Rachele / Kleiman, Yanir / Cohen-Or, Daniel | 2016
1
Resolving fluid boundary layers with particle strength exchange and weak adaptivity
Zhang, Xinxin / Li, Minchen / Bridson, Robert | 2016
1
Generating dynamically feasible trajectories for quadrotor cameras
Roberts, Mike / Hanrahan, Pat | 2016
1
Automatically scheduling halide image processing pipelines
Mullapudi, Ravi / Adams, Andrew / Sharlet, Dillon / Ragan-Kelley, Jonathan / Fatahalian, Kayvon | 2016
1
Fast approximations for boundary element based brittle fracture simulation
Hahn, David / Wojtan, Chris | 2016
1
Non-linear shape optimization using local subspace projections
Musialski, Przemyslaw / Hafner, Christian / Rist, Florian / Birsak, Michael / Wimmer, Michael / Kobbelt, Leif | 2016
1
Printing arbitrary meshes with a 5DOF wireframe printer
Wu, Rundong / Peng, Huaishu / Guimbretière, François / Marschner, Steve | 2016
1
Multi-scale label-map extraction for texture synthesis
Lockerman, Yitzchak / Sauvage, Basile / Allègre, Rémi / Dischler, Jean-Michel / Dorsey, Julie / Rushmeier, Holly | 2016
1
Synthesis of filigrees for digital fabrication
Chen, Weikai / Zhang, Xiaolong / Xin, Shiqing / Xia, Yang / Lefebvre, Sylvain / Wang, Wenping | 2016
1
Tactile mesh saliency
Lau, Manfred / Dev, Kapil / Shi, Weiqi / Dorsey, Julie / Rushmeier, Holly | 2016
1
Mapping virtual and physical reality
Sun, Qi / Wei, Li-Yi / Kaufman, Arie | 2016
1
Real-time polygonal-light shading with linearly transformed cosines
Heitz, Eric / Dupuy, Jonathan / Hill, Stephen / Neubelt, David | 2016
1
cSculpt
Calabrese, Claudio / Salvati, Gabriele / Tarini, Marco / Pellacini, Fabio | 2016
1
Live intrinsic video
Meka, Abhimitra / Zollhöfer, Michael / Richardt, Christian / Theobalt, Christian | 2016
1
Physics-driven pattern adjustment for direct 3D garment editing
Bartle, Aric / Sheffer, Alla / Kim, Vladimir / Kaufman, Danny / Vining, Nicholas / Berthouzoz, Floraine | 2016
1
Adjoint-driven Russian roulette and splitting in light transport simulation
Vorba, Jiří / Křivánek, Jaroslav | 2016
1
An anatomically-constrained local deformation model for monocular face capture
Wu, Chenglei / Bradley, Derek / Gross, Markus / Beeler, Thabo | 2016
1
Adaptive polynomial rendering
Moon, Bochang / McDonagh, Steven / Mitchell, Kenny / Gross, Markus | 2016
1
PiGraphs
Savva, Manolis / Chang, Angel / Hanrahan, Pat / Fisher, Matthew / Nießner, Matthias | 2016
1
Volume-encoded UV-maps
Tarini, Marco | 2016
1
Real-time skeletal skinning with optimized centers of rotation
Le, Binh / Hodgins, Jessica | 2016
1
PATEX
Guerrero, Paul / Bernstein, Gilbert / Li, Wilmot / Mitra, Niloy | 2016
1
SketchiMo
Choi, Byungkuk / i Ribera, Roger / Lewis, J / Seol, Yeongho / Hong, Seokpyo / Eom, Haegwang / Jung, Sunjin / Noh, Junyong | 2016
1
Computational thermoforming
Schüller, Christian / Panozzo, Daniele / Grundhöfer, Anselm / Zimmer, Henning / Sorkine, Evgeni / Sorkine-Hornung, Olga | 2016
1
Transfiguring portraits
Kemelmacher-Shlizerman, Ira | 2016
1
Fitting procedural yarn models for realistic cloth rendering
Zhao, Shuang / Luan, Fujun / Bala, Kavita | 2016
1
The diffractive achromat full spectrum computational imaging with diffractive optics
Peng, Yifan / Fu, Qiang / Heide, Felix / Heidrich, Wolfgang | 2016
1
Example-based plastic deformation of rigid bodies
Jones, Ben / Thuerey, Nils / Shinar, Tamar / Bargteil, Adam | 2016
1
StyLit
Fišer, Jakub / Jamriška, Ondřej / Lukáč, Michal / Shechtman, Eli / Asente, Paul / Lu, Jingwan / Sýkora, Daniel | 2016
1
Flow-guided warping for image-based shape manipulation
Vergne, Romain / Barla, Pascal / Bonneau, Georges-Pierre / Fleming, Roland | 2016
1
Multiple-scattering microfacet BSDFs with the Smith model
Heitz, Eric / Hanika, Johannes / d'Eon, Eugene / Dachsbacher, Carsten | 2016
1
G 1 non-uniform Catmull-Clark surfaces
Li, Xin / Finnigan, G / Sederberg, Thomas | 2016
1
Realtime 3D eye gaze animation using a single RGB camera
Wang, Congyi / Shi, Fuhao / Xia, Shihong / Chai, Jinxiang | 2016
1
The sketchy database
Sangkloy, Patsorn / Burnell, Nathan / Ham, Cusuh / Hays, James | 2016
1
Binary continuous image decomposition for multi-view display
Koutaki, Gou | 2016
1
A system for rapid exploration of shader optimization choices
He, Yong / Foley, Tim / Fatahalian, Kayvon | 2016
1
Mesh arrangements for solid geometry
Zhou, Qingnan / Grinspun, Eitan / Zorin, Denis / Jacobson, Alec | 2016
1
Fusion4D
Dou, Mingsong / Khamis, Sameh / Degtyarev, Yury / Davidson, Philip / Fanello, Sean / Kowdle, Adarsh / Escolano, Sergio / Rhemann, Christoph / Kim, David / Taylor, Jonathan et al. | 2016
1
Emulating displays with continuously varying frame rates
Templin, Krzysztof / Didyk, Piotr / Myszkowski, Karol / Seidel, Hans-Peter | 2016
1
Perceptual effect of shoulder motions on crowd animations
Hoyet, Ludovic / Olivier, Anne-Helene / Kulpa, Richard / Pettré, Julien | 2016
1
Learning how objects function via co-analysis of interactions
Hu, Ruizhen / van Kaick, Oliver / Wu, Bojian / Huang, Hui / Shamir, Ariel / Zhang, Hao | 2016
1
Interactive sketching of urban procedural models
Nishida, Gen / Garcia-Dorado, Ignacio / Aliaga, Daniel / Benes, Bedrich / Bousseau, Adrien | 2016
1
Reflectance modeling by neural texture synthesis
Aittala, Miika / Aila, Timo / Lehtinen, Jaakko | 2016
1
Multiphase SPH simulation for interactive fluids and solids
Yan, Xiao / Jiang, Yun-Tao / Li, Chen-Feng / Martin, Ralph / Hu, Shi-Min | 2016
1
Bounded distortion harmonic shape interpolation
Chien, Edward / Chen, Renjie / Weber, Ofir | 2016
1
Surface-only liquids
Da, Fang / Hahn, David / Batty, Christopher / Wojtan, Chris / Grinspun, Eitan | 2016
1
An interaction-aware, perceptual model for non-linear elastic objects
Piovarči, Michal / Levin, David / Rebello, Jason / Chen, Desai / Ďurikovič, Roman / Pfister, Hanspeter / Matusik, Wojciech / Didyk, Piotr | 2016
1
A semi-implicit material point method for the continuum simulation of granular materials
Daviet, Gilles / Bertails-Descoubes, Florence | 2016
1
A deep learning framework for character motion synthesis and editing
Holden, Daniel / Saito, Jun / Komura, Taku | 2016
1
Real-time rendering on a power budget
Wang, Rui / Yu, Bowen / Marco, Julio / Hu, Tianlei / Gutierrez, Diego / Bao, Hujun | 2016
1
Position-normal distributions for efficient rendering of specular microstructure
Yan, Ling-Qi / Hašan, Miloš / Marschner, Steve / Ramamoorthi, Ravi | 2016
1
Artist-directed dynamics for 2D animation
Bai, Yunfei / Kaufman, Danny / Liu, C / Popović, Jovan | 2016
1
Shadow theatre
Won, Jungdam / Lee, Jehee | 2016
1
Additive light field displays
Lee, Seungjae / Jang, Changwon / Moon, Seokil / Cho, Jaebum / Lee, Byoungho | 2016
1
Motion graphs for unstructured textured meshes
Prada, Fabián / Kazhdan, Misha / Chuang, Ming / Collet, Alvaro / Hoppe, Hugues | 2016
1
ProxImaL
Heide, Felix / Diamond, Steven / Nießner, Matthias / Ragan-Kelley, Jonathan / Heidrich, Wolfgang / Wetzstein, Gordon | 2016
1
Painting style transfer for head portraits using convolutional neural networks
Selim, Ahmed / Elgharib, Mohamed / Doyle, Linda | 2016
1
Practical multispectral lighting reproduction
LeGendre, Chloe / Yu, Xueming / Liu, Dai / Busch, Jay / Jones, Andrew / Pattanaik, Sumanta / Debevec, Paul | 2016
1
Learning to simplify
Simo-Serra, Edgar / Iizuka, Satoshi / Sasaki, Kazuma / Ishikawa, Hiroshi | 2016
1
Efficient GPU rendering of subdivision surfaces using adaptive quadtrees
Brainerd, Wade / Foley, Tim / Kraemer, Manuel / Moreton, Henry / Nießner, Matthias | 2016
1
Procedural voronoi foams for additive manufacturing
Martínez, Jonàs / Dumas, Jérémie / Lefebvre, Sylvain | 2016
1
Terrain-adaptive locomotion skills using deep reinforcement learning
Peng, Xue / Berseth, Glen / van de Panne, Michiel | 2016
1
CofiFab
Song, Peng / Deng, Bailin / Wang, Ziqi / Dong, Zhichao / Li, Wei / Fu, Chi-Wing / Liu, Ligang | 2016
1
Beyond developable
Konaković, Mina / Crane, Keenan / Deng, Bailin / Bouaziz, Sofien / Piker, Daniel / Pauly, Mark | 2016
1
ZoeMatrope
Miyashita, Leo / Ishihara, Kota / Watanabe, Yoshihiro / Ishikawa, Masatoshi | 2016
1
Rigel
Hegarty, James / Daly, Ross / DeVito, Zachary / Ragan-Kelley, Jonathan / Horowitz, Mark / Hanrahan, Pat | 2016
1
Computational design of reconfigurables
Garg, Akash / Jacobson, Alec / Grinspun, Eitan | 2016
1
A compiler for 3D machine knitting
McCann, James / Albaugh, Lea / Narayanan, Vidya / Grow, April / Matusik, Wojciech / Mankoff, Jen / Hodgins, Jessica | 2016
1
Sky is not the limit
Tsai, Yi-Hsuan / Shen, Xiaohui / Lin, Zhe / Sunkavalli, Kalyan / Yang, Ming-Hsuan | 2016
1
Subdivision exterior calculus for geometry processing
de Goes, Fernando / Desbrun, Mathieu / Meyer, Mark / DeRose, Tony | 2016
1
Schrödinger's smoke
Chern, Albert / Knöppel, Felix / Pinkall, Ulrich / Schröder, Peter / Weißmann, Steffen | 2016
1
Rich360
Lee, Jungjin / Kim, Bumki / Kim, Kyehyun / Kim, Younghui / Noh, Junyong | 2016
1
Cinema 3D
Efrat, Netalee / Didyk, Piotr / Foshey, Mike / Matusik, Wojciech / Levin, Anat | 2016
1
Body talk
Streuber, Stephan / Quiros-Ramirez, M / Hill, Matthew / Hahn, Carina / Zuffi, Silvia / O'Toole, Alice / Black, Michael | 2016
1
Wasserstein barycentric coordinates
Bonneel, Nicolas / Peyré, Gabriel / Cuturi, Marco | 2016
1
Rig animation with a tangible and modular input device
Glauser, Oliver / Ma, Wan-Chun / Panozzo, Daniele / Jacobson, Alec / Hilliges, Otmar / Sorkine-Hornung, Olga | 2016
1
Multi-scale rendering of scratched materials using a structured SV-BRDF model
Raymond, Boris / Guennebaud, Gaël / Barla, Pascal | 2016
1
GazeStereo3D
Kellnhofer, Petr / Didyk, Piotr / Myszkowski, Karol / Hefeeda, Mohamed / Seidel, Hans-Peter / Matusik, Wojciech | 2016
1
Pose-space subspace dynamics
Xu, Hongyi / Barbič, Jernej | 2016
1
Let there be color
Iizuka, Satoshi / Simo-Serra, Edgar / Ishikawa, Hiroshi | 2016
1
Globally optimal toon tracking
Zhu, Haichao / Liu, Xueting / Wong, Tien-Tsin / Heng, Pheng-Ann | 2016
1
Automatic triage for a photo series
Chang, Huiwen / Yu, Fisher / Wang, Jue / Ashley, Douglas / Finkelstein, Adam | 2016
1
Lightweight eye capture using a parametric model
Bérard, Pascal / Bradley, Derek / Gross, Markus / Beeler, Thabo | 2016
1
Toward animating water with complex acoustic bubbles
Langlois, Timothy / Zheng, Changxi / James, Doug | 2016
1
Spectral style transfer for human motion between independent actions
Yumer, M / Mitra, Niloy | 2016
1
Bijective maps from simplicial foliations
Campen, Marcel / Silva, Cláudio / Zorin, Denis | 2016
1
Acoustic voxels
Li, Dingzeyu / Levin, David / Matusik, Wojciech / Zheng, Changxi | 2016
1
RAID
Guerrero, Paul / Mitra, Niloy / Wonka, Peter | 2016
1
Modeling dense inflorescences
Owens, Andrew / Cieslak, Mikolaj / Hart, Jeremy / Classen-Bockhoff, Regine / Prusinkiewicz, Przemyslaw | 2016
1
Fast and exact discrete geodesic computation based on triangle-oriented wavefront propagation
Qin, Yipeng / Han, Xiaoguang / Yu, Hongchuan / Yu, Yizhou / Zhang, Jianjun | 2016
1
Legible compact calligrams
Zou, Changqing / Cao, Junjie / Ranaweera, Warunika / Alhashim, Ibraheem / Tan, Ping / Sheffer, Alla / Zhang, Hao | 2016
1
JALI
Edwards, Pif / Landreth, Chris / Fiume, Eugene / Singh, Karan | 2016
1
Erosion thickness on medial axes of 3D shapes
Yan, Yajie / Sykes, Kyle / Chambers, Erin / Letscher, David / Ju, Tao | 2016
1
Preserving geometry and topology for fluid flows with thin obstacles and narrow gaps
Azevedo, Vinicius / Batty, Christopher / Oliveira, Manuel | 2016
1
Perspective-aware manipulation of portrait photos
Fried, Ohad / Shechtman, Eli / Goldman, Dan / Finkelstein, Adam | 2016
1
Drucker-prager elastoplasticity for sand animation
Klár, Gergely / Gast, Theodore / Pradhana, Andre / Fu, Chuyuan / Schroeder, Craig / Jiang, Chenfanfu / Teran, Joseph | 2016
1
Roto
Li, Wenbin / Viola, Fabio / Starck, Jonathan / Brostow, Gabriel / Campbell, Neill | 2016
1
Soli
Lien, Jaime / Gillian, Nicholas / Karagozler, M / Amihood, Patrick / Schwesig, Carsten / Olson, Erik / Raja, Hakim / Poupyrev, Ivan | 2016
1
Computational network design from functional specifications
Peng, Chi-Han / Yang, Yong-Liang / Bao, Fan / Fink, Daniel / Yan, Dong-Ming / Wonka, Peter / Mitra, Niloy | 2016
1
Point registration via efficient convex relaxation
Maron, Haggai / Dym, Nadav / Kezurer, Itay / Kovalsky, Shahar / Lipman, Yaron | 2016
1
Connected fermat spirals for layered fabrication
Zhao, Haisen / Gu, Fanglin / Huang, Qi-Xing / Garcia, Jorge / Chen, Yong / Tu, Changhe / Benes, Bedrich / Zhang, Hao / Cohen-Or, Daniel / Chen, Baoquan | 2016
1
Seamless visual sharing with color vision deficiencies
Shen, Wuyao / Mao, Xiangyu / Hu, Xinghong / Wong, Tien-Tsin | 2016
1
Generalized non-reflecting boundaries for fluid re-simulation
Bojsen-Hansen, Morten / Wojtan, Chris | 2016
1
Efficient dynamic skinning with low-rank helper bone controllers
Mukai, Tomohiko / Kuriyama, Shigeru | 2016
1
Designing structurally-sound ornamental curve networks
Zehnder, Jonas / Coros, Stelian / Thomaszewski, Bernhard | 2016
1
Crowd-driven mid-scale layout design
Feng, Tian / Yu, Lap-Fai / Yeung, Sai-Kit / Yin, KangKang / Zhou, Kun | 2016
1
AutoHair
Chai, Menglei / Shao, Tianjia / Wu, Hongzhi / Weng, Yanlin / Zhou, Kun | 2016
1
Computational imaging with multi-camera time-of-flight systems
Shrestha, Shikhar / Heide, Felix / Heidrich, Wolfgang / Wetzstein, Gordon | 2016
1
HexEx
Lyon, Max / Bommes, David / Kobbelt, Leif | 2016
1
Entropic metric alignment for correspondence problems
Solomon, Justin / Peyré, Gabriel / Kim, Vladimir / Sra, Suvrit | 2016
1
Accelerated quadratic proxy for geometric optimization
Kovalsky, Shahar / Galun, Meirav / Lipman, Yaron | 2016
1
Real-time facial animation with image-based dynamic avatars
Cao, Chen / Wu, Hongzhi / Weng, Yanlin / Shao, Tianjia / Zhou, Kun | 2016
1
Computational design of stable planar-rod structures
Miguel, Eder / Lepoutre, Mathias / Bickel, Bernd | 2016
1
Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences
Taylor, Jonathan / Bordeaux, Lucas / Cashman, Thomas / Corish, Bob / Keskin, Cem / Sharp, Toby / Soto, Eduardo / Sweeney, David / Valentin, Julien / Luff, Benjamin et al. | 2016
1
All-hex meshing using closed-form induced polycube
Fang, Xianzhong / Xu, Weiwei / Bao, Hujun / Huang, Jin | 2016
1
Task-based locomotion
Agrawal, Shailen / van de Panne, Michiel | 2016
Feedback