DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels (Unknown language)

in Symposium on Geometry Processing 2017- Posters; 3-4

In the context of scene understanding, a variety of methods exists to estimate different information channels from mono or stereo images, including disparity, depth, and normals. Although several advances have been reported in the recent years for these tasks, the estimated information is often imprecise particularly near depth contours or creases. Studies have however shown that precisely such depth edges carry critical cues for the perception of shape, and play important roles in tasks like depth-based segmentation or foreground selection. Unfortunately, the currently extracted channels often carry conflicting signals, making it difficult for subsequent applications to effectively use them. In this paper, we focus on the problem of obtaining high-precision depth edges by jointly analyzing such unreliable information channels. We propose DEPTHCUT, a data-driven fusion of the channels using a convolutional neural network trained on a large dataset with known depth. The resulting depth edges can be used for segmentation, decomposing a scene into segments with relatively smooth depth, or improving the accuracy of the depth estimate near depth edges by constraining its gradients to agree with these edges. Quantitative experiments show that our depth edges result in an improved segmentation performance compared to a more naive channel fusion. Qualitatively, we demonstrate that the depth edges can be used for superior segmentation and an improved depth estimate near depth edges.

Commercial: €17.50 Academic: €4.50

Download for a fee

Document information

Table of contents conference proceedings

The table of contents of the conference proceedings is generated automatically, so it can be incomplete, although all articles are available in the TIB.

Sequentially-Defined Compressed Modes via ADMM
Houston, Kevin | 2017
DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels
Guerrero, Paul / Winnemöller, Holger / Li, Wilmot / Mitra, Niloy J. | 2017
Localized Manifold Harmonics for Spectral Shape Analysis
Melzi, Simone / Rodolà, Emanuele / Castellani, Umberto / Bronstein, Michael M. | 2017
A Primal-to-Primal Discretization of Exterior Calculus on Polygonal Meshes
Ptackova, Lenka / Velho, Luiz | 2017
Schrödinger Operator for Sparse Approximation of 3D Meshes
Choukroun, Yoni / Pai, Gautam / Kimmel, Ron | 2017
PCR: A Geometric Cocktail for Triangulating Point Clouds Beautifully Without Angle Bounds
Leitão, Gonçalo N. V. / Gomes, Abel J. P. | 2017

Similar titles