Welcome to the homepage of the

Mathematical Optimization Group

Department of Mathematics, University of Tübingen, Germany

Hierarchy of Localized Random Forests for Video Annotation

N.S. Nagaraja, P. Ochs, K. Liu and T. Brox

We address the problem of annotating a video sequence with partial supervision. Given the pixel-wise annotations in the first frame, we aim to propagate these labels ideally throughout the whole video. While some labels can be propagated using optical flow, disocclusion and unreliable flow in some areas require additional cues. To this end, we propose to train localized classifiers on the annotated frame. In con- trast to a global classifier, localized classifiers allow to distinguish colors that appear in both the foreground and the background but at very dif- ferent locations. We design a multi-scale hierarchy of localized random forests, which collectively takes a decision. Cues from optical flow and the classifier are combined in a variational framework. The approach can deal with multiple objects in a video. We present qualitative and quantitative results on the Berkeley Motion Segmentation Dataset.
pdf Bibtex Publisher's link
N.S. Nagaraja, P. Ochs, K. Liu, T. Brox:
Hierarchy of Localized Random Forests for Video Annotation. [pdf]
In A. Pinz, T. Pock, H. Bischof, F. Leberl (Eds.): Pattern Recognition (Proc. DAGM). Lecture Notes in Computer Science, Vol. 7476, Springer, 2012.
  title        = {Hierarchy of Localized Random Forests for Video Annotation},
  author       = {N.S. Nagaraja and P. Ochs and K. Liu and T. Brox},
  year         = {2012},
  editor       = {A. Pinz and T. Pock and H. Bischof and F. Leberl},
  booktitle    = {Pattern Recognition (Proc. DAGM)},
  series       = {Lecture Notes in Computer Science},
  publisher    = {Springer},
  volume       = {7476},

MOP Group
The author is not
responsible for
the content of
external pages.