xie06asilomar

Lexing Xie, Dong Xu, Shahram Ebadollahi, Katya Scheinberg, Shih-Fu Chang, John R. Smith. Detecting Generic Visual Events with Temporal Cues. In Proc. 40th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, October 2006.

Download [help]

Download paper: Adobe portable document (pdf)

Copyright notice:This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We present novel algorithms for detecting generic visual events from video. Target event models will produce binary decisions on each shot about classes of events involving object actions and their interactions with the scene, such as {airplane taking off}, {exiting car}, {riot}. While event detection has been studied in scenarios with strong scene and imaging assumptions, the detection of generic visual events from an unconstrained domain such as broadcast news has not been explored. This work extends our recent work \cite{ebadollahi06event} on event detection by (1) using a novel bag-of-features representation along with the earth movers' distance to account for the temporal variations within a shot, (2) learn the importance among input modalities with a double-convex combination along both different kernels and different support vectors, which is in turn solved via multiple kernel learning. Experiments show that the bag-of-features representation significantly outperforms the static baseline; multiple kernel learning yields promising performance improvement while providing intuitive explanations for the importance of the input kernels

Contact

Lexing Xie
Dong Xu
Shahram Ebadollahi
Shih-Fu Chang

BibTex Reference

@InProceedings{xie06asilomar,
   Author = {Xie, Lexing and Xu, Dong and Ebadollahi, Shahram and Scheinberg, Katya and Chang, Shih-Fu and R. Smith, John},
   Title = {Detecting Generic Visual Events with Temporal Cues},
   BookTitle = {Proc. 40th Asilomar Conference on Signals, Systems, and Computers},
   Address = {Pacific Grove, CA},
   Month = {October},
   Year = {2006}
}

EndNote Reference [help]

Get EndNote Reference (.ref)

For problems or questions regarding this web site contact The Web Master.