Subhabrata Bhattacharya, Felix X. Yu, Shih-Fu Chang. Minimally Needed Evidence for Complex Event Recognition in Unconstrained Videos. In ACM International Conference on Multimedia Retrieval (ICMR), full paper (oral), April 2014.
Download paper:
Adobe portable document (pdf) 
Copyright notice:This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.
This paper addresses the fundamental question - How do humans recognize complex events in videos? Normally, humans view videos in a sequential manner. We hypothesize that humans can make high-level inference such as an event is present or not in a video, by looking at a very small number of frames not necessarily in a linear order. We attempt to verify this cognitive capability of humans and to discover the Minimally Needed Evidence (MNE) for each event. To this end, we introduce an online game based event quiz facilitating selection of minimal evidence required by humans to judge the presence or absence of a complex event in an open source video. Each video is divided into a set of temporally coherent microshots (1.5 secs in length) which are revealed only on player request. The player's task is to identify the positive and negative occurrences of the given target event with minimal number of requests to reveal evidence. Incentives are given to players for correct identification with the minimal number of requests. Our extensive human study using the game quiz validates our hypothesis - 55% of videos need only one microshot for correct human judgment and events of varying complexity require different amounts of evidence for human judgment. In addition, the proposed notion of MNE enables us to select discriminative features, drastically improving speed and accuracy of a video retrieval system
Subhabrata Bhattacharya
FelixX. Yu 
Shih-Fu Chang
@InProceedings{icmr14:mne,
Author = {Bhattacharya, Subhabrata and Yu, Felix X. and Chang, Shih-Fu},
Title = {Minimally Needed Evidence for Complex Event Recognition in Unconstrained Videos},
BookTitle = {ACM International Conference on Multimedia Retrieval (ICMR), full paper (oral)},
Month = {April},
Year = {2014}
}
Get EndNote Reference (.ref)
For problems or questions regarding this web site contact The
Web Master.
This document was translated automatically from BibTEX by bib2html (Copyright 2003 © Eric Marchand, INRIA, Vista Project).