%0 Conference Proceedings %F dvmmPub9 %A Oami, Ryoma %A Benitez, Ana B. %A Chang, Shih-Fu %A Dimitrova, Nevenka %T Understanding and Modeling User Interest in Consumer Videos %B IEEE International Conference On Multimedia & Expo (ICME) %C Taipei, Taiwan %X This paper analyzes the interests of users in viewing and organizing consumer videos. It proposes a taxon-omy of relevant concepts with three basic Dimensions Of Interest (DOIs) and effective models to predict the user interest in each dimension. The three DOIs corre-spond to the objects, the scenes and the events. Our conclusions are backed with an extensive study, in which users were asked to annotate and score the im-portance of each DOI in short clips of diverse and real consumer videos. Analysis of the user study data re-veals high consistency (70%) of the scores across dif-ferent users, higher importance of objects and events, and independence between objects and events. In addi-tion, we show how heuristic rules and neural networks can accurately predict these scores using camera mo-tion, foreground object and audio information. The automatic and effective prediction of user interests has the potential for improving automatic applications for annotating and summarizing consumer videos, among others %U http://www.ee.columbia.edu/dvmm/publications/04/icme2004_ryoma.pdf %8 June %D 2004