Jump to : Download | Abstract | Contact | BibTex reference | EndNote reference |

sundaram-chang-multimedia-02

Hari Sundaram, Shih-Fu Chang. Computable Scenes and Structures in Films. IEEE Transactions on Multimedia, 4(4):482-491, December 2002.

Download [help]

Download paper: Adobe portable document (pdf)

Copyright notice:This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract

We present a computational scene model and also derive novel algorithms for computing audio and visual scenes and within-scene structures in films. We use constraints derived from film-making rules and from experimental results in the psychology of audition, in our computational scene model. Central to the computational model is the notion of a causal, finite-memory viewer model. We segment the audio and video data separately. In each case, we determine the degree of correlation of the most recent data in the memory with the past. The audio and video scene boundaries are determined using local maxima and minima, respectively. We derive four types of computable scenes that arise due to different kinds of audio and video scene boundary synchronizations. We show how to exploit the local topology of an image sequence in conjunction with statistical tests, to determine dialogs. We also derive a simple algorithm to detect silences in audio. An important feature of our work is to introduce semantic constraints based on structure and silence in our computational model. This results in computable scenes that are more consistent with human observations. The algorithms were tested on a difficult data set: three commercial films. We take the first hour of data from each of the three films. The best results: computational scene detection: 94%; dialogue detection: 91%; and recall 100% precision

Contact

Hari Sundaram
Shih-Fu Chang

BibTex Reference

@article{sundaram-chang-multimedia-02,
   Author = {Sundaram, Hari and Chang, Shih-Fu},
   Title = {Computable Scenes and Structures in Films},
   Journal = {IEEE Transactions on Multimedia},
   Volume = {4},
   Number = {4},
   Pages = {482--491},
   Month = {December},
   Year = {2002}
}

EndNote Reference [help]

Get EndNote Reference (.ref)

 
bar

For problems or questions regarding this web site contact The Web Master.

This document was translated automatically from BibTEX by bib2html (Copyright 2003 © Eric Marchand, INRIA, Vista Project).