Jump to : Download | Abstract | Contact | BibTex reference | EndNote reference |


Joseph G Ellis, Brendan Jou, Shih-Fu Chang. Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News. In ACM International Conference on Multimodal Interaction (ICMI), November 2014.

Download [help]

Download paper: Adobe portable document (pdf)

Copyright notice:This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


We present a multimodal sentiment study performed on a novel collection of videos mined from broadcast and cable television news programs. To the best of our knowledge, this is the first dataset released for studying sentiment in the domain of broadcast video news. We describe our algorithm for the processing and creation of person-specific segments from news video, yielding 929 sentence-length videos, and are annotated via Amazon Mechanical Turk. The spoken transcript and the video content itself are each annotated for their expression of positive, negative or neutral sentiment. Based on these gathered user annotations, we demonstrate for news video the importance of taking into account multimodal information for sentiment prediction, and in particular, challenging previous text-based approaches that rely solely on available transcripts. We show that as much as 21.54\% of the sentiment annotation of users for transcripts differ from their respective sentiment annotations when the video clip itself is presented. We present audio and visual classification baselines over a three-way sentiment prediction of positive, negative and neutral, as well as person-dependent versus person-independent classification influence on performance. Finally, we release the dataset to the greater research community


Joseph Ellis
Brendan Jou
Shih-Fu Chang

BibTex Reference

   Author = {Ellis, Joseph G and Jou, Brendan and Chang, Shih-Fu},
   Title = {Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News},
   BookTitle = {ACM International Conference on Multimodal Interaction (ICMI)},
   Month = {November},
   Year = {2014}

EndNote Reference [help]

Get EndNote Reference (.ref)


For problems or questions regarding this web site contact The Web Master.

This document was translated automatically from BibTEX by bib2html (Copyright 2003 © Eric Marchand, INRIA, Vista Project).