- June: Defended my PhD thesis on "Large-scale Affective Computing for Visual Multimedia" and joined Google Research. Our work on "Multilingual Visual Sentiment Concept Matching" won the Best Multimodal Paper Award and work on "SentiCart: Cartography and Geo-contextualization for Multilingual Visual Sentiment" won the Best Demo Award at ACM ICMR'16 (read papers). Also, our long paper "Deep Cross Residual Learning for Multitask Visual Recognition" was accepted at ACM Intl. Conf. on Multimedia 2016.
- April: My colleagues Joseph G. Ellis and Dan Morozoff are spinning off our News Rover project into a full-fledged startup (see VidRovr). They also finished an accelerator program with the NYC Media Lab Combine program (read announcement).
- March: Three papers accepted to ACM Intl. Conf. on Multimedia Retrieval (ICMR) 2016 — a long submission on "Multilingual Visual Sentiment Concept Matching" and two technical demos titled "SentiCart: Cartography and Geo-contextualization for Multilingual Visual Sentiment" and "Complura: Exploring and Leveraging a Large-scale Multilingual Visual Sentiment Ontology" (read papers).
- January: My collaborators Joseph G. Ellis and Dan Morozoff are growing our once, small project News Rover under the care and direction of the NYC Media Lab Combine program (read announcement, press release, and spotlight).
- October: Our project on developing a Multilingual Visual Sentiment Ontology (MVSO) was presented at ACM Multimedia 2015 (read paper).
- August: Finished a Google internship with the Machine Perception team, where I built and scaled out new deep video network architectures in DistBelief and TensorFlow. Also, work done by my student Víctor Campos, co-advised with Xavier Giró-i-Nieto at UPC, analyzing CNNs for visual sentiment prediction was accepted to the ACM MM Workshop on Affect and Sentiment in Multimedia (ASM) 2015 (read paper).
- July: Our paper submission titled "Visual Affect Around the World: A Large-scale Multilingual Visual Sentiment Ontology" was accepted to ACM Intl. Conf. on Multimedia 2015 (read paper).
- May: Joined Google's Machine Perception team in Mountain View, CA as a Software Engineering Intern for the summer working on new deep learning architectures with George Toderici, Christian Szegedy, and Rahul Sukthankar.
- March: Our work on predicting perceived emotions in animated GIFs was mentioned on WIRED and featuring work by some colleagues at MIT Media Lab (read article / read paper).
- Feburary: I received my MPhil in Electrical Engineering from Columbia University.
- November: I passed my Thesis Proposal Exam at Columbia University's Electrical Engineering department. Also, our paper on perceived emotion prediction in animated GIFs won the Grand Challenge 3rd Place Award at ACM Multimedia 2014 (read paper).
- October: The NYC Media Lab featured our paper on perceived emotion prediction in animated GIFs in a short news post (read news post / read paper).
- September: We presented two Columbia systems, AICER and News Rover at the NYC Media Lab Annual Summit, and we won the Second Place Demo Award for News Rover. I also received the ACM Multimedia 2014 Student Travel Grant Award.
- August: Finished a research internship with Technicolor Los Altos. Also, our paper titled "Why We Watch the News: A Dataset for Exploring Sentiment in Broadcast Video News" was accepted to ACM Intl. Conf. on Multimodal Interaction 2014 (read paper). And we presented our work on "Structured Exploration of Who, What, When, and Where in Heterogeneous Multimedia News Sources" at NewsKDD 2014.
- July: Our Grand Challenge solution submission titled "Predicting Viewer Perceived Emotions in Animated GIFs" was accepted to ACM Intl. Conf. on Multimedia 2014 (read paper).
- June: I am organizing a new Special Session on Big Data Representation and Processing in Data Science at IEEE Big Data 2014.
- May: Joined Technicolor Research Labs in Los Altos, CA on the Research & Innovation's Studio & Wearable Analytics team as a Research Intern for the summer working on metrics from content-based multimedia and wearable biosensors with Fernando Silveira and Brian Eriksson.
- December: Gave invited talk on News Rover at OTMedia International Conference.
- November: Our system, News Rover, was presented at the NY Tech Meetup (watch feature and Q/A) and was reported on the Alley Watch (read post) and Madison+MountainView (read post). Some of my previous work on Soft Biometrics and Face Recognition at the CMU CyLab Biometrics Center was also featured on CBS Pittsburgh Local News (watch/read here).
- October: Won the overall Grand Challenge 1st Place Award at ACM Multimedia 2013 for work submitted to the Technicolor Grand Challenge track titled "Structured Exploration of Who, What, When, and Where in Heterogeneous Multimedia News Sources" (news also featured here) and was also nominated for the Best Demo Award. I also gave an invited talk at the Universitat Politecnica de Catalunya (UPC) in Barcelona titled "News Rover: Exploring the News | Multi-source, Multimodal, and Personalized".
- September: Awarded Wei Family Private Foundation 2013 Special Scholarship Grant and ACM Multimedia 2013 Student Travel Grant.
- July: Co-authored "News Rover: Exploring Topical Structures and Serendipity in Heterogeneous Multimedia News" and "Structured Exploration of Who, What, When, and Where in Heterogeneous Multimedia News Sources" appearing in ACM Intl. Conf. on Multimedia 2013 (read papers).
- June: Best Demo Award for "News Rover: Exploring Topical Structures and Serendipity in Heterogeneous Multimedia News" at GNY Multimedia & Vision (GNYMV) Workshop.
- May: Some of my previous work on Soft Biometrics and Face/Periocular Recognition at the CMU CyLab Biometrics Center was featured on PBS NewsHour (watch feature), CBS 60 Minutes (watch feature), and Ars Technica (read article).
- April: Journalism think-tank Neiman Journalism Labs featured our lean-back work on Personalized Television News (read article). And the Pittsburgh Post-Gazette featured some my previous work on Poisonous Plant Identification at the CMU CyLab Biometrics Center (read article).
- March: Co-authored "Robust Object Co-Detection" appearing in Computer Vision and Pattern Recognition (CVPR) 2013 (read paper).
- Feburary: CMU release a press release on some of my previous work on Poisonous Plant Identification at the CMU CyLab Biometrics Center (read article). It was also reposted at Examiner.com (read article). And our project Personalized Television News was presented as a poster at the Computation + Journalism Symposium 2013.
- January: Passed Columbia University's Electrical Engineering Doctoral Qualifier Exam (DQE).
- June: Awarded Brown Institute of Media Innovation's Magic Grant.
- April: Awarded National Science & Defense Graduate (NDSEG) Fellowship.
- December: We ranked 5th worldwide of over 8,200 teams in the DARPA Shredder Challenge 2011. An overview of our solution is here.
- September: Began Doctor of Philosophy (PhD) studies in Electrical Engineering at Columbia University under the advisement of Professor Shih-Fu Chang at the Digital Video & Multimedia (DVMM) Lab.
- August: Finished consulting for an Intelligent Infrastructure company specializing in computer vision algorithms to improve the efficiency and profitability of parking facilities, Park Assist.
- July: Co-authored "Fusion of Region-based Representations for Gender Identification" appearing in Intl. Joint Conf. on Biometrics (IJCB) 2011 (read paper).
- May: Graduated from Carnegie Mellon University's Electrical and Computer Engineering Master's of Science (M.S.) program.
- April: Awarded Wei Family Private Foundation 2011 Scholarship Grant and Columbia University's Electrical Engineering Departmental Scholarship.
- August: Selected as an Office of the Director of National Intelligence (ODNI)'s Intelligence Community (IC) Centers of Academic Excellence (CAE) Scholar.
- July: Co-authored "An Exploration of Gender Identification Using Only the Periocular Region" appearing in IEEE Intl. Conf. on Biometrics: Theory, Applications and Systems (BTAS) 2010 (read paper).