

Home page 
Announcements
General Information
OverviewAudio processing is a huge field, so this course will necessarily be eclectic rather than comprehensive. The first half of the course will cover fundamentals in signal processing, pattern recognition, acoustics and auditory perception. In the second half we will look at several application areas, including psychoacoustic compression schemes (such as MP3), speech recognition, music analysis and retrieval, and sound mixture organization. ObjectivesThis course will give students a foundation in current audio and recognition technologies. One objective is to build up a familiarity with the perceptuallysalient aspects of the audio signal, and how they can be extracted and manipulated through signal processing. A second related but separate objective is to obtain a thorough understanding of the statistical pattern recognition technology at the core of contemporary speech and audio recognition systems. Thirdly, the course aims to deepen each student's familiarity with the practical application of signal processing in general, through the study of specific instances, and through the experience of the term project. PrerequisitesThe course assumes a familiarity with signals and systems. We will be working in the discretetime domain, so a basic DSP course such as ELEN E4810 is most suitable. The material on pattern recognition assumes a basic familiarity with probability, including Bayes' theory. Grade structureThe course consists of lectures each week, weekly problem sets, a midterm event, and a final project. The grade will be broken down as follows:
The midterm portion of the grade comes from a collective assessment of the midterm project proposals i.e. each student will make a brief presentation of their proposed projects, and the other students will assign the grades based on the quality of the project and presentation. HomeworkProblem sets will be announced on the problem sets page of this web site directly after each lecture. They will be due by the time of the following lecture, at which time the solutions will be posted on the website. Late problems sets will not be accepted. Most problem sets will include some kind of practical that will be run under the numerical computation package Matlab; you will need access to a machine running this software. For more information, see the course Matlab page. ProjectsFor details and suggestions, see the separate projects page. Course outlineSee the course outline page. AcknowledgmentThis material is based in part upon work supported by the National Science Foundation under Grant No. IIS0238301. Any opinions, findings and conclusions or recomendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation (NSF). Dan Ellis <dpwe@ee.columbia.edu> Last updated: Thu Jan 22 08:58:58 EST 2009 