MUSIC SIGNAL PROCESSING

Home page

Course outline

Code

Practicals

Assignments

Columbia Courseworks E4896

Assignments

This page presents the mini-project assignments, as they are assigned.

This project is an extension of this week's practical. In the practical, you experimented with a trained chord recognition system, evaluated over a number of Beatles tracks for which we have manual ground-truth data. The mini project assignment is to spend some more time trying to improve the final accuracy number by whatever means you like.

Unlike most of the material in the course so far, this is a task with a clear, quantitative evaluation goal. This makes it much easier to tell how you are getting on - you can quickly check whether a change makes things better or not. However, it can also be a distraction - beware of spending too much time tuning parameters to achieve the single, absolute maximum value. It's often more important to step back and think of entirely different places you can make changes.

Things you can try could include the areas mentioned in the practical: looking at applying a compressive nonlinearity to the features (or other normalization -- maybe reducing the magnitude of the single largest value, since this is often dominated by the melody line, rather than the accompanying chord); experimenting with modifying the transition matrix, or the balance between the transition matrix probabilities and the probabilities evaluated by the Gaussians, since it is this balance between local match and sequential constraints that gives the HMM its power (raising the probabilities to a power before finding the Viterbi path may help).

For a long time, the only good ground-truth chord label collection was for the Beatles (done by Chris Harte at Queen Mary, London). However, there are now some other collections that have been transcribed in the same way. Here's a small set of 20 tracks by Queen, represented in the same way: chords_data_queen.zip (1.2 MB) along with the list file queenfilelist.txt. This set is probably too small to train useful models, but it could be interesting to test models trained on the beatles on this somewhat "different" data.

I encourage you to try to analyze the kinds of errors that the current system is making by inspecting the confusion matrix, and perhaps the particularly difficult tracks, and seeing if that will guide the kinds of changes you choose to make.

Here are some related papers:

• Chord Segmentation and Recognition using EM-Trained Hidden Markov Models, A. Sheh and D. Ellis, ISMIR-03, 185-191, Baltimore, October 2003. Our first attempt at chord recognition with HMMs. We didn't have any hand-labeled training data, so the paper is mainly about how to deal with that situation (and performance is poor).
• Automatic chord recognition from audio using an HMM with supervised learning, K. Lee and M. Slaney, ISMIR-06, 133-137, Victoria BC, 2006. They used synthesized MIDI to obtain training data that was time-aligned to ground-truth chord labels, and were able to build chord models much like the ones in this mini-project.
• Chord recognition using measures of fit, chord templates, and filtering methods, Laurent Oudre, Yves Grenier, and Cedric Fevotte, WASPAA-09, 9-12, Mohonk NY, Oct. 2009. This approach is based on predefined templates instead of learning them from labeled data, but it works very well.

The project report is due by 5pm on Wednesday, 2013-04-24. Although we are interested to know what accuracies you obtain on the test set, your grade will not be based on this raw measure of achievement. Rather, we will make an assessment of how well you analyzed the situation, how skillfully and originally you approached it, etc.

This miniproject follows on from the autotuning practical. Your assignment is to try to come up with a more usable auto-tune system.

You can make any enhancements or modifications you like, but here are some possible ideas:

• Make it quantize to notes of a scale rather than every semitone. You could even try different scales (major, minor, pentatonic).
• Improve the transitions between notes, perhaps including hysteresis in the quantization (so that it won't change note for vibrato).
• Preserve the vibrato in the original pitch, i.e., small variations around a (corrected) average pitch. This sounds like a good way to make the result sound more "natural", although I haven't actually tried it in practice. You could also introduce artificial vibrato, regardless of the input, although sometimes you might want to "shape" this so it builds up slowly as the note is held.
• Harmonizing - use one input pitch to synthesize several voices at different pitches. Note, to do this in the most "musical" way, the intervals (e.g., a third) should change depending on which note is being sung (e.g., always singing two "white notes" higher).

Here is the Stevie Wonder example of vibrato that I played in class: superstition.wav.

The project is due by 5pm on Wednesday 2013-04-10. As before, you should submit a report of 3 pages or so (as a PDF, please) explaining what you did and how it worked. You should also submit your patch or patches.

The goal of this miniproject is essentially to complete what we tried to do in the analog synthesizer practical - come up with a good emulation of an analog synth sound using Pd.

You should choose one of the sounds either from the Loomer Aspect demo or the Juno-106 examples page, and work to duplicate that sound with your Pd patch. You might want to look at the spectrogram and/or waveforms of the original sounds to figure out what's going on, and to validate your reproduction. Working with an actual voice from the Aspect synth will allow you to actually see how it's put together within that synthesizer, although there's still some detective work to be done to figure out exactly what it does internally.

The project is due by 5pm on Wednesday 2013-02-27. You should submit a report of 3 pages or so (as a PDF, please) explaining what you did and how it worked. You should also submit your patches.

This work is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.
Dan Ellis <dpwe@ee.columbia.edu>
Last updated: Wed Apr 10 09:34:12 AM EDT 2013