RingoMatic
Sony Computer Science Laboratories, 2002-2006
As part of the music research team of Sony CSL (led by Francois Pachet), I designed and developped several music interactive systems based on real-time audio processing. This aimed to fill the gap between "playing" and "listening" to music: these new instruments use musical materials automatically extracted from arbitrary mp3 files. If you like Ringo Starr, why not ask him to play on your new track?
Joint work with: Francois Pachet, Anthony Beurive, Aymeric Zils, Peter Hanappe.
"It's Ringo Starr in a box. Great Fun" (Paul Lamere,
Duke Listens !)
Our "Ringomatic" system builds automatic accompaniment tracks in real-time by concatenating samples extracted automatically from real music pieces. The samples are selected to both match the properties of the user's interaction and some temporal consistency constraints.
Related publications:
- Aucouturier, J.-J. and Pachet, F. Jamming with plunderphonics: Interactive contatenative synthesis of music. Journal of New Music Research, vol.
35(1), pp. 35-50, 2006.
-
Aucouturier, J.-J. and Pachet, F. Ringomatic: A real-time interactive drummer using constraint-satisfaction and drum sound descriptors. Proceedings of the 6th International Conference on Music Information Retrieval (ISMIR), London, UK, Sept. 2005.
Organ with jazz drumming
This uses extracts (automatic detection) from real jazz drum solo like
this to build an interactive drum track for a human performer (using a midi
keyboard).
When the human performer plays more energetically, the drumtrack
contains more bass drum and toms.
Automatic Sergent Pepper
This uses extracts from the Beatles "Sergent
Pepper" (
extract) (hence, the whole system's name ringomatic, an automatic ringo starr.
When the human performer plays more energetically, the system triggers the drums then loud guitars.
Good vibes
This uses extracts from
the Beach Boys - Good Vibrations (
extract).
When the human performer plays high pitched sounds, the accompaniment is a drumtrack. When medium pitched, the accompaniment gets more energetic.
Raining
This uses sounds from Emilie Simon - Il pleut (
extract).
Jamming with Ringomatic (and, yes, a squeezebox) at ISMIR2005, London UK.