Multimodal Sensor Analysis of Sitar Performance: Where is the Beat?

In this paper we describe a system for detecting the tempo of sitar performance using a multimodal signal processing approach. Real-time measurements are obtained from sensors on the instrument and by wearable sensors on the performer's body. Experiments comparing audio-based and sensor-based t...

Full description

Saved in:
Bibliographic Details
Main Authors: Benning, M.S., Kapur, A., Till, B.C., Tzanetakis, G.
Format: Conference Proceeding
Language:English
Subjects:
Filtering
Instruments
kalman filter
Kalman filters
Multimodal sensors
musical multi-modal sensors systems
musical robotics
Performance analysis
Performance evaluation
Real time systems
Sensor fusion
Signal processing
tempo tracking
Wearable sensors
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper we describe a system for detecting the tempo of sitar performance using a multimodal signal processing approach. Real-time measurements are obtained from sensors on the instrument and by wearable sensors on the performer's body. Experiments comparing audio-based and sensor-based tempo tracking are described. The real-time tempo tracking method is based on extracting onsets and applying Kalman filtering. We show how late fusion of the audio and sensor tempo estimates can improve tracking. The obtained results are used to inform design parameters for a real-time system for human-robot musical performance.
DOI:10.1109/MMSP.2007.4412821