[Paper Review] Moving to Communicate, Moving to Interact: Patterns of Body Motion in Musical Duo Performance

Laura Bishop, Carlos Cancino-Chacón+1 more|arXiv (Cornell University)|Nov 20, 2019

Neuroscience and Music Perception60 references88 citations

TL;DR

This study investigates how body motion patterns in piano and clarinet duos support musical coordination and interaction. Using motion capture during rehearsals and performances under varying visual conditions, it finds that visual interaction increases during temporally unstable passages, enhances movement consistency and interperformer coordination, and functions as a social motivator that supports creative risk-taking and ensemble cohesion beyond mere timing coordination.

ABSTRACT

Skilled ensemble musicians coordinate with high precision, even when improvising or interpreting loosely-defined notation. Successful coordination is supported primarily through shared attention to the musical output; however, musicians also interact visually, particularly when the musical timing is irregular. This study investigated the performance conditions that encourage visual signalling and interaction between ensemble members. Piano and clarinet duos rehearsed a new piece as their body motion was recorded. Analyses of head movement showed that performers communicated gesturally following held notes. Gesture patterns became more consistent as duos rehearsed, though consistency dropped again during a final performance given under no-visual-contact conditions. Movements were smoother and interperformer coordination was stronger during irregularly-timed passages than elsewhere in the piece, suggesting heightened visual interaction. Performers moved more after rehearsing than before, and more when they could see each other than when visual contact was occluded. Periods of temporal instability and increased familiarity with the music and co-performer seem to encourage visual interaction, while specific communicative gestures are integrated into performance routines through rehearsal. We propose that visual interaction may support successful ensemble performance by affirming coordination throughout periods of temporal instability and serving as a social motivator to promote creative risk-taking.

Motivation & Objective

• To investigate how body motion patterns support communication and interaction in musical duo performance.
• To examine the influence of musical structure, rehearsal progression, and visual contact on movement consistency and interperformer coordination.
• To distinguish between communicative gestures (signalling) and mutual interaction in ensemble performance.
• To explore whether visual interaction supports coordination beyond audio-based timing cues, particularly in irregularly-timed passages.

Proposed method

• Motion capture was used to record head and body movements of piano and clarinet duos during multiple performance sessions.
• Performances were conducted under three conditions: before rehearsal, during rehearsal, and after rehearsal, with visual contact manipulated (occluded vs. visible).
• Movement kinematics were analyzed for smoothness, amplitude, and interperformer coordination using cross-correlation and Granger causality tests.
• Musical sections were categorized by temporal regularity (e.g., unmetered, held notes, irregular passages) to compare movement patterns across structural features.
• Rehearsal progression was tracked to assess changes in movement consistency and coordination over time.
• Statistical analysis compared movement characteristics across performance phases and visual contact conditions.

Experimental results

Research questions

• RQ1 How does visual contact influence the quantity and coordination of performers’ body movements in musical duos?
• RQ2 In what ways do movement patterns differ between temporally stable and unstable musical passages?
• RQ3 How does rehearsal affect the consistency and communicative function of performers’ gestures?
• RQ4 To what extent do movement patterns reflect interperformer interaction rather than independent expressive interpretation?
• RQ5 What role does visual interaction play in supporting ensemble coordination when audio cues are insufficient?

Key findings

• Performers exhibited significantly more body movement during performances when visual contact was available compared to when it was occluded.
• Interperformer movement coordination was strongest during irregularly-timed passages, indicating heightened visual interaction in conditions of temporal instability.
• Movement consistency increased with rehearsal, suggesting the development of shared performance routines, but declined again under no-visual-contact conditions.
• Granger causality analysis revealed significant unidirectional movement influences between performers during entrances and unmetered sections, indicating active visual interaction.
• The increase in movement and coordination with rehearsal was not solely due to expressive interpretation, as it was dependent on visual feedback, indicating a functional role in interaction.
• Visual interaction appears to serve as a social motivator that supports creative risk-taking and enhances performers’ sense of togetherness, particularly during uncertain or complex musical moments.