[Paper Review] Framing Visual Musicology through Methodology Transfer

Matthias Miller, Hanna Schäfer+4 more|arXiv (Cornell University)|Aug 21, 2019

Music and Audio Processing57 references4 citations

TL;DR

This position paper introduces Visual Musicology as an interdisciplinary field merging musicology and visual analytics, proposing methodology transfer to adapt established visualization techniques from text, geospatial, time-series, and high-dimensional data domains to solve complex musicological problems. The key contribution is a structured framework for identifying transferable solutions, enabling collaborative innovation between musicologists and visualization researchers while highlighting research gaps and future opportunities.

ABSTRACT

In this position paper, we frame the field of Visual Musicology by providing an overview of well-established musicological sub-domains and their corresponding analytic and visualization tasks. To foster collaborative, interdisciplinary research, we discuss relevant data and domain characteristics. We give a description of the problem space, as well as the design space of musicology and discuss how existing problem-design mappings or solutions from other fields can be transferred to musicology. We argue that, through methodology transfer, established methods can be exploited to solve current musicological problems and show exemplary mappings from analytics fields related to text, geospatial, time-series, and other high-dimensional data to musicology. Finally, we point out open challenges, discuss research gaps, and highlight future research opportunities.

Motivation & Objective

• To frame Visual Musicology as a distinct interdisciplinary research field at the intersection of musicology and visual analytics.
• To identify and map existing visualization solutions from other domains—such as text, geospatial, time-series, and high-dimensional data—to musicological problems.
• To address the underdevelopment of visualization in musicology by proposing a methodology transfer model (MTM) to repurpose proven techniques.
• To highlight research gaps and open challenges in visual musicology, motivating new collaborative research between musicologists and visualization experts.
• To demonstrate the potential of visual analytics in enabling musicologists to uncover complex patterns in large, diverse musicological datasets.

Proposed method

• The paper defines the problem space and design space of visual musicology by analyzing data characteristics, user needs, domains, and goals, analogous to established frameworks like TextVis.
• It identifies parallels between musicology and other domains by comparing data types, analytical tasks, and visualization challenges across text, geospatial, temporal, and high-dimensional data applications.
• The methodology transfer model (MTM) is applied to map existing visualization solutions from non-music domains to musicological use cases, enabling reuse and adaptation.
• Three exemplary use cases are presented to illustrate how visualization techniques from text, time-series, and high-dimensional data analytics can be transferred to musicological problems.
• The approach emphasizes domain-driven design, where musicological needs guide the adaptation of visualization methods rather than forcing methods into ill-fitting contexts.
• The framework encourages collaboration by positioning musicologists as domain experts and visualization researchers as methodological partners, fostering co-creation of new tools.

Experimental results

Research questions

• RQ1 How can visualization techniques from well-established domains such as text, geospatial, time-series, and high-dimensional data be meaningfully transferred to musicological research problems?
• RQ2 What are the key similarities and differences between the problem spaces of musicology and other visualization domains in terms of data, users, and analytical goals?
• RQ3 Which visualization solutions from existing domains are most readily adaptable to musicological tasks such as analyzing musical structure, emotion, or performance gestures?
• RQ4 What are the major research gaps in visual musicology that cannot be addressed by direct transfer and thus require novel visualization techniques?
• RQ5 How can interdisciplinary collaboration between musicologists and visualization researchers be structured to maximize mutual benefit and innovation?

Key findings

• The field of visual musicology remains underdeveloped compared to other domains, with limited dedicated visualization research despite growing data availability and complex analytical needs.
• Existing visualization techniques from text, geospatial, time-series, and high-dimensional data domains can be meaningfully transferred to musicological problems, offering immediate pathways for innovation.
• Methodology transfer enables researchers to leverage decades of prior work in visualization, reducing redundant development and accelerating progress in musicology.
• The integration of visual analytics can significantly enhance musicologists’ ability to explore and interpret complex datasets, such as performance gestures, emotional responses, or large-scale music collections.
• The proposed MTM framework identifies specific research gaps where new visualization techniques are required, particularly for embodied music cognition and multimodal music data.
• Collaboration between musicologists and visualization researchers is not only beneficial but essential for advancing both fields, with musicology offering unique, complex problems and visualization research providing proven methodological tools.