[Paper Review] Case Study on Using Colours in Constructing Emotions by Interactive Digital Narratives

Kuldar Taveter, Eliise Marie Taveter|arXiv (Cornell University)|Apr 25, 2021

Color perception and design40 references4 citations

TL;DR

This paper proposes a method for using color associations to construct emotions in interactive digital narratives (IDNs) by leveraging synesthetic color-emotion mappings. Using goal models to structure protostories like Cinderella, two synesthetes selected colors for eight core emotions and then mapped those to narrative goals, demonstrating a viable framework for emotionally expressive IDNs with empirically grounded color choices.

ABSTRACT

This article addresses the possibility of supporting the construction of emotions in the participants of Interactive Digital Narratives (IDN) by means of colours. The article uses goal models for expressing protostories. The core of the article consists of the case study where two colour synes-thetes were asked to choose colours for eight emotions. Thereafter the same synesthetes were asked to choose colours for the emotions that support the attainment of goals in the Cinderella narrative, which serves as an example protostory. The article also discusses the perspectives for applying the method proposed by us to using colours in constructing emotions by IDNs.

Motivation & Objective

• To investigate how color can be systematically used to evoke and construct specific emotions in interactive digital narratives (IDNs).
• To address the challenge of emotion representation in IDNs by leveraging individualized color-emotion associations from synesthetic participants.
• To develop a method that maps emotional states to colors within a structured narrative framework using goal models.
• To demonstrate the feasibility of applying color-based emotion construction in a prototypical narrative, such as Cinderella.
• To provide a foundation for future IDN design that integrates subjective color-emotion mappings into narrative interactivity.

Proposed method

• Employed goal models to represent protostories, such as the Cinderella narrative, to structure narrative goals and emotional arcs.
• Identified eight core emotions (e.g., joy, sadness, fear) as targets for color mapping based on emotional theory and narrative relevance.
• Recruited two individuals with color-emotion synesthesia to select specific colors for each of the eight emotions based on their personal associations.
• Applied the same synesthetic color choices to map emotional states to narrative milestones in the Cinderella story, aligning colors with emotional transitions.
• Used the resulting color-emotion mappings to inform potential visual and interactive design in IDNs, ensuring emotional consistency.
• Proposed a framework for extending this method to broader IDN applications by integrating subjective color mappings into narrative authoring tools.

Experimental results

Research questions

• RQ1 How can color-emotion synesthesia be systematically applied to construct emotional experiences in interactive digital narratives?
• RQ2 To what extent can goal models in protostories guide the mapping of colors to specific emotional states in narrative progression?
• RQ3 Can individualized color choices from synesthetic participants effectively represent and convey core emotions in a narrative context?
• RQ4 What is the potential of using color mappings to enhance emotional engagement and coherence in IDNs?
• RQ5 How can the proposed method be generalized for use in diverse interactive narrative systems?

Key findings

• The two synesthetes consistently associated specific colors with core emotions, demonstrating reliable and distinct color-emotion mappings.
• Color choices for emotions like joy, sadness, and fear were highly individualized but coherent within each participant’s perceptual framework.
• The method successfully mapped emotional states in the Cinderella narrative to corresponding colors, showing alignment with narrative emotional arcs.
• The integration of goal models with color-emotion mappings enabled a structured, repeatable approach to emotional design in IDNs.
• The case study demonstrated that color can serve as a powerful, intuitive tool for expressing and guiding emotional experiences in interactive storytelling.
• The approach provides a foundation for future IDN systems to incorporate personalized emotional cues through color, enhancing user immersion and affective engagement.