[Paper Review] Social Robots for People with Developmental Disabilities: A User Study on Design Features of a Graphical User Interface

Xiaodong Wu, Lyn Bartram|arXiv (Cornell University)|Aug 1, 2018

Social Robot Interaction and HRI8 references4 citations

TL;DR

This study evaluates a graphical user interface (GUI) for a social robot designed to assist individuals with developmental disabilities, finding that animated transitions, simplified visuals, and reduced cognitive load significantly improve engagement and comprehension. The research demonstrates that standard UI design principles do not apply universally, especially for users with severe cognitive impairments, and highlights the need for tailored, step-by-step interaction models.

ABSTRACT

Social robots, also known as service or assistant robots, have been developed to improve the quality of human life in recent years. The design of socially capable and intelligent robots can vary, depending on the target user groups. In this work, we assess the effect of social robots' roles, functions, and communication approaches in the context of a social agent providing service or entertainment to users with developmental disabilities. In this paper, we describe an exploratory study of interface design for a social robot that assists people suffering from developmental disabilities. We developed series of prototypes and tested one in a user study that included three residents with various function levels. This entire study had been recorded for the following qualitative data analysis. Results show that each design factor played a different role in delivering information and in increasing engagement. We also note that some of the fundamental design principles that would work for ordinary users did not apply to our target user group. We conclude that social robots could benefit our target users, and acknowledge that these robots were not suitable for certain scenarios based on the feedback from our users.

Motivation & Objective

• To investigate how design features of a graphical user interface (GUI) on a social robot affect engagement and comprehension in individuals with developmental disabilities.
• To identify which GUI design principles—such as animation, color use, and layout—work effectively for users with varying cognitive abilities.
• To adapt human-robot interaction (HRI) design for users with developmental disabilities by drawing on caregiver insights and user feedback.
• To evaluate the effectiveness of a semi-automated Wizard-of-Oz prototype in simulating robot behavior during user testing.
• To inform future development of socially assistive robots by identifying design limitations and user-specific needs.

Proposed method

• Developed a series of GUI prototypes for Aether, a semi-humanoid social robot, focusing on visual clarity, animation, and layout.
• Conducted a user study with three residents with developmental disabilities, using a Wizard-of-Oz setup to simulate robot behavior.
• Recorded interactions for qualitative analysis to assess user affect, attention, and comprehension during GUI interactions.
• Applied cognitive design principles such as proximity, color contrast, and Gestalt laws, while testing their applicability to users with cognitive impairments.
• Implemented animated transitions (resizing, fading, movement) to guide attention and reduce cognitive load during screen changes.
• Categorized users into two groups based on cognitive ability to tailor GUI design and evaluate differential responses.

Experimental results

Research questions

• RQ1 How do animated transitions in a GUI affect user engagement and comprehension in individuals with developmental disabilities?
• RQ2 To what extent do standard graphical user interface design principles (e.g., color contrast, icon familiarity) apply to users with severe cognitive impairments?
• RQ3 How do different levels of cognitive ability influence responses to visual and animated GUI elements in a social robot interface?
• RQ4 What role does the robot’s physical presence play in dual-reference challenges during GUI interaction?
• RQ5 How can GUI design be optimized to support step-by-step task execution for users with limited short-term memory?

Key findings

• Animated transitions such as fading and gradual resizing significantly reduced cognitive perturbation and improved user comprehension during GUI changes.
• Contrastive color schemes, while effective for typical users, were ineffective for individuals with severe cognitive impairments, who struggled with subtle visual changes.
• Residents with higher cognitive abilities responded positively to animated elements, while those with lower cognitive abilities found them distracting and confusing.
• Static, unchanging visuals were more effective for users with limited cognitive capacity, as they reduced processing load and improved focus.
• The robot’s physical presence created dual-reference challenges, as users struggled to process both the robot and the GUI simultaneously.
• A single primary action per screen and step-by-step task presentation were essential for maintaining user coherence and reducing confusion.