[Paper Review] As Content and Layout Co-Evolve: TangibleSite for Scaffolding Blind People's Webpage Design through Multimodal Interaction

Jiasheng Li, Zining Zhang+5 more|arXiv (Cornell University)|Feb 22, 2026

Tactile and Sensory Interactions0 citations

TL;DR

The paper investigates how blind designers can co-evolve content and layout in webpage design and introduces TangibleSite, a multimodal Tangible UI that provides real-time feedback for end-to-end web authoring. A formative study with blind participants informs the design and evaluation of the prototype.

ABSTRACT

Creating webpages requires generating content and arranging layout while iteratively refining both to achieve a coherent design, a process that can be challenging for blind individuals. To understand how blind designers navigate this process, we conducted two rounds of co-design sessions with blind participants, using design probes to elicit their strategies and support needs. Our findings reveal a preference for content and layout to co-evolve, but this process requires external support through cues that situate local elements within the broader page structure as well as multimodal interactions. Building on these insights, we developed TangibleSite, an accessible web design tool that provides real-time multimodal feedback through tangible, auditory, and speech-based interactions. TangibleSite enables blind individuals to create, edit, and reposition webpage elements while integrating content and layout decisions. A formative evaluation with six blind participants demonstrated that TangibleSite enabled independent webpage creation, supported refinement across content and layout, and reduced barriers to achieving visually consistent designs.

Motivation & Objective

• Understand how blind designers conceptualize and organize content and layout during webpage creation.
• Identify information that helps detect conflicts between content and layout and maintain page-level consistency.
• Design a tool that supports integrated editing of content and layout for blind web authors.
• Develop TangibleSite to provide real-time multimodal feedback and scaffolding.
• Evaluate whether TangibleSite enables independent webpage creation and iterative refinement.

Proposed method

• Conduct two rounds of co-design sessions with blind participants using a tangible design probe inspired by TangibleGrid.
• Perform qualitative analysis through video, audio transcripts, and thematic analysis to extract workflows and feedback needs.
• Develop TangibleSite as an accessible multimodal web authoring prototype with tangible, audio, and speech interactions.
• Carry out a formative evaluation with six blind participants to assess end-to-end webpage creation and refinement.

Experimental results

Research questions

• RQ1 RQ1: How do blind individuals conceptualize and organize the workflow of content and layout during webpage creation?
• RQ2 RQ2: What information helps blind individuals detect conflicts between local content and layout and maintain page-level consistency?
• RQ3 RQ3: What features and mechanisms should authoring tools provide to resolve global layout consequences of local edits?

Key findings

• Blind designers prefer co-evolving content and layout, but complexity reduces flexibility and increases cognitive load.
• Nonvisual workflows rely on touch for inspection and planning, but need clear interaction modes and feedback to avoid misinterpretation.
• Hands are the primary channel for monitoring and planning, with audio feedback used to resolve ambiguities in content–layout fit.
• Explicit, actionable audio feedback about content capacity and element relationships is highly desired to reduce memory burden.
• TangibleSite supports end-to-end design with real-time multimodal feedback, helping users independently create and refine pages.