[Paper Review] SWift -- A SignWriting improved fast transcriber

Claudia S. Bianchini, Fabrizio Borgia+2 more|arXiv (Cornell University)|May 21, 2012

Hearing Impairment and CommunicationPsychology7 references10 citations

TL;DR

SWift is a modular, user-friendly SignWriting editor designed to accelerate the creation of sign language representations using intuitive glyph-based composition. By replacing linear menu navigation with a multi-criteria, interactive Choose Box system, it reduces user effort and improves accessibility for deaf users and linguists, achieving high usability in initial evaluations with deaf participants.

ABSTRACT

We present SWift (SignWriting improved fast transcriber), an advanced editor for computer-aided writing and transcribing using SignWriting (SW). SW is devised to allow deaf people and linguists alike to exploit an easy-to-grasp written form of (any) sign language. Similarly, SWift has been developed for everyone who masters SW, and is not exclusively deaf-oriented. Using SWift, it is possible to compose and save any sign, using elementary components called glyphs. A guided procedure facilitates the composition process. SWift is aimed at helping to break down the "electronic" barriers that keep the deaf community away from Information and Communication Technology (ICT). The editor has been developed modularly and can be integrated everywhere the use of SW, as an alternative to written vocal language, may be advisable.

Motivation & Objective

• To address the lack of effective digital tools for creating and using SignWriting (SW) in ICT environments.
• To overcome usability barriers in existing SW editors like SignMaker (SM), particularly slow navigation and poor discoverability of glyphs.
• To develop a modular, extensible editor that supports both deaf users and linguists in composing and saving complex signs using SW.
• To improve accessibility of sign language writing by reducing reliance on video and enabling text-based interaction, search, and note-taking.
• To validate the interface with deaf users through a customized usability study using signed video and SL-based questionnaires.

Proposed method

• The system uses a novel glyph selection interface based on multiple, independent Choose Boxes for different glyph features (e.g., hand configuration, rotation, number of fingers).
• Each Choose Box presents compatible options for a specific sign component, and real-time filtering updates the glyph panel as choices are made or changed.
• The interface avoids linear menu hierarchies by allowing users to select features in any order, reducing cognitive load and navigation time.
• A central Sign Display area allows real-time drag-and-drop of selected glyphs, with immediate visual feedback.
• The system integrates a modular architecture to support integration into broader web applications and e-learning platforms.
• A usability study adapted the Think-Aloud Protocol using a projector to record signed expressions and screen interactions, with tasks and questionnaires delivered in both sign and written language.

Experimental results

Research questions

• RQ1 How can a SignWriting editor be redesigned to reduce navigation time and improve discoverability of glyphs for deaf users?
• RQ2 To what extent does a multi-criteria, non-linear glyph selection interface outperform traditional hierarchical menus in sign composition?
• RQ3 Can a usability evaluation framework adapted for deaf users—using signed video and SL-based questionnaires—yield reliable and actionable feedback?
• RQ4 How do deaf users perceive the usability of a SW editor that supports complex sign composition through structured, feature-based selection?
• RQ5 What interface patterns best support efficient and intuitive sign creation while maintaining the expressive richness of SignWriting?

Key findings

• The multi-criteria Choose Box interface significantly reduced navigation time and cognitive load compared to hierarchical menus in SignMaker.
• Deaf users preferred making single feature choices first and then browsing the resulting set of ~400 glyphs, indicating a need for better visual signaling of multi-selection capability.
• The lack of visible glyphs on the home screen misled users, suggesting that interface expectations shaped by prior tools like SignMaker influenced usability perception.
• The usability study confirmed high reliability of responses through a signed questionnaire, with participants expressing strong appreciation for the test modality and final evaluation.
• The system achieved low error rates with interface controls, indicating effective design of core interaction elements such as the wastebasket icon and navigation buttons.
• Overall, the evaluation demonstrated strong usability and user satisfaction, with clear trends supporting further refinement of the interface and interaction model.