[Paper Review] Comparative Layouts Revisited: Design Space, Guidelines, and Future Directions

Sehi L’Yi, Jaemin Jo+1 more|arXiv (Cornell University)|Sep 1, 2020

Data Visualization and Analytics42 references4 citations

TL;DR

This paper presents a systematic review of 127 research papers on comparative layouts—juxtaposition, superposition, and explicit-encoding—to resolve terminology confusion and inconsistent usage in visualization design. By analyzing 15 quantitative user studies, the authors establish a refined design space with clear terminology (e.g., chart-wise vs. item-wise juxtaposition), identify trade-offs, and propose seven actionable guidelines for effective visual comparison, offering a reusable framework for researchers and practitioners in information visualization.

ABSTRACT

We present a systematic review on three comparative layouts (i.e., juxtaposition, superposition, and explicit-encoding) which are information visualization (InfoVis) layouts designed to support comparison tasks. For the last decade, these layouts have served as fundamental idioms in designing many visualization systems. However, we found that the layouts have been used with inconsistent terms and confusion, and the lessons from previous studies are fragmented. The goal of our research is to distill the results from previous studies into a consistent and reusable framework. We review 127 research papers, including 15 papers with quantitative user studies, which employed comparative layouts. We first alleviate the ambiguous boundaries in the design space of comparative layouts by suggesting lucid terminology (e.g., chart-wise and item-wise juxtaposition). We then identify the diverse aspects of comparative layouts, such as the advantages and concerns of using each layout in the real-world scenarios and researchers' approaches to overcome the concerns. Building our knowledge on top of the initial insights gained from the Gleicher et al.'s survey, we elaborate on relevant empirical evidence that we distilled from our survey (e.g., the actual effectiveness of the layouts in different study settings) and identify novel facets that the original work did not cover (e.g., the familiarity of the layouts to people). Finally, we show the consistent and contradictory results on the performance of comparative layouts and offer practical implications for using the layouts by suggesting trade-offs and seven actionable guidelines.

Motivation & Objective

• To resolve long-standing confusion in terminology and inconsistent application of comparative layouts—juxtaposition, superposition, and explicit-encoding—in information visualization research.
• To systematize fragmented insights from prior studies into a consistent, reusable framework for designing comparative visualizations.
• To identify practical trade-offs and design considerations for real-world deployment of comparative layouts.
• To propose seven actionable guidelines based on empirical evidence and emerging research gaps.
• To extend the foundational work of Gleicher et al. [19] by incorporating new facets such as user familiarity and perceptual heuristics.

Proposed method

• Conducted a systematic literature review of 127 research papers citing Gleicher et al. [19], focusing on those employing comparative layouts.
• Identified and classified 15 papers with quantitative user studies to extract empirical evidence on layout effectiveness.
• Introduced refined terminology (e.g., chart-wise and item-wise juxtaposition) to clarify ambiguous boundaries in the design space.
• Aggregated pairwise layout comparisons across 15 studies to map consistent and contradictory performance results.
• Analyzed factors such as difference size, task type (local vs. global), and scalability to assess layout performance.
• Developed a web-based visualization gallery using a flexible grammar to explore the design space interactively.

Experimental results

Research questions

• RQ1 How do different terminologies and classifications of comparative layouts lead to confusion in visualization research?
• RQ2 What are the consistent and contradictory performance outcomes of juxtaposition, superposition, and explicit-encoding across varying task types and study settings?
• RQ3 How do perceptual heuristics and user familiarity influence the effectiveness of comparative layouts?
• RQ4 What are the scalability limitations of each layout when comparing more than two visualizations?
• RQ5 What design trade-offs and practical guidelines emerge from real-world evaluation and user study findings?

Key findings

• Chart-wise juxtaposition outperformed item-wise juxtaposition in certain global comparison tasks, such as identifying correlations between bar charts, while stacked arrangements were superior for comparing means.
• Superposition was not consistently superior for detecting small differences; in some cases, juxtaposition performed better, particularly for global characteristics, challenging the long-held assumption of superposition’s dominance in sensitivity.
• The effectiveness of layouts varied significantly based on the nature of the difference (local vs. global) and visual representation, indicating that layout choice must be context-dependent.
• Juxtaposition and superposition showed limited scalability for more than two visualizations, while explicit-encoding demonstrated better potential in multi-visualization scenarios, though it was less preferred for small-scale comparisons.
• User familiarity and perceptual heuristics significantly influenced performance, with some users favoring arrangements that align with natural visual scanning patterns.
• The study revealed inconsistent findings across user studies, particularly for global tasks, highlighting the need for more controlled, systematic evaluation of layout performance under varying conditions.