[Paper Review] Probing a Self-Developed Aesthetics Measurement Application (SDA) in Measuring Aesthetics of Mandarin Learning Web Page Interfaces

Jasni Mohamad Zain, Mengkar Tey+1 more|arXiv (Cornell University)|Jan 8, 2011

Color perception and design12 references16 citations

TL;DR

This study evaluates a self-developed Aesthetics Measurement Application (SDA) that objectively quantifies visual aesthetics in Mandarin learning web page interfaces by analyzing layout elements such as balance, symmetry, and rhythm. The SDA's rankings closely matched user perceptions, demonstrating that subjective aesthetics can be measured objectively using structured design principles and computational modeling.

ABSTRACT

This article describes the accurateness of our application namely Self-Developed Aesthetics Measurement Application (SDA) in measuring the aesthetics aspect by comparing the results of our application and users' perceptions in measuring the aesthetics of the web page interfaces. For this research, the positions of objects, images element and texts element are defined as objects in a web page interface. Mandarin learning web pages are used in this research. These learning web pages comprised of main pages, learning pages and exercise pages, on the first author's E-portfolio web site. The objects of the web pages were manipulated in order to produce the desired aesthetic values. The six aesthetics related elements used are balance, equilibrium, symmetry, sequence, rhythm, as well as order and complexity. Results from the research showed that the ranking of the aesthetics values of the web page interfaces measured of the users were congruent with the expected perceptions of our designed Mandarin learning web page interfaces (reported also in [18]). Thus, it implies that the subjectivity of aesthetics can be measured in an objective manner. For further understanding on our effort in doing aesthetics measurement, we discussed in details the object modelling used as well as the process in developing this application. We also explained the steps on how to run our application. Additionally, the strength and the weakness of our SDA application shared in this paper suggest that there is still room for the improvement for aesthetics measurement.

Motivation & Objective

• To develop an objective method for measuring visual aesthetics in web page interfaces.
• To validate the SDA application against human perception of aesthetics in Mandarin learning web pages.
• To assess the effectiveness of design elements—balance, symmetry, rhythm, order, and complexity—in shaping perceived aesthetics.
• To explore the feasibility of reducing subjectivity in aesthetics evaluation through computational modeling.
• To identify strengths and limitations of the SDA for future refinement in usability and design evaluation.

Proposed method

• The SDA evaluates web page interfaces by analyzing spatial arrangements of text, image, and object elements based on six aesthetic principles: balance, equilibrium, symmetry, sequence, rhythm, order, and complexity.
• Web page interfaces were generated from the first author’s e-portfolio, including main, learning, and exercise pages, with controlled variations in element positioning.
• Aesthetic values were computed using a rule-based algorithm that assigns scores based on adherence to design principles and their visual impact.
• User perception data was collected through surveys ranking the aesthetic quality of the same interfaces.
• The SDA’s output was compared against user rankings to assess correlation and accuracy.
• The application was implemented as a standalone tool with defined input parameters for layout configuration and aesthetic scoring.

Experimental results

Research questions

• RQ1 Can a computational application accurately measure the aesthetic quality of web page interfaces based on design principles?
• RQ2 To what extent do the SDA’s computed aesthetic scores correlate with human user perceptions of aesthetics?
• RQ3 How do specific design elements—such as symmetry, balance, and rhythm—affect perceived aesthetic value in educational web interfaces?
• RQ4 Can subjective aesthetic judgments be objectively quantified using a structured, rule-based system?
• RQ5 What are the limitations of the current SDA model in capturing nuanced human aesthetic preferences?

Key findings

• The SDA’s computed aesthetic rankings showed strong congruence with user perception rankings, indicating high reliability in measuring aesthetics.
• The application successfully quantified aesthetic values based on design principles like symmetry, balance, and rhythm, with consistent results across multiple interface variations.
• Users perceived interfaces with higher SDA scores as more visually appealing, confirming the model’s alignment with human judgment.
• The study demonstrated that subjective aesthetic evaluation can be objectively modeled through algorithmic analysis of layout composition.
• Despite strong performance, the SDA exhibited limitations in capturing complex or context-dependent aesthetic nuances, suggesting room for improvement.
• The results support the feasibility of using computational tools to standardize and automate aesthetic evaluation in web design, especially in educational contexts.