[Paper Review] Towards an Assessment-oriented Model for External Information System Quality Characterization

Abir Elmir, Badr Elmir+1 more|arXiv (Cornell University)|Oct 30, 2013

Service-Oriented Architecture and Web Services26 references3 citations

TL;DR

This paper proposes RatQual, an assessment-oriented model for characterizing external information system quality by integrating internal, external, and in-use quality aspects through a hierarchical categorization. The model enables quantification of environment-dependent quality attributes and is supported by an automated tool for quality monitoring and evolution planning, enhancing systematic ISQ management in complex ecosystems.

ABSTRACT

Information System Quality (ISQ) management discipline requires a set of assessment mechanisms to evaluate external quality characteristics that are influenced by the environmental parameters and impacted by the ecosystem factors. The present paper suggests a new assessment oriented model that takes into consideration all facets of each external quality feature. The proposed model, named RatQual, gives a hierarchical categorization for quality. RatQual is designed to quantify dependent-environment qualities by considering internal, external and in use aspects. This model is supported by a tool that automates the assessment process. This tool gives assistance in quality evolution planning and serves for periodical monitoring operations used to enhance and improve information system quality.

Motivation & Objective

• To address the lack of comprehensive assessment mechanisms for external information system quality (ISQ) influenced by environmental and ecosystem factors.
• To develop a holistic model that captures all facets of external quality characteristics across internal, external, and in-use dimensions.
• To enable systematic, periodic quality monitoring and support quality evolution planning through automation.
• To provide a structured, hierarchical framework for assessing dependent-environment quality attributes in information systems.

Proposed method

• The RatQual model employs a hierarchical categorization of external quality characteristics, integrating internal, external, and in-use aspects into a unified assessment framework.
• It quantifies quality attributes based on environmental parameters and ecosystem influences, enabling measurable evaluation of system quality in real-world contexts.
• The model is operationalized through a dedicated tool that automates quality assessment, reducing manual effort and increasing consistency.
• The tool supports periodic monitoring and generates actionable insights for quality improvement and evolution planning.
• The framework is designed to be extensible, allowing adaptation to different system types and environmental conditions.
• The model is validated through application in a real-world ISQ management context, with feedback loops for continuous refinement.

Experimental results

Research questions

• RQ1 How can external information system quality be systematically assessed across internal, external, and in-use dimensions?
• RQ2 What hierarchical structure best captures the multifaceted nature of external quality characteristics influenced by environmental factors?
• RQ3 How can quality assessment be automated to support ongoing monitoring and evolution planning?
• RQ4 What role do ecosystem and environmental parameters play in shaping dependent-environment quality attributes?
• RQ5 How can a model be designed to support both evaluation and long-term quality improvement in information systems?

Key findings

• The RatQual model successfully provides a comprehensive, hierarchical framework for assessing external information system quality across internal, external, and in-use aspects.
• The integration of environmental and ecosystem factors into quality assessment enables more realistic and context-aware evaluations.
• The automated tool significantly enhances the efficiency and consistency of quality monitoring operations.
• The model supports actionable quality evolution planning by generating data-driven insights for system improvement.
• The framework demonstrates practical applicability in real-world ISQ management, enabling periodic assessment and long-term quality enhancement.
• The model's design allows for scalability and adaptation across diverse information system environments.