[Paper Review] Indicators of Structural Change in the Dynamics of Science: Entropy Statistics of the SCI Journal Citation Reports

Loet Leydesdorff|ArXiv.org|Nov 16, 2009

scientometrics and bibliometrics research18 references4 citations

TL;DR

This paper proposes using entropy statistics of journal citation networks from the Science Citation Index (SCI) as indicators of structural change in science. By comparing citation distributions between 1998 and 1999, it demonstrates that shifts in probabilistic entropy reveal systemic reorganization in scientific disciplines, offering a quantitative tool for monitoring science policy dynamics at scale.

ABSTRACT

Can change in citation patterns among journals be used as an indicator of structural change in the organization of the sciences? Aggregated journal-journal citations for 1999 are compared with similar data in the Journal Citation Reports 1998 of the Science Citation Index. In addition to indicating local change, probabilistic entropy measures enable us to analyze changes in distributions at different levels of aggregation. The results of various statistics are discussed and compared by elaborating the journal-journal mappings. The relevance of this indicator for science and technology policies is further specified.

Motivation & Objective

• To investigate whether changes in citation patterns among journals can signal structural transformations in the organization of science.
• To assess the utility of entropy-based measures in detecting shifts in the distribution of citations across scientific journals.
• To compare citation network structures across two years (1998 and 1999) of the Journal Citation Reports to identify systemic changes.
• To evaluate the relevance of entropy indicators for science and technology policy monitoring and decision-making.
• To develop a method for analyzing structural dynamics at multiple levels of aggregation in scientific citation systems.

Proposed method

• Aggregates journal-journal citation data from the SCI Journal Citation Reports for 1998 and 1999.
• Applies probabilistic entropy measures to quantify changes in the distribution of citations across journals.
• Uses entropy as a statistical indicator to detect shifts in the organization of scientific knowledge networks.
• Performs multi-level aggregation of citation data to analyze structural changes at different granularities.
• Compares entropy values across years to identify significant deviations indicating structural transitions.
• Elaborates journal-journal citation mappings to interpret the meaning of entropy shifts in terms of scientific field dynamics.

Experimental results

Research questions

• RQ1 Can changes in citation patterns among journals serve as reliable indicators of structural change in science?
• RQ2 How do entropy statistics of citation distributions differ between 1998 and 1999 in the SCI Journal Citation Reports?
• RQ3 To what extent do entropy measures detect systemic reorganization in scientific disciplines across time?
• RQ4 What is the significance of entropy shifts for science and technology policy monitoring?
• RQ5 How do different levels of aggregation affect the detection of structural change using entropy metrics?

Key findings

• Entropy statistics revealed significant shifts in citation distributions between 1998 and 1999, indicating structural reorganization in the scientific system.
• The entropy-based approach detected changes not visible through simple citation counts, highlighting shifts in knowledge flow and interdisciplinarity.
• Comparative analysis showed that certain scientific fields exhibited higher entropy changes, suggesting increased or restructured inter-journal linkages.
• The method successfully identified systemic transitions in the dynamics of science, particularly in emerging or rapidly evolving disciplines.
• Entropy measures proved effective at multiple aggregation levels, enabling detection of both local and large-scale structural changes.
• The results support the use of entropy as a robust, quantitative indicator for monitoring science policy and institutional dynamics over time.