[Paper Review] The impact of Monte Carlo simulation: a scientometric analysis of scholarly literature

Maria Grazia Pia, Tullio Basaglia+2 more|arXiv (Cornell University)|Dec 15, 2010

Radiation Detection and Scintillator Technologies5 references4 citations

TL;DR

This scientometric study analyzes the scholarly impact of Monte Carlo simulation in radiation physics from 1960 to 2009, using citation and keyword frequency analysis across major journals. It reveals a steady rise in Monte Carlo mentions—from under 5% in the 1960s to over 30% in medical physics by 2009—and identifies Geant4 as the most cited code, with its 2003 reference paper surpassing 2000 citations, highlighting software's growing role in high-energy physics research.

ABSTRACT

A scientometric analysis of Monte Carlo simulation and Monte Carlo codes has been performed over a set of representative scholarly journals related to radiation physics. The results of this study are reported and discussed. They document and quantitatively appraise the role of Monte Carlo methods and codes in scientific research and engineering applications.

Motivation & Objective

• To quantify the increasing scholarly impact of Monte Carlo simulation across radiation physics disciplines from 1960 to 2009.
• To assess the role of major Monte Carlo codes—such as MCNP, Geant4, EGS, FLUKA, and GEANT—in scientific literature.
• To evaluate the citation impact of landmark software publications, particularly the Geant4 reference paper.
• To identify trends in code adoption across different research domains, including medical physics, fundamental physics, and instrumentation.
• To examine the shift from hardware-centric to software-driven research in nuclear and particle physics through citation patterns.

Proposed method

• Conducted a scientometric analysis on 10 representative journals in radiation physics, including IEEE TNS, NIM, Physical Review, and Medical Physics.
• Performed text searches for the strings 'Monte Carlo', 'Monte Carlo simulation', and 'simulation' to track usage trends across five decades.
• Tracked mentions of specific Monte Carlo codes (e.g., MCNP, Geant4, EGS, FLUKA, GEANT) using variant spellings and naming conventions.
• Normalized citation and mention frequencies by journal and time period to assess relative impact and adoption trends.
• Corrected for potential misattributions (e.g., Geant4 mislabeled as GEANT) where possible, though full manual verification was infeasible.
• Used Thomson-Reuters Journal Citation Reports to assess citation impact of the Geant4 reference paper, identifying it as a 'current classic'.

Experimental results

Research questions

• RQ1 How has the frequency of 'Monte Carlo' mentions evolved in radiation physics journals from 1960 to 2009?
• RQ2 Which large-scale Monte Carlo codes are most frequently cited in different research domains (e.g., medical physics, fundamental physics, instrumentation) over time?
• RQ3 What is the citation impact of key software publications, such as the Geant4 reference paper, in the context of nuclear and particle physics research?
• RQ4 How do citation trends reflect the shift from hardware-centric to software-driven research in high-energy physics?
• RQ5 To what extent do code mentions correlate with technological advancements and the availability of open-source simulation tools?

Key findings

• The percentage of papers mentioning 'Monte Carlo' rose from less than 5% in the 1960s to approximately 15–25% in instrumentation journals and 12% in fundamental physics journals by the 2000s.
• In medical physics journals, 'Monte Carlo' mentions increased from negligible levels in the 1960s to over 30% by the 2000s, reflecting growing methodological adoption.
• Geant4 emerged as the most frequently mentioned code in instrumentation journals, while EGS dominated in medical physics journals during the 2000–2009 period.
• The 2003 Geant4 reference paper became the most cited article in the Nuclear Science and Technology category of Journal Citation Reports, surpassing 2000 citations by August 2010.
• MCNP showed increasing relative weight in instrumentation and medical physics journals during the 2000–2009 decade, indicating broader adoption in engineering and applied physics.
• Despite the rise of software, the citation landscape in nuclear and particle physics remains largely dominated by hardware-related research, underscoring the significance of Geant4’s high citation count as an outlier.