[Paper Review] Status Report Of The Dphep Collaboration: A Global Effort For Sustainable Data Preservation In High Energy Physics

DPHEP Collaboration, S. Amerio+32 more|arXiv (Cornell University)|Dec 7, 2015

Big Data Technologies and Applications9 citations

TL;DR

This paper presents the DPHEP collaboration's progress from 2013 to 2015 in establishing a global framework for sustainable data preservation in high energy physics. It outlines technical and organizational strategies for preserving unique, high-value HEP data, resulting in a formalized collaboration with funding agencies and the development of long-term preservation standards and infrastructure.

ABSTRACT

Data from High Energy Physics (HEP) experiments are collected with significant financial and human effort and are mostly unique. An inter-experimental study group on HEP data preservation and long-term analysis was convened as a panel of the International Committee for Future Accelerators (ICFA). The group was formed by large collider-based experiments and investigated the technical and organizational aspects of HEP data preservation. An intermediate report was released in November 2009 addressing the general issues of data preservation in HEP and an extended blueprint paper was published in 2012. In July 2014 the DPHEP collaboration was formed as a result of the signature of the Collaboration Agreement by seven large funding agencies (others have since joined or are in the process of acquisition) and in June 2015 the first DPHEP Collaboration Workshop and Collaboration Board meeting took place. This status report of the DPHEP collaboration details the progress during the period from 2013 to 2015 inclusive.

Motivation & Objective

• To address the challenge of preserving unique, high-cost HEP experimental data for long-term access and reuse.
• To establish a coordinated, international effort among major HEP experiments and funding agencies to ensure data sustainability.
• To develop technical and organizational blueprints for data preservation based on prior ICFA panel work and extended blueprint papers.
• To formalize collaboration through a signed agreement among funding agencies and launch structured workshops and governance.
• To ensure that HEP data remains accessible, reproducible, and analyzable beyond the lifetime of individual experiments.

Proposed method

• Established the DPHEP collaboration through a formal Collaboration Agreement signed by seven major funding agencies.
• Conducted an inter-experimental study group under ICFA to assess technical and organizational challenges in HEP data preservation.
• Built on prior reports, including the 2009 intermediate report and the 2012 blueprint paper, to inform current strategies.
• Organized the first DPHEP Collaboration Workshop and Board meeting in June 2015 to align institutional goals and technical roadmaps.
• Developed a framework for long-term data preservation including metadata standards, software sustainability, and infrastructure planning.
• Promoted institutional buy-in and coordination across experiments and funding bodies to ensure sustained support.

Experimental results

Research questions

• RQ1 How can large-scale, unique HEP experimental data be preserved for decades beyond the original experiment’s lifetime?
• RQ2 What institutional and technical frameworks are required to ensure sustainable data preservation across international collaborations?
• RQ3 What governance and funding models can ensure long-term stewardship of HEP data across multiple experiments and agencies?
• RQ4 How can existing data preservation practices be standardized and scaled globally within high energy physics?
• RQ5 What role do funding agencies play in enabling and sustaining long-term data preservation in HEP?

Key findings

• The DPHEP collaboration was formally established in July 2014 with the signing of a collaboration agreement by seven major funding agencies.
• The first DPHEP Collaboration Workshop and Board meeting were held in June 2015, marking institutional coordination and strategic planning.
• The collaboration built upon prior ICFA panel work, including the 2009 report and 2012 blueprint paper, to define a comprehensive preservation strategy.
• The report details progress in technical planning, metadata modeling, and infrastructure design for long-term data accessibility.
• The collaboration has since expanded, with additional agencies joining or in the process of joining the initiative.
• The work laid the foundation for a sustainable, globally coordinated approach to HEP data preservation, now recognized as a critical scientific infrastructure.