[论文解读] Software Uncertainty in Integrated Environmental Modelling: the role of Semantics and Open Science

Daniele de Rigo|arXiv (Cornell University)|Jan 1, 2013

Scientific Computing and Data Management被引用 6

一句话总结

本文提出，软件不确定性——源于复杂环境建模代码中的错误——显著削弱了综合环境评估的可靠性。通过倡导语义透明度和开放科学实践，特别是通过免费、模块化且经过语义验证的软件，本研究展示了如何在跨学科环境建模中提升模型结果的可重现性与可信度。

ABSTRACT

de Rigo, D., 2013. <strong>Software Uncertainty in Integrated Environmental Modelling: the role of Semantics and Open Science</strong>.<br><em>Geophysical Research Abstracts 15</em>, 13292+. ISSN 1607-7962, European Geosciences Union (EGU). arXiv:1311.4762 This is the author's version of the work. The definitive version is published in the Vol. 15 of Geophysical Research Abstracts (ISSN 1607-7962) and presented at the European Geosciences Union (EGU) General Assembly 2013, Vienna, Austria, 07-12 April 2013<br>http://www.egu2013.eu/ <strong>Software Uncertainty in Integrated Environmental Modelling: the role of Semantics and Open Science</strong> <strong><br></strong> Daniele de Rigo ¹ ² ¹ European Commission, Joint Research Centre, Institute for Environment and Sustainability,<br>Via E. Fermi 2749, I-21027 Ispra (VA), Italy ² Politecnico di Milano, Dipartimento di Elettronica e Informazione,<br>Via Ponzio 34/5, I-20133 Milano, Italy <strong>Excerpt:</strong> Computational aspects increasingly shape environmental sciences. Actually, transdisciplinary modelling of complex and uncertain environmental systems is challenging computational science (CS) and also the science-policy interface. Large spatial-scale problems falling within this category - i.e. wide-scale transdisciplinary modelling for environment (WSTMe) - often deal with factors (a) for which deep-uncertainty may prevent usual statistical analysis of modelled quantities and need different ways for providing policy-making with science-based support. Here, practical recommendations are proposed for tempering a peculiar - not infrequently underestimated - source of uncertainty. Software errors in complex WSTMe may subtly affect the outcomes with possible consequences even on collective environmental decision-making. Semantic transparency in CS and free software are discussed as possible mitigations. [...] <strong>References</strong> [1] Casagrandi, R., Guariso, G., 2009. Impact of ICT in environmental sciences: A citation analysis 1990-2007. Environmental Modelling &amp; Software 24 (7), 865-871. DOI:10.1016/j.envsoft.2008.11.013 <br><br>[2] de Rigo, D., (exp.) 2013. Behind the horizon of reproducible integrated environmental modelling at European scale: ethics and practice of scientific knowledge freedom. F1000 Research. Submitted<br><br>[3] Gomes, C. P 2009. Computational sustainability: Computational methods for a sustainable environment, economy, and society. The Bridge 39 (4), 5-13. http://www.nae.edu/File.aspx?id=17673<br><br>[4] Easterbrook, S. M., Johns, T. C., 2009. Engineering the software for understanding climate change. Computing in Science &amp; Engineering 11 (6), 65-74. DOI:10.1109/MCSE.2009.193<br><br>[5] Hamarat, C., Kwakkel, J. H., Pruyt, E., 2012. Adaptive robust design under deep uncertainty. Technological Forecasting and Social Change. DOI:10.1016/j.techfore.2012.10.004<br><br>[6] Bankes, S. C., 2002. Tools and techniques for developing policies for complex and uncertain systems. Proceedings of the National Academy of Sciences of the United States of America 99 (Suppl 3), 7263-7266. DOI:10.1073/pnas.092081399<br><br>[7] Kandlikar, M., Risbey, J., Dessai, S., 2005. Representing and communicating deep uncertainty in climate-change assessments. Comptes Rendus Geoscience 337 (4), 443-455. DOI:10.1016/j.crte.2004.10.010 <br><br>[8] de Rigo, D., Corti, P Caudullo, G., McInerney, D., Di Leo, M., San-Miguel-Ayanz, J., 2013. Toward Open Science at the European scale: Geospatial Semantic Array Programming for Integrated Environmental Modelling. Geophysical Research Abstracts 15, 13245+ DOI:10.6084/m9.figshare.155703<br><br>[9] Rodriguez Aseretto, D., Di Leo, M., de Rigo, D., Corti, P., McInerney, D., Camia, A., San Miguel-Ayanz, J., 2013. Free and Open Source Software underpinning the European Forest Data Centre. Geophysical Research Abstracts 15, 12101+ DOI:10.6084/m9.figshare.155700<br><br>[10] de Rigo, D., Corti, P Caudullo, G., McInerney, D., Di Leo, M., San-Miguel-Ayanz, J., (exp.) 2013. Supporting Environmental Modelling and Science-Policy Interface at European Scale with Geospatial Semantic Array Programming. In prep.<br><br>[11] Lempert, R. J., 2002. A new decision sciences for complex systems. Proceedings of the National Academy of Sciences of the United States of America 99 (Suppl 3), 7309-7313. DOI:10.1073/pnas.082081699<br><br>[12] Gober, P Kirkwood, C. W., 2010. Vulnerability assessment of climate-induced water shortage in Phoenix. Proceedings of the National Academy of Sciences 107 (50), 21295-21299. DOI:10.1073/pnas.0911113107<br><br>[13] de Rigo, D., 2012. Semantic Array Programming for Environmental Modelling: Application of the Mastrave library. In: Seppelt, R., Voinov, A. A., Lange, S., Bankamp, D. (Eds.), International Environmental Modelling and Software Society (iEMSs) 2012 International Congress on Environmental Modelling and Software. Managing Resources of a Limited Planet: Pathways and Visions under Uncertainty, Sixth Biennial Meeting. pp. 1167-1176. http://www.iemss.org/iemss2012/proceedings/D3_1_0715_deRigo.pdf<br><br>[14] de Rigo, D., 2012. Semantic Array Programming with Mastrave - Introduction to Semantic Computational Modelling. http://mastrave.org/doc/MTV-1.012-1 <br><br>[15] Free Software Foundation, 2012. What is free software? http://www.gnu.org/philosophy/free-sw.html (revision 1.118 archived at http://www.webcitation.org/6DXqCFAN3 )<br><br>[16] Stallman, R. M., 2009. Viewpoint: Why "open source" misses the point of free software. Communications of the ACM 52 (6), 31-33. DOI:10.1145/1516046.1516058 (free access version: http://www.gnu.org/philosophy/open-source-misses-the-point.html )<br><br>[17] de Rigo, D., 2012. Integrated Natural Resources Modelling and Management: minimal redefinition of a known challenge for environmental modelling. Excerpt from the Call for a shared research agenda toward scientific knowledge freedom, Maieutike Research Initiative. http://www.citeulike.org/groupfunc/15400/home<br><br>[18] Morin, A., Urban, J., Adams, P D., Foster, I., Sali, A., Baker, D., Sliz, P., 2012. Shining light into black boxes. Science 336 (6078), 159-160. DOI:10.1126/science.1218263<br><br>[19] Lempert, R., Schlesinger, M. E., 2001. Climate-change strategy needs to be robust. Nature 412 (6845), 375. DOI:10.1038/35086617<br><br>[20] Shell, K. M., 2012. Constraining cloud feedbacks. Science 338 (6108), 755-756. DOI:10.1126/science.1231083<br><br>[21] van der Sluijs, J. P 2012. Uncertainty and dissent in climate risk assessment: A Post-Normal perspective. Nature and Culture 7 (2), 174-195. DOI:10.3167/nc.2012.070204<br><br>[22] Lenton, T. M., Held, H., Kriegler, E., Hall, J. W., Lucht, W., Rahmstorf, S., Schellnhuber, H. J., 2008. Tipping elements in the earth’s climate system. Proceedings of the National Academy of Sciences 105 (6), 1786-1793. DOI:10.1073/pnas.0705414105<br><br>[23] Hastings, A., Wysham, D. B., 2010. Regime shifts in ecological systems can occur with no warning. Ecology Letters 13 (4), 464-472. DOI:10.1111/j.1461-0248.2010.01439.x<br><br>[24] Barnosky, A. D., Hadly, E. A., Bascompte, J., Berlow, E. L., Brown, J. H., Fortelius, M., Getz, W. M., Harte, J., Hastings, A., Marquet, P A., Martinez, N. D., Mooers, A., Roopnarine, P., Vermeij, G., Williams, J. W., Gillespie, R., Kitzes, J., Marshall, C., Matzke, N., Mindell, D. P., Revilla, E., Smith, A. B., 2012. Approaching a state shift in earth’s biosphere. Nature 486 (7401), 52-58. DOI:10.1038/nature11018<br><br>[25] Milly, P C. D., Betancourt, J., Falkenmark, M., Hirsch, R. M., Kundzewicz, Z. W., Lettenmaier, D. P., Stouffer, R. J., 2008. Stationarity is dead: Whither water management? Science 319 (5863), 573-574. DOI:10.1126/science.1151915<br><br>[26] Sloan, S., Pelletier, J., 2012. How accurately may we project tropical forest-cover change? A validation of a forward-looking baseline for REDD. Global Environmental Change 22 (2), 440-453. DOI:10.1016/j.gloenvcha.2012.02.001<br><br>[27] Nabuurs, G. J., van Putten, B., Knippers, T. S., Mohren, G. M. J., 2008. Comparison of uncertainties in carbon sequestration estimates for a tropical and a temperate forest. Forest Ecology and Management 256 (3), 237-245. DOI:10.1016/j.foreco.2008.04.010<br><br>[28] Green, D. G., Sadedin, S., 2005. Interactions matter – complexity in landscapes and ecosystems. Ecological Complexity 2 (2), 117-130. DOI:10.1016/j.ecocom.2004.11.006<br><br>[29] Baker, R., Koch, F., Kriticos, D., Rafoss, T., Venette, R., van der Werf, W. (Eds.), 2012. Advancing risk assessment models for invasive alien species in the food chain: contending with climate change, economics and uncertainty. Bioforsk FOKUS 7. Bioforsk, Frederik A. Dahls vei 20, 1432 Ås, Norway. http://www.pestrisk.org/2012/BioforskFOKUS7-10_IPRMW-VI.pdf<br><br>[30] de Rigo, D., Caudullo, G., San-Miguel-Ayanz, J., Stancanelli, G., 2012. Mapping European forest tree species distribution to support pest risk assessment. In: Baker, R., Koch, F., Kriticos, D., Rafoss, T., Venette, R., van der Werf, W. (Eds.), Advancing risk assessment models for invasive alien species in the food chain: contending with climate change, economics and uncertainty. Bioforsk FOKUS 7. Bioforsk, Frederik A. Dahls vei 20, 1432 ås, Norway. http://www.pestrisk.org/2012/BioforskFOKUS7-10_IPRMW-VI.pdf<br><br>[31] Thompson, I., Mackey, B., McNulty, S., Mosseler, A., 2009. Forest resilience, biodiversity, and climate change: a synthesis of the biodiversity/resilience/stability relationship in forest ecosystems. Vol. 43 of Technical Series. Secretariat of the Convention on Biological Diversity. ISBN: 9292251376<br><br>[32] Center for International Forestry Research., FAO Regional Office for Asia and the Pacific, 2005. Forests and floods: drowning in fiction or thriving on facts? Center for International Forestry Research; Food and Agriculture Organization of the United Nations, Regional Office for Asia and the Pacific. http://www.worldcat.org/isbn/9793361646<br><br>[33]

研究动机与目标

• 识别软件不确定性作为大规模跨学科环境建模（WSTMe）中常被忽视的关键误差来源。
• 应对因依赖黑箱软件和专有代码而导致的环境建模缺乏透明度与可重现性的问题。
• 推广开放科学与语义验证，作为降低软件相关不确定性并提升模型可信度的手段。
• 展示免费、模块化且经语义增强的软件如何提升环境建模流程的透明度与正确性。

提出的方法

• 提出理论D-TM（Y = f*(X)）与实际D-TM（Y = fζ(X, θζ, ζ)）之间的正式区分，其中ζ代表软件不确定性。
• 引入语义增强的D-TM（Y = ::f(θ, X, ζ)::sem），使用模态逻辑（□）对输入、输出和模型行为施加前置与后置条件。
• 倡导模块化、免费的软件架构，以暴露中间数据层与源代码，从而支持验证与可重现性。
• 应用语义数组编程（SemAP）及地理空间扩展，提升环境建模中代码的可读性、正确性与可审计性。
• 建议将语义检查作为不变量集成，以确保在复杂、相互关联的建模链中维持模型完整性。
• 推广开放科学原则——尤其是源代码与中间输出的免费获取——以支持环境科学中的可重现研究。

实验结果

研究问题

• RQ1 软件不确定性如何在复杂、相互关联的环境建模链中传播，并影响政策相关结果？
• RQ2 语义验证与开放科学实践在多大程度上可降低综合环境建模中的软件相关不确定性？
• RQ3 软件透明度在提升环境模型可重现性与可信度方面发挥何种作用？
• RQ4 如何通过模块化、免费且经语义注释的软件提升环境建模系统的可审计性与正确性？

主要发现

• 复杂环境建模系统中的软件错误可能以微妙但显著的方式改变模型结果，对集体环境决策构成风险。
• 在模型组件中使用语义检查（□sem）可确保输入、输出与内部逻辑符合指定约束，降低未被发现的错误风险。
• 模块化、免费且经语义增强的软件不仅支持代码审查，还促进对模型行为的理解与修正，从而增强透明度。
• 当源代码不可用或未经语义验证时，即使结果已发表，环境建模的可重现性也会从根本上受到损害。
• 语义数组编程（SemAP）为构建透明、可验证且可维护的环境建模系统提供了实用框架。
• 从黑箱模型向开放、模块化且经语义检查的软件链转型，是降低不确定性并提升环境科学可信度的关键。