Showing posts with label AGU2024. Show all posts
Showing posts with label AGU2024. Show all posts

Saturday, December 7, 2024

Modelling by Components and Modular Systems

The modeling-by-components (MBC) approach has been conceptually present for over 40 years (Holling, 1978). However, it is only in the past two decades that it has gained significant traction within the environmental modeling community (Argent, 2004). Often referred to as integrated environmental modeling (IEM), MBC arose from the need to analyze heterogeneous processes collectively, integrating knowledge across diverse disciplines (Moore and Hughes, 2017).


In the more specialized hydrological and meteorological domains, examples of MBC applications are relatively limited but include prominent frameworks such as TIME (Rahman et al., 2003), OpenMI (Gregersen et al., 2007), CSDMS (Peckham et al., 2013), ESMF (Collins et al., 2005), and OMS (David et al., 2013), RAVEN (Craig et al., 2020). A more comprehensive list can be found in Chen et al. (2020).

Figure from UniFHy v0.1. another modular framework to investigate
While MBC concepts and their associated technological implications are highly appealing, their practical implementation can be challenging. One key challenge is their “invasiveness”—in some cases, MBC frameworks require programmers to adapt their habits and adopt new programming styles (Lloyd et al., 2011). Among the aforementioned examples, the OMS framework explicitly tackled this issue and provided encouraging solutions (Lloyd et al., 2011).

MBC inherently supports a service-oriented architecture (SOA), a software design approach particularly suited for integrating heterogeneous data sources. SOA frameworks are designed to work across different machines and scales, accommodating a variety of hardware architectures. Importantly, SOA abstracts the computational details, allowing users to focus on modeling rather than the intricacies of the underlying engines. Infrastructures that do not implement such type of architecture, probably abuse the word "framework" and should be named differently. 


Key Features of the MBC Approach:


1. Encapsulation and Testing:

The framework employs encapsulation, making code easier to inspect. Each component can operate independently within the system’s infrastructure and can be tested in isolation.

2. Ownership and Collaboration:

MBC allows for clear intellectual property ownership. Components are often developed by a small group of contributors, enabling diverse collaboration without dispersing efforts across thousands of lines of code. Adding new components is straightforward and does not require recompiling the entire system.

3. Component Substitution and Hypothesis Testing:

The modularity of MBC simplifies the replacement of components, making it a valuable tool for hypothesis testing (Beven, 2019).

4. Built-in Services:

Features like implicit parallelism and tools for model parameter calibration are provided seamlessly, reducing the burden on developers.

5. Flexibility Across Disciplines:

A well-designed MBC system allows for nearly unlimited composition of modeling solutions. Components can address tasks across disciplines, breaking down silos and fostering interdisciplinary collaboration.


In summary, the MBC approach offers a robust and scalable framework for tackling complex environmental modeling challenges. Its emphasis on modularity, flexibility, and interoperability makes it a powerful tool for advancing scientific understanding across domains.


References on Modelling by Components

An initial and certainly non-exhaustive list of reference for who wants to know more about modelling by components


  • Argent, R. M.: An overview of model integration for environmental applications – components, frameworks and semantics, Environ. Modell. Softw., 19, 219–234, 2004. 
  • Beven, K.: Towards a methodology for testing models as hypotheses in the inexact sciences, Proc. Math. Phys. Eng. Sci., 475, 20180862, https://doi.org/10.1098/rspa.2018.0862, 2019.
  • Chen, M., Voinov, A., Ames, D. P., Kettner, A. J., Goodall, J. L., Jakeman, A. J., Barton, M. C., Harpham, Q., Cuddy, S. M., DeLuca, C., Yue, S., Wang, J., Zhang, F., Wen, Y., and Lü, G.: Position paper: Open web-distributed integrated geographic modelling and simulation to enable broader participation and applications, Earth Sci. Rev., 207, 103223, https://doi.org/10.1016/j.earscirev.2020.103223, 2020.
  • Collins, N., Theurich, G., DeLuca, C., Suarez, M., Trayanov, A., Balaji, V., Li, P., Yang, W., Hill, C., and da Silva, A.: Design and Implementation of Components in the Earth System Modeling Framework, Int. J. High Perform. Comput. Appl., 19, 341–350, 2005. 
  • Craig, J. R., Brown, G., Chlumsky, R., Jenkinson, R. W., Jost, G., Lee, K., Mai, J., Serrer, M., Sgro, N., Shafii, M., Snowdon, A. P., and Tolson, B. A.: Flexible watershed simulation with the Raven hydrological modelling framework, Environ. Modell. Softw., 129, 104728, https://doi.org/10.1016/j.envsoft.2020.104728, 2020.
  • David, O., Ascough, II, J. C., Lloyd, W., Green, T. R., Rojas, K. W., Leavesley, G. H., and Ahuja, L. R.: A software engineering perspective on environmental modeling framework design: The Object Modeling System, Environ. Modell. Softw., 39, 201–213, 2013. 
  • David, O., Lloyd, W., Rojas, K., Arabi, M., Geter, F., Ascough, J., Green, T., Leavesley, G., and Carlson, J.: Modeling-as-a-Service (MaaS) using the Cloud Services Innovation Platform (CSIP), in: International Congress on Environmental Modelling and Software, scholarsarchive.byu.edu, 13, https://digitalcommons.tacoma.uw.edu/tech_pub/13 (last access: 23 September 2022), 2014. 
  • Gregersen, J. B., Gijsbers, P. J. A., and Westen, S. J. P.: OpenMI: Open modelling interface, J. Hydroinform., 9, 175–191, 2007. 
  • Holling, C. S.: Adaptive Environmental Assessment and Management. John Wiley & Sons. http://pure.iiasa.ac.at/id/eprint/823/ (last access: 27 September 2022), ISBN 0471996327, 402 pp., 1978. 
  • Lloyd, W., David, O., Ascough, J. C., Rojas, K. W., Carlson, J. R., Leavesley, G. H., Krause, P., Green, T. R., and Ahuja, L. R.: Environmental modeling framework invasiveness: Analysis and implications, Environ. Modell. Softw., 26, 1240–1250, 2011.
  • Moore, R. V. and Hughes, A. G.: Integrated environmental modelling: achieving the vision, Geological Society, London, Special Publications, 408, 17–34, 2017. 
  • Peckham, S. D., Hutton, E. W. H., and Norris, B.: A component-based approach to integrated modeling in the geosciences: The design of CSDMS, Comput. Geosci., 53, 3–12, 2013.
  • Rahman, J. M., Seaton, S. P., Perraud, J. M., Hotham, H., Verrelli, D. I., and Coleman, J. R.: It's TIME for a new environmental modelling framework, in: MODSIM 2003 International Congress on Modelling and Simulation, vol. 4, 1727–1732, Modelling and Simulation Society of Australia and New Zealand Inc. Townsville, http://www.research.div1.com.au/RESOURCES/research/publications/conferences/20030714ff_MODSIM2003/RahmanSeatonPerraudHothamVerrelliColeman2003_1727.n.pdf (last access: 27 September 2022), 2003.