Reusable Agent-Based Simulations of Cyber-Physical Energy Systems: Environments as First-Class Entities

Rico Schrage; Astrid Nieße

doi:10.52825/ocp.v9i.3271

Authors

Rico Schrage Carl von Ossietzky Universität Oldenburg https://orcid.org/0000-0001-5339-6553
Astrid Nieße Carl von Ossietzky Universität Oldenburg

DOI:

https://doi.org/10.52825/ocp.v9i.3271

Keywords:

FAIR4RS, Agent-Based Simulation, Cyber-Physical Energy Systems, Reusable Simulations, Agent Framework, Energy System Optimization

Abstract

Agent-based simulation in cyber-physical energy systems is a challenging task, often involving multiple dimensions and layers, heterogeneous actors, and large-scale systems, to serve as an effective analysis tool. It is also hard to compare multi-agent systems because most simulations use complex, non-reusable agent environments. To address these problems, a simulation framework that supports not only complex simulation but also reusable environments for agent systems is needed. This paper describes a Julia-based simulation framework for agent-based simulations of cyber-physical (energy) systems, featuring an environment API that enables the creation of reusable environments. For this purpose, an event-based architecture for agent-environment interaction is proposed, implemented in a framework, and demonstrated as a showcase.

Downloads

Download data is not yet available.

References

[1] P. Ringler, D. Keles, and W. Fichtner, “Agent-based modelling and simulation of smart electricity grids and markets – a literature review,” Renewable and Sustainable Energy Reviews, vol. 57, pp. 205–215, 2016, ISSN: 1364-0321. DOI: https://doi.org/10.1016/j.rser.2015.12.169. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S136403211501552X.

[2] N. Harder et al., “Assume: An agent-based simulation framework for exploring electricity market dynamics with reinforcement learning,” SoftwareX, vol. 30, p. 102 176, 2025, ISSN: 2352-7110. DOI: https : / / doi . org /10.1016/ j . softx .2025.102176. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2352711025001438.

[3] S. J. Russell and P. Norvig, Artificial intelligence a modern approach. London: Prentice Hall, 2010.

[4] N. P. Chue Hong et al., Fair principles for research software (fair4rs principles), version 1.0, May 2022. DOI: 10.15497/RDA00068. [Online]. Available: https://doi.org/10.15497/RDA00068.

[5] M. Barker et al., “Introducing the fair principles for research software,” Scientific Data, vol. 9, no. 1, p. 622, 2022. DOI: https://doi.org/10.1038/s41597-022-01710-x.

[6] S. Ferenz et al., “Ten recommendations for engineering research software in energy research,” in Proceedings of the 16th ACM International Conference on Future and Sustainable Energy Systems, ser. E-Energy ’25, Association for Computing Machinery, 2025, pp. 446–459, ISBN: 9798400711251. DOI: 10.1145/3679240.3734606. [Online]. Available: https://doi.org/10.1145/3679240.3734606.

[7] U. Wilensky, “NetLogo,” Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL, 1999. [Online]. Available: https://ccl.northwestern.edu/netlogo/.

[8] E. ter Hoeven et al., “Mesa 3: Agent-based modeling with Python in 2025,” Journal of Open Source Software, vol. 10, no. 107, p. 7668, Mar. 2025. DOI: 10.21105/joss.07668. [Online]. Available: https://joss.theoj.org/papers/10.21105/joss.07668.

[9] G. Datseris, A. R. Vahdati, and T. C. DuBois, “Agents.jl: A performant and feature-full agent-based modeling software of minimal code complexity,” SIMULATION, vol. 0, no. 0, p. 003 754 972 110 688, Jan. 2022. DOI: 10.1177/00375497211068820. [Online]. Available: https://doi.org/10.1177/00375497211068820.

[10] R. Schrage, J. Sager, J. P. H¨ ording, and S. Holly, “Mango: A modular python-based agent simulation framework,” SoftwareX, vol. 27, p. 101 791, 2024, ISSN: 2352-7110. DOI: https://doi.org/10.1016/j.softx.2024.101791. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2352711024001626.

[11] ie3 - Institute of Energy Systems, Energy Efficiency and Energy Economics - TU Dortmund University et al., SIMONA - A Discrete-Event Distribution Grid Simulation Environment, version 4.0.0, May 2025. [Online]. Available: https://github.com/ie3-institute/simona.

[12] C. Steinbrink et al., “Cpes testing with mosaik: Co-simulation planning, execution and analysis,” Applied Sciences, vol. 9, no. 5, 2019, ISSN: 2076-3417. DOI: 10.3390/app9050923. [Online]. Available: https://www.mdpi.com/2076-3417/9/5/923.

[13] T. D. Hardy, B. Palmintier, P. L. Top, D. Krishnamurthy, and J. C. Fuller, “Helics: A cosimulation framework for scalable multi-domain modeling and analysis,” IEEE Access, vol. 12, pp. 24 325–24 347, 2024. DOI: 10.1109/ACCESS.2024.3363615.

[14] M. Towers et al., Gymnasium: A Standard Interface for Reinforcement Learning Environments. [Online]. Available: https://github.com/Farama-Foundation/Gymnasium.

[15] B. Donnot, Grid2op- A testbed platform to model sequential decision making in power systems. 2020. [Online]. Available: https://github.com/Grid2op/grid2op

[16] K. Nweye et al., “Citylearn v2: Energy-flexible, resilient, occupant-centric, and carbonaware management of grid-interactive communities,” Journal of Building Performance Simulation, vol. 0, no. 0, pp. 1–22, 2024. DOI: 10.1080/19401493.2024.2418813. [Online]. Available: https://doi.org/10.1080/19401493.2024.2418813.

[17] T. Wolgast and A. Niese, “Learning the optimal power flow: Environment design matters,”Energy and AI, vol. 17, p. 100 410, 2024, ISSN: 2666-5468. DOI: https://doi.org/10.1016/j.egyai.2024.100410. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2666546824000764.

[18] R. Morrison, “Energy system modeling: Public transparency, scientific reproducibility, and open development,” Energy Strategy Reviews, vol. 20, pp. 49–63, 2018, ISSN: 2211-467X. DOI: https://doi.org/10.1016/j.esr.2017.12.010. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2211467X17300949.

[19] G. M. Huebner, M. J. Fell, and N. E. Watson, “Improving energy research practices: Guidance for transparency, reproducibility and quality,” Buildings and Cities, Jan. 2021.

DOI: 10.5334/bc.67. [20] A. Plietzsch et al., “Powerdynamics.jl–an experimentally validated open-source package for the dynamical analysis of power grids,” SoftwareX, vol. 17, p. 100 861, 2022.

[21] J. D. Lara, C. Barrows, D. Thom, D. Krishnamurthy, and D. Callaway, PowerSystems.jl — A power system data management package for large scale modeling,” SoftwareX, vol. 15, Jul. 2021. DOI: https://doi.org/10.1016/j.softx.2021.100747. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2352711021000765.

[22] C. Coffrin, R. Bent, K. Sundar, Y. Ng, and M. Lubin, “Powermodels.jl: An open-source framework for exploring power flow formulations,” in 2018 Power Systems Computation Conference (PSCC), Jun. 2018, pp. 1–8. DOI: 10.23919/PSCC.2018.8442948.

[23] L. Jian, Z. Qian, Z. Liangang, and Y. Mengkai, “Distributed economic dispatch method for power system based on consensus,” IET Renewable Power Generation, vol. 14, no. 9, pp. 1424–1432, 2020. DOI: https://doi.org/10.1049/iet-rpg.2019.1085. eprint: https://ietresearch.onlinelibrary.wiley.com/doi/pdf/10.1049/iet-rpg.2019.1085. [Online]. Available: https://ietresearch.onlinelibrary.wiley.com/doi/abs/10.1049/iet-rpg.2019.1085.

[24] NREL-Sienna contributors, PowerSystemCaseBuilder.jl, Package to build cases for power systems modeling, version 2.1.0, GitHub repository, National Renewable Energy Laboratory (NREL), Nov. 30, 2025. Accessed: Dec. 15, 2025. [Online]. Available: https://github.com/NREL-Sienna/PowerSystemCaseBuilder.jl.

Reusable Agent-Based Simulations of Cyber-Physical Energy Systems: Environments as First-Class Entities

Authors

DOI:

Keywords:

Abstract

Downloads

References

Downloads

Published

How to Cite

Conference Proceedings Volume

Section

License

Funding data