Open Energy Data Server Used in Research Data Management

Florian Maurer; Jonathan Sejdija; Volker Sander

doi:10.52825/ocp.v9i.3296

Authors

Florian Maurer FH Aachen https://orcid.org/0000-0001-8345-3889
Jonathan Sejdija FH Aachen https://orcid.org/0009-0009-3615-4160
Volker Sander FH Aachen https://orcid.org/0009-0006-8850-8520

DOI:

https://doi.org/10.52825/ocp.v9i.3296

Keywords:

Open Data, Infrastructure, Fair Access

Abstract

The integration of open data in energy informatics is increasingly crucial for the transformation towards a digital and decentralized energy system. However, challenges arise like licensing, accessibility as well as inconsistencies between source formats and desired formats, impeding efficient querying processes. To address these issues, the Open Energy Data Server has been developed, facilitating efficient usage of time series, geospatial and structural data in energy research, and applications in compliance with FAIR principles, despite limitations in the original sources. It features an administration frontend, dashboard visualizations and a REST API for application development. The included datasets contain information on power systems, weather, network frequency, as well as historic data on European energy and gas demands or generation.

Downloads

Download data is not yet available.

References

[1] S. Pfenninger, J. DeCarolis, L. Hirth, S. Quoilin, and I. Staffell, "The Importance of Open Data and Software: Is Energy Research Lagging Behind?", Energy Policy, vol. 101, pp. 211–215. ISSN: 0301-4215. DOI: 10.1016/j.enpol.2016.11.046. Accessed: Jul. 13, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0301421516306516.

[2] F. Bauer, and M. Kaltenböck, "Linked Open Data: The Essentials". ISBN: 978-3-902796-05-9.

[3] L. Hirth, "Open Data for Electricity Modeling: Legal Aspects", Energy Strategy Reviews, vol. 27, p. 100433. ISSN: 2211-467X. DOI: 10.1016/j.esr.2019.100433. Accessed: Jul. 13, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2211467X19301269.

[4] M. D. Wilkinson, M. Dumontier, g. J. g. family=Aalbersberg et al., "The FAIR Guiding Principles for Scientific Data Management and Stewardship", Sci Data, vol. 3, no. 1, p. 160018. ISSN: 2052-4463. DOI: 10.1038/sdata.2016.18. Accessed: Oct. 27, 2023. [Online]. Available: https://www.nature.com/articles/sdata201618.

[5] A. S. Kumar, I. Kouveliotis-Lysikatos, and L. Soder, "Comparison of Openly Available Power System Data for the Nordic Region", p. 6.

[6] F. Wiese, I. Schlecht, W. Bunke et al., "Open Power System Data – Frictionless Data for Electricity System Modelling", Applied Energy, vol. 236, pp. 401–409. ISSN: 03062619. DOI: 10.1016/j.apenergy.2018.11.097. Accessed: Jul. 13, 2022. [Online]. Available: https://linkinghub.elsevier.com/retrieve/pii/S0306261918318130.

[7] J. DeCarolis, H. Daly, P. Dodds et al., "Formalizing Best Practice for Energy System Optimization Modelling", Applied Energy, vol. 194, pp. 184–198. ISSN: 0306-2619. DOI: 10.1016/j.apenergy.2017.03.001. Accessed: May. 19, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0306261917302192.

[8] D. Fowler, J. Barratt, and P. Walsh, "Frictionless Data: Making Research Data Quality Visible", International Journal of Digital Curation, vol. 12, no. 2, pp. 274–285. ISSN: 1746-8256. DOI: 10.2218/ijdc.v12i2.577. Accessed: May. 19, 2024. [Online]. Available: https://ijdc.net/index.php/ijdc/article/view/577.

[9] F. Terroso-Saenz, A. González-Vidal, A. P. Ramallo-González, and A. F. Skarmeta, "An Open IoT Platform for the Management and Analysis of Energy Data", Future Generation Computer Systems, vol. 92, pp. 1066–1079. ISSN: 0167-739X. DOI: 10.1016/j.future.2017.08.046. Accessed: May. 19, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0167739X17304181.

[10] S. Liang, T. Khalafbeigi, H. v. D. Schaaf et al., "OGC SensorThings API Part 1 : Sensing Version 1.1". Accessed: May. 19, 2024. [Online]. Available: https://brgm.hal.science/hal-04235851.

[11] S. Netscher, and A. Katsanidou, "Understanding and Implementing Research Data Management", in Handbuch Methoden der Politikwissenschaft, C. Wagemann, A. Goerres, and M. Siewert, Eds., Wiesbaden: Springer Fachmedien, pp. 1–18. ISBN: 978-3-658-16937-4. DOI: 10.1007/978-3-658-16937-4_4-1. Accessed: May. 21, 2024. [Online]. Available: https://doi.org/10.1007/978-3-658-16937-4_4-1.

[12] European Organization For Nuclear Research and OpenAIRE, "Zenodo". DOI: 10.25495/7GXK-RD71. Accessed: Jan. 25, 2024. [Online]. Available: https://zenodo.org/.

[13] M. Politze, F. Claus, B. Brenger, M. A. Yazdi, B. Heinrichs, and A. Schwarz, "How to Manage IT Resources in Research Projects? Towards a Collaborative Scientific Integration Environment", European Journal of Higher Eduction IT, p. 8.

[14] E. Kötter, B. Müller, L. Hülk, and M. Glauer (OvGU), "The OpenEnergy Platform (OEP) - A Web-Platform to Improve Transparency and Reproducibility of Energy System Analyses". Accessed: Jan. 25, 2024. [Online]. Available: https://policycommons.net/artifacts/1554568/the-openenergy-platform-oep/2244377/.

[15] A. Vaisman, and E. Zimányi, Data Warehouse Systems: Design and Implementation, ser. Data-Centric Systems and Applications, Berlin, Heidelberg: Springer. ISBN: 978-3-662-65167-4. DOI: 10.1007/978-3-662-65167-4. Accessed: May. 20, 2024. [Online]. Available: https://link.springer.com/10.1007/978-3-662-65167-4.

[16] Q. Yang, M. Ge, and M. Helfert, "Analysis of Data Warehouse Architectures: Modeling and Classification", pp. 604–611. ISBN: 978-989-758-372-8. Accessed: May. 22, 2024. [Online]. Available: https://www.scitepress.org/Link.aspx?doi=10.5220/0007728006040611.

[17] K. Bakshi, "Considerations for Big Data: Architecture and Approach", in 2012 IEEE Aerospace Conference, pp. 1–7. ISSN: 1095-323X. DOI: 10.1109/AERO.2012.6187357. Accessed: May. 22, 2024. [Online]. Available: https://ieeexplore.ieee.org/abstract/document/6187357?casa_token=EAi1oV7QsPEAAAAA:iLL4Y3FyVn8of4PcdvWfIip29wCoHoDg-8Xt8Z_Wg5V_41AlibEkFMf_OxhiaHSvNXbK_lfNhg.

[18] S. Chaudhuri, and U. Dayal, "An Overview of Data Warehousing and OLAP Technology", SIGMOD Rec., vol. 26, no. 1, pp. 65–74. ISSN: 0163-5808. DOI: 10.1145/248603.248616. Accessed: May. 20, 2024. [Online]. Available: https://dl.acm.org/doi/10.1145/248603.248616.

[19] P. O. Queiroz-Sousa, and A. C. Salgado, "A Review on OLAP Technologies Applied to Information Networks", ACM Trans. Knowl. Discov. Data, vol. 14, no. 1, pp. 8:1–8:25. ISSN: 1556-4681. DOI: 10.1145/3370912. Accessed: May. 22, 2024. [Online]. Available: https://doi.org/10.1145/3370912.

[20] V. Goar, P. S. Sarangdevot, G. Tanwar, and D. A. Sharma, "Improve Performance of Extract, Transform and Load (ETL) in Data Warehouse", International Journal on Computer Science and Engineering, vol. 2.

[21] A. A. Yulianto, "Extract Transform Load (ETL) Process in Distributed Database Academic Data Warehouse", Aptikom Journal on Computer Science and Information Technologies, vol. 4, no. 2, pp. 61–68. ISSN: 2528-2425. DOI: 10.11591/APTIKOM.J.CSIT.36. Accessed: May. 22, 2024. [Online]. Available: http://aptikomjournal.com/index.php/CSIT/article/view/36.

[22] K. Barker, and A. Y. Noaman, "Distributed Data Warehouse Architecture and Design". Accessed: May. 22, 2024. [Online]. Available: https://www.semanticscholar.org/paper/Distributed-data-warehouse-architecture-and-design-Barker-Noaman/f32cc55a8ce440150bfb83ad374505c1865086a2.

[23] C. Mathis, "Data Lakes", Datenbank Spektrum, vol. 17, no. 3, pp. 289–293. ISSN: 1610-1995. DOI: 10.1007/s13222-017-0272-7. Accessed: May. 22, 2024. [Online]. Available: https://doi.org/10.1007/s13222-017-0272-7.

[24] Eurostat, "Territorial Units for Statistics (NUTS) - Eurostat". Accessed: May. 22, 2024. [Online]. Available: https://ec.europa.eu/eurostat/web/gisco/geodata/statistical-units/territorial-units-statistics.

[25] Bundesnetzagentur, "Marktstammdatenregister Datendownload". Accessed: Oct. 24, 2023. [Online]. Available: https://www.marktstammdatenregister.de/MaStR/Datendownload.

[26] copernicus, "Climate Reanalysis | ECMWF". Accessed: Oct. 24, 2023. [Online]. Available: https://climate.copernicus.eu/climate-reanalysis.

[27] Bundesnetzagentur, "SMARD | Marktdaten". Accessed: Jan. 5, 2024. [Online]. Available: https://www.smard.de/home/downloadcenter/download-marktdaten/.

[28] ENTSO-E, "ENTSO-E Transparency Platform". Accessed: Mar. 25, 2024. [Online]. Available: https://transparency.entsoe.eu/.

[29] ENTSO-G, "European Network of Transmission System Operators for Gas - Transparency Platform". Accessed: May. 22, 2024. [Online]. Available: https://transparency.entsog.eu/.

[30] JAO, "Auctions | Joint Allocation Office S.A. Leading Service Provider for TSOs". Accessed: May. 22, 2024. [Online]. Available: https://www.jao.eu/auctions#/.

[31] Gas Infrastructure Europe, "GIE - Aggregated Gas Storage Inventory". Accessed: Jun. 5, 2024. [Online]. Available: https://agsi.gie.eu/.

[32] Gas Infrastructure Europe, "GIE - Aggregated LNG System Inventory". Accessed: Jun. 5, 2024. [Online]. Available: https://alsi.gie.eu/.

[33] 50Hertz and Amprion and TenneT and TransnetBW, "German Balancing Power Datacenter FCR/aFRR/mFRR". Accessed: Jun. 5, 2024. [Online]. Available: https://www.regelleistung.net/apps/datacenter/tenders/.

[34] C. Matke, W. Medjroubi, D. Kleinhans, and S. Sager, "Structure Analysis of the German Transmission Network Using the Open Source Model SciGRID", in Advances in Energy System Optimization, V. Bertsch, W. Fichtner, V. Heuveline, and T. Leibfried, Eds., Cham: Springer International Publishing, pp. 177–188. ISBN: 978-3-319-51795-7. DOI: 10.1007/978-3-319-51795-7_11.

[35] PostGIS Project Steering Committee and others, "PostGIS, Spatial and Geographic Objects for postgreSQL", PostGIS. Accessed: May. 27, 2024. [Online]. Available: https://postgis.net/.

[36] Open Geospatial Consortium, "ISO 19125 Simple Feature Access", Open Geospatial Consortium. Accessed: Jun. 5, 2024. [Online]. Available: https://www.ogc.org/standard/sfa/.

[37] E. Stefancova, "Evaluation of the TimescaleDB PostgreSQL Time Series Extension". Accessed: Dec. 14, 2025. [Online]. Available: https://repository.cern/records/bt7te-gr790.

[38] A. Dunning, g. p. u. family=Smaele, and J. Böhmer, "Are the FAIR Data Principles Fair?", International Journal of Digital Curation, vol. 12, no. 2, pp. 177–195. ISSN: 1746-8256. DOI: 10.2218/ijdc.v12i2.567. Accessed: May. 22, 2024. [Online]. Available: https://ijdc.net/index.php/ijdc/article/view/567.

Open Energy Data Server Used in Research Data Management

Authors

DOI:

Keywords:

Abstract

Downloads

References

Downloads

Published

How to Cite

Conference Proceedings Volume

Section

License