TSOTSALearning at LLMs4OL Tasks A and B : Combining Rules to Large Language Model for Ontology Learning
DOI:
https://doi.org/10.52825/ocp.v4i.2484Keywords:
Ontology Learning, Large Language Models, Rules, BERTAbstract
This paper presents our contribution to the Large Language Model For Ontology Learning (LLMs4OL) challenge hosted by ISWC conference. The challenge involves extracting and classifying various ontological components from multiple datasets. The organizers of the challenge provided us with the train set and the test set. Our goal consists of determining in which conditions foundation models such as BERT can be used for ontologies learning. To achieve this goal, we conducted a series of experiments on various datasets. Initially, GPT-4 was tested on the wordnet dataset, achieving an F1-score of 0.9264. Subsequently, we performed additional experiments on the same dataset using BERT. These experiments demonstrated that by combining BERT with rule-based methods, we achieved an F1-score of 0.9938, surpassing GPT-4 and securing the first place for term typing on the Wordnet dataset.
Downloads
References
[1] F. J. Azanzi, G. Camara, and M. Tchuente, “Extracting ontological knowledge from java source code using hidden markov models,” Open Computer Science, vol. 9, no. 2, pp. 181–199, Aug. 2019. DOI : 10.1515/comp-2019-0013.
[2] H. Zaragoza, P. M. D. Cabeza, and J. R. Sanz, “Learning ontologies from text: A survey of approaches and techniques,” Journal of Computer Science and Technology, vol. 32, no. 1, pp. 1–14, 2017. DOI : 10.1007/s11390-016-1662-0.
[3] P. F. Patel-Schneider, “A framework for ontology extraction from databases,” in Proceedings of the International Workshop on Ontology Learning, Springer, 2005. DOI : 10.1007/11516172_12.
[4] R. Meersman, A. L. de Moor, and H. W. de Bruijn, “Ontology-based xml data management,” Data Knowledge Engineering, vol. 55, no. 1, pp. 1–10, 2005. DOI : 10.1016/j. datak.2004.11.005.
[5] S. G. J. Zeng and H. M. Xie, “Ontology extraction from vocabularies and knowledge bases: A survey and new method,” IEEE Transactions on Knowledge and Data Engineering, vol. 27, no. 8, pp. 2267–2280, 2015. DOI: 10.1109/TKDE.2014.2345382.
[6] A. Jiomekong, A. Oelen, S. Auer, L. Anna-Lena, and V. Lars, “Food information engineering,” AI Magazine, 2023. DOI : 10.1002/aaai.12185.
[7] H. T. Azanzi Jiomekong Martins Folefac, “Food composition knowledge extraction from scientific literature,” in Artificial Intelligence: Towards Sustainable Intelligence, AI4S 2023, S. Tiwari, F. Ortiz-Rodrı́guez, S. Mishra, E. Vakaj, and K. Kotecha, Eds., ser. Communications in Computer and Information Science, vol. 1907, Springer, Cham, 2023, pp. 89–103, ISBN: 978-3-031-47996-0. DOI: 10.1007/978-3-031-47997-7_7. [Online]. Available: https://doi.org/10.1007/978-3-031-47997-7_7.
[8] G. C. Azanzi Jiomekong Hippolyte Tapamo, “An ontology for tuberculosis surveillance system,” in Iberoamerican Knowledge Graphs and Semantic Web Conference, Springer Nature Switzerland, 2023, pp. 1–15.
[9] H. B. Giglou, J. D’Souza, and S. Auer, “Llms4ol: Large language models for ontology learning,” in The Semantic Web – ISWC 2023: 22nd International Semantic Web Conference, Athens, Greece, November 6–10, 2023, Proceedings, Part I, Springer, 2023,
pp. 408–427. DOI : 10.1007/978-3-031-47240-4_22.
[10] H. Babaei Giglou, J. D’Souza, and S. Auer, “Llms4ol 2024 overview: The 1st large language models for ontology learning challenge,” Open Conference Proceedings, vol. 4, Oct. 2024.
[11] H. Babaei Giglou, J. D’Souza, S. Sadruddin, and S. Auer, “Llms4ol 2024 datasets: Toward ontology learning with large language models,” Open Conference Proceedings, vol. 4, Oct. 2024.
[12] D. Jacob, C. Ming-Wei, L. Kenton, and T. Kristina, “Bert: Pre-training of deep bidirectional transformers for language understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, 2019, pp. 4171–4186.
Downloads
Published
How to Cite
Conference Proceedings Volume
Section
License
Copyright (c) 2024 Carick Appolinaire Atezong Ymele, Azanzi Jiomekong
This work is licensed under a Creative Commons Attribution 4.0 International License.