ARTÍCULO
TITULO

Computers? Interpretations of Knowledge Representation Using Pre-Conceptual Schemas: An Approach Based on the BERT and Llama 2-Chat Models

Jesus Insuasti    
Felipe Roa and Carlos Mario Zapata-Jaramillo    

Resumen

Pre-conceptual schemas are a straightforward way to represent knowledge using controlled language regardless of context. Despite the benefits of using pre-conceptual schemas by humans, they present challenges when interpreted by computers. We propose an approach to making computers able to interpret the basic pre-conceptual schemas made by humans. To do that, the construction of a linguistic corpus is required to work with large language models?LLM. The linguistic corpus was mainly fed using Master?s and doctoral theses from the digital repository of the University of Nariño to produce a training dataset for re-training the BERT model; in addition, we complement this by explaining the elicited sentences in triads from the pre-conceptual schemas using one of the cutting-edge large language models in natural language processing: Llama 2-Chat by Meta AI. The diverse topics covered in these theses allowed us to expand the spectrum of linguistic use in the BERT model and empower the generative capabilities using the fine-tuned Llama 2-Chat model and the proposed solution. As a result, the first version of a computational solution was built to consume the language models based on BERT and Llama 2-Chat and thus automatically interpret pre-conceptual schemas by computers via natural language processing, adding, at the same time, generative capabilities. The validation of the computational solution was performed in two phases: the first one for detecting sentences and interacting with pre-conceptual schemas with students in the Formal Languages and Automata Theory course?the seventh semester of the systems engineering undergraduate program at the University of Nariño?s Tumaco campus. The second phase was for exploring the generative capabilities based on pre-conceptual schemas; this second phase was performed with students in the Object-oriented Design course?the second semester of the systems engineering undergraduate program at the University of Nariño?s Tumaco campus. This validation yielded favorable results in implementing natural language processing using the BERT and Llama 2-Chat models. In this way, some bases were laid for future developments related to this research topic.

 Artículos similares

       
 
Gabriel Andrés Casal,Patricia Vallati,Lucio Manuel Ibiricu,Andrea De Sosa Tomas,Nicolás Foix,José Óscar Alllard,Rubén Darío Martínez     Pág. 162 - 178
The presence of stromatolites from Cretaceous outcrops at the headwaters of the río Chico locality in the Golfo San Jorge Basin is reported for the first time. They are present in the uppermost part of the Lago Colhué Huapi Formation (Coniacian-Maastrich... ver más
Revista: Andean Geology

 
Simo Häyrynen and Jussi Semi    
Finding a new destination for declining industrial communities is a common European trend, wherein local, national and EU interests are intertwined and sometimes contested. New meaning is sought, among other things, in economics, political activity, and ... ver más
Revista: Urban Science

 
Giorgos Maneas, Eirini Makopoulou, Dimitris Bousbouras, Håkan Berg and Stefano Manzoni    
Human interventions during the last 70 years have altered the characteristics of the Gialova Lagoon, a coastal wetland that is part of a wider Natura 2000 site. In this study, we explore how human interventions and climate altered the wetland?s hydrologi... ver más
Revista: Water

 
Emmanuel Papadakis, George Baryannis, Andreas Petutschnig and Thomas Blaschke    
Searching for places rather than traditional keyword-based search represents significant challenges. The most prevalent method of addressing place-related queries is based on place names but has limited potential due to the vagueness of natural language ... ver más

 
Pablo Rodríguez-Gonzálvez, Ángel Guerra Campo, Ángel L. Muñoz-Nieto, Luis J. Sánchez-Aparicio and Diego González-Aguilera    
Cultural heritage (CH) documentation is essential for the study and promotion of CH assets/sites, and provides a way of transmitting knowledge about heritage to future generations. The integration of the fourth dimension into geospatial datasets enables ... ver más