Treffer: An Autonomous Domain-Independent Framework Based on LLMs for Text-to-SPARQL.

Large language models (LLMs) currently are the state of the art for pre-trained language models. LLMs have been applied to many tasks, including question and answering over Knowledge Graphs (KGs) and text-to-SPARQL, that is, the translation of Natural Language questions to SPARQL queries. With such motivation, this paper first describes preliminary experiments to evaluate the ability of ChatGPT to answer Natural Language questions over KGs. Based on these experiments, the paper introduces Auto-KGQA, an autonomous domain-independent framework based on LLMs for text-to-SPARQL. The framework selects fragments of the KG, which the LLM uses to translate the user's Natural Language question to a SPARQL query on the KG. The paper describes preliminary experiments with Auto-KGQA with ChatGPT that indicate that the framework substantially reduced the number of tokens passed to ChatGPT without sacrificing performance. Finally, the paper includes an evaluation of Auto-KGQA in a publicly available benchmark, which showed that the framework is competitive, achieving an improvement of 13.2% in accuracy with respect to the state of the art and a reduction of 51.12% in the number of tokens passed to the LLM. [ABSTRACT FROM AUTHOR]

Copyright of International Journal of Semantic Computing is the property of World Scientific Publishing Company and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)