arXiv Study: In-Depth Analysis of Ontology Checkers for LLM Agents over Knowledge Graphs

Summary:arXiv has released a study on ontology checkers for LLM agents answering questions over knowledge graphs. The research examines the performance of curated, LLM-generated, and data-derived ontologies in catching errors and avoiding false alarms. The findings reveal that while curated ontologies flag more correct answers on the UniProt dataset, their performance on real agent answers is only marginally better than random flags. The study also analyzes the trade-offs between different ontology sour

---

Background and Motivation

As LLM agents are increasingly applied to question-answering tasks over knowledge graphs, ensuring the accuracy of their responses becomes crucial. A common approach is to use the ontology of the knowledge graph as a checker, assuming that a formal schema can reliably judge the correctness of answers. However, the effectiveness of this method has not been thoroughly validated. This study aims to analyze the performance of different ontology sources in LLM agent checking and explore their strengths and weaknesses.

Methodology

The research team conducted a systematic evaluation of three different ontology sources:

1. Curation-Based Ontology: Written by domain experts, highly structured and accurate.
2. LLM-Generated Ontology: Automatically generated by an LLM from the data.
3. Data-Derived Ontology: Directly mined from the data.

These ontologies were used as prompt context, checker, or both, and tested on public knowledge graphs and a private graph with nearly 1 billion triples. The team assessed the performance of each ontology in catching errors and avoiding false alarms, and analyzed the trade-offs between different sources, error types, and the benefits of combining sources or providing feedback to agents.

Key Findings

1. Curation-Based Ontology Performs Well on UniProt Dataset: The curation-based ontology flagged more correct answers on the UniProt dataset, but its false alarm rate was also higher.
2. Marginally Better Than Random on Real Agent Answers: On real agent answers, the curation-based ontology's flags were only marginally more precise than random flags, indicating limited effectiveness in practical applications.
3. LLM-Generated and Data-Derived Ontologies Perform Similarly: Both performed comparably in catching errors and avoiding false alarms, but were inferior to the curation-based ontology.
4. Combining Sources or Providing Feedback Did Not Significantly Improve Performance: Combining multiple ontology sources or providing feedback to the agent did not significantly enhance overall performance.

Engineering Trade-offs and Challenges

1. Cost and Benefit of Curation-Based Ontology: While curation-based ontologies perform well on certain datasets, their high cost and complexity pose challenges for widespread adoption.
2. Scalability of LLM-Generated Ontology: LLM-generated ontologies are highly scalable, but their accuracy depends on the quality of the training data and the model's performance.
3. Limitations of Data-Derived Ontology: Data-derived ontologies rely on the quality and distribution of the data and may not capture complex semantic relationships.

Developer Recommendations

1. Choose the Appropriate Ontology Source Based on the Application Scenario: In resource-constrained environments, consider using LLM-generated or data-derived ontologies; in scenarios where accuracy is paramount, combine curation-based ontologies for checking.
2. Combine Multiple Checking Mechanisms: In addition to ontology checking, combine other mechanisms (such as rule engines, statistical methods) to improve overall accuracy.
3. Continuous Optimization and Iteration: Regularly evaluate and update ontologies to adapt to changing data and requirements.

---

Source: ArXiv AI (cs.AI) (2026-10-30)

— END —

Tags: #LLMs & Foundation Models Follow #Knowledge Graph Follow #Ontology Checking Follow #arXiv Follow #AI Research Follow