Abstract:The increasing amount of published scholarly articles, exceeding 2.5 million yearly, raises the challenge for researchers in following scientific progress. Integrating the contributions from scholarly articles into a novel type of cognitive knowledge graph (CKG) will be a crucial element for accessing and organizing scholarly knowledge, surpassing the insights provided by titles and abstracts. This research focuses on effectively conveying structured scholarly knowledge by utilizing large language models (LLMs) to categorize scholarly articles and describe their contributions in a structured and comparable manner. While previous studies explored language models within specific research domains, the extensive domain-independent knowledge captured by LLMs offers a substantial opportunity for generating structured contribution descriptions as CKGs. Additionally, LLMs offer customizable pathways through prompt engineering or fine-tuning, thus facilitating to leveraging of smaller LLMs known for their efficiency, cost-effectiveness, and environmental considerations. Our methodology involves harnessing LLM knowledge, and complementing it with domain expert-verified scholarly data sourced from a CKG. This strategic fusion significantly enhances LLM performance, especially in tasks like scholarly article categorization and predicate recommendation. Our method involves fine-tuning LLMs with CKG knowledge and additionally injecting knowledge from a CKG with a novel prompting technique significantly increasing the accuracy of scholarly knowledge extraction. We integrated our approach in the Open Research Knowledge Graph (ORKG), thus enabling precise access to organized scholarly knowledge, crucially benefiting domain-independent scholarly knowledge exchange and dissemination among policymakers, industrial practitioners, and the general public.

ORKG ASK: a Neuro-symbolic Scholarly Search and Exploration System

NLP-KG: A System for Exploratory Search of Scientific Literature in Natural Language Processing

Fine-tuning and Prompt Engineering with Cognitive Knowledge Graphs for Scholarly Knowledge Organization

Conversational Exploratory Search of Scholarly Publications Using Knowledge Graphs

Leveraging Large Language Models for Semantic Query Processing in a Scholarly Knowledge Graph

ORKG-Leaderboards: A Systematic Workflow for Mining Leaderboards as a Knowledge Graph

GEAR-Up: Generative AI and External Knowledge-based Retrieval Upgrading Scholarly Article Searches for Systematic Reviews

DiscoverPath: A Knowledge Refinement and Retrieval System for Interdisciplinarity on Biomedical Research

Knowledge Navigator: LLM-guided Browsing Framework for Exploratory Search in Scientific Literature

Researcher or Crowd Member? Why not both! The Open Research Knowledge Graph for Applying and Communicating CrowdRE Research

A Knowledge Graph Approach for Exploratory Search in Research Institutions

KRAGEN: a knowledge graph-enhanced RAG framework for biomedical problem solving using large language models

The Digitalization of Bioassays in the Open Research Knowledge Graph

Common Conversational Community Prototype: Scholarly Conversational Assistant

Scholarly Knowledge Extraction from Published Software Packages

Persistent Identification and Interlinking of FAIR Scholarly Knowledge

Assisted neuroscience knowledge extraction via machine learning applied to neural reconstruction metadata on NeuroMorpho.Org

Argo Scholar: Interactive Visual Exploration of Literature in Browsers

Automating Knowledge Discovery from Scientific Literature via LLMs: A Dual-Agent Approach with Progressive Ontology Prompting

Operational Research Literature as a Use Case for the Open Research Knowledge Graph

From Big Scholarly Data to Solution-Oriented Knowledge Repository