Abstract:In the contemporary information era, significantly accelerated by the advent of Large-scale Language Models, the proliferation of scientific literature is reaching unprecedented levels. Researchers urgently require efficient tools for reading and summarizing academic papers, uncovering significant scientific literature, and employing diverse interpretative methodologies. To address this burgeoning demand, the role of automated scientific literature interpretation systems has become paramount. However, prevailing models, both commercial and open-source, confront notable challenges: they often overlook multimodal data, grapple with summarizing over-length texts, and lack diverse user interfaces. In response, we introduce an open-source multi-modal automated academic paper interpretation system (MMAPIS) with three-step process stages, incorporating LLMs to augment its functionality. Our system first employs the hybrid modality preprocessing and alignment module to extract plain text, and tables or figures from documents separately. It then aligns this information based on the section names they belong to, ensuring that data with identical section names are categorized under the same section. Following this, we introduce a hierarchical discourse-aware summarization method. It utilizes the extracted section names to divide the article into shorter text segments, facilitating specific summarizations both within and between sections via LLMs with specific prompts. Finally, we have designed four types of diversified user interfaces, including paper recommendation, multimodal Q\&A, audio broadcasting, and interpretation blog, which can be widely applied across various scenarios. Our qualitative and quantitative evaluations underscore the system's superiority, especially in scientific summarization, where it outperforms solutions relying solely on GPT-4.

Research of Paragraphs Segmentation and Elements Recognition for Academic Papers Based on Multi-features

CRFs Based Chinese Word Segmentation

A Hybrid Approach to Chinese Word Segmentation around CRFs

Research on the Structure Recognition of Academic Texts Under Different Characteristics

Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark

A morphology-based Chinese word segmentation method

Automatic Identification of Parallel Structure Based on Conditional Random Field

CRF-based Approach to Sentence Segmentation and Punctuation for Ancient Chinese Prose

Bridging Research and Readers: A Multi-Modal Automated Academic Papers Interpretation System

Named entity recognition in Chinese electronic medical records based on multi-feature integration

Parsing-based Chinese word segmentation integrating morphological and syntactic information

A Comparative Study on Chinese Word Segmentation Using Statistical Models

Chunk Parsing and Entity Relation Extracting to Chinese Text by Using Conditional Random Fields Model

Multi-documents Automatic Abstracting Based on Text Clustering and Semantic Analysis

A Survey of CRF Algorithm Based Knowledge Extraction of Elementary Mathematics in Chinese

A Sentence Segmentation Method for Ancient Chinese Texts Based on NNLM.

Chinese Word Segmentation Via BiLSTM+Semi-CRF with Relay Node

Fusion of Multiple Features for Chinese Named Entity Recognition Based on CRF Model

Combine CRF and MMSEG to Boost Chinese Word Segmentation in Social Media

Chinese Named Entity Recognition with a Multi-Phase Model

Information Extraction from Resume Documents in PDF Format