Abstract:In the contemporary information era, significantly accelerated by the advent of Large-scale Language Models, the proliferation of scientific literature is reaching unprecedented levels. Researchers urgently require efficient tools for reading and summarizing academic papers, uncovering significant scientific literature, and employing diverse interpretative methodologies. To address this burgeoning demand, the role of automated scientific literature interpretation systems has become paramount. However, prevailing models, both commercial and open-source, confront notable challenges: they often overlook multimodal data, grapple with summarizing over-length texts, and lack diverse user interfaces. In response, we introduce an open-source multi-modal automated academic paper interpretation system (MMAPIS) with three-step process stages, incorporating LLMs to augment its functionality. Our system first employs the hybrid modality preprocessing and alignment module to extract plain text, and tables or figures from documents separately. It then aligns this information based on the section names they belong to, ensuring that data with identical section names are categorized under the same section. Following this, we introduce a hierarchical discourse-aware summarization method. It utilizes the extracted section names to divide the article into shorter text segments, facilitating specific summarizations both within and between sections via LLMs with specific prompts. Finally, we have designed four types of diversified user interfaces, including paper recommendation, multimodal Q\&A, audio broadcasting, and interpretation blog, which can be widely applied across various scenarios. Our qualitative and quantitative evaluations underscore the system's superiority, especially in scientific summarization, where it outperforms solutions relying solely on GPT-4.

Automatic Decomposition of Multi-Author Documents Using Grammar Analysis

Document Author Classification Using Parsed Language Structure

Multi-documents Automatic Abstracting Based on Text Clustering and Semantic Analysis

An automatic approach for efficient text segmentation

Learning from syntax generalizations for automatic semantic annotation

Multi-head Span-based Detector for AI-generated Fragments in Scientific Papers

Automatic Text Generation Via Text Extraction Based On Submodular

Artificially Generated Text Fragments Search in Academic Documents

Automatic Annotation of Grammaticality in Child-Caregiver Conversations

Automating Academic Document Analysis with ChatGPT: A Mendeley Case

Extracting Noun Phrases from Large-Scale Texts: A Hybrid Approach and Its Automatic Evaluation

Separating Style from Substance: Enhancing Cross-Genre Authorship Attribution through Data Selection and Presentation

Towards an understanding and explanation for mixed-initiative artificial scientific text detection

Text clustering on authorship attribution based on the features of punctuations usage

Automating Easy Read Text Segmentation

Bridging Research and Readers: A Multi-Modal Automated Academic Papers Interpretation System

Spot the bot: Coarse-Grained Partition of Semantic Paths for Bots and Humans

Topic-Centric Unsupervised Multi-Document Summarization of Scientific and News Articles

The Learnable Typewriter: A Generative Approach to Text Analysis

Study on Topic Partition in Automatic Abstracting System

Authorship Verification based on the Likelihood Ratio of Grammar Models