OpenChemIE: An Information Extraction Toolkit For Chemistry Literature

Vincent Fan,Yujie Qian,Alex Wang,Amber Wang,Connor W. Coley,Regina Barzilay
2024-04-02
Abstract:Information extraction from chemistry literature is vital for constructing up-to-date reaction databases for data-driven chemistry. Complete extraction requires combining information across text, tables, and figures, whereas prior work has mainly investigated extracting reactions from single modalities. In this paper, we present OpenChemIE to address this complex challenge and enable the extraction of reaction data at the document level. OpenChemIE approaches the problem in two steps: extracting relevant information from individual modalities and then integrating the results to obtain a final list of reactions. For the first step, we employ specialized neural models that each address a specific task for chemistry information extraction, such as parsing molecules or reactions from text or figures. We then integrate the information from these modules using chemistry-informed algorithms, allowing for the extraction of fine-grained reaction data from reaction condition and substrate scope investigations. Our machine learning models attain state-of-the-art performance when evaluated individually, and we meticulously annotate a challenging dataset of reaction schemes with R-groups to evaluate our pipeline as a whole, achieving an F1 score of 69.5%. Additionally, the reaction extraction results of \ours attain an accuracy score of 64.3% when directly compared against the Reaxys chemical database. We provide OpenChemIE freely to the public as an open-source package, as well as through a web interface.
Machine Learning,Computation and Language,Information Retrieval
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to extract detailed reaction data from chemical literature. These data are usually distributed in multiple modalities such as text, tables and charts. Existing automation technologies mainly focus on extracting information from a single modality, such as individual charts or text paragraphs, but fail to fully integrate information from multiple modalities. Therefore, the paper proposes the OpenChemIE system, aiming to overcome the limitations of a single modality and achieve more comprehensive data extraction through document - level information extraction. Specifically, the goals of the OpenChemIE system are: 1. **Multi - modal information fusion**: Combine information from text, tables and charts to obtain complete reaction data. This includes identifying molecular structures, reaction conditions, substrate ranges, etc. 2. **Fine - grained reaction data extraction**: Not only extract the overall information of the reaction, but also be able to parse detailed information such as reaction conditions and substrate ranges. 3. **High - precision extraction**: Improve the accuracy and completeness of information extraction by using specialized neural models and chemical knowledge algorithms. The paper evaluated the overall performance of OpenChemIE by constructing a labeled dataset containing 1,007 reactions and achieved an F1 score of 69.5%. In addition, in comparison with the Reaxys chemical database, the accuracy of OpenChemIE in extracting reaction data reached 64.3%. These results indicate that OpenChemIE has significant advantages in multi - modal information fusion and fine - grained reaction data extraction.