Abstract:BACKGROUND:In biomedical information extraction, event extraction plays a crucial role. Biological events are used to describe the dynamic effects or relationships between biological entities such as proteins and genes. Event extraction is generally divided into trigger detection and argument recognition. The performance of trigger detection directly affects the results of the event extraction. In general, the traditional method is used to address the trigger detection as a classification task, as well as the use of machine learning or rules method, which construct many features to improve the classification results. Moreover, the classification model only recognizes triggers composed of single words, whereas for multiple words, the result is unsatisfactory.RESULTS:The corpus of our model is MLEE. If we were to only use the biomedical LSTM and CRF model without other features, the F-score would reach about 78.08%. Comparing entity to part of speech (POS), we find the entity features more conducive to the improvement of performance of detection, with the F-score potentially reaching about 80%. Furthermore, we also experiment on the other three corpora (BioNLP 2009, BioNLP 2011, and BioNLP 2013) to verify the generalization of our model. Hence, F-scores can reach more than 60%, which are better than the comparative experiments.CONCLUSIONS:The trigger recognition method based on the sequence annotation model does not require initial complex feature engineering, and only requires a simple labeling mechanism to complete the training. Therefore, generalization of our model is better compared to other traditional models. Secondly, this method can identify multi-word triggers, thereby improving the F-scores of trigger recognition. Thirdly, details on the entity have a crucial impact on trigger detection. Finally, the combination of character-level word embedding and word-level word embedding provides increasingly effective information for the model; therefore, it is a key to the success of the experiment.

Multi-word Trigger Pair Language Model Using FP-tree

A trigger language model-based IR system

Trigger-based language models: a maximum entropy approach

Improving and Scaling Trans-dimensional Random Field Language Models.

Model Interpolation with Trans-dimensional Random Field Language Models for Speech Recognition

Language Models-enhanced Semantic Topology Representation Learning for Temporal Knowledge Graph Extrapolation

FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models

TRAMS: Training-free Memory Selection for Long-range Language Modeling

Parsing Models for Identifying Multiword Expressions

Better & Faster Large Language Models via Multi-token Prediction

Bidirectional Long Short-Term Memory with CRF for Detecting Biomedical Event Trigger in FastText Semantic Space

Recognize Foreign Low-Frequency Words with Similar Pairs

INTEGRATING DISCRETE AND NEURAL FEATURES VIA MIXED-FEATURE TRANS-DIMENSIONAL RANDOM FIELD LANGUAGE MODELS

Improved Phonotactic Language Recognition Using Collaborated Language Model.

What Kinds of Tokens Benefit from Distant Text? An Analysis on Long Context Language Modeling

Multi-task Recurrent Model for True Multilingual Speech Recognition

Top-down Tree Long Short-Term Memory Networks

Securing Multi-turn Conversational Language Models From Distributed Backdoor Triggers

Topical Word Trigger Model for Keyphrase Extraction.

Learning Trans-Dimensional Random Fields with Applications to Language Modeling