Learning Semantic Text Similarity to rank Hypernyms of Financial Terms

Sohom Ghosh,Ankush Chopra,Sudip Kumar Naskar
DOI: https://doi.org/10.1007/s42979-023-02134-z
2023-08-13
Abstract:Over the years, there has been a paradigm shift in how users access financial services. With the advancement of digitalization more users have been preferring the online mode of performing financial activities. This has led to the generation of a huge volume of financial content. Most investors prefer to go through these contents before making decisions. Every industry has terms that are specific to the domain it operates in. Banking and Financial Services are not an exception to this. In order to fully comprehend these contents, one needs to have a thorough understanding of the financial terms. Getting a basic idea about a term becomes easy when it is explained with the help of the broad category to which it belongs. This broad category is referred to as hypernym. For example, "bond" is a hypernym of the financial term "alternative debenture". In this paper, we propose a system capable of extracting and ranking hypernyms for a given financial term. The system has been trained with financial text corpora obtained from various sources like DBpedia [4], Investopedia, Financial Industry Business Ontology (FIBO), prospectus and so on. Embeddings of these terms have been extracted using FinBERT [3], FinISH [1] and fine-tuned using SentenceBERT [54]. A novel approach has been used to augment the training set with negative samples. It uses the hierarchy present in FIBO. Finally, we benchmark the system performance with that of the existing ones. We establish that it performs better than the existing ones and is also scalable.
Computation and Language
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve The paper primarily aims to address the issue of identifying the relationship between financial terms and their hypernyms (i.e., broader categories). Specifically, the goals of the paper include: 1. **Propose a System**: Develop a system capable of extracting and ranking the hypernyms of given financial terms. 2. **Improve Readability**: Enhance the readability and comprehensibility of financial texts by displaying the hypernyms of financial terms. 3. **Improve Existing Methods**: Perform better and be more scalable compared to existing methods. ### Research Questions The paper attempts to answer the following research questions: - **RQ1**: How have the datasets and solution architectures of the FinSim challenge evolved over the past few years? - **RQ2**: How to develop a system to rank a set of hypernyms for a given financial term? - **RQ3**: Can using domain-specific embeddings improve model performance? - **RQ4**: What is the impact of adding data from other sources on model performance? ### Contributions The main contributions of the paper are as follows: - Reviewed and summarized various methods used by participants in all 3 editions of the FinSim challenge and compiled the performance of these methods. - Explored multiple external financial data sources to supplement the training set. - Proposed a novel approach to enhance the training set to include the hierarchy within the hypernym set. - Developed a system capable of ranking a set of hypernyms for a given financial term.