Abstract:Academic expert finding has numerous advantages, such as: finding paper-reviewers, research collaboration, enhancing knowledge transfer, etc. Especially, for research collaboration, researchers tend to seek collaborators who share similar backgrounds or with the same native languages. Despite its importance, academic expert findings remain relatively unexplored within the context of Indonesian language. Recent studies have primarily relied on static word embedding techniques such as Word2Vec to match documents with relevant expertise areas. However, Word2Vec is unable to capture the varying meanings of words in different contexts. To address this research gap, this study employs Bidirectional Encoder Representations from Transformers (BERT), a state-of-the-art contextual embedding model. This paper aims to examine the effectiveness of BERT on the task of academic expert finding. The proposed model in this research consists of three variations of BERT, namely IndoBERT (Indonesian BERT), mBERT (Multilingual BERT), and SciBERT (Scientific BERT), which will be compared to a static embedding model using Word2Vec. Two approaches were employed to rank experts using the BERT variations: feature-based and fine-tuning. We found that the IndoBERT model outperforms the baseline by 6–9% when utilizing the feature-based approach and shows an improvement of 10–18% with the fine-tuning approach. Our results proved that the fine-tuning approach performs better than the feature-based approach, with an improvement of 1–5%. It concludes by using IndoBERT, this research has shown an improved effectiveness in the academic expert finding within the context of Indonesian language.

NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural

IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP

IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding

NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages

IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages

NusaMT-7B: Machine Translation for Low-Resource Indonesian Languages with Large Language Models

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia

Domain-Specific Language Model Post-Training for Indonesian Financial NLP

Constructing and Expanding Low-Resource and Underrepresented Parallel Datasets for Indonesian Local Languages

Komodo: A Linguistic Expedition into Indonesia's Regional Languages

Fine-tuning Pretrained Multilingual BERT Model for Indonesian Aspect-based Sentiment Analysis

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation

IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces

L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERT

NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages

Hybrid Models for Emotion Classification and Sentiment Analysis in Indonesian Language

Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch

IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization

Replicable Benchmarking of Neural Machine Translation (NMT) on Low-Resource Local Languages in Indonesia

Academic expert finding using BERT pre-trained language model

BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis