Abstract:Natural language processing (NLP) has experienced rapid advancements with the rise of deep learning, significantly outperforming traditional rule-based methods. By capturing hidden patterns and underlying structures within data, deep learning has improved performance across various NLP tasks, overcoming the limitations of rule-based systems. However, most research and development in NLP has been concentrated on a select few languages, primarily those with large numbers of speakers or financial significance, leaving many others underexplored. This lack of research is often attributed to the scarcity of adequately annotated datasets essential for training deep learning models. Despite this challenge, there is potential in leveraging the linguistic similarities between unexplored and well-studied languages, particularly those in close geographic and linguistic proximity. This thesis investigates the application of transfer learning for Part-of-Speech (POS) tagging between Hindi and Nepali, two highly similar languages belonging to the Indo-Aryan language family. Specifically, the work explores whether joint training of a POS tagging model for both languages enhances performance. Additionally, we assess whether multitask learning in Hindi, with auxiliary tasks such as gender and singular/plural tagging, can contribute to improved POS tagging accuracy. The deep learning architecture employed is the BLSTM-CNN-CRF model, trained under different conditions: monolingual word embeddings, vector-mapped embeddings, and jointly trained Hindi-Nepali word embeddings. Varying dropout rates (0.25 to 0.5) and optimizers (ADAM and AdaDelta) are also evaluated. Results indicate that jointly trained Hindi-Nepali word embeddings improve performance across all models compared to monolingual and vector-mapped embeddings.

Towards a General-Purpose Linguistic Annotation Backend

A neural approach for inducing multilingual resources and natural language processing tools for low-resource languages

Building Low-Resource NER Models Using Non-Speaker Annotation

Aperture synthesis for gravitational-wave data analysis: Deterministic Sources

Morphological Processing of Low-Resource Languages: Where We Are and What's Next

Transcribing Natural Languages for The Deaf via Neural Editing Programs

Bridging the Gap between Text, Audio, Image, and Any Sequence: A Novel Approach using Gloss-based Annotation

ATLAS: A flexible and extensible architecture for linguistic annotation

Automatic Annotation of Grammaticality in Child-Caregiver Conversations

Learning to Generate Semantic Annotation for Domain Specific Sentences.

CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation

LLMs in the Loop: Leveraging Large Language Model Annotations for Active Learning in Low-Resource Languages

Enhancing linguistic research through AI-powered reference management: A proposal for a voice-controlled academic assistant

Large Language Models for Data Annotation: A Survey

Exploring transfer learning for Deep NLP systems on rarely annotated languages

Multi-lingual Geoparsing based on Machine Translation

Implementing a Portable Clinical NLP System with a Common Data Model - a Lisp Perspective

A case study on using speech-to-translation alignments for language documentation

Dependency Parsing with Noisy Multi-annotation Data

AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators

Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis: The case of apology