Abstract:The project aims to provide a semi-supervised approach to identify Multiword Expressions in a multilingual context consisting of English and most of the major Indian languages. Multiword expressions are a group of words which refers to some conventional or regional way of saying things. If they are literally translated from one language to another the expression will lose its inherent meaning. To automatically extract multiword expressions from a corpus, an extraction pipeline have been constructed which consist of a combination of rule based and statistical approaches. There are several types of multiword expressions which differ from each other widely by construction. We employ different methods to detect different types of multiword expressions. Given a POS tagged corpus in English or any Indian language the system initially applies some regular expression filters to narrow down the search space to certain patterns (like, reduplication, partial reduplication, compound nouns, compound verbs, conjunct verbs etc.). The word sequences matching the required pattern are subjected to a series of linguistic tests which include verb filtering, named entity filtering and hyphenation filtering test to exclude false positives. The candidates are then checked for semantic relationships among themselves (using Wordnet). In order to detect partial reduplication we make use of Wordnet as a lexical database as well as a tool for lemmatising. We detect complex predicates by investigating the features of the constituent words. Statistical methods are applied to detect collocations. Finally, lexicographers examine the list of automatically extracted candidates to validate whether they are true multiword expressions or not and add them to the multiword dictionary accordingly.

IndoUKC: A Concept-Centered Indian Multilingual Lexical Resource.

Language Diversity: Visible to Humans, Exploitable by Machines

OntoSenseNet: A Verb-Centric Ontological Resource for Indian Languages

IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages

An Interactive Platform for Multilingual Linguistic Resource Enrichment

IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages

LexGen: Domain-aware Multilingual Lexicon Generation

BharatBhasaNet-A Unified Framework to Identify Indian Code Mix Languages

Diversicon: Pluggable Lexical Domain Knowledge

INDoRI: Indian Dataset of Recipes and Ingredients and its Ingredient Network

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages

Jambu: A historical linguistic database for South Asian languages

Creating and Managing a large annotated parallel corpora of Indian languages

Representing Interlingual Meaning in Lexical Databases

Building a bilingual WordNet-like lexicon: the new approach and algorithms

Multilingual Multiword Expressions

Challenge Dataset of Cognates and False Friend Pairs from Indian Languages

Creating Lexical Resources for Endangered Languages

Bhasha-Abhijnaanam: Native-script and romanized Language Identification for 22 Indic languages

IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context

A Formal Ontology-Based Classification of Lexemes and its Applications