Towards the first UD Treebank of Spoken Italian: the KIParla forest

Ludovica Pannitto

2024-10-07

Abstract:The present project endeavors to enrich the linguistic resources available for Italian by constructing a Universal Dependencies treebank for the KIParla corpus (Mauri et al., 2019, Ballarè et al., 2020), an existing and well known resource for spoken Italian.

Computation and Language

What problem does this paper attempt to address?

The KIPARLA Forest treebank of spoken Italian: an overview of initial design choices

Ludovica Pannitto,Caterina Mauri

2024-11-11

Abstract:The paper presents an overview of initial design choices discussed towards the creation of a treebank for the Italian KIParla corpus

Computation and Language
Unifying Lexicons in view of a Phonological and Morphological Lexical DB

Federico Calzolari,Michele Mammini,Monica Monachini

DOI: https://doi.org/10.48550/arXiv.cs/0612062

2006-12-11

Information Retrieval

Abstract:The present work falls in the line of activities promoted by the European Languguage Resource Association (ELRA) Production Committee (PCom) and raises issues in methods, procedures and tools for the reusability, creation, and management of Language Resources. A two-fold purpose lies behind this experiment. The first aim is to investigate the feasibility, define methods and procedures for combining two Italian lexical resources that have incompatible formats and complementary information into a Unified Lexicon (UL). The adopted strategy and the procedures appointed are described together with the driving criterion of the merging task, where a balance between human and computational efforts is pursued. The coverage of the UL has been maximized, by making use of simple and fast matching procedures. The second aim is to exploit this newly obtained resource for implementing the phonological and morphological layers of the CLIPS lexical database. Implementing these new layers and linking them with the already exisitng syntactic and semantic layers is not a trivial task. The constraints imposed by the model, the impact at the architectural level and the solution adopted in order to make the whole database `speak' efficiently are presented. Advantages vs. disadvantages are discussed.
MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank

Verena Blaschke,Barbara Kovačić,Siyao Peng,Hinrich Schütze,Barbara Plank

2024-03-15

Abstract:Despite the success of the Universal Dependencies (UD) project exemplified by its impressive language breadth, there is still a lack in `within-language breadth': most treebanks focus on standard languages. Even for German, the language with the most annotations in UD, so far no treebank exists for one of its language varieties spoken by over 10M people: Bavarian. To contribute to closing this gap, we present the first multi-dialect Bavarian treebank (MaiBaam) manually annotated with part-of-speech and syntactic dependency information in UD, covering multiple text genres (wiki, fiction, grammar examples, social, non-fiction). We highlight the morphosyntactic differences between the closely-related Bavarian and German and showcase the rich variability of speakers' orthographies. Our corpus includes 15k tokens, covering dialects from all Bavarian-speaking areas spanning three countries. We provide baseline parsing and POS tagging results, which are lower than results obtained on German and vary substantially between different graph-based parsers. To support further research on Bavarian syntax, we make our dataset, language-specific guidelines and code publicly available.

Computation and Language
ITALIC: An Italian Intent Classification Dataset

Alkis Koudounas,Moreno La Quatra,Lorenzo Vaiani,Luca Colomba,Giuseppe Attanasio,Eliana Pastor,Luca Cagliero,Elena Baralis

DOI: https://doi.org/10.21437/Interspeech.2023-1980

2023-06-14

Abstract:Recent large-scale Spoken Language Understanding datasets focus predominantly on English and do not account for language-specific phenomena such as particular phonemes or words in different lects. We introduce ITALIC, the first large-scale speech dataset designed for intent classification in Italian. The dataset comprises 16,521 crowdsourced audio samples recorded by 70 speakers from various Italian regions and annotated with intent labels and additional metadata. We explore the versatility of ITALIC by evaluating current state-of-the-art speech and text models. Results on intent classification suggest that increasing scale and running language adaptation yield better speech models, monolingual text models outscore multilingual ones, and that speech recognition on ITALIC is more challenging than on existing Italian benchmarks. We release both the dataset and the annotation scheme to streamline the development of new Italian SLU models and language-specific datasets.

Computation and Language,Sound,Audio and Speech Processing
LuxBank: The First Universal Dependency Treebank for Luxembourgish

Alistair Plum,Caroline Döhmer,Emilia Milano,Anne-Marie Lutgen,Christoph Purschke

2024-11-07

Abstract:The Universal Dependencies (UD) project has significantly expanded linguistic coverage across 161 languages, yet Luxembourgish, a West Germanic language spoken by approximately 400,000 people, has remained absent until now. In this paper, we introduce LuxBank, the first UD Treebank for Luxembourgish, addressing the gap in syntactic annotation and analysis for this `low-research' language. We establish formal guidelines for Luxembourgish language annotation, providing the foundation for the first large-scale quantitative analysis of its syntax. LuxBank serves not only as a resource for linguists and language learners but also as a tool for developing spell checkers and grammar checkers, organising existing text archives and even training large language models. By incorporating Luxembourgish into the UD framework, we aim to enhance the understanding of syntactic variation within West Germanic languages and offer a model for documenting smaller, semi-standardised languages. This work positions Luxembourgish as a valuable resource in the broader linguistic and NLP communities, contributing to the study of languages with limited research and resources.

Computation and Language
Building Tamil Treebanks

Kengatharaiyer Sarveswaran

2024-09-23

Abstract:Treebanks are important linguistic resources, which are structured and annotated corpora with rich linguistic annotations. These resources are used in Natural Language Processing (NLP) applications, supporting linguistic analyses, and are essential for training and evaluating various computational models. This paper discusses the creation of Tamil treebanks using three distinct approaches: manual annotation, computational grammars, and machine learning techniques. Manual annotation, though time-consuming and requiring linguistic expertise, ensures high-quality and rich syntactic and semantic information. Computational deep grammars, such as Lexical Functional Grammar (LFG), offer deep linguistic analyses but necessitate significant knowledge of the formalism. Machine learning approaches, utilising off-the-shelf frameworks and tools like Stanza, UDpipe, and UUParser, facilitate the automated annotation of large datasets but depend on the availability of quality annotated data, cross-linguistic training resources, and computational power. The paper discusses the challenges encountered in building Tamil treebanks, including issues with Internet data, the need for comprehensive linguistic analysis, and the difficulty of finding skilled annotators. Despite these challenges, the development of Tamil treebanks is essential for advancing linguistic research and improving NLP tools for Tamil.

Computation and Language
Treebanking User-Generated Content: a UD Based Overview of Guidelines, Corpora and Unified Recommendations

Manuela Sanguinetti,Lauren Cassidy,Cristina Bosco,Özlem Çetinoğlu,Alessandra Teresa Cignarella,Teresa Lynn,Ines Rehbein,Josef Ruppenhofer,Djamé Seddah,Amir Zeldes

DOI: https://doi.org/10.48550/arXiv.2011.02063

2020-11-04

Abstract:This article presents a discussion on the main linguistic phenomena which cause difficulties in the analysis of user-generated texts found on the web and in social media, and proposes a set of annotation guidelines for their treatment within the Universal Dependencies (UD) framework of syntactic analysis. Given on the one hand the increasing number of treebanks featuring user-generated content, and its somewhat inconsistent treatment in these resources on the other, the aim of this article is twofold: (1) to provide a condensed, though comprehensive, overview of such treebanks -- based on available literature -- along with their main features and a comparative analysis of their annotation criteria, and (2) to propose a set of tentative UD-based annotation guidelines, to promote consistent treatment of the particular phenomena found in these types of texts. The overarching goal of this article is to provide a common framework for researchers interested in developing similar resources in UD, thus promoting cross-linguistic consistency, which is a principle that has always been central to the spirit of UD.

Computation and Language
Universal Dependencies for Learner English

Yevgeni Berzak,Jessica Kenney,Carolyn Spadine,Jing Xian Wang,Lucia Lam,Keiko Sophie Mori,Sebastian Garza,Boris Katz

DOI: https://doi.org/10.48550/arXiv.1605.04278

2016-06-08

Abstract:We introduce the Treebank of Learner English (TLE), the first publicly available syntactic treebank for English as a Second Language (ESL). The TLE provides manually annotated POS tags and Universal Dependency (UD) trees for 5,124 sentences from the Cambridge First Certificate in English (FCE) corpus. The UD annotations are tied to a pre-existing error annotation of the FCE, whereby full syntactic analyses are provided for both the original and error corrected versions of each sentence. Further on, we delineate ESL annotation guidelines that allow for consistent syntactic treatment of ungrammatical English. Finally, we benchmark POS tagging and dependency parsing performance on the TLE dataset and measure the effect of grammatical errors on parsing accuracy. We envision the treebank to support a wide range of linguistic and computational research on second language acquisition as well as automatic processing of ungrammatical language. The treebank is available at <a class="link-external link-http" href="http://universaldependencies.org" rel="external noopener nofollow">this http URL</a>. The annotation manual used in this project and a graphical query engine are available at <a class="link-external link-http" href="http://esltreebank.org" rel="external noopener nofollow">this http URL</a>.

Computation and Language
DILLo: an Italian lexical database for speech-language pathologists

Federica Beccaria,Angela Cristiano,Flavio Pisciotta,Noemi Usardi,Elisa Borgogni,Filippo Prayer Galletti,Giulia Corsi,Lorenzo Gregori,Gloria Gagliardi

DOI: https://doi.org/10.1007/s10579-024-09722-2

2024-03-24

Language Resources and Evaluation

Abstract:A novel lexical resource for treating speech impairments from childhood to senility: DILLo— Database Italiano del Lessico per Logopedisti (i.e., Italian Database for Speech-Language Pathologists) is presented. DILLo is a free online web application that allows extraction of filtered wordlists for flexible rehabilitative purposes. Its major aim is to provide Italian speech-language pathologists (SLPs) with a resource that takes advantage of Information and Communication Technologies for language in a healthcare setting. DILLo's design adopts an integrated approach that envisages fruitful cooperation between clinical and linguistic professionals. The 7690 Italian words in the database have been selected based on phonological, phonotactic, and morphological properties, and their frequency of use. These linguistic features are encoded in the tool, which includes the orthographic and phonological transcriptions, and the phonotactic structure of each word. Moreover, most of the entries are associated with their respective ARASAAC pictogram, providing an additional and inclusive tool for treating speech impairments. The user-friendly interface is structured to allow for different and adaptable search options. DILLo allows Speech-Language Pathologists (SLPs) to obtain a rich, tailored, and varied selection of suitable linguistic stimuli. It can be used to customize the treatment of many impairments, e.g., Speech Sound Disorders, Childhood Apraxia of Speech, Specific Learning Disabilities, aphasia, dysarthria, dysphonia, and the auditory training that follows cochlear implantations.

computer science, interdisciplinary applications
The TreeBanker: a Tool for Supervised Training of Parsed Corpora

David Carter

DOI: https://doi.org/10.48550/arXiv.cmp-lg/9705008

1997-05-07

Computation and Language

Abstract:I describe the TreeBanker, a graphical tool for the supervised training involved in domain customization of the disambiguation component of a speech- or language-understanding system. The TreeBanker presents a user, who need not be a system expert, with a range of properties that distinguish competing analyses for an utterance and that are relatively easy to judge. This allows training on a corpus to be completed in far less time, and with far less expertise, than would be needed if analyses were inspected directly: it becomes possible for a corpus of about 20,000 sentences of the complexity of those in the ATIS corpus to be judged in around three weeks of work by a linguistically aware non-expert.
The Status of Function Words in Dependency Grammar: A Critique of Universal Dependencies (UD)

Timothy Osborne,Kim Gerdes

DOI: https://doi.org/10.5334/gjgl.537

2019-01-01

Abstract:The article examines the Universal Dependencies (UD) annotation scheme. The UD project is an international initiative to produce treebanks of the world's languages, whereby the treebanks have been annotated in a cross-linguistically consistent manner. A central aspect of the UD annotation scheme is its analysis of function words. The scheme advocates subordinating function words to content words. This article discusses linguistic and practical motivations behind the UD decision to subordinate function words to content words. It demonstrates that UD choices in this area are not supported linguistically. At the same time, the near convertibility of the UD treebanks to a more linguistically motivated annotation format means that the UD initiative remains of great value to linguistics in general.
A Universal Framework for Inductive Transfer Parsing Across Multi-typed Treebanks.

Jiang Guo,Wanxiang Che,Haifeng Wang,Ting Liu

2016-01-01

Abstract:Various treebanks have been released for dependency parsing. Despite that treebanks may belong to different languages or have different annotation schemes, they contain common syntactic knowledge that is potential to benefit each other. This paper presents a universal framework for transfer parsing across multi-typed treebanks with deep multi-task learning. We consider two kinds of treebanks as source: the multilingual universal treebanks and the monolingual heterogeneous treebanks. Knowledge across the source and target treebanks are effectively transferred through multi-level parameter sharing. Experiments on several benchmark datasets in various languages demonstrate that our approach can make effective use of arbitrary source treebanks to improve target parsing models.
Annotating Constructions with UD: the experience of the Italian Constructicon

Ludovica Pannitto,Beatrice Bernasconi,Lucia Busso,Flavio Pisciotta,Giulia Rambelli,Francesca Masini

2024-11-12

Abstract:The paper descirbes a first attempt of linking the Italian constructicon to UD resources

Computation and Language
Domain embeddings for generating complex descriptions of concepts in Italian language

Alessandro Maisto

DOI: https://doi.org/10.1007/s10339-024-01234-9

2024-10-22

Cognitive Processing

Abstract:In this work, we propose a Distributional Semantic resource enriched with linguistic and lexical information extracted from electronic dictionaries. This resource is designed to bridge the gap between the continuous semantic values represented by distributional vectors and the discrete descriptions provided by general semantics theory. Recently, many researchers have focused on the connection between embeddings and a comprehensive theory of semantics and meaning. This often involves translating the representation of word meanings in Distributional Models into a set of discrete, manually constructed properties, such as semantic primitives or features, using neural decoding techniques. Our approach introduces an alternative strategy based on linguistic data. We have developed a collection of domain-specific co-occurrence matrices derived from two sources: a list of Italian nouns classified into four semantic traits and 20 concrete noun sub-categories and Italian verbs classified by their semantic classes. In these matrices, the co-occurrence values for each word are calculated exclusively with a defined set of words relevant to a particular lexical domain. The resource includes 21 domain-specific matrices, one comprehensive matrix, and a Graphical User Interface. Our model facilitates the generation of reasoned semantic descriptions of concepts by selecting matrices directly associated with concrete conceptual knowledge, such as a matrix based on location nouns and the concept of animal habitats. We assessed the utility of the resource through two experiments, achieving promising outcomes in both the automatic classification of animal nouns and the extraction of animal features.

psychology, experimental
EventNet-ITA: Italian Frame Parsing for Events

Marco Rovera

2024-02-19

Abstract:This paper introduces EventNet-ITA, a large, multi-domain corpus annotated full-text with event frames for Italian. Moreover, we present and thoroughly evaluate an efficient multi-label sequence labeling approach for Frame Parsing. Covering a wide range of individual, social and historical phenomena, with more than 53,000 annotated sentences and over 200 modeled frames, EventNet-ITA constitutes the first systematic attempt to provide the Italian language with a publicly available resource for Frame Parsing of events, useful for a broad spectrum of research and application tasks. Our approach achieves a promising 0.9 strict F1-score for frame classification and 0.72 for frame element classification, on top of minimizing computational requirements. The annotated corpus and the frame parsing model are released under open license.

Computation and Language
A Joint Initiative to Support the Semantic Interoperability within the GIIDA Project

Paolo Plini,Sabin Di Franco,Valentina De Santis,Vito F. Uricchio,Dario De Carlo,Stefania D'Arpa,Monica De Martino,Riccardo Albertoni

DOI: https://doi.org/10.48550/arXiv.1012.0160

2010-12-01

Abstract:The GIIDA project aims to develop a digital infrastructure for the spatial information within CNR. It is foreseen to use semantic-oriented technologies to ease information modeling and connecting, according to international standards like the ISO/IEC 11179. Complex information management systems, like GIIDA, will take benefit from the use of terminological tools like thesauri that make available a reference lexicon for the indexing and retrieval of information. Within GIIDA the goal is to make available the EARTh thesaurus (Environmental Applications Reference Thesaurus), developed by the CNR-IIA-EKOLab. A web-based software, developed by the CNR-Water Research Institute (IRSA) was implemented to allow consultation and utilization of thesaurus through the web. This service is a useful tool to ensure interoperability between thesaurus and other systems of the indexing, with, the idea of cooperating to develop a comprehensive system of knowledge organization, that could be defined integrated, open, multi-functional and multilingual. Currently the system is available in multiple languages mode (Italian - English) and navigation can be done in the following ways: Alphabetical, Hierarchical and for Themes. A full search allows to find any term by searching for the whole term or a part of it and as well as allows to filter the results by themes. Within a collaborative initiative with the CNR-Institute of Applied Mathematics and Information Technology (IMATI) a SKOS (Simple Knowledge Organization System) version of EARTh was developed. This will ensure the possibility to support the use of the thesaurus within the framework of the Semantic Web in order to be used in decentralized metadata applications

Digital Libraries
Unsupervised Learning of Discourse Structures using a Tree Autoencoder

Patrick Huber,Giuseppe Carenini

DOI: https://doi.org/10.1609/aaai.v35i14.17549

2021-05-18

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Discourse information, as postulated by popular discourse theories, such as RST and PDTB, has been shown to improve an increasing number of downstream NLP tasks, showing positive effects and synergies of discourse with important real-world applications. While methods for incorporating discourse become more and more sophisticated, the growing need for robust and general discourse structures has not been sufficiently met by current discourse parsers, usually trained on small scale datasets in a strictly limited number of domains. This makes the prediction for arbitrary tasks noisy and unreliable. The overall resulting lack of high-quality, high-quantity discourse trees poses a severe limitation to further progress. In order the alleviate this shortcoming, we propose a new strategy to generate tree structures in a task-agnostic, unsupervised fashion by extending a latent tree induction framework with an auto-encoding objective. The proposed approach can be applied to any tree-structured objective, such as syntactic parsing, discourse parsing and others. However, due to the especially difficult annotation process to generate discourse trees, we initially develop a method to generate larger and more diverse discourse treebanks. In this paper we are inferring general tree structures of natural text in multiple domains, showing promising results on a diverse set of tasks.

English Else
ArCo: the Italian Cultural Heritage Knowledge Graph

Valentina Anita Carriero,Aldo Gangemi,Maria Letizia Mancinelli,Ludovica Marinucci,Andrea Giovanni Nuzzolese,Valentina Presutti,Chiara Veninata

DOI: https://doi.org/10.48550/arXiv.1905.02840

IF: 14.4

2019-05-07

Artificial Intelligence

Abstract:ArCo is the Italian Cultural Heritage knowledge graph, consisting of a network of seven vocabularies and 169 million triples about 820 thousand cultural entities. It is distributed jointly with a SPARQL endpoint, a software for converting catalogue records to RDF, and a rich suite of documentation material (testing, evaluation, how-to, examples, etc.). ArCo is based on the official General Catalogue of the Italian Ministry of Cultural Heritage and Activities (MiBAC) - and its associated encoding regulations - which collects and validates the catalogue records of (ideally) all Italian Cultural Heritage properties (excluding libraries and archives), contributed by CH administrators from all over Italy. We present its structure, design methods and tools, its growing community, and delineate its importance, quality, and impact.
Data-driven Parsing Evaluation for Child-Parent Interactions

Zoey Liu,Emily Prud’hommeaux

DOI: https://doi.org/10.1162/tacl_a_00624

IF: 10.9

2023-01-01

Transactions of the Association for Computational Linguistics

Abstract:Abstract We present a syntactic dependency treebank for naturalistic child and child-directed spoken English. Our annotations largely follow the guidelines of the Universal Dependencies project (UD [Zeman et al., 2022]), with detailed extensions to lexical and syntactic structures unique to spontaneous spoken language, as opposed to written texts or prepared speech. Compared to existing UD-style spoken treebanks and other dependency corpora of child-parent interactions specifically, our dataset is much larger (44,744 utterances; 233,907 words) and contains data from 10 children covering a wide age range (18–66 months). We conduct thorough dependency parser evaluations using both graph-based and transition-based parsers, trained on three different types of out-of-domain written texts: news, tweets, and learner data. Out-of-domain parsers demonstrate reasonable performance for both child and parent data. In addition, parser performance for child data increases along children’s developmental paths, especially between 18 and 48 months, and gradually approaches the performance for parent data. These results are further validated with in-domain training.
LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models

Salvatore Mario Carta,Stefano Chessa,Giulia Contu,Andrea Corriga,Andrea Deidda,Gianni Fenu,Luca Frigau,Alessandro Giuliani,Luca Grassi,Marco Manolo Manca,Mirko Marras,Francesco Mola,Bastianino Mossa,Piergiorgio Mura,Marco Ortu,Leonardo Piano,Simone Pisano,Alessia Pisu,Alessandro Sebastian Podda,Livio Pompianu,Simone Seu,Sandro Gabriele Tiddia

2024-11-21

Abstract:Minority languages are vital to preserving cultural heritage, yet they face growing risks of extinction due to limited digital resources and the dominance of artificial intelligence models trained on high-resource languages. This white paper proposes a framework to generate linguistic tools for low-resource languages, focusing on data creation to support the development of language models that can aid in preservation efforts. Sardinian, an endangered language, serves as the case study to demonstrate the framework's effectiveness. By addressing the data scarcity that hinders intelligent applications for such languages, we contribute to promoting linguistic diversity and support ongoing efforts in language standardization and revitalization through modern technologies.

Computation and Language,Artificial Intelligence

Towards the first UD Treebank of Spoken Italian: the KIParla forest

The KIPARLA Forest treebank of spoken Italian: an overview of initial design choices

Unifying Lexicons in view of a Phonological and Morphological Lexical DB

MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank

ITALIC: An Italian Intent Classification Dataset

LuxBank: The First Universal Dependency Treebank for Luxembourgish

Building Tamil Treebanks

Treebanking User-Generated Content: a UD Based Overview of Guidelines, Corpora and Unified Recommendations

Universal Dependencies for Learner English

DILLo: an Italian lexical database for speech-language pathologists

The TreeBanker: a Tool for Supervised Training of Parsed Corpora

The Status of Function Words in Dependency Grammar: A Critique of Universal Dependencies (UD)

A Universal Framework for Inductive Transfer Parsing Across Multi-typed Treebanks.

Annotating Constructions with UD: the experience of the Italian Constructicon

Domain embeddings for generating complex descriptions of concepts in Italian language

EventNet-ITA: Italian Frame Parsing for Events

A Joint Initiative to Support the Semantic Interoperability within the GIIDA Project

Unsupervised Learning of Discourse Structures using a Tree Autoencoder

ArCo: the Italian Cultural Heritage Knowledge Graph

Data-driven Parsing Evaluation for Child-Parent Interactions

LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models