The KIPARLA Forest treebank of spoken Italian: an overview of initial design choices

Ludovica Pannitto,Caterina Mauri

2024-11-11

Abstract:The paper presents an overview of initial design choices discussed towards the creation of a treebank for the Italian KIParla corpus

Computation and Language

What problem does this paper attempt to address?

Towards the first UD Treebank of Spoken Italian: the KIParla forest

Ludovica Pannitto

2024-10-07

Abstract:The present project endeavors to enrich the linguistic resources available for Italian by constructing a Universal Dependencies treebank for the KIParla corpus (Mauri et al., 2019, Ballarè et al., 2020), an existing and well known resource for spoken Italian.

Computation and Language
The TreeBanker: a Tool for Supervised Training of Parsed Corpora

David Carter

DOI: https://doi.org/10.48550/arXiv.cmp-lg/9705008

1997-05-07

Computation and Language

Abstract:I describe the TreeBanker, a graphical tool for the supervised training involved in domain customization of the disambiguation component of a speech- or language-understanding system. The TreeBanker presents a user, who need not be a system expert, with a range of properties that distinguish competing analyses for an utterance and that are relatively easy to judge. This allows training on a corpus to be completed in far less time, and with far less expertise, than would be needed if analyses were inspected directly: it becomes possible for a corpus of about 20,000 sentences of the complexity of those in the ATIS corpus to be judged in around three weeks of work by a linguistically aware non-expert.
Unifying Lexicons in view of a Phonological and Morphological Lexical DB

Federico Calzolari,Michele Mammini,Monica Monachini

DOI: https://doi.org/10.48550/arXiv.cs/0612062

2006-12-11

Information Retrieval

Abstract:The present work falls in the line of activities promoted by the European Languguage Resource Association (ELRA) Production Committee (PCom) and raises issues in methods, procedures and tools for the reusability, creation, and management of Language Resources. A two-fold purpose lies behind this experiment. The first aim is to investigate the feasibility, define methods and procedures for combining two Italian lexical resources that have incompatible formats and complementary information into a Unified Lexicon (UL). The adopted strategy and the procedures appointed are described together with the driving criterion of the merging task, where a balance between human and computational efforts is pursued. The coverage of the UL has been maximized, by making use of simple and fast matching procedures. The second aim is to exploit this newly obtained resource for implementing the phonological and morphological layers of the CLIPS lexical database. Implementing these new layers and linking them with the already exisitng syntactic and semantic layers is not a trivial task. The constraints imposed by the model, the impact at the architectural level and the solution adopted in order to make the whole database `speak' efficiently are presented. Advantages vs. disadvantages are discussed.
Building Tamil Treebanks

Kengatharaiyer Sarveswaran

2024-09-23

Abstract:Treebanks are important linguistic resources, which are structured and annotated corpora with rich linguistic annotations. These resources are used in Natural Language Processing (NLP) applications, supporting linguistic analyses, and are essential for training and evaluating various computational models. This paper discusses the creation of Tamil treebanks using three distinct approaches: manual annotation, computational grammars, and machine learning techniques. Manual annotation, though time-consuming and requiring linguistic expertise, ensures high-quality and rich syntactic and semantic information. Computational deep grammars, such as Lexical Functional Grammar (LFG), offer deep linguistic analyses but necessitate significant knowledge of the formalism. Machine learning approaches, utilising off-the-shelf frameworks and tools like Stanza, UDpipe, and UUParser, facilitate the automated annotation of large datasets but depend on the availability of quality annotated data, cross-linguistic training resources, and computational power. The paper discusses the challenges encountered in building Tamil treebanks, including issues with Internet data, the need for comprehensive linguistic analysis, and the difficulty of finding skilled annotators. Despite these challenges, the development of Tamil treebanks is essential for advancing linguistic research and improving NLP tools for Tamil.

Computation and Language
ITALIC: An Italian Intent Classification Dataset

Alkis Koudounas,Moreno La Quatra,Lorenzo Vaiani,Luca Colomba,Giuseppe Attanasio,Eliana Pastor,Luca Cagliero,Elena Baralis

DOI: https://doi.org/10.21437/Interspeech.2023-1980

2023-06-14

Abstract:Recent large-scale Spoken Language Understanding datasets focus predominantly on English and do not account for language-specific phenomena such as particular phonemes or words in different lects. We introduce ITALIC, the first large-scale speech dataset designed for intent classification in Italian. The dataset comprises 16,521 crowdsourced audio samples recorded by 70 speakers from various Italian regions and annotated with intent labels and additional metadata. We explore the versatility of ITALIC by evaluating current state-of-the-art speech and text models. Results on intent classification suggest that increasing scale and running language adaptation yield better speech models, monolingual text models outscore multilingual ones, and that speech recognition on ITALIC is more challenging than on existing Italian benchmarks. We release both the dataset and the annotation scheme to streamline the development of new Italian SLU models and language-specific datasets.

Computation and Language,Sound,Audio and Speech Processing
ARCA. Semantic exploration of a bookstore

Eleonora Bernasconi,Miguel Ceriani,Massimo Mecella,Tiziana Catarci,Maria Cristina Capanna,Clara Di Fazio,Roberto Marcucci,Erik Pender,Fabio Maria Petriccione

DOI: https://doi.org/10.1145/3399715.3399939

2020-09-28

Abstract:In this demo paper, we present ARCA, a visual-search based system that allows the semantic exploration of a bookstore. Navigating a domain-specific knowledge graph, students and researchers alike can start from any specific concept and reach any other related concept, discovering associated books and information. To achieve this paradigm of interaction we built a prototype system, flexible and adaptable to multiple contexts of use, that extracts semantic information from the contents of a books' corpus, building a dedicated knowledge graph that is linked to external knowledge bases. The web-based user interface of ARCA integrates text-based search, visual knowledge graph navigation, and linear visualization of filtered books (ordered according to multiple criteria) in a comprehensive coordinated view aimed at exploiting the underlying data while avoiding information overload and unnecessary cluttering. A proof-of-concept of ARCA is available online at http://arca.diag.uniroma1.it
MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank

Verena Blaschke,Barbara Kovačić,Siyao Peng,Hinrich Schütze,Barbara Plank

2024-03-15

Abstract:Despite the success of the Universal Dependencies (UD) project exemplified by its impressive language breadth, there is still a lack in `within-language breadth': most treebanks focus on standard languages. Even for German, the language with the most annotations in UD, so far no treebank exists for one of its language varieties spoken by over 10M people: Bavarian. To contribute to closing this gap, we present the first multi-dialect Bavarian treebank (MaiBaam) manually annotated with part-of-speech and syntactic dependency information in UD, covering multiple text genres (wiki, fiction, grammar examples, social, non-fiction). We highlight the morphosyntactic differences between the closely-related Bavarian and German and showcase the rich variability of speakers' orthographies. Our corpus includes 15k tokens, covering dialects from all Bavarian-speaking areas spanning three countries. We provide baseline parsing and POS tagging results, which are lower than results obtained on German and vary substantially between different graph-based parsers. To support further research on Bavarian syntax, we make our dataset, language-specific guidelines and code publicly available.

Computation and Language
DILLo: an Italian lexical database for speech-language pathologists

Federica Beccaria,Angela Cristiano,Flavio Pisciotta,Noemi Usardi,Elisa Borgogni,Filippo Prayer Galletti,Giulia Corsi,Lorenzo Gregori,Gloria Gagliardi

DOI: https://doi.org/10.1007/s10579-024-09722-2

2024-03-24

Language Resources and Evaluation

Abstract:A novel lexical resource for treating speech impairments from childhood to senility: DILLo— Database Italiano del Lessico per Logopedisti (i.e., Italian Database for Speech-Language Pathologists) is presented. DILLo is a free online web application that allows extraction of filtered wordlists for flexible rehabilitative purposes. Its major aim is to provide Italian speech-language pathologists (SLPs) with a resource that takes advantage of Information and Communication Technologies for language in a healthcare setting. DILLo's design adopts an integrated approach that envisages fruitful cooperation between clinical and linguistic professionals. The 7690 Italian words in the database have been selected based on phonological, phonotactic, and morphological properties, and their frequency of use. These linguistic features are encoded in the tool, which includes the orthographic and phonological transcriptions, and the phonotactic structure of each word. Moreover, most of the entries are associated with their respective ARASAAC pictogram, providing an additional and inclusive tool for treating speech impairments. The user-friendly interface is structured to allow for different and adaptable search options. DILLo allows Speech-Language Pathologists (SLPs) to obtain a rich, tailored, and varied selection of suitable linguistic stimuli. It can be used to customize the treatment of many impairments, e.g., Speech Sound Disorders, Childhood Apraxia of Speech, Specific Learning Disabilities, aphasia, dysarthria, dysphonia, and the auditory training that follows cochlear implantations.

computer science, interdisciplinary applications
Treebanking User-Generated Content: a UD Based Overview of Guidelines, Corpora and Unified Recommendations

Manuela Sanguinetti,Lauren Cassidy,Cristina Bosco,Özlem Çetinoğlu,Alessandra Teresa Cignarella,Teresa Lynn,Ines Rehbein,Josef Ruppenhofer,Djamé Seddah,Amir Zeldes

DOI: https://doi.org/10.48550/arXiv.2011.02063

2020-11-04

Abstract:This article presents a discussion on the main linguistic phenomena which cause difficulties in the analysis of user-generated texts found on the web and in social media, and proposes a set of annotation guidelines for their treatment within the Universal Dependencies (UD) framework of syntactic analysis. Given on the one hand the increasing number of treebanks featuring user-generated content, and its somewhat inconsistent treatment in these resources on the other, the aim of this article is twofold: (1) to provide a condensed, though comprehensive, overview of such treebanks -- based on available literature -- along with their main features and a comparative analysis of their annotation criteria, and (2) to propose a set of tentative UD-based annotation guidelines, to promote consistent treatment of the particular phenomena found in these types of texts. The overarching goal of this article is to provide a common framework for researchers interested in developing similar resources in UD, thus promoting cross-linguistic consistency, which is a principle that has always been central to the spirit of UD.

Computation and Language
BRAIN - Holocene archaeo-data for assessing plant-cultural diversity in Italy and other Mediterranean regions

Anna Maria Mercuri,Eleonora Clò,Jessica Zappa,Giovanna Bosi,Elisa Furia,Cristina Ricucci,Matteo Di Lena,Federico Camerini,Assunta Florenzano

DOI: https://doi.org/10.1038/s41597-024-03346-5

2024-05-22

Scientific Data

Abstract:In the field of botany applied to archaeological and palaeoecological studies, the multi- and inter-disciplinary nature of this research produces a lack of data sharing and scattered articles in the specialty literature or in national and international journals. The vast production of archaeobotany and palynology data makes it necessary to develop a tool for the availability, accessibility, and dissemination of existing research. Many databases exist on palaeoecology, archaeobotany or pollen data. There are no collections focused on archaeological sites and human-induced environments and centred on Southern Europe and the Mediterranean. BRAIN - Botanical Records of Archaeobotany Italian Network is the first database listing sites from which all types of plant records are available in Italy and nearby Mediterranean regions. BRAIN represents the largest integrated collection of archaeo/palaeo-botanical data and a range of descriptive information that makes data recovery FAIR ready. This unique network hosts data on the availability of anthropogenic pollen, palynomorphs and plant macroremains in the same database, and experts of different research fields may contribute to it.

multidisciplinary sciences
Latin Treebanks in Review: An Evaluation of Morphological Tagging Across Time

Marisa Hudspeth,Brendan O'Connor,Laure Thompson

2024-08-13

Abstract:Existing Latin treebanks draw from Latin's long written tradition, spanning 17 centuries and a variety of cultures. Recent efforts have begun to harmonize these treebanks' annotations to better train and evaluate morphological taggers. However, the heterogeneity of these treebanks must be carefully considered to build effective and reliable data. In this work, we review existing Latin treebanks to identify the texts they draw from, identify their overlap, and document their coverage across time and genre. We additionally design automated conversions of their morphological feature annotations into the conventions of standard Latin grammar. From this, we build new time-period data splits that draw from the existing treebanks which we use to perform a broad cross-time analysis for POS and morphological feature tagging. We find that BERT-based taggers outperform existing taggers while also being more robust to cross-domain shifts.

Computation and Language
ArCo: the Italian Cultural Heritage Knowledge Graph

Valentina Anita Carriero,Aldo Gangemi,Maria Letizia Mancinelli,Ludovica Marinucci,Andrea Giovanni Nuzzolese,Valentina Presutti,Chiara Veninata

DOI: https://doi.org/10.48550/arXiv.1905.02840

IF: 14.4

2019-05-07

Artificial Intelligence

Abstract:ArCo is the Italian Cultural Heritage knowledge graph, consisting of a network of seven vocabularies and 169 million triples about 820 thousand cultural entities. It is distributed jointly with a SPARQL endpoint, a software for converting catalogue records to RDF, and a rich suite of documentation material (testing, evaluation, how-to, examples, etc.). ArCo is based on the official General Catalogue of the Italian Ministry of Cultural Heritage and Activities (MiBAC) - and its associated encoding regulations - which collects and validates the catalogue records of (ideally) all Italian Cultural Heritage properties (excluding libraries and archives), contributed by CH administrators from all over Italy. We present its structure, design methods and tools, its growing community, and delineate its importance, quality, and impact.
Next Generation Language Resources using GRID

Federico Calzolari,Eva Sassolini,Manuela Sassi,Sebastiana Cucurullo,Eugenio Picchi,Francesca Bertagna,Alessandro Enea,Monica Monachini,Claudia Soria,Nicoletta Calzolari

DOI: https://doi.org/10.48550/arXiv.cs/0611148

2006-12-13

Abstract:This paper presents a case study concerning the challenges and requirements posed by next generation language resources, realized as an overall model of open, distributed and collaborative language infrastructure. If a sort of "new paradigm" is required, we think that the emerging and still evolving technology connected to Grid computing is a very interesting and suitable one for a concrete realization of this vision. Given the current limitations of Grid computing, it is very important to test the new environment on basic language analysis tools, in order to get the feeling of what are the potentialities and possible limitations connected to its use in NLP. For this reason, we have done some experiments on a module of Linguistic Miner, i.e. the extraction of linguistic patterns from restricted domain corpora.

Distributed, Parallel, and Cluster Computing,Computation and Language
EventNet-ITA: Italian Frame Parsing for Events

Marco Rovera

2024-02-19

Abstract:This paper introduces EventNet-ITA, a large, multi-domain corpus annotated full-text with event frames for Italian. Moreover, we present and thoroughly evaluate an efficient multi-label sequence labeling approach for Frame Parsing. Covering a wide range of individual, social and historical phenomena, with more than 53,000 annotated sentences and over 200 modeled frames, EventNet-ITA constitutes the first systematic attempt to provide the Italian language with a publicly available resource for Frame Parsing of events, useful for a broad spectrum of research and application tasks. Our approach achieves a promising 0.9 strict F1-score for frame classification and 0.72 for frame element classification, on top of minimizing computational requirements. The annotated corpus and the frame parsing model are released under open license.

Computation and Language
PILA: A Historical-Linguistic Dataset of Proto-Italic and Latin

Stephen Bothwell,Brian DuSell,David Chiang,Brian Krostenko

2024-04-25

Abstract:Computational historical linguistics seeks to systematically understand processes of sound change, including during periods at which little to no formal recording of language is attested. At the same time, few computational resources exist which deeply explore phonological and morphological connections between proto-languages and their descendants. This is particularly true for the family of Italic languages. To assist historical linguists in the study of Italic sound change, we introduce the Proto-Italic to Latin (PILA) dataset, which consists of roughly 3,000 pairs of forms from Proto-Italic and Latin. We provide a detailed description of how our dataset was created and organized. Then, we exhibit PILA's value in two ways. First, we present baseline results for PILA on a pair of traditional computational historical linguistics tasks. Second, we demonstrate PILA's capability for enhancing other historical-linguistic datasets through a dataset compatibility study.

Computation and Language
Cerbero-7B: A Leap Forward in Language-Specific LLMs Through Enhanced Chat Corpus Generation and Evaluation

Federico A. Galatolo,Mario G.C.A. Cimino

DOI: https://doi.org/10.48550/arXiv.2311.15698

2023-11-27

Abstract:This study introduces a novel approach for generating high-quality, language-specific chat corpora using a self-chat mechanism. We combine a generator LLM for creating new samples and an embedder LLM to ensure diversity. A new Masked Language Modelling (MLM) model-based quality assessment metric is proposed for evaluating and filtering the corpora. Utilizing the llama2-70b as the generator and a multilingual sentence transformer as embedder, we generate an Italian chat corpus and refine the Fauno corpus, which is based on translated English ChatGPT self-chat data. The refinement uses structural assertions and Natural Language Processing techniques. Both corpora undergo a comprehensive quality evaluation using the proposed MLM model-based quality metric. The Italian LLM fine-tuned with these corpora demonstrates significantly enhanced language comprehension and question-answering skills. The resultant model, cerbero-7b, establishes a new state-of-the-art for Italian LLMs. This approach marks a substantial advancement in the development of language-specific LLMs, with a special emphasis on augmenting corpora for underrepresented languages like Italian.

Computation and Language,Artificial Intelligence
The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italian

Giovanni Puccetti,Maria Cassese,Andrea Esuli

2024-09-17

Abstract:While Italian is a high-resource language, there are few Italian-native benchmarks to evaluate generative Large Language Models (LLMs) in this language. This work presents three new benchmarks: Invalsi MATE to evaluate models performance on mathematical understanding in Italian, Invalsi ITA to evaluate language understanding in Italian and Olimpiadi MATE for more complex mathematical understanding. The first two benchmarks are based on the Invalsi tests, which are administered to students of age between 6 and 18 within the Italian school system and have been validated by several experts in teaching and pedagogy, the third one comes from the Italian high school math Olympics. We evaluate 10 powerful language models on these benchmarks and find that they are bound by 71% accuracy on Invasli MATE, achieved by Llama 3.1 70b instruct and by 88% on Invalsi ITA. For both Invalsi MATE and Invalsi ITA we compare LLMs with the average performance of Italian students to show that Llama 3.1 is the only one to outperform them on Invalsi MATE while most models do so on Invalsi ITA, we then show that Olimpiadi MATE is more challenging than Invalsi MATE and the highest accuracy, achieved by Llama 3.1 405b instruct is 45%. We will make data and evaluation code openly available upon acceptance of the paper.

Computation and Language
A survey on text classification: Practical perspectives on the Italian language.

Andrea Gasparetto,Alessandro Zangari,Matteo Marcuzzo,Andrea Albarelli

DOI: https://doi.org/10.1371/journal.pone.0270904

IF: 3.7

2022-07-08

PLoS ONE

Abstract:Text Classification methods have been improving at an unparalleled speed in the last decade thanks to the success brought about by deep learning. Historically, state-of-the-art approaches have been developed for and benchmarked against English datasets, while other languages have had to catch up and deal with inevitable linguistic challenges. This paper offers a survey with practical and linguistic connotations, showcasing the complications and challenges tied to the application of modern Text Classification algorithms to languages other than English. We engage this subject from the perspective of the Italian language, and we discuss in detail issues related to the scarcity of task-specific datasets, as well as the issues posed by the computational expensiveness of modern approaches. We substantiate this by providing an extensively researched list of available datasets in Italian, comparing it with a similarly sought list for French, which we use for comparison. In order to simulate a real-world practical scenario, we apply a number of representative methods to custom-tailored multilabel classification datasets in Italian, French, and English. We conclude by discussing results, future challenges, and research directions from a linguistically inclusive perspective.

multidisciplinary sciences
Urban Green Development and Resilient Cities: A First Insight into Urban Forest Planning in Italy

Luca Battisti,Fabrizio Aimar,Giovanni Giacco,Marco Devecchi

DOI: https://doi.org/10.3390/su151512085

IF: 3.9

2023-08-08

Sustainability

Abstract:The research proposes an application of a modification of the 3–30–300 rule to identify areas that require Urban Forestry implementation in small and medium-sized Roman and/or medieval urban areas. The selected case study is that of Asti in Piedmont, Italy. An open source, cross-platform desktop geographic information system is used to process geospatial datasets via qualitative analyses of electoral sections (or wards). An analysis of the number and distribution of trees around each building is performed, in addition to the calculation of tree canopy cover and distance between buildings and green spaces. Findings reveal that 64 out of 70 wards have an average of at least three trees per building and sufficient green areas of at least 0.5 hectares within 300 m of the buildings. Additionally, the tree canopy cover ranges from approximately 0.6% (lowest) to about 55% (highest) for the electoral sections. Lastly, findings suggest that the highly built-up urban fabric in these areas may significantly affect the availability and quality of green spaces. In conclusion, the case study proves the benefits of applying the 3–30–300 rule to small and medium-sized urban areas using an integrated assessment approach based on nature-based solutions and ecosystem services.

environmental sciences,environmental studies,green & sustainable science & technology
LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models

Salvatore Mario Carta,Stefano Chessa,Giulia Contu,Andrea Corriga,Andrea Deidda,Gianni Fenu,Luca Frigau,Alessandro Giuliani,Luca Grassi,Marco Manolo Manca,Mirko Marras,Francesco Mola,Bastianino Mossa,Piergiorgio Mura,Marco Ortu,Leonardo Piano,Simone Pisano,Alessia Pisu,Alessandro Sebastian Podda,Livio Pompianu,Simone Seu,Sandro Gabriele Tiddia

2024-11-21

Abstract:Minority languages are vital to preserving cultural heritage, yet they face growing risks of extinction due to limited digital resources and the dominance of artificial intelligence models trained on high-resource languages. This white paper proposes a framework to generate linguistic tools for low-resource languages, focusing on data creation to support the development of language models that can aid in preservation efforts. Sardinian, an endangered language, serves as the case study to demonstrate the framework's effectiveness. By addressing the data scarcity that hinders intelligent applications for such languages, we contribute to promoting linguistic diversity and support ongoing efforts in language standardization and revitalization through modern technologies.

Computation and Language,Artificial Intelligence

The KIPARLA Forest treebank of spoken Italian: an overview of initial design choices

Towards the first UD Treebank of Spoken Italian: the KIParla forest

The TreeBanker: a Tool for Supervised Training of Parsed Corpora

Unifying Lexicons in view of a Phonological and Morphological Lexical DB

Building Tamil Treebanks

ITALIC: An Italian Intent Classification Dataset

ARCA. Semantic exploration of a bookstore

MaiBaam: A Multi-Dialectal Bavarian Universal Dependency Treebank

DILLo: an Italian lexical database for speech-language pathologists

Treebanking User-Generated Content: a UD Based Overview of Guidelines, Corpora and Unified Recommendations

BRAIN - Holocene archaeo-data for assessing plant-cultural diversity in Italy and other Mediterranean regions

Latin Treebanks in Review: An Evaluation of Morphological Tagging Across Time

ArCo: the Italian Cultural Heritage Knowledge Graph

Next Generation Language Resources using GRID

EventNet-ITA: Italian Frame Parsing for Events

PILA: A Historical-Linguistic Dataset of Proto-Italic and Latin

Cerbero-7B: A Leap Forward in Language-Specific LLMs Through Enhanced Chat Corpus Generation and Evaluation

The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italian

A survey on text classification: Practical perspectives on the Italian language.

Urban Green Development and Resilient Cities: A First Insight into Urban Forest Planning in Italy

LIMBA: An Open-Source Framework for the Preservation and Valorization of Low-Resource Languages using Generative Models