Abstract:In the proposed demo, we will present a new software - Linguistic Field Data Management and Analysis System - LiFE (https://github.com/kmi-linguistics/life) - an open-source, web-based linguistic data management and analysis application that allows for systematic storage, management, sharing and usage of linguistic data collected from the field. The application allows users to store lexical items, sentences, paragraphs, audio-visual content with rich glossing / annotation; generate interactive and print dictionaries; and also train and use natural language processing tools and models for various purposes using this data. Since its a web-based application, it also allows for seamless collaboration among multiple persons and sharing the data, models, etc with each other. The system uses the Python-based Flask framework and MongoDB in the backend and HTML, CSS and Javascript at the frontend. The interface allows creation of multiple projects that could be shared with the other users. At the backend, the application stores the data in RDF format so as to allow its release as Linked Data over the web using semantic web technologies - as of now it makes use of the OntoLex-Lemon for storing the lexical data and Ligt for storing the interlinear glossed text and then internally linking it to the other linked lexicons and databases such as DBpedia and WordNet. Furthermore it provides support for training the NLP systems using scikit-learn and HuggingFace Transformers libraries as well as make use of any model trained using these libraries - while the user interface itself provides limited options for tuning the system, an externally-trained model could be easily incorporated within the application; similarly the dataset itself could be easily exported into a standard machine-readable format like JSON or CSV that could be consumed by other programs and pipelines.

Zhishi.Lemon: On Publishing Zhishi.Me As Linguistic Linked Open Data

Zhishi.Me - Weaving Chinese Linking Open Data

On Publishing Chinese Linked Open Schema

ZhishiLink: Entity Linking on Zhishi.me.

CSL: A Large-scale Chinese Scientific Literature Dataset

LexO: an open-source system for managing OntoLex-Lemon resources

Chinese-DiMLex: a lexicon of Chinese discourse connectives

On Building and Publishing Linked Open Schema from Social Web Sites

RuThes Cloud: Towards a Multilevel Linguistic Linked Open Data Resource for Russian

Clinga: Bringing Chinese Physical And Human Geography In Linked Open Data

Aqulia-Med LLM: Pioneering Full-Process Open-Source Medical Language Models

YuLan: An Open-source Large Language Model

Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasets

Human-LLM Collaborative Construction of a Cantonese Emotion Lexicon

CHBench: A Chinese Dataset for Evaluating Health in Large Language Models

Demo of the Linguistic Field Data Management and Analysis System -- LiFE

BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Competitive Large Language Model Baseline

Visualizing Linguistic Diversity of Text Datasets Synthesized by Large Language Models

A structured sentiment analysis dataset based on public comments from various domains

Zyda: A 1.3T Dataset for Open Language Modeling

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism