Abstract:The project was funded in 2021-2023 by the National Programme of Estonian Language Technology. Its main aim was to develop spelling and grammar correction tools for the Estonian language. The main challenge was the very small amount of available error correction data needed for such development. To mitigate this, (1) we annotated more correction data for model training and testing, (2) we tested transfer-learning, i.e. retraining machine learning models created for other tasks, so as not to depend solely on correction data, (3) we compared the developed method and model with alternatives, including large language models. We also developed automatic evaluation, which can calculate the accuracy and yield of corrections by error category, so that the effectiveness of different methods can be compared in detail. There has been a breakthrough in large language models during the project: GPT4, a commercial language model with Estonian-language support, has been created. We took into account the existence of the model when adjusting plans and in the report we present a comparison with the ability of GPT4 to improve the Estonian language text. The final results show that the approach we have developed provides better scores than GPT4 and the result is usable but not entirely reliable yet. The report also contains ideas on how GPT4 and other major language models can be implemented in the future, focusing on open-source solutions. All results of this project are open-data/open-source, with licenses that allow them to be used for purposes including commercial ones.

Open source platform for Estonian speech transcription

Advanced Rich Transcription System for Estonian Speech

Neural Speech Synthesis for Estonian

Developing a Multi-Platform Speech Recording System Toward Open Service of Building Large-Scale Speech Corpora

IMS-Speech: A Speech to Text Tool

SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognition

Rapid development of a Latvian speech-to-text system

Manual Post-editing of Automatically Transcribed Speeches from the Icelandic Parliament - Althingi

RELATE: A Modern Processing Platform for Romanian Language

MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languages

Open Source Automatic Speech Recognition for German

Finetuning End-to-End Models for Estonian Conversational Spoken Language Translation

Speech transcription platform speech services

Helping Domain Experts Build Speech Translation Systems

Lahjoita puhetta -- a large-scale corpus of spoken Finnish with some benchmarks

Take the aTrain. Introducing an Interface for the Accessible Transcription of Interviews

An open-source voice type classifier for child-centered daylong recordings

SpeechColab Leaderboard: An Open-Source Platform for Automatic Speech Recognition Evaluation

Reverb: Open-Source ASR and Diarization from Rev

OLISIA: a Cascade System for Spoken Dialogue State Tracking

Autocorrect for Estonian texts: final report from project EKTB25