Abstract:The recent developments in Large Language Models (LLM), mark a significant moment in the research and development of social interactions with artificial agents. These agents are widely deployed in a variety of settings, with potential impact on users. However, the study of social interactions with agents powered by LLM is still emerging, limited by access to the technology and to data, the absence of standardised interfaces, and challenges to establishing controlled experimental setups using the currently available business-oriented platforms. To answer these gaps, we developed LEXI, LLMs Experimentation Interface, an open-source tool enabling the deployment of artificial agents powered by LLM in social interaction behavioural experiments. Using a graphical interface, LEXI allows researchers to build agents, and deploy them in experimental setups along with forms and questionnaires while collecting interaction logs and self-reported data. The outcomes of usability testing indicate LEXI's broad utility, high usability and minimum mental workload requirement, with distinctive benefits observed across disciplines. A proof-of-concept study exploring the tool's efficacy in evaluating social HAIs was conducted, resulting in high-quality data. A comparison of empathetic versus neutral agents indicated that people perceive empathetic agents as more social, and write longer and more positive messages towards them.

Outilex, plate-forme logicielle de traitement de textes écrits

A Robust Linguistic Platform for Efficient and Domain specific Web Content Analysis

Helping Domain Experts Build Speech Translation Systems

Towards an Automatic Consolidation of French Law

OpenUE: an Open Toolkit of Universal Extraction from Text

Knowledge Extraction from the Language Extended Lexicon Glossary Using Natural Language Processing

Lexicon management and standard formats

Temperature Effects on Mechanical Properties of Zinc Dithiophosphate Tribofilms

Un système modulaire d'acquisition automatique de traductions à partir du Web

Producing NLP-based On-line Contentware

The ALVIS Format for Linguistically Annotated Documents

OIL: an industrial case study in language engineering with Spoofax

JRC EuroVoc Indexer JEX - A freely available multi-label categorisation tool

Preliminary Results from the Free Linguistic Environment Project

A Web Service Enabling Gradable Post-edition of Pre-translations Produced by Existing Translation Tools: Practical Use to Provide High-quality Translation of an Online Encyclopedia

LEXI: Large Language Models Experimentation Interface

LMF Reloaded

A Java-Based Software Platformr For Xml Processing

LAREX - A semi-automatic open-source Tool for Layout Analysis and Region Extraction on Early Printed Books

The WebStand Project

Terminologies, mod{è}les de donn{é}es arch{é}ologiques et th{é}saurus documentaires