Abstract:The question of whether people's experience in the world shapes conceptual representation and lexical semantics is longstanding. Word-association, feature-listing and similarity rating tasks aim to address this question but require a subjective interpretation of the latent dimensions identified. In this study, we introduce a supervised representational-alignment method that (i) determines whether two groups of individuals share the same basis of a certain category, and (ii) explains in what respects they differ. In applying this method, we show that congenital blindness induces conceptual reorganization in both a-modal and sensory-related verbal domains, and we identify the associated semantic shifts. We first apply supervised feature-pruning to a language model (GloVe) to optimize prediction accuracy of human similarity judgments from word embeddings. Pruning identifies one subset of retained GloVe features that optimizes prediction of judgments made by sighted individuals and another subset that optimizes judgments made by blind. A linear probing analysis then interprets the latent semantics of these feature-subsets by learning a mapping from the retained GloVe features to 65 interpretable semantic dimensions. We applied this approach to seven semantic domains, including verbs related to motion, sight, touch, and amodal verbs related to knowledge acquisition. We find that blind individuals more strongly associate social and cognitive meanings to verbs related to motion or those communicating non-speech vocal utterances (e.g., whimper, moan). Conversely, for amodal verbs, they demonstrate much sparser information. Finally, for some verbs, representations of blind and sighted are highly similar. The study presents a formal approach for studying interindividual differences in word meaning, and the first demonstration of how blindness impacts conceptual representation of everyday verbs.

Effective presentation of ontological overlap of multiple conceptual models

A Visual Analytics Environment for Navigating Large Conceptual Models by Leveraging Generative Artificial Intelligence

DesignFusion: Integrating Generative Models for Conceptual Design Enrichment

Unifying Effects of Direct and Relational Associations for Visual Communication

An Integrated Cognitive Computing Approach for Systematic Conceptual Design

The Role of Mental Models in Collaborative Sketching

Exploring Comprehension Strategies of Modular Process Models: A Combined Eye-Tracking and Concurrent Think-Aloud Study

Understanding Inter-Concept Relationships in Concept-Based Models

AI-Spectra: A Visual Dashboard for Model Multiplicity to Enhance Informed and Transparent Decision-Making

Attention-Enhanced Multimodal Learning for Conceptual Design Evaluations

Visualizing the Impact of Art: An Update and Comparison of Current Psychological Models of Art Experience

Colors $-$Messengers of Concepts: Visual Design Mining for Learning Color Semantics

Visualizing textual models with in-text and word-as-pixel highlighting

Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservables

Statistical Analysis of Multisensory and Text-Derived Representations on Concept Learning

Why Combining Text and Visualization Could Improve Bayesian Reasoning: A Cognitive Load Perspective

Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Models

Graph Visualization: Alternative Models Inspired by Bioinformatics

Meaningful Models: Utilizing Conceptual Structure to Improve Machine Learning Interpretability

Identifying and interpreting non-aligned human conceptual representations using language modeling

Efficient Contrast Effect Compensation with Personalized Perception Models