Graft vs. host reaction in a newborn.

V. Morhenn,H. Maibach

DOI: https://doi.org/10.2340/0001555554133136

1974-03-01

Abstract:Abstract is not availeble.

What problem does this paper attempt to address?

Exploring the Sensory Spaces of English Perceptual Verbs in Natural Language Data

Roxana Girju,David Peng

DOI: https://doi.org/10.48550/arXiv.2110.09721

2021-10-19

Computation and Language

Abstract:In this study, we explore how language captures the meaning of words, in particular meaning related to sensory experiences learned from statistical distributions across texts. We focus on the most frequent perception verbs of English analyzed from an and Agentive vs. Experiential distinction across the five basic sensory modalities: Visual (to look vs. to see), Auditory (to listen vs. to hear), Tactile (to touch vs. to feel), Olfactory (to smell), and Gustatory (to taste). In this study we report on a data-driven approach based on distributional-semantic word embeddings and clustering models to identify and uncover the descriptor sensory spaces of the perception verbs. In the analysis, we identified differences and similarities of the generated descriptors based on qualitative and quantitative differences of the perceptual experience they denote. For instance, our results show that while the perceptual spaces of the experiential verbs like to see, to hear show a more detached, logical way of knowing and learning, their agentive counterparts (to look, listen) provide a more intentional as well as more intimate and intuitive way of discovering and interacting with the world around us. We believe that such an approach has a high potential to expand our understanding and the applicability of such sensory spaces to different fields of social and cultural analysis. Research on the semantic organization of sensory spaces for various applications might benefit from an the Agentive/Experiential account to address the complexity of multiple senses wired with each other in still unexplored ways.
Vision Verbs Emerge First in English Acquisition but Touch, not Audition, Follows Second

Lila San Roque,Elisabeth Norcliffe,Asifa Majid

DOI: https://doi.org/10.1111/cogs.13469

IF: 2.617

2024-06-25

Cognitive Science

Abstract:Words that describe sensory perception give insight into how language mediates human experience, and the acquisition of these words is one way to examine how we learn to categorize and communicate sensation. We examine the differential predictions of the typological prevalence hypothesis and embodiment hypothesis regarding the acquisition of perception verbs. Studies 1 and 2 examine the acquisition trajectories of perception verbs across 12 languages using parent questionnaire responses, while Study 3 examines their relative frequencies in English corpus data. We find the vision verbs see and look are acquired first, consistent with the typological prevalence hypothesis. However, for children at 12–23 months, touch—not audition—verbs take precedence in terms of their age of acquisition, frequency in child‐produced speech, and frequency in child‐directed speech, consistent with the embodiment hypothesis. Later at 24–35 months old, frequency rates are observably different and audition begins to align with what has previously been reported in adult English data. It seems the initial orientation to verbalizing touch over audition in child–caregiver interaction is especially related to the control of physically and socially appropriate behaviors. Taken together, the results indicate children's acquisition of perception verbs arises from the complex interplay of embodiment, language‐specific input, and child‐directed socialization routines.

psychology, experimental
Vision dominates in perceptual language: English sensory vocabulary is optimized for usage

Bodo Winter,Marcus Perlman,Asifa Majid

DOI: https://doi.org/10.1016/j.cognition.2018.05.008

IF: 4.011

2018-10-01

Cognition

Abstract:Researchers have suggested that the vocabularies of languages are oriented towards the communicative needs of language users. Here, we provide evidence demonstrating that the higher frequency of visual words in a large variety of English corpora is reflected in greater lexical differentiation-a greater number of unique words-for the visual domain in the English lexicon. In comparison, sensory modalities that are less frequently talked about, particularly taste and smell, show less lexical differentiation. In addition, we show that even though sensory language can be expected to change across historical time and between contexts of use (e.g., spoken language versus fiction), the pattern of visual dominance is a stable property of the English language. Thus, we show that across the board, precisely those semantic domains that are more frequently talked about are also more lexically differentiated, for perceptual experiences. This correlation between type and token frequencies suggests that the sensory lexicon of English is geared towards communicative efficiency.

psychology, experimental
OntoSenseNet: A Verb-Centric Ontological Resource for Indian Languages

Jyoti Jha,Sreekavitha Parupalli,Navjyoti Singh

DOI: https://doi.org/10.13140/RG.2.2.29641.03687

2018-08-02

Abstract:Following approaches for understanding lexical meaning developed by Yaska, Patanjali and Bhartrihari from Indian linguistic traditions and extending approaches developed by Leibniz and Brentano in the modern times, a framework of formal ontology of language was developed. This framework proposes that meaning of words are in-formed by intrinsic and extrinsic ontological structures. The paper aims to capture such intrinsic and extrinsic meanings of words for two major Indian languages, namely, Hindi and Telugu. Parts-of-speech have been rendered into sense-types and sense-classes. Using them we have developed a gold- standard annotated lexical resource to support semantic understanding of a language. The resource has collection of Hindi and Telugu lexicons, which has been manually annotated by native speakers of the languages following our annotation guidelines. Further, the resource was utilised to derive adverbial sense-class distribution of verbs and karaka-verb sense- type distribution. Different corpora (news, novels) were compared using verb sense-types distribution. Word Embedding was used as an aid for the enrichment of the resource. This is a work in progress that aims at lexical coverage of language extensively.

Computation and Language
Exploration of the Usage of Color Terms by Color-blind Participants in Online Discussion Platforms

Ella Rabinovich,Boaz Carmeli

DOI: https://doi.org/10.48550/arXiv.2210.11905

2022-10-30

Abstract:Prominent questions about the role of sensory vs. linguistic input in the way we acquire and use language have been extensively studied in the psycholinguistic literature. However, the relative effect of various factors in a person's overall experience on their linguistic system remains unclear. We study this question by making a step forward towards a better understanding of the conceptual perception of colors by color-blind individuals, as reflected in their spontaneous linguistic productions. Using a novel and carefully curated dataset, we show that red-green color-blind speakers use the "red" and "green" color terms in less predictable contexts, and in linguistic environments evoking mental image to a lower extent, when compared to their normal-sighted counterparts. These findings shed some new and interesting light on the role of sensory experience on our linguistic system.

Computation and Language
Paths of linguistic synesthesia across cultures

Ádám Galac,Daler Zayniev

DOI: https://doi.org/10.1075/cogls.00108.gal

2023-11-17

Cognitive Linguistic Studies

Abstract:Abstract The article focuses on the conventionalized cross-sensory uses of basic-level adjectives in a sample of eight languages: English, German, French, Spanish, Russian, Hungarian, Tajik, and Uzbek. After a differentiation of cross-sensory language use (also called linguistic synesthesia) from other phenomena that combine the senses (namely, neuropsychological synesthesia and cross-sensory correspondences), it reports on a dictionary-based semantic analysis that distinguishes between three main semantic mechanisms leading to cross-sensory language use: direct cross-sensory transfer (e.g., a dark sound ), more schematic generalized meanings (e.g., soft ‘pleasant, gentle, not too intense’), and highly figurative extensions (e.g., a dark melody , in which dark means ‘gloomy’). It also emphasizes that these three categories are often intertwined due to the inherent fog-like nature of meaning. After summarizing every instance of conventionalized cross-sensory meaning potential that could be found in the dictionaries, it concludes that ( 1 ) the results are in line with the widely observed directional preferences also referred to as the hierarchy of the senses; ( 2 ) the evaluative dimension is present in many transfers, but it cannot account for the extended uses alone; ( 3 ) there are some obvious differences between the Western and the Central Asian languages, even though one cannot speak of fundamentally different conceptual systems regarding the language of the senses. Besides these general observations, the outcomes of this principally exploratory investigation also point to many uncharted territories to be examined in future studies.
Raising the Roof: Situating Verbs in Symbolic and Embodied Language Processing

John Hollander,Andrew Olney

DOI: https://doi.org/10.1111/cogs.13442

IF: 2.617

2024-04-26

Cognitive Science

Abstract:Recent investigations on how people derive meaning from language have focused on task‐dependent shifts between two cognitive systems. The symbolic (amodal) system represents meaning as the statistical relationships between words. The embodied (modal) system represents meaning through neurocognitive simulation of perceptual or sensorimotor systems associated with a word's referent. A primary finding of literature in this field is that the embodied system is only dominant when a task necessitates it, but in certain paradigms, this has only been demonstrated using nouns and adjectives. The purpose of this paper is to study whether similar effects hold with verbs. Experiment 1 evaluated a novel task in which participants rated a selection of verbs on their implied vertical movement. Ratings correlated well with distributional semantic models, establishing convergent validity, though some variance was unexplained by language statistics alone. Experiment 2 replicated previous noun‐based location‐cue congruency experimental paradigms with verbs and showed that the ratings obtained in Experiment 1 predicted reaction times more strongly than language statistics. Experiment 3 modified the location‐cue paradigm by adding movement to create an animated, temporally decoupled, movement‐verb judgment task designed to examine the relative influence of symbolic and embodied processing for verbs. Results were generally consistent with linguistic shortcut hypotheses of symbolic‐embodied integrated language processing; location‐cue congruence elicited processing facilitation in some conditions, and perceptual information accounted for reaction times and accuracy better than language statistics alone. These studies demonstrate novel ways in which embodied and linguistic information can be examined while using verbs as stimuli.

psychology, experimental
Anticipatory Processing in a Verb-Initial Mayan Language: Eye-Tracking Evidence During Sentence Comprehension in Tseltal

Gabriela Garrido Rodriguez,Elisabeth Norcliffe,Penelope Brown,Falk Huettig,Stephen C Levinson

DOI: https://doi.org/10.1111/cogs.13219

Abstract:We present a visual world eye-tracking study on Tseltal (a Mayan language) and investigate whether verbal information can be used to anticipate an upcoming referent. Basic word order in transitive sentences in Tseltal is Verb-Object-Subject (VOS). The verb is usually encountered first, making argument structure and syntactic information available at the outset, which should facilitate anticipation of the post-verbal arguments. Tseltal speakers listened to verb-initial sentences with either an object-predictive verb (e.g., "eat") or a general verb (e.g., "look for") (e.g., "Ya slo'/sle ta stukel on te kereme," Is eating/is looking (for) by himself the avocado the boy/ "The boy is eating/is looking (for) an avocado by himself") while seeing a visual display showing one potential referent (e.g., avocado) and three distractors (e.g., bag, toy car, coffee grinder). We manipulated verb type (predictive vs. general) and recorded participants' eye movements while they listened and inspected the visual scene. Participants' fixations to the target referent were analyzed using multilevel logistic regression models. Shortly after hearing the predictive verb, participants fixated the target object before it was mentioned. In contrast, when the verb was general, fixations to the target only started to increase once the object was heard. Our results suggest that Tseltal hearers pre-activate semantic features of the grammatical object prior to its linguistic expression. This provides evidence from a verb-initial language for online incremental semantic interpretation and anticipatory processing during language comprehension. These processes are comparable to the ones identified in subject-initial languages, which is consistent with the notion that different languages follow similar universal processing principles.
Linguistic Synesthesia in Turkish: A Corpus-based Study of Crossmodal Directionality

Alper Kumcu

DOI: https://doi.org/10.1080/10926488.2021.1921557

2021-10-02

Metaphor and Symbol

Abstract:Linguistic synesthesia (or synesthetic/intrafield/crossmodal metaphor) refers to crossmodal instances in which expressions in different sensory modalities are combined as in the case of sweet (taste) melody (hearing). Ullmann was among the first to show that synesthetic transfers seem to follow a potentially universal hierarchy that goes from the so-called "lower" (i.e., touch, taste and smell) to "higher" senses (i.e., hearing and sight). Several studies across languages, cultures, domains and text types seem to support the hierarchy in linguistic synesthesia despite some crosslinguistic differences and varying explanations . To extend results to an underrepresented language and thus, to test the universality of the crossmodal hierarchy, 5,693 token cases of linguistic synesthesia in written and spoken Turkish were investigated using a general-purpose, large corpus. Token, type, and hapax legomena frequencies showed that although three backward and thus, hierarchy-inconsistent transfers (i.e., from taste to touch, from sight to smell and from sight to hearing) were more frequent than their hierarchy-consistent counterparts, forward transfers in the canonical direction were more frequent overall than the backward transfers in Turkish. We conclude that Turkish linguistic synesthesia complies with the hierarchy as a descriptive generalization. Results are discussed in comparison to the crossmodal use of sensory words in other languages.

linguistics
Perception of Voicing and Aspiration in Hindi, American English, and Tamil Listeners in Quiet and in Background Noise

Reethee Antony,Brett Martin,Valerie Shafer,Susan Behrens

DOI: https://doi.org/10.1044/2024_jslhr-22-00531

2024-05-17

Journal of Speech Language and Hearing Research

Abstract:Purpose: There is a dearth of literature in determining whether language groups for whom aspiration and/or voicing is phonologically contrastive show better perception relative to those who do not use these features contrastively and whether the cue type modulates perception in noise. This study addresses perception of laryngeal cues (voicing and aspiration) by Hindi, English, and Tamil listeners, in quiet and in noise. Method: Sixteen participants between 20 and 45 years of age were included in each of the three language groups. The stimuli were bilabial stops that contrasted phonetically in voicing and aspiration, voicing-lead [ba], short-lag [pa], and long-lag aspirated [pha], with one set corresponding to the Hindi phonemes /ba/, /pa/, and /p h a/ and the second set to the English phonemes /ba/ and /pa/ (which are phonetically [pa] and [pha], respectively). Tamil includes only the short-lag [pa] as a bilabial stop consonant. The stimuli were presented at 70 dB SPL, in quiet and in speech-shaped noise at a signal-to-noise ratio of 0. Participants performed two speech identification tasks and a speech discrimination task. Results: Patterns of perceptual assimilation related to the first language were observed in all three language groups, and accuracy was generally higher in quiet than in noise. Hindi participants identified the English /pa/ as Hindi /p h a/ and English /ba/ as Hindi /pa/. The American English participants identified Hindi /p h a/ as English /pa/ and both the Hindi /pa/ and Hindi /ba/ as English /ba/. In contrast, Tamil listeners generally perceived both Hindi and English bilabial stops as one category, regardless of voicing and aspiration. English and Hindi participants generally showed higher accuracy for native language stimuli. Patterns of assimilation in quiet and noise differed across language groups for each stimulus type. The aspirated stimuli were most likely to be misperceived in noise by all groups (often as /ha/). Conclusions: The results serve as evidence that listeners accurately access native language speech cues, even in noise. The results contribute toward a better understanding of cross-linguistic speech processing in noise.

rehabilitation,audiology & speech-language pathology,linguistics
Visual experience modulates the sensitivity to the distributional history of words in natural language

Giorgia Anceresi,Daniele Gatti,Tomaso Vecchi,Marco Marelli,Luca Rinaldi

DOI: https://doi.org/10.3758/s13423-024-02557-6

2024-08-22

Abstract:Different experiential traces (i.e., linguistic, motor, and perceptual) are likely contributing to the organization of human semantic knowledge. Here, we aimed to address this issue by investigating whether visual experience may affect the sensitivity to distributional priors from natural language. We conducted an independent reanalysis of data from Bottini et al., in which early blind and sighted participants performed an auditory lexical decision task. Since previous research has shown that semantic neighborhood density-the mean distance between a target word and its closest semantic neighbors-can influence performance in lexical decision tasks, we investigated whether vision may alter the reliance on this semantic index. We demonstrate that early blind participants are more sensitive to semantic neighborhood density than sighted participants, as indicated by the significantly faster response times for words with higher levels of semantic neighborhood density shown by the blind group. These findings suggest that an early lack of visual experience may lead to enhanced sensitivity to the distributional history of words in natural language, deepening in turn our understanding of the strict interplay between linguistic and perceptual experience in the organization of conceptual knowledge.
A Cognitive Semantic Analysis of Arabic Verb of Visual Perception رأى (ra’a) in Fiction Writing

Ruaa Talal Jumaah,Sabariah Md Rashid,Mohd Azidan Bin Abdul Jabar,Afida Mohamad Ali

DOI: https://doi.org/10.1177/2158244020949525

IF: 2.032

2020-07-01

SAGE Open

Abstract:This study focuses on whether the metaphors of visual perception are really as universal as has been argued in the literature as research in non-Western languages has demonstrated that the metaphors are not universal. Thus, this study aims at unraveling the conceptual metaphors underlying the linguistic expressions of the Arabic verb of visual perception ىأر (ra’a) in fiction writing. This study adopts a qualitative approach and is situated within the field of cognitive semantics. A corpus of Arabic fiction writing, comprising 1 million words, between the period of 2010 and 2017 was compiled from different sources. Specifically, a sample consisting of 1,000 examples of the Arabic verb of visual perception ىأر was randomly extracted from the corpus using Ghawwas_V4.6 concordancer. The metaphor identification procedures (MIPs) were used to identify the metaphorical linguistic expressions in the corpus, and Lakoff and Johnson’s and Sweetser’s analytical frameworks were adopted for data analysis. The data analysis revealed many conceptual metaphors of knowledge and understanding underlying the metaphorical linguistic expression of the verb ىأر in Arabic. The findings of this study support Sweetser’s claim regarding the universality of conceptual metaphors related to the verbs of visual perception in motivating metaphors of knowledge and intellection. Thus, this study contributes to the literature on verbs of perception, particularly verbs of visual perception, as it is the first to address the conceptual metaphors underlying the verb ىأر in Arabic using real authentic corpus of fiction writing.

social sciences, interdisciplinary
Sensory Emotion in Words: Evidence From an Event-related Potential (ERP) Study in Light of the Emotioncy Model

Sahar Tabatabaee Farani,Reza Pishghadam,Azin Khodaverdi

DOI: https://doi.org/10.32598/bcn.2021.1870.1

Abstract:Introduction: Delving into the prominent role of emotions and senses in language is not something new in the field. Thereupon, the newly developed notion of emotioncy has been introduced to foreign language education to underscore the role of sense-induced emotions in the language learning and teaching process. Methods: The present study implemented event-related potentials (ERPs) to provide evidence of the significance of employing emosensory instructional strategies in teaching vocabulary items. Hence, 18 female participants were randomly instructed on six English nouns toward which they had no prior knowledge and received no instruction for the other three words. Then, while the participants' electroencephalogram (EEG) was being recorded, they took a sentence comprehension task. Results: Behavioral results demonstrated significant differences among the avolved, the exvolved, and the involved nouns. However, ERP analyses of target words indicated the modulations of N100 and N480 components while no significant effect was observed at P200. Further, the analysis of sensory N100 for the critical words revealed no significant effect. Conclusion: In conclusion, emotioncy-based language instruction can affect neural correlates of emotional word comprehension from the early stages of EEG recording. The results of this study can clarify the importance of including senses and emotions in language teaching, learning, and testing, along with materials development. Highlights: Direct emosensory involvement can affect word semantic processing.Indirect emosensory involvement can affect sensorial comprehension of the word.Direct sensory involvement may enhance the accuracy of the responses.Direct sensory involvement may reduce the response time. Plain language summary: Nowadays, learning a foreign language is considered one of the challenges in our lives. It is believed that including senses and emotions in education can foster learning new words in a foreign language. One concept that focuses on the use of sensory emotions is called emotioncy. This study employed brain imaging to analyze the effects of teaching through emotioncy on related neural modulations. Based on the results of the study, higher levels of employing senses and emotions can affect the processing and comprehension of words.
Does language rule perception? Testing a radical view of linguistic relativity.

Diane Baier,Soonja Choi,Florian Goller,Yunju Nam,Ulrich Ansorge

DOI: https://doi.org/10.1037/xge0001296

2023-04-15

Abstract:To investigate whether language rules the visual features that can be discriminated (a radical assumption of linguistic relativity), we examined crosslinguistic differences between native Korean and German speakers during liminal perception of a target disk that was difficult to perceive because its visibility suffered from masking by a ring that followed and enclosed the target disk (metacontrast-masking). Target-mask fit varied, with half of the masks tightly and the other half loosely encircling the targets. In Korean, such tight versus loose spatial relations are semantically distinguished and thus highly practiced, whereas in German, they are collapsed within a single semantic category, thus are not distinguished by language. We expected higher sensitivity and greater attention to varying spatial target-mask distances in Korean than in German speakers. This was confirmed in Experiment 1, where Korean speakers consistently outperformed German speakers in discriminating liminal metacontrast-masked stimuli. To ensure that this effect was not attributable to generic differences in attention capture or by language-independent differences between participant groups, we investigated stimulus-driven attention capture by color singletons and conducted a control experiment using object-substitution masking, where tightness of fit was not manipulated. We found no differences between Korean and German speakers regarding stimulus-driven attention capture or perceptual sensitivity. This was confirmed in Experiment 3, where we manipulated types of masking within participants. In addition, we validated the tightness-of-fit manipulation in a language-related task (Experiment 4). Overall, our results are consistent with linguistic relativity, namely its assumed generalized language influences in nonlinguistic perceptual tasks. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

psychology, experimental
The Nature of Language and Cognition Interactions in Color Perception

DOI: https://doi.org/10.7816/nesne-10-23-08

2022-03-31

Nesne Psikoloji Dergisi

Abstract:Perception of hue has been at the center of the debates on the relation between language and thought due to the diversity of color terms in the lexicon of different languages. In this article, we review empirical evidence on the language-cognition interface in the color domain. This discussion takes two theoretical positions regarding language and thought interactions, linguistic relativity and universalism, as a basis and asks whether color terms in language affect color perception or post-perceptual decision processes rather than perception itself. Several behavioral, developmental, electrophysiological, neuroimaging and neuromodulation studies have found language-related differences in color processing. In these studies, people have an advantage in visually discriminating colors labeled by different linguistic terms compared to colors labeled by the same linguistic terms. However, the fact that these differences disappear when access to verbal codes is prevented by behavioral methods or neuromodulation strongly suggests that this advantage does not stem from deep and permanent changes in color perception due to language. Taken together, these differences seem to be best explained by momentary and temporary interactions between visual and verbal codes during post-perceptual decisions during color processing. Keywords Color perception, language-cognition interface, language and thought, visual perception
How language influences spatial thinking, categorization of motion events, and gaze behavior: a cross-linguistic comparison

Efstathia Soroli

DOI: https://doi.org/10.1017/langcog.2023.66

2024-01-25

Language and Cognition

Abstract:According to Talmy, in verb-framed languages (e.g., French), the core schema of an event (Path) is lexicalized, leaving the co-event (Manner) in the periphery of the sentence or optional; in satellite-framed languages (e.g., English), the core schema is jointly expressed with the co-event in construals that lexicalize Manner and express Path peripherally. Some studies suggest that such differences are only surface differences that cannot influence the cognitive processing of events, while others support that they can constrain both verbal and non-verbal processing. This study investigates whether such typological differences, together with other factors, influence visual processing and decision-making. English and French participants were tested in three eye-tracking tasks involving varied Manner–Path configurations and language to different degrees. Participants had to process a target motion event and choose the variant that looked most like the target (non-verbal categorization), then describe the events (production), and perform a similarity judgment after hearing a target sentence (verbal categorization). The results show massive cross-linguistic differences in production and additional partial language effects in visualization and similarity judgment patterns – highly dependent on the salience and nature of events and the degree of language involvement. The findings support a non-modular approach to language–thought relations and a fine-grained vision of the classic lexicalization/conflation theory.

psychology, experimental,linguistics
A multimodal approach to polysemy: the senses of touch

Irene Bolumar Martínez,Daniel Alcaraz Carrión,Javier Valenzuela Manzanares

DOI: https://doi.org/10.1017/langcog.2024.23

2024-04-24

Language and Cognition

Abstract:This study investigated whether speakers use multimodal information (speech and gesture) to differentiate the physical and emotional meanings of the polysemous verb touch. We analyzed 302 hand gestures that co-occurred with this perception verb. For each case, we annotated (1) the meaning of touch (physical vs. emotional), (2) the gesture referent speakers physically touched (other-touch vs. self-touch), (3) the personal pronoun following the verb and (4) if they used intensifiers and negation. There were three main findings. First, we have seen that when speakers express the physical meaning, they are likely to reach an external referent (other-touch), but when they imply the emotional meaning, they tend to touch their own body (self-touch). Second, the most frequent co-speech gesture (chest-touching gesture) was associated with the emotional meaning, uncovering the metaphor the heart is container for emotions. Third, this study showed that the physical meaning of touch usually coexists with a wide variety of personal pronouns and negation words; in contrast, the emotional meaning of touch occurs primarily with the pronoun me and it is usually modified by intensifiers. Thus, speakers use both speech and gesture to differentiate the meanings of the polysemous verb touch.

psychology, experimental,linguistics
P53 accumulation, deoxyribonucleic acid ploidy and progression of bladder cancer.

M. Raitanen,T. Tammela,M. Kallioinen,J. Isola

DOI: https://doi.org/10.1016/S0022-5347(01)64939-5

1997-04-01

Abstract:
AUDIOVISUAL SPEECH PERCEPTION IN DIOTIC AND DICHOTIC LISTENING CONDITIONS

Sandhya Vinay,Vinay Swarnalatha Nagaraj

DOI: https://doi.org/10.17430/jhs.2022.12.2.2

2022-06-30

Journal of Hearing Science

Abstract:Background Speech perception is multisensory, relying on auditory as well as visual information from the articulators. Watching articulatory gestures which are either congruent or incongruent with the speech audio can change the auditory percept, indicating that there is a complex integration of auditory and visual stimuli. A speech segment is comprised of distinctive features, notably voice onset time (VOT) and place of articulation (POA). Understanding the importance of each of these features for audiovisual (AV) speech perception is critical. The present study investigated the perception of AV consonant-vowel (CV) syllables with various VOTs and POAs under two conditions: diotic incongruent and dichotic congruent. Material and methods AV stimuli comprised diotic and dichotic CV syllables with stop consonants (bilabial /pa/ and /ba/; alveolar /ta/ and /da/; and velar /ka/ and /ɡa/) presented with congruent and incongruent video CV syllables with stop consonants. There were 40 righthanded normal hearing young adults (20 females, mean age 23 years, SD = 2.4 years) and 20 males (mean age 24 years, SD = 2.1 years) who participated in the experiment. Results In the diotic incongruent AV condition, short VOT (voiced CV syllables) of the visual segments were identified when auditory segments had a CV syllable with long VOT (unvoiced CV syllables). In the dichotic congruent AV condition, there was an increase in identification of the audio segment when the subject was presented with a video segment congruent to either ear, in this way overriding the otherwise presented ear advantage in dichotic listening. Distinct visual salience of bilabial stop syllables had greater visual influence (observed as greater identification scores) than velar stop syllables and thus overrode the acoustic dominance of velar syllables. Conclusions The findings of the present study have important implications for understanding the perception of diotic incongruent and dichotic congruent audiovisual CV syllables in which the stop consonants have different VOT and POA combinations. Earlier findings on the effect of VOT on dichotic listening can be extended to AV speech having dichotic auditory segments.
Individual word and phrase frequency effects in collocational processing: Evidence from typologically different languages, English and Turkish.

Doğuş Öksüz,Vaclav Brezina,Padraic Monaghan,Patrick Rebuschat

DOI: https://doi.org/10.1037/xlm0001324

2024-01-15

Abstract:Collocations are understood to be integral building blocks of language processing, alongside individual words, but thus far evidence for the psychological reality of collocations has tended to be confined to English. In contrast to English, Turkish is an agglutinating language, utilizing productive morphology to convey complex meanings using a single word. Given this, we expected Turkish speakers to be less sensitive to phrasal frequencies than English speakers. In Study 1, we conducted a corpus analysis of translation-equivalent adjective-noun collocations (e.g., front door) and found differences between the two languages in frequency counts. In Study 2, we conducted a reaction time experiment to determine the sensitivity of native speakers of English and Turkish to the frequency of adjectives, nouns, and whole collocations. Turkish speakers were less sensitive to whole-phrase frequencies, as predicted, indicating that collocations are processed less holistically in Turkish than English. Both groups demonstrated that processing collocations involves combining information about individual words and phrases. Taken together, we show that speakers are sensitive to frequency information at multiple grain sizes that are attuned to the typology of different languages. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

psychology, experimental

Graft vs. host reaction in a newborn.

Exploring the Sensory Spaces of English Perceptual Verbs in Natural Language Data

Vision Verbs Emerge First in English Acquisition but Touch, not Audition, Follows Second

Vision dominates in perceptual language: English sensory vocabulary is optimized for usage

OntoSenseNet: A Verb-Centric Ontological Resource for Indian Languages

Exploration of the Usage of Color Terms by Color-blind Participants in Online Discussion Platforms

Paths of linguistic synesthesia across cultures

Raising the Roof: Situating Verbs in Symbolic and Embodied Language Processing

Anticipatory Processing in a Verb-Initial Mayan Language: Eye-Tracking Evidence During Sentence Comprehension in Tseltal

Linguistic Synesthesia in Turkish: A Corpus-based Study of Crossmodal Directionality

Perception of Voicing and Aspiration in Hindi, American English, and Tamil Listeners in Quiet and in Background Noise

Visual experience modulates the sensitivity to the distributional history of words in natural language

A Cognitive Semantic Analysis of Arabic Verb of Visual Perception رأى (ra’a) in Fiction Writing

Sensory Emotion in Words: Evidence From an Event-related Potential (ERP) Study in Light of the Emotioncy Model

Does language rule perception? Testing a radical view of linguistic relativity.

The Nature of Language and Cognition Interactions in Color Perception

How language influences spatial thinking, categorization of motion events, and gaze behavior: a cross-linguistic comparison

A multimodal approach to polysemy: the senses of touch

P53 accumulation, deoxyribonucleic acid ploidy and progression of bladder cancer.

AUDIOVISUAL SPEECH PERCEPTION IN DIOTIC AND DICHOTIC LISTENING CONDITIONS

Individual word and phrase frequency effects in collocational processing: Evidence from typologically different languages, English and Turkish.