Abstract:For the past thirty years, qualitative psychology researchers have focused on the study of written or spoken word while relegating the study of visual communications to children or those deemed unable to speak (Reavey, 2021, p. 2). Thus, the discipline now pays much attention to the collection and analysis of spoken or written words but significantly less to visual and auditory expressions of experience (Reavey, 2021, p. 3), and most transcription methods for psychology researchers are those designed for interviews that only capture the spoken word. However, these transcription methods have yet to account for the current context of ubiquitous, technologically mediated interactions. People from diverse groups use social media platforms such as YouTube and TikTok to interact using speech, audio and video. While they offer rich data for qualitative psychology researchers, the tools to capture such multimodal expressions are still in early stages of development within the discipline (Marshall et al., 2021). In this article, we present a transcription structure that allows for the recording of both speech and visual elements in audiovisual content. Inspired by methods from communications and visual anthropology, the Four Column Analysis Structure (or, FoCAS) allows for the simultaneous analysis of both audio and visual data by allowing for the transcription of four dimensions: (1) timestamp, (2) setting, (3) scene, and (4) audio. Based on its application in two completed studies and one study in progress, we describe the development of the FoCAS, how to set it up, transcription conventions, and how to analyze qualitative data using all four columns. We additionally discuss sampling considerations and the advantages and disadvantages of the structure. By expanding the amount of meaningful data that can be captured by qualitative transcription, we hope the FoCAS can be used to create more multidimensional, rigorous analyses of audiovisual data.

Multimodal Analysis in Qualitative Research: Extending Grounded Theory Through the Lens of Social Semiotics

Engaging the Senses in Qualitative Research via Multimodal Coding: Triangulating Transcript, Audio, and Video Data in a Study With Sexual and Gender Minority Youth

Exploring reading in social semiotics: theory and methods

Multimodal analysis within an interactive software environment: critical discourse perspectives

Semiotic mode and sensory modality in multimodal semiotics: Recognizing difference and building complementarity between the terms

A Digital Mixed Methods Research Design: Integrating Multimodal Analysis With Data Mining and Information Visualization for Big Data Analytics

Qualitative Research in Digital Era: Innovations, Methodologies and Collaborations

Critical Multimodal Studies of Popular Discourse

Social media as semiotic technology and social practice: the case of ResearchGate’s design and its potential to transform social practice

Interpreting old texts with new tools: Digital multimodal composition for a high school reading assignment

Discourse Analysis and Multimodal Meaning Making in a Science Classroom: Meta-Methodological Insights from Three Theoretical Perspectives

Analyzing social media data: A mixed-methods framework combining computational and qualitative text analysis

Developing and sustaining a social media ecosystem in speech-language pathology: Using innovative qualitative methods to visualise and cultivate a social media garden

In the Eye of the Transcriber: Four Column Analysis Structure for Qualitative Research With Audiovisual Data

Composing meaning through multiliteracies and multimodality with adolescent and adult learners

Introduction: Multimodal interaction

Semiotically-grounded distant viewing of diagrams: insights from two multimodal corpora

Digital platforms as socio-cultural artifacts: developing digital methods for cultural research

Object interviews, material imaginings and ‘unsettling’ methods: interdisciplinary approaches to understanding materials and material culture

Semiotics of Communication: From Semiosis of Nature to Culture

FRAMEWORK OF MULTIMODAL DISCOURSE ANALYSIS OF AMATEUR VIDEO NARRATIVES (ON THE ISSUE OF MATERIALIZATION OF IDENTITY)