Abstract:This article presents exploratory work in the newly emerging field of multimodal stylistics. By bringing together literary studies, linguistics and multimodal semiotics, multimodal stylisticians aim to extend the stylistic tool box by developing methodological frameworks applicable to the description and analysis of literary texts which – in addition to wording – make use of other semiotic modes such as typography, visual images, colour and layout for their meaning-making. The approach to multimodality deployed and examined is that proposed, for instance, by Kress and van Leeuwen (e. g. Reading Images. The Grammar of Visual Design, 1996; Multimodal Discourse. The Modes and Media of Contemporary Communication, 2001) and Baldry and Thibault (Multimodal Transcription and Text Analysis, 2006). According to Kress and van Leeuwen (Multimodal Discourse. The Modes and Media of Contemporary Communication, 2001, 2) »common semiotic principles operate in and across different modes«. Following this line of thought, the article sets out to examine modality as a cross-modal semiotic principle. After a brief introduction to the field of multimodal stylistics, the concept of modality is presented in its (Hallidayan) linguistic context as a verbal resource for the expression of speaker commitment by means of modal verbs, adverbials, modalised sentences and metaphorised modality. From here, the concept is transferred to the context of visual communication where it concerns the truth value of the visual representation, described at a »lexico-grammatical« level in terms of the visual modal parameters of articulation of detail, background, light, shadow, depth and colour (Kress/van Leeuwen, Reading Images. The Grammar of Visual Design, 1996). Subsequently, the concept of modality is applied to the analysis of two explicitly multimodal novels, with particular focus on the realisation of modality in visual images and typography. The texts put up for analysis are Alexander Masters' Stuart. A Life Backwards and Jonathan Safran Foer's Extremely Loud and Incredibly Close. While Kress and van Leeuwen's modal parameters prove to apply well to the analysis of modality at a lexico-grammatical level of the photographic images, analysis of the two novels reveals that modality also appears to be at play at a discourse level as a result of the multimodal interplay of the verbal and the visual. The analysis of Masters' and Foer's sporadic use of special typography, in turn, reveals that although some of Kress and van Leeuwen's modality parameters may be applicable to typography, the descriptive system is clearly less adequate in a typographic context where further work is needed before workable tools can be added to the multimodal stylistic tool kit.

Multimodal discourse analysis, film and adaptation theory: Hardy's/Winterbottom's Jude the Obscure

Corpus-Assisted Multimodal Discourse Analysis of Television and Film Narratives

A Multimodal Discourse Analysis of Advertisements and Movie Posters

Multimodal analysis within an interactive software environment: critical discourse perspectives

Modality. Commitment, Truth Value and Reality Claims Across Modes in Multimodal Novels

Screen Adaptation of Henry James’s Novel What Maisie Knew: Amateur Film Discourse as a Subtype of Institutional Film Discourse

Insights From Mental Model Theory and Cognitive Narratology as a Tool for Content Selection in Audio Description

Doing critical discourse studies with multimodality: from metafunctions to materiality

Multimodal Discourse Analysis of Interactive Environment of Film Discourse Based on Deep Learning

Cognitive and Intersemiotic Model of the Visual and Verbal Modes in a Screen Adaptation to Literary Texts

The cinematic mode in twentieth-century fiction a comparative approach

FRAMEWORK OF MULTIMODAL DISCOURSE ANALYSIS OF AMATEUR VIDEO NARRATIVES (ON THE ISSUE OF MATERIALIZATION OF IDENTITY)

The Possibility of Fidelity in Adaptations: The Case of Director Michael Haneke

Intersemiotic translation: meaning-making in film and musical art

Critical Multimodal Studies of Popular Discourse

Multimodal English

A Multimodal Critical Discourse Analysis of “The Marvels” Movie Poster

A multimodal discourse analysis of the textual and logical relations in marketing texts written by international undergraduate students

The need for a social and affordance-driven multimodal critical discourse studies

INDIAN DECENTRINGS OF MACBETH: POSTMODERN CREATIVITY IN FILMIC ADAPTATIONS BY VISHAL BHARDWAJ AND JAYARAJ

Intricateness of Adaptation of Literature to Film in Today’s Crisscrossed World