Abstract:This article presents exploratory work in the newly emerging field of multimodal stylistics. By bringing together literary studies, linguistics and multimodal semiotics, multimodal stylisticians aim to extend the stylistic tool box by developing methodological frameworks applicable to the description and analysis of literary texts which – in addition to wording – make use of other semiotic modes such as typography, visual images, colour and layout for their meaning-making. The approach to multimodality deployed and examined is that proposed, for instance, by Kress and van Leeuwen (e. g. Reading Images. The Grammar of Visual Design, 1996; Multimodal Discourse. The Modes and Media of Contemporary Communication, 2001) and Baldry and Thibault (Multimodal Transcription and Text Analysis, 2006). According to Kress and van Leeuwen (Multimodal Discourse. The Modes and Media of Contemporary Communication, 2001, 2) »common semiotic principles operate in and across different modes«. Following this line of thought, the article sets out to examine modality as a cross-modal semiotic principle. After a brief introduction to the field of multimodal stylistics, the concept of modality is presented in its (Hallidayan) linguistic context as a verbal resource for the expression of speaker commitment by means of modal verbs, adverbials, modalised sentences and metaphorised modality. From here, the concept is transferred to the context of visual communication where it concerns the truth value of the visual representation, described at a »lexico-grammatical« level in terms of the visual modal parameters of articulation of detail, background, light, shadow, depth and colour (Kress/van Leeuwen, Reading Images. The Grammar of Visual Design, 1996). Subsequently, the concept of modality is applied to the analysis of two explicitly multimodal novels, with particular focus on the realisation of modality in visual images and typography. The texts put up for analysis are Alexander Masters' Stuart. A Life Backwards and Jonathan Safran Foer's Extremely Loud and Incredibly Close. While Kress and van Leeuwen's modal parameters prove to apply well to the analysis of modality at a lexico-grammatical level of the photographic images, analysis of the two novels reveals that modality also appears to be at play at a discourse level as a result of the multimodal interplay of the verbal and the visual. The analysis of Masters' and Foer's sporadic use of special typography, in turn, reveals that although some of Kress and van Leeuwen's modality parameters may be applicable to typography, the descriptive system is clearly less adequate in a typographic context where further work is needed before workable tools can be added to the multimodal stylistic tool kit.

Designerly ≠ Readerly

Using Media-Mechanism Shifts To Uncover Design Communication Needs

On Design in Multimodal Discourse

Multimodal analysis within an interactive software environment: critical discourse perspectives

Modality. Commitment, Truth Value and Reality Claims Across Modes in Multimodal Novels

Doing critical discourse studies with multimodality: from metafunctions to materiality

A discourse–design approach to multimodality: the visual communication of neoliberal management discourse

Interpreting old texts with new tools: Digital multimodal composition for a high school reading assignment

GUNTHER KRESS & THEO VAN LEEUWEN, Multimodal discourse: The modes and media of contemporary communication. London: Arnold, 2001. Pp. vii, 142. Hb $72.00, Pb $24.95.

Reading: skilled linguistic action

Multimodal Composition in a College ESL Class: New Tools, Traditional Norms

Analyzing multimodal Chinese discourse

Multimodal writing: the avant-garde assemblage and other minimal texts

“Making Sense” of Art through Design: Towards a Multisensory Theory of Reception Aesthetics

A Multimodal Discourse Analysis in Media

Multimodal assessment of and for learning: A theory-driven design rubric

The interface as discourse: The production of norms through web design

The need for a social and affordance-driven multimodal critical discourse studies

Social media as semiotic technology and social practice: the case of ResearchGate’s design and its potential to transform social practice

In the Frame: Signalling Structure in Academic Articles and Blogs

“Because I’m Smooth”: Material Intra-actions and Text Productions among Young Latino Picture Book Makers