Multimodality is an innovative approach to representation, communication and interaction which looks beyond language to investigate the multitude of ways we through images, sound and music to gestures, body posture and the use of space. The Routledge Handbook of Multimodal Analysis is the first comprehensive ‘research tool kit’ for multimodal analysis, with 22 chapters written by leading figures in the field on a wide range of theoretical and methodological issues. It clarifies terms and concepts, synthesizes the key literature with in-depth exploration and illustrative analysis, and tackles challenging methodological issues. The Handbook includes chapters on key factors for Multimodality such as technology, culture, notions of identity and macro issues such as literacy policy. The handbook takes a broad look at multimodality and engages with how a variety of other theoretical approaches have looked at multimodal communication and representation, including visual studies, anthropology, conversation analysis, socio-cultural theory, socio-linguistics and new literacy studies. Detailed multimodal analysis case studies are also included, along with an extensive glossary of key terms, to support those new to multimodality and allow those already engaged in multimodal research to explore the fundamentals further. The Routledge Handbook of Multimodal Analysis is essential reading for undergraduate and postgraduate students as well as researchers involved in the study of multimodal communication.
Ah yes, the multimodal meaning of IKEA tables, 'human-table interactivity', indeed …
This book is very broad in scope. It covers multimodality 101, theoretical considerations of multimodality in a very wide range of contexts, and equally wide ranging case studies. An individual reader might (optimistically), therefore, only find half of the chapters of much relevance to their own interests. The other chapters, however, are accessible enough to provide an interesting insight into how multimodal theories are applied elsewhere – for example the signification of posture or 3D space. Very little direct relevance to the non-textual/verbal features of text or documents. Many of the examples used are far more exotic and where text examples are used (chapter 9 for example on mobile novels), it is not the details of the text features that are the focus of multimodal consideration.
I've only covered a couple of chapters. Could be ambiguous sometimes, like when "mode" is introduced (or it could be the nature of this field). A relatively easy read on the topic -- especially if you compare with the work of Kress and/or Van Leeuwen.