Multimodal As A New Perspective In Pragmatics In The Digital Era: Literature Review

Putri Haryanti; Kundharu Saddhono; Atikah Anindyarini

Authors

Putri Haryanti Universitas Sebelas Maret
Kundharu Saddhono Universitas Sebelas Maret
Atikah Anindyarini Universitas Sebelas Maret

Keywords:

Multimodal, Pragmatics, Digital Era

Abstract

The language context in the study of pragmatics in the digital era has changed from initially using linguistic aspects to now using audio and visuals. This research aims to collect and analyze several sources related to multimodality as a new perspective in pragmatic analysis in the digital era. The research design used is a literature review by collecting various sources from books and relevant scientific articles. Based on the books and articles collected and reviewed, it can be concluded that the research results show (1) The multimodal concept is a theory that observes the use of various modes by individuals to communicate and express themselves, which involves writing, gestures, body posture, eye gaze, font choice and colours, images, videos, and interactions between individuals. (2) Multimodal characteristics include multimodality and its interactions, the role of technology, visual modality, social and cultural context, analysis of social interactions, multimodal literacy skills, semiotic analysis, and case studies. (3) The multimodal aspect includes the giving and creation of meaning, the multiple modes involved, and multimodal practices. (4) Multimodal pragmatics is a new perspective in pragmatic analysis that examines linguistic or verbal modes and other modes, such as audio and visual, which are used simultaneously to communicate with each other. Thus, pragmatic studies using a multimodal perspective are important because understanding a speech analyzes linguistic aspects and pays attention to multimodal visual and audiovisual aspects to strengthen the meaning or purpose of the speech act.

References

Allan, K., & Jaszczolt, K. (2012). The Cambridge Handbook of Pragmatics. United States of America: Cambridge University Press.

Anchimbe, E. A., & Janney, R. W. (2011). “Ostcolonial Pragmatics: An Introduction”. Journal of Pragmatics, Vol. 43, No. 6, page 1451-1459.

Anstey, Michelle; Geoff Bull. (2010). “Helping Teachers to Explore Multimodal Texts”. Curriculum Leadership: An Electronic Journal for Leaders in Education, Vol. 8, No. 16.

Atmaja, D. (2017). “Implementasi Augmented Reality untuk Pembelajaran Interaktif”. ILKOM Jurnal Ilmiah, Vol. 9, No. 2, page 227-232.

Badriyah, I &Antono, M. N. (2022). “Varieties of Illocutionary Speech of Madurese Religion Teachers at YPI Al Khoiriyah”. The 2nd International Conference of Humanities and Social Science. Vol. 2, No. 2, page 44-50.

Baltrušaitis, T., Ahuja, C., & Morency, L. P. (2018). “Multimodal Machine Learning: A Survey and Taxonomy”. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 41, No. 2, page 423-443.

Braun, S. (2016). “The Importance of Being Relevant? A Cognitive-Pragmatic Framework for Conceptualising Audiovisual Translation”. Target, Vol. 28, No. 2, page 302-313.

Brown, J., & Williams, E. (2022). “Pragmatik: Kajian Tentang Konteks dan Penggunaan Bahasa”. Jurnal Linguistik Terapan, Vol. 39, No. 2, page 201-218.

Bucher, H. (2017). Understanding Multimodal Meaning Making: Theories of Multimodality in the Light of Reception Studies. In book: (eds.) 2017: New Studies in Multimodality. Conceptual and Methodological Elaborations. New York: Bloomsbury.

Chen, L., et al. (2020). “Cross-Cultural Interpretations of Multimodal Communication: A Case Study of International Business Negotiations”. Journal of Intercultural Pragmatics, Vol. 28, No. 3, page 311-328.

Chen, L. (2021). “Interpretasi Pesan dalam Komunikasi Multimodal: Pengaruh Bahasa Verbal dan Non-Verbal”. Jurnal Psikologi Komunikasi, Vol. 28, No. 4, page 521-537.

Darmadi, H. (2011). Metode Penelitian Pendidikan. Bandung: Alfabeta.

Forceville, Charles. (2014). Relevance Theory as Model for Analyzing Visual and

Multimodal Communication, in David Machin (ed.). In book: Visual Communication. Berlin: Mouton de Gruyter, page 51-70.

Garcia, C., & Lee, S. (2019). “The Role of Context in Multimodal Communication: A Cross-Cultural Perspective”. International Journal of Intercultural Communication, Vol. 35, No. 4, page 521-537.

Garcia, C., Lee, M., & Johnson, B. (2023). “Kompleksitas Pragmatik Multimodal dalam Interaksi Sosial”. Jurnal Komunikasi Multimodal, Vol. 45, No. 1, page 301-315.

Gee, J. P. (2003). What Video Games Have to Teach Us About Learning and Literacy. New York: Palgrave Macmillan.

Groenke. (2021). “Multimodal Text and 21st Century Literacy Institution”. The Alan Review Winter 2012, Vol. 39, No. 2, page 62-67.

Huang, Lihe. (2021). “Toward Multimodal Corpus Pragmatics: Rationale, Case, and

Agenda”. Digital Scholarship in the Humanities, Vol. 36, No. 1, page 101–114.

Huang. Lihe. (2022). Toward Multimodal Pragmatics: A Study of Illocutionary Force in Chinese Situated Discourse. New York: Routledge.

Jewitt, C., & Kress, G. R. (Eds.). (2003). Multimodal Literacy. New York: Peter Lang.

Jewitt, C. M. (2009). The Routledge Handbook of Multimodal Analysis. London: Routledge.

Jones, R., & Smith, A. (2022). “Pragmatik Multimodal: Integrasi Bahasa Verbal dan Non-Verbal dalam Komunikasi Manusia”. Jurnal Studi Komunikasi, Vol. 40, No. 3, page 201-218.

Kress, G., & van Leeuwen, T. (2001). Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Routledge.

Mayer, R. E. (2009). Multimedia Learning: Combining Media and Modes. In K. Wentland & C. McLellan (Eds.), The Cambridge Handbook of the Learning Sciences. USA: Cambridge University Press

Norris, S. (2004). Analyzing Multimodal Interaction: A Methodological Framework. New York dan London: Ruotledge.

Nursalam. (2016). Metodologi Penelitian ilmu keperawatan. Jakarta: Selemba Medika.

Orsini-Jones,et all. (2019). “The Trouble With Cyberpragmatics: Embedding An Online Intercultural Learning Project Into The Curriculum”. International Journal of Computer-Assisted Language Learning and Teaching, Vol 7, No. 1, page 50-65.

Oviatt, S. (2003). Multimodal Interfaces in Encyclopedia of Library and Information Science, 2nd Edition. London: Routledge.

Rahardi, R. K. (2020). “Kenomotetisan dan Keideosinkretisan Makna Simbolis Peranti Pernikahan Adat Masyarakat Nusa Tenggara Timur dan Jambi: Perspektif Ekolinguistik”. Lensa: Kajian Kebahasaan, Kesusastraan, dan Budaya, Vol. 10, No. 1, page 69-82.

Rahardi, K. (2022). “Persepsi Urgensi Inklusi Aspek-aspek Multimodalitas dalam Desain Model Pembelajaran Pragmatik Edukasional”. LOA Jurnal Ketatabahasaan dan Kesustraan, Vol. 17, No. 2, page 161-171.

Ruddel, M., & Unrau, N. (2004). “The Role of Emoticons in Online Communication: A Study of Text-Based Communication Among College Students”. Journal of Educational Computing Research, Vol. 30, No. 4, page 387-404.

Sheridan, T. (2019). The Future of Multimodal Communication: Augmented Reality and Virtual reality. In M. C. Wetzel (Ed.), The Handbook of Multimodal Communication. John Wiley & Sons.

Smith, A., & Johnson, B. (2018). “Understanding Multimodal Pragmatics: Integrating Verbal and Nonverbal Communication”. Journal of Communication Studies, Vol. 45, No. 2, page 201-218.

Vedantam, R., et all (2017). “Contextaware Captions from Context-Agnostic Supervision”. Proceedings 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, page 251-260.

Williams, D., & Brown, K. (2021). “The Impact of Technology on Multimodal Communication: Trends and Future Directions”. Communication and Society, Vol. 18, No. 1, page 81-97.

Zed, M. (2008). Metode Penelitian Kepustakaan. Jakarta: Yayasan Obor Indonesia