Exploring augmentation of meaning through intersemiotic complementarity in children comic book series

Nur Annisa Haris, Yusnita Febrianti, Nurenzia Yannuar

Abstract


Comic books are taking a new turn as a medium of learning. The combination of modes of visual and verbal in comics is a rich source of meanings. They are arguably one of the contributors to why comic books are considered as a form of reading materials for the purpose of language learning. With this regard, the present study is looking into a comic book series targeted for young readers, entitled ‘Little Dim Sum Warriors’. The overall aim of the study is to comprehend how the readers are likely to learn language with the comic. More specifically, the study addresses the details of the verbal-visual relation in LDSW and the prediction on how readers might be able to perceive the meaning-making process in LDSW. In doing so, the study analyzes the first two installments of the series in terms of the relationships between the verbal texts and visual images in terms of the ideational meanings. Data analysis is facilitated primarily using Royce’s (1998) framework of ideational Intersemiotic Complementarity to map out and categorize any instances of visual-verbal relation in the data in terms of the instances of repetition, synonymy, antonymy, hyponymy, meronymy, and collocation. Through the analysis, the study found that the verbal-visual relations mostly fall into the categories of repetition and collocation, which further indicate that the repeated meaning in both verbal and visual aspects are found effective in learning language. Other relations, however, such as those that appeared as anonymy or synonymy, might require the attendance of teachers or parents to create a discussion with the young readers regarding the meaning-making process. The results of the study also implied some hints on how reading activities between parents and children may be conducted. 


Keywords


Comic books; intersemiotic complementarity; Little Dim Sum Warriors

Full Text:

PDF

References


Bender, L., & Lourie, R. S. (1941). The effect of comic books on the ideology of children. American Journal of Orthopsychiatry, 11(3), 540–550. https://psycnet.apa.org/doi/10.1111/j.1939-0025.1941.tb05840.x

Damayanti, I. L., & Febrianti, Y. (2020). Multimodal literacy: Unfolding reading path in children’s picture book and its potential for EFL classrooms. Indonesian Journal of Applied Linguistics, 9(3), 616–627. https://doi.org/10.17509/ijal.v9i3.23212

Fricke, E. (2012). Grammatik multimodal: Wie Wörter und Gesten zusammenwirken [Grammar multimodal: How words and gestures work together]. de Gruyter.

Fricke, E. (2013). 46. Towards a unified grammar of gesture and speech: A multimodal approach. In C. Müller, A. Cienki, E. Fricke, S. Ladewig, D. McNeill & S. Tessendorf (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 1) (pp. 733-754). De Gruyter Mouton. https://doi.org/10.1515/9783110261318.733

Hu, Y., & Qiu, Q. (2020). A study on verbal and image relations in multimodal texts from the perspective of intersemiotic complementarity. Canadian Social Science, 16(10), 50–56. http://doi.org/10.3968/11938

Kaindl, K. (1999). Thump, whizz, poom: A framework for the study of comics under translation. Target: International Journal of Translation Studies, 11(2), 263–288. https://doi.org/10.1075/target.11.2.05kai

Kress G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.

Kress, G., & van Leeuwen, T. (1996). Reading images: The grammar of visual design. Routledge.

Kuttner, P. J., Weaver-Hightower, M. B., & Sousanis, N. (2020). Comics-based research: The affordances of comics for research across disciplines. Qualitative Research, 21(2), 195–214. https://doi.org/10.1177/1468794120918845

Lin, S.-F., & Lin, H. (2016). Learning nanotechnology with texts and comics: The impacts on students of different achievement levels. International Journal of Science Education, 38(8), 1373–1391. https://doi.org/10.1080/09500693.2016.1191089

Lin, S.-F., Lin, H., Lee, L., & Yore, D. L. (2015). Are science comics a good medium for science communication? The case for public learning of nanotechnology. International Journal of Science Education, Part B: Communication and Public Engagement, 5(3), 276–294. https://doi.org/10.1080/21548455.2014.941040

Marchetti, L., & Cullen, P. (2016). A multimodal approach in the classroom for creative learning and teaching. Psychological and Creative Approaches to Language Teaching, 5(1), 39–51.

MODE. (2012). Glossary of multimodal terms. https://multimodalityglossary.wordpress.com/. Retrieved 02 August 2021.

Morrison, T., Brian, G., & Chilcoat, G. (2002). Using student-generated comic books in the classroom. Journal of Adolescent & Adult Literacy, 45(8), 758–767.

Nakakuwa, T., & Jawahar, K. (2020). Intersemiotic complementarity In Namibian physical Science Teachers’ classroom practice. African Journal of Research in Mathematics, Science and Technology Education, 24(3), 387–399.

Omaggio, A. C. (1979). Pictures and second language comprehension: Do they help? Foreign Language Annals, 12(2), 107–116. https://doi.org/10.1111/j.1944-9720.1979.tb00153.x

Royce, T. D. (1998). Synergy on the page: Exploring intersemiotic complementarity in page-based multimodal text. JASFL Occasional Papers, 1(1), 25–49.

Royce, T. D., & Bowcher, W. L. (2007). New directions in the analysis of multimodal discourse. Erlbaum.

Siefkes, M. (2015). How semiotic modes work together in multimodal texts: Defining and representing intermodal relations. 10plus1: Living Linguistics, 1, 113–131.

Tatalovic, M. (2009). Science comics as tools for science education and communication: A brief, exploratory study. Journal of Science Communication, 8(4), A02. https://doi.org/10.22323/2.08040202

Unsworth, L., & Ngo, T. (2014). Vai trò của hình ảnh trong sách giáo khoa dạy tiếng Anh ở Việt Nam: Part 1 [The role of images in English language textbooks in Vietnam: Part 1]. Linguistics Society of Vietnam, 11, 104. https://hdl.handle.net/1959.11/16347

Vu, T., & Y. Febrianti, (2018). Teachers’ reflections on the visual resources in English textbooks for Vietnamese lower secondary schools. TEFLIN Journal, 29(2), 266. http://doi.org/10.15639/teflinjournal.v29i2/266-292

Widyastuti, P. D., Mardiyana, M., & Saputro, D. R. (2017). An instructional media using comics on the systems of linear equation. Journal of Physics: Conference Series, 895. 10.1088/1742-6596/895/1/012039

Wildfeuer, J. (2012). Intersemiosis in film: Towards a new organisation of semiotic resources in multimodal filmic text. Journal Multimodal Communication, 1(3), 276–304. https://doi.org/10.1515/mc-2012-0016

Wildfeuer, J. (2014). Film discourse interpretation: Towards a new paradigm for multimodal film analysis. Routledge.

Wright, A. (1989). Pictures for language learning: Cambridge handbooks for language teachers. Cambridge University Press.




DOI: https://doi.org/10.17509/ijal.v12i3.39951

Refbacks

  • There are currently no refbacks.


View My Stats

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.