As the development of digital media has changed the environments and the ways of communication, Multimodal texts, that consist of letters, images, and sounds, have emerged as a core communication medium. Therefore, the purpose of this research was to ...
As the development of digital media has changed the environments and the ways of communication, Multimodal texts, that consist of letters, images, and sounds, have emerged as a core communication medium. Therefore, the purpose of this research was to lay the foundation for theoretical and practical knowledge of the Multimodal text reading education by understanding the characteristics of Multimodal text, and ability and performance aspects of Multimodal text reading. First, we conceptualize the way and characteristics of Multimodal text exist and function as 'multimodal textuality'. and derive its reference element by conceptualizing 'imagance' as a key characteristic of Multimodal textuality. Second, we identify the impact of Multimodal texts on reading to learn, and identify aspects of strategies used by skilled readers to read Multimodal texts, enhancing their understanding of Multimodal text reading performance. Third, by deriving constructs and cognitive evaluation factors of Multimodal text text reading ability, we identify Multimodal text reading ability, and lay the foundation for Multimodal text reading education and evaluation of Multimodal text reading ability. Fourth, we identify the relationship between Letter-based text reading ability and Multimodal text reading ability, confirming the correlation and impact relationship between the two reading abilities as well as having similar tendencies. Through the above studies, the researchers promoted a systematic understanding of Multimodal text and laid the foundation for Multimodal literacy education. Furthermore, we suggests directions for improvement of teaching and learning for the Multimodal text reading ability, and specify what educational support is needed to improve Multimodal text ability.