Multimodal semiotic resources and their functional potential for learning systems

http://dx.doi.org/10.20339/AM.06-16.083

Zh.E. Vavilova is Senior lecturer at Kazan State Power Engineering University

e-mail: zhannavavilova@mail.ru

K.V.  Rusetsky is Program engineer at Belarusian State University of Informatics and Radio-electronics

e-mail: rusetski@bsuir.by

Presented are basic approaches to analysis of the concept of “multimodality”. Shown is the spectrum of it’s elements, as well as pool, containing semiotic resources to be used for aims of education. Determined is proportion of concrete components semiotic resources as one of aims of the project of «Models and tools for multimodal text synthesis in intelligent learning systems», that is being carried out by scientists from Kazan in cooperation with their Belarusian colleagues. In the course of mutually realizing scientific educational project, it is intended to create and test of the program, aimed at definition conditions of communication through various semiotic resources. At starting stage of the project, multimodality is being analyzed from point of view of social semiotics, focused on meaning-making of all types, i.e. from verbal to often over-looked somatosensory.

Key words: multimodality, semiotic resources, channels of transmission information, intelligent learning systems.

References

1. Vavilova, Zh.E. Epistemic injustice and the principle of dialog. Alma mater (Vestnik vysshei shkoly), 2014, no. 8, pp. 100–104.
2. Golenkov, V.V., Gulyakina, N.A. Graphic dynamic models of parallel non-synchronic processing. Language technologies, 2012, no. 1, pp. 3–14.
3. Kibrik, A.A. Multi-model linguistic. Moscow, 2010, pp. 134–152.
4. Myodova, A.A. On the problem of existence of the notion of “modality” in modern humanitarian and philosophical knowledge. Vestnik of Tomsk state university, 2012, no. 356, pp. 53–57.
5. Azaoui, B. Analyse Multimodale de l’Agir Professoral et Degré de Granularité. Réflexions Méthodologiques / Coord. S. Canelas-Trevisi & R. Gagnon. Lidil, 2014, no. 49, pp. 17–32.
6. Halliday, M.A.K. Towards a Language-Based Theory of Learning. Linguistics and Education, 1993, no. 5, pp. 93–116.
7. Kress, G. Multimodality: A Social Semiotic Approach to Contemporary Communication. New York: Routledge, 2010.
8. O’Sullivan, C. Introduction: Multimodality as Challenge and Resource for Translation. The Journal of Specialised Translation, 2013, no. 20, pp. 2–14.
9. Thurlow, С. Multimodality, Materiality and Everyday Textualities: The Sensuous Stuff of Status? In Handbook of Intermediality, 2015. DeGruyter (In Press).