SOME ASPECTS OF VISUAL-AUDITORY PERCEPTION OF ORAL SPEECH WHILE VIDEO AND SOUND RECORDINGS EXAMINATION
DOI:
https://doi.org/10.32353/khrife.1.2020_24Keywords:
forensic examination of video and sound recordings, visual and auditory perception of oral speech, lip reading, video recording.Abstract
A problematic issue that frequently arises in the examination of video and audio recordings, namely the question of visual and auditory perception of oral speech – the establishment of the content of a conversation based on its image (lip reading) – is considered.
The article purpose is to analyze the possibility and feasibility of examining the visual-auditory perception of oral speech in the framework of the examination of video and sound recordings, considering the peculiarities of such research; the ability to use visual information either as an independent object of examination (lip reading), or as a supplementary, additional to auditory analysis of a particular message. The main components of the process of lip reading, the possibility of visual examination of visual and auditory information in order to establish the content of a conversation are considered. Attention is paid to the features of visual and auditory perception of oral speech, and the factors that contribute enormously to the informative nature of the overall picture of oral speech perception by an image are analyzed.
The influence of the visual image on the speech perception by an image is considered, such as active articulation, facial expressions, head movement, position of teeth, gestures, etc. In addition to the quality of the image, the duration of the speech fragment also affects the perception of oral speech by the image: a fully uttered expression is usually read better than its individual parts. The article also draws attention to the ambiguity of articulatory images of sounds. The features of the McGurk effect – a perception phenomenon that demonstrates the interaction between hearing and vision while the perception of speech – are considered.
The analysis of the possibility and feasibility of examining visual and auditory perception of oral speech within the framework of the examination of video and sound recordings is carried out, and the peculiarities of such research are highlighted.
References
DongSuk Yuk. (1999) Robust speech recognition using neural networks and hidden Mar- kov models. Adaptations using non-linear transformations. – New Jersey: The State University of New Jersey.
Fant, G. (1964). Akusticheskaia teoriia recheobrazovaniia. Moscow [in Russian]. Flanagan Dzh. (1968). Analiz, sintez i vospriiatie rechi [in Russian].
Huang Xuedong. (2001). Spoken language processing: a guide to theory, algorithm and system development. – New Jersey: Prentice Hall PTR.
Instruktsiia pro pryznachennia ta provedennia sudovykh ekspertyz ta ekspertnykh doslidzhen. Naukovo-metodychni rekomendatsii z pytan pidhotovky ta pryznachennia sudovykh ekspertyz ta ekspertnykh doslidzhen: vid 08.10.98 № 53/5 (zi zminamy ta dop.). URL: zakon.rada.gov.ua/go/z0705-98 (data zvernennia: 10.12.2018) [in Ukranian].
Kulikov, G. A. (1986). Neirofiziologicheskie osnovy obrabotki akusticheskikh signalov. Akustika rechi i slukha. Sbornik trudov [in Russian].
Potapov, V. V. (1989). Nekotorye aspekty zritelno-slukhovogo raspoznavaniia rechi. Vozmozhnosti sudebnoi videofonograficheskoi ekspertizy: sb. nauch.tr. N. P. Mailis, E. K. Rebgun (Eds.). Moscow. VNII sudebnykh ekspertiz [in Russian]. Shupliakov, V. S. (1986). Fiziologiia perifericheskogo otdela slukhovoi sistemy. Slukhovaia sistema. Leningrad: Nauka [in Russian].
Untley, R. (1959). Factors involved in the teaching and testing of lip reading ability through the use of motion pictures. Volta Revirw.
Vikipediia. Chtenie po gubam. URL: https://ru.wikipedia.org/wiki/Chtenie _po_gubam (data zvernennya 14.05.2020) [in Russian].
