Human Computer Interaction: Research and Applications

EnglishTürkçe

CHAPTER


DOI :10.26650/B/ET07.2020.012.17   IUP :10.26650/B/ET07.2020.012.17    Full Text (PDF)

Research on the Effects of Watching Videos With Subtitles

Mehmet Boz, Erokan Canbazoğlu

Watching a foreign language movie with subtitles is extremely convenient for understanding the movie. However, adding subtitles to a video greatly changes the viewing behavior. The audience has to read the text as well as focus on the visual and audio data in the video. This research is based on the assumption that this situation negatively affects the visual data processing performance of the audience. Within the scope of this research, a 1 minute 55 second video from a foreign language movie that the participant did not know was watched in two different groups with subtitles and dubbing. The eye movements of the participants were recorded with eye tracking technology. At the end of the video, a test was applied to measure the participants’ visual data processing performances. As a result of the analysis, it was determined that watching a video with subtitles does not have a negative effect on face recognition, but negatively affects detail capture and scene sorting performance.


Keywords: Subtitle, Video, Visual Data Processing, Eye Tracking
DOI :10.26650/B/ET07.2020.012.17   IUP :10.26650/B/ET07.2020.012.17    Full Text (PDF)

Altyazılı Video İzlemenin Etkileri Üzerine Bir Araştırma

Mehmet Boz, Erokan Canbazoğlu

Yabancı dildeki bir filmi altyazılı izlemek filmi anlama konusunda büyük kolaylık sağlamaktadır. Ancak, bir videoya altyazı eklenmesi izleme davranışını büyük oranda değiştirmektedir. İzleyici video üzerindeki görsel ve işitsel verileri işlemenin yanında metin okumak durumunda kalmaktadır. Araştırma, bu durumun izleyicilerin görsel veri işleme performanslarını olumsuz etkilediği varsayımından hareket etmektedir. Araştırma kapsamında, katılımcının bilmediği yabancı dildeki bir filmden alınan 1 dakika 55 saniye uzunluğundaki video altyazılı ve dublajlı olarak iki farklı gruba izletilmiştir. Göz izleme teknolojisi ile katılımcıların izleme sırasındaki göz hareketleri kaydedilmiştir. Video sonunda, katılımcıların görsel veri işleme performanslarını ölçmek üzere test uygulanmıştır. Yapılan analizler sonucunda, altyazılı video izlemenin yüz tanıma üzerinde olumsuz bir etkisinin olmadığı fakat detay yakalama ve sahne sıralama performansını olumsuz etkilediği tespit edilmiştir. 


Keywords: Altyazı, Video, Görsel Veri İşleme, Göz İzleme

References

  • Büyüköztürk, Ş., Çakmak, E. K., Akgün, Ö. E., Karadeniz, Ş., & Demirel, F. (2011). Bilimsel araştırma yöntemleri. Ankara: Pegem Akademi. google scholar
  • d’Ydewalle, G. (2002). Foreign-language acquisition by watching subtitled television programs. google scholar
  • d’Ydewalle, G., & De Bruycker, W. (2007). Eye movements of children and adults while reading television subtitles. European Psychologist, 12(3), 196–205. google scholar
  • Hershler, O., & Hochstein, S. (2005). At first sight: A high-level pop out effect for faces. Vision Research, 45(13), 1707–1724. google scholar
  • Jensema, C. J., El Sharkawy, S., Danturthi, R. S., Burch, R., & Hsu, D. (2000). Eye movement patterns of captioned television viewers. American Annals of the Deaf, 145(3), 275–285. google scholar
  • Kruger, J.-L., & Steyn, F. (2014). Subtitles and eye tracking: Reading and performance. Reading Research Quarterly, 49(1), 105–120. google scholar
  • Kruger, J.-L., Szarkowska, A., Krejtz, I., & others. (2015). Subtitles on the moving image: An overview of eye tracking studies. google scholar
  • Lavaur, J.-M., & Bairstow, D. (2011). Languages on the screen: Is film comprehension related to the viewers’ fluency level and to the language in the subtitles? International Journal of Psychology, 46(6), 455–462. google scholar
  • Perego, E. (2012). Eye tracking in audiovisual translation (ss. 13-35). Aracne, Rome: Taylor, Christopher. google scholar
  • Perego, E., Del Missier, F., & Bottiroli, S. (2015). Dubbing versus subtitling in young and older adults: cognitive and evaluative aspects. Perspectives, 23(1), 1–21. google scholar
  • Perego, E., Del Missier, F., Porta, M., & Mosconi, M. (2010). The cognitive effectiveness of subtitle processing. Media Psychology, 13(3), 243–272. google scholar
  • Perego, E., Orrego-Carmona, D., & Bottiroli, S. (2016). An empirical take on the dubbing vs. subtitling debate. An eye movement study. Lingue e Linguaggi, 255–274. google scholar
  • Wissmath, B., Weibel, D., & Groner, R. (2009). Dubbing or Subtitling?: Effects on Spatial Presence, Transportation, Flow, and Enjoyment. Journal of Media Psychology: Theories, Methods, and Applications, 21, 114–125. google scholar


SHARE




Istanbul University Press aims to contribute to the dissemination of ever growing scientific knowledge through publication of high quality scientific journals and books in accordance with the international publishing standards and ethics. Istanbul University Press follows an open access, non-commercial, scholarly publishing.