第二届语言习得、认知与脑科学学术论坛--学术报告(五)

发布日期: 2020-09-30 浏览次数:
题目:Recent Empirical Advances in Multimodal and Multilingual Language Processing in Subtitles and Captions
主讲人:澳大利亚Stephen Doherty教授
时间:2020-09-30 09:00
地点:ZOOM ID: 750 888 0655
主办单位:语言认知科学学科创新引智基地
讲座内容:

主讲人简介:

Stephen Doherty教授,为澳大利亚悉尼人文与语言学部教育学院的副院长,指导了12个博士生,共做17个项目,在国际顶级期刊共发表具有影响力的论文44余篇。受邀国际会议发言6

讲座内容简介:

The use of video has accelerated rapidly in the past decade owing to technological developments, globalisation, trends in new media, and a range of other factors. We now regularly interact with video, particularly for entertainment, information, and education. Such videos, however, represent a language and accessibility barrier, especially for those who need or may benefit from support in a first or foreign language. Subtitles (interlingual) and captions (intralingual) represent a unique solution, and despite indications of their ability to enhance language processing and related performance, this potential has yet to be realised due to methodological and technological limitations and a limited evidence base leading to a divergence between academic research and industry practice.

 

In this talk, I will report on a series of recent collaborative projects which have explored L1 and L2 language processing in subtitles and captions within educational and entertainment settings. I will describe how methodologies have developed to move from self-reports, psychometrics and task performance, including comprehension and recall, to online methods of eye tracking and electroencephalography with a focus on cognitive load and immersion. Through these methodological innovations, we have examined various aspects of the complex multimodal and multilingual language processing, including the impact of errors and discreet linguistic targets, ‘cognitively efficient’ captions, viewers’ integration of bimodal input, and comparisons of monolingual and bilingual subtitles, and machine- and human-generated subtitles and captions.

 

In closing, I will reflect on the abovementioned methods and situate the reported findings within a broader context of on-going developments in language technologies. I also show how subtitles and captions represent an attractive and stimulating testing ground for future investigations of language processing in multilingual and multimodal contexts leading to refinement of evidence-based models and large-scale local and global applications.


ZOOM 链接: https://zoom.com.cn/j/7508880655

Baidu
sogou