Отслеживание взгляда

_________________________________________________________________________________________________________ French Cued Speech perception and expertise effect in hearing people Since French Cued Speech (CS) is multi-signal (lip movements and CS gestures), we conducted an eye tracking study to …...

In the present work we raise the hypothesis that eye-movements when reading texts reveal task performance, as measured by the level of understanding of the reader. With the objective of …...

Word Sense Disambiguation (WSD) ap- proaches have reported good accuracies in recent years. However, these approaches can be classified as weak AI systems. According to the classical definition, a strong …...

Typing has traditionally been the only in- put method used by human translators working with computer-assisted transla- tion (CAT) tools. However, speech is a nat- ural communication channel for humans …...

In this paper, we take a closer look at the MT evaluation process from a glass-box perspective using eye-tracking. We an- alyze two aspects of the evaluation task – the …...

It is well-known that readers are less likely to fixate their gaze on closed class syn- tactic categories such as prepositions and pronouns. This paper investigates to what extent the …...

AbstractThe Dundee Eyetracking Corpus contains eyetracking data collected while native speakers of English and French read newspaper editorial articles. Similar resources for other languages are still rare, especially for languages …...

This paper contributes to the research field of multichannel discourse analysis. Multimodal discourse analysis explores numerous channels involved in natural communication, such as verbal structure, prosody, gesticulation, facial expression, eye …...

Phonetic segmentation is the process of splitting speech into distinct phonetic units. Human experts routinely perform this task manually by analyzing auditory and visual cues using analysis software, which is …...

AbstractWe present a novel approach for determining learners’ second language proficiency which utilizes behavioral traces of eye movements during reading. Our approach provides stand-alone eyetracking based English proficiency scores which …...

AbstractWhen learning POS taggers and syntactic chunkers for low-resource languages, different resources may be available, and often all we have is a small tag dictionary, motivating type-constrained unsupervised induction. Even …...

AbstractAn interesting method of evaluating word representations is by how much they reflect the semantic representations in the human brain. However, most, if not all, previous works only focus on …...

AbstractWe use synchronized 120 fps motion capture and 50 fps eye tracking data from two native signers to investigate the temporal order in which the dominant hand, the head, the …...

AbstractWe study the problem of integrating cognitive language processing signals (e.g., eye-tracking or EEG data) into pre-trained language models like BERT. Existing methods typically fine-tune pre-trained models on cognitive data, …...

AbstractIntegrating human feedback in models can improve the performance of natural language processing (NLP) models. Feedback can be either explicit (e.g. ranking used in training language models) or implicit (e.g. …...