|
1
|
Miura K, Yoshida M, Morita K, Fujimoto M, Yasuda Y, Yamamori H, Takahashi J, Miyata S, Okazaki K, Matsumoto J, Toyomaki A, Makinodan M, Hashimoto N, Onitsuka T, Kasai K, Ozaki N, Hashimoto R. Gaze behaviors during free viewing revealed differences in visual salience processing across four major psychiatric disorders: a mega-analysis study of 1012 individuals. Mol Psychiatry 2025; 30:1594-1600. [PMID: 39394456 PMCID: PMC11919774 DOI: 10.1038/s41380-024-02773-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 09/20/2024] [Accepted: 09/26/2024] [Indexed: 10/13/2024]
Abstract
Aberrant salience processing has been proposed as a pathophysiological mechanism underlying psychiatric symptoms in patients with schizophrenia. The gaze trajectories of individuals with schizophrenia have been reported to be abnormal when viewing an image, suggesting anomalous visual salience as one possible pathophysiological mechanism associated with psychiatric diseases. This study was designed to determine whether visual salience is affected in individuals with schizophrenia, and whether this abnormality is unique to patients with schizophrenia. We examined the gaze behaviors of 1012 participants recruited from seven institutes (550 healthy individuals and 238, 41, 50 and 133 individuals with schizophrenia, bipolar disorder, major depressive disorder and autism spectrum disorder, respectively) when they looked at stationary images as they liked, i.e., free-viewing condition. We used an established computational model of salience maps derived from low-level visual features to measure the degree to which the gaze trajectories of individuals were guided by visual salience. The analysis revealed that the saliency at the gaze of individuals with schizophrenia were higher than healthy individuals, suggesting that patients' gazes were guided more by low-level image salience. Among the low-level image features, orientation salience was most affected. Furthermore, a general linear model analysis of the data for the four psychiatric disorders revealed a significant effect of disease. This abnormal salience processing depended on the disease and was strongest in patients with schizophrenia, followed by patients with bipolar disorder, major depressive disorder, and autism spectrum disorder, suggesting a link between abnormalities in salience processing and strength/frequency for psychosis of these disorders.
Collapse
Affiliation(s)
- Kenichiro Miura
- Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, 184-8553, Japan.
- Section of Brain Function Information, National Institute for Physiological Sciences, Okazaki, 444-8585, Japan.
| | - Masatoshi Yoshida
- Center for Human Nature, Artificial Intelligence, and Neuroscience (CHAIN), Hokkaido University, Sapporo, 060-0812, Japan.
| | - Kentaro Morita
- Department of Rehabilitation, University of Tokyo Hospital, Tokyo, 113-8655, Japan
| | - Michiko Fujimoto
- Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, 184-8553, Japan
- Department of Psychiatry, Osaka University Graduate School of Medicine, Suita, 565-0871, Japan
| | - Yuka Yasuda
- Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, 184-8553, Japan
- Medical Corporation Foster, Life Grow Brilliant Mental Clinic, Osaka, 531-0075, Japan
| | - Hidenaga Yamamori
- Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, 184-8553, Japan
- Japan Community Health Care Organization, Osaka Hospital, Osaka, 553-0003, Japan
| | - Junichi Takahashi
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, 812-8582, Japan
| | - Seiko Miyata
- Department of Psychiatry, Nagoya University Graduate School of Medicine, Nagoya, 466-8550, Japan
| | - Kosuke Okazaki
- Department of Psychiatry, Nara Medical University School of Medicine, Kashihara, 634-8521, Japan
| | - Junya Matsumoto
- Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, 184-8553, Japan
| | - Atsuto Toyomaki
- Department of Psychiatry, Hokkaido University Graduate School of Medicine, Sapporo, 060-8638, Japan
| | - Manabu Makinodan
- Department of Psychiatry, Nara Medical University School of Medicine, Kashihara, 634-8521, Japan
| | - Naoki Hashimoto
- Department of Psychiatry, Hokkaido University Graduate School of Medicine, Sapporo, 060-8638, Japan
| | | | - Kiyoto Kasai
- Department of Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo, 113-8655, Japan
- The International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study (UTIAS), Tokyo, 113-0033, Japan
| | - Norio Ozaki
- Pathophysiology of Mental Disorders, Nagoya University Graduate School of Medicine, Nagoya, 466-8550, Japan
- Institute for Glyco-core Research (iGCORE), Nagoya University, Nagoya, 464-8601, Japan
| | - Ryota Hashimoto
- Department of Pathology of Mental Diseases, National Institute of Mental Health, National Center of Neurology and Psychiatry, Kodaira, 184-8553, Japan
| |
Collapse
|
|
2
|
Yuan Y, Wu B, Mo Z, Liu W, Hong J, Li Z, Liu J, Liu N. Temporal-Spatial Redundancy Reduction in Video Sequences: A Motion-Based Entropy-Driven Attention Approach. Biomimetics (Basel) 2025; 10:192. [PMID: 40277591 PMCID: PMC12025262 DOI: 10.3390/biomimetics10040192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2025] [Revised: 03/07/2025] [Accepted: 03/19/2025] [Indexed: 04/26/2025] Open
Abstract
The existence of redundant video frames results in a substantial waste of computational resources during video-understanding tasks. Frame sampling is a crucial technique in improving resource utilization. However, existing sampling strategies typically adopt fixed-frame selection, which lacks flexibility in handling different action categories. In this paper, inspired by the neural mechanism of the human visual pathway, we propose an effective and interpretable frame-sampling method called Entropy-Guided Motion Enhancement Sampling (EGMESampler), which can remove redundant spatio-temporal information in videos. Our fundamental motivation is that motion information is an important signal that drives us to adaptively select frames from videos. Thus, we first perform motion modeling in EGMESampler to extract motion information from irrelevant backgrounds. Then, we design an entropy-based dynamic sampling strategy based on motion information to ensure that the sampled frames can cover important information in videos. Finally, we perform attention operations on the motion information and sampled frames to enhance the motion expression of the sampled frames and remove redundant spatial background information. Our EGMESampler can be embedded in existing video processing algorithms, and experiments on five benchmark datasets demonstrate its effectiveness compared to previous fixed-sampling strategies, as well as its generalizability across different video models and datasets.
Collapse
Affiliation(s)
- Ye Yuan
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| | - Baolei Wu
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| | - Zifan Mo
- School of Automation and Electronic Information, Xiangtan University, Xiangtan 411105, China
| | - Weiye Liu
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| | - Ji Hong
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| | - Zongdao Li
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| | - Jian Liu
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| | - Na Liu
- Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China; (Y.Y.)
| |
Collapse
|
|
3
|
Cont C, Stute N, Galli A, Schulte C, Wojtecki L. Eye Tracking as Biomarker Compared to Neuropsychological Tests in Parkinson Syndromes: An Exploratory Pilot Study Before and After Deep Transcranial Magnetic Stimulation. Brain Sci 2025; 15:180. [PMID: 40002513 PMCID: PMC11852570 DOI: 10.3390/brainsci15020180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2024] [Revised: 02/08/2025] [Accepted: 02/11/2025] [Indexed: 02/27/2025] Open
Abstract
Background/Objectives: Neurodegenerative diseases such as Parkinson's disease (PD) are becoming increasingly prevalent, necessitating diverse treatment options to manage symptoms. The effectiveness of these treatments depends on accurate and sensitive diagnostic methods. This exploratory pilot study explores the use of eye tracking and compares it to neuropsychological tests on patients treated with deep transcranial magnetic stimulation (dTMS). Methods: We used the HTC Vive Pro Eye VR headset with Tobii eye tracker to measure eye movements in 10 Parkinson syndrome patients while viewing three 360-degree scenes. Eye movements were recorded pre- and post-dTMS, focusing on Fixation Duration, Longest Fixation Period, Saccade Rate, and Total Fixations. Neuropsychological assessments (MoCA, TUG, BDI) were conducted before and after stimulation. dTMS was performed using the Brainsway device with the H5 helmet, targeting the motor cortex (1 Hz) and the prefrontal cortex (10 Hz) for 7-12 sessions. Results: ROC analysis indicated a moderate ability to differentiate between states using eye movement parameters. Significant correlations were found between changes in the longest fixation period and MoCA scores (r = 0.65, p = 0.025), and between fixation durations and BDI scores (r = -0.55, p = 0.043). Paired t-tests showed no significant differences in eye movement parameters, but BDI scores significantly reduced post-dTMS (t(5) = 2.57, p = 0.049). Conclusions: Eye-tracking parameters, particularly the Longest Fixation Duration and Saccade Rate, could serve as sensitive and feasible biomarkers for cognitive changes in Parkinson's Syndrome, offering a quick alternative to traditional methods. Traditional neuropsychological tests showed a significant improvement in depressive symptoms after dTMS. Further research with larger sample sizes is necessary to validate these findings and explore the diagnostic utility of eye tracking.
Collapse
Affiliation(s)
- Celine Cont
- Department for Neurology and Neurorehabilitation, Hospital Zum Heiligen Geist, Academic Teaching Hospital of the Heinrich-Heine-University Duesseldorf, 47906 Kempen, Germany; (C.C.)
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine-University Düsseldorf, 40225 Düsseldorf, Germany
| | - Nathalie Stute
- Department for Neurology and Neurorehabilitation, Hospital Zum Heiligen Geist, Academic Teaching Hospital of the Heinrich-Heine-University Duesseldorf, 47906 Kempen, Germany; (C.C.)
| | - Anastasia Galli
- Department for Neurology and Neurorehabilitation, Hospital Zum Heiligen Geist, Academic Teaching Hospital of the Heinrich-Heine-University Duesseldorf, 47906 Kempen, Germany; (C.C.)
| | - Christina Schulte
- Department for Neurology and Neurorehabilitation, Hospital Zum Heiligen Geist, Academic Teaching Hospital of the Heinrich-Heine-University Duesseldorf, 47906 Kempen, Germany; (C.C.)
| | - Lars Wojtecki
- Department for Neurology and Neurorehabilitation, Hospital Zum Heiligen Geist, Academic Teaching Hospital of the Heinrich-Heine-University Duesseldorf, 47906 Kempen, Germany; (C.C.)
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine-University Düsseldorf, 40225 Düsseldorf, Germany
| |
Collapse
|
|
4
|
Lee YT, Tai YH, Chang YH, Barquero C, Chao SP, Wang CA. Disrupted microsaccade responses in late-life depression. Sci Rep 2025; 15:2827. [PMID: 39843485 PMCID: PMC11754810 DOI: 10.1038/s41598-025-86399-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2024] [Accepted: 01/10/2025] [Indexed: 01/24/2025] Open
Abstract
Late-life depression (LLD) is a psychiatric disorder in older adults, characterized by high prevalence and significant mortality rates. Thus, it is imperative to develop objective and cost-effective methods for detecting LLD. Individuals with depression often exhibit disrupted levels of arousal, and microsaccades, as a type of fixational eye movement that can be measured non-invasively, are known to be modulated by arousal. This makes microsaccades a promising candidate as biomarkers for LLD. In this study, we used a high-resolution, video-based eye-tracker to examine microsaccade behavior in a visual fixation task between LLD patients and age-matched healthy controls (CTRL). Our goal was to determine whether microsaccade responses are disrupted in LLD compared to CTRL. LLD patients exhibited significantly higher microsaccade peak velocities and larger amplitudes compared to CTRL. Although microsaccade rates were lower in LLD than in CTRL, these differences were not statistically significant. Additionally, while both groups displayed microsaccadic inhibition and rebound in response to changes in background luminance, this modulation was significantly blunted in LLD patients, suggesting dysfunction in the neural circuits responsible for microsaccade generation. Together, these findings, for the first time, demonstrate significant alterations in microsaccade behavior in LLD patients compared to CTRL, highlighting the potential of these disrupted responses as behavioral biomarkers for identifying individuals at risk for LLD.
Collapse
Affiliation(s)
- Yao-Tung Lee
- Department of Psychiatry, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Department of Psychiatry, Far Eastern Memorial Hospital, New Taipei City, Taiwan
- Department of Psychiatry, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
| | - Ying-Hsuan Tai
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Yi-Hsuan Chang
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
- Institute of Cognitive Neuroscience, College of Health Science and Technology, National Central University, Taoyuan City, Taiwan
| | - Cesar Barquero
- Department of Physical Activity and Sport Science, Peruvian University of Applied Sciences, Lima, Peru
| | - Shu-Ping Chao
- Taipei Neuroscience Institute, Taipei Medical University, New Taipei City, Taiwan
- Dementia Center, Department of Neurology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Chin-An Wang
- Department of Anesthesiology, School of Medicine, College of Medicine, Taipei Medical University, Taipei City, Taiwan.
- Department of Anesthesiology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan.
- Eye-Tracking Laboratory, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan.
| |
Collapse
|
|
5
|
Reyes-Lopez M, Vaca-Palomares I, Dávila-Ortiz de Montellano DJ, White BJ, Brien DC, Coe BC, Munoz DP, Fernandez-Ruiz J. Saccades, pupil response and blink abnormalities in Huntington's disease patients during free viewing. Clin Neurophysiol 2024; 165:117-124. [PMID: 39013355 DOI: 10.1016/j.clinph.2024.06.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 05/16/2024] [Accepted: 06/18/2024] [Indexed: 07/18/2024]
Abstract
OBJECTIVE Video-based eye tracking was used to investigate saccade, pupil, and blink abnormalities among patients with Huntington's disease (HD) who watched sequences of short videos. HD, an autosomal dominant neurodegenerative disorder resulting from a CAG mutation on chromosome 4, produces motor and cognitive impairments including slow or irregular eye movements, which have been studied using structured tasks. METHODS To explore how HD affects eye movements under instruction free conditions, we assessed 22 HD patients and their age matched controls in a 10-minute video-based free viewing task. RESULTS Patients with HD experienced a significant reduction in saccade exploration rate following video clip transitions, an increase in pupil reactions to luminance changes after clip transitions, and a significant higher blink rate throughout the task compared to the control group. CONCLUSIONS These results show that HD has a significant impact on how patients visually explore and respond to their environment under unconstrained and ecologically natural conditions. SIGNIFICANCE Eye tracking in HD patients revealed saccadic, pupil, and blink abnormalities in early HD patients, suggestive of brain circuitry abnormalities that probably involve brain stem deficits. Further research should explore the impact of these changes on the quality of life of the patients affected by the disease.
Collapse
Affiliation(s)
- Mariana Reyes-Lopez
- Ciencias Cognitivas y del Comportamiento, Facultad de Psicología, Universidad Nacional Autónoma de México, CDMX, Mexico
| | - Israel Vaca-Palomares
- Ciencias Cognitivas y del Comportamiento, Facultad de Psicología, Universidad Nacional Autónoma de México, CDMX, Mexico
| | | | - Brian J White
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Juan Fernandez-Ruiz
- Instituto de Neuroetología, Universidad Veracruzana, Xalapa, Mexico; Departamento de Fisiología, Facultad de Medicina, Universidad Nacional Autónoma de México, CDMX, Mexico.
| |
Collapse
|
|
6
|
Koch NA, Voss P, Cisneros-Franco JM, Drouin-Picaro A, Tounkara F, Ducharme S, Guitton D, de Villers-Sidani É. Eye movement function captured via an electronic tablet informs on cognition and disease severity in Parkinson's disease. Sci Rep 2024; 14:9082. [PMID: 38643273 PMCID: PMC11032372 DOI: 10.1038/s41598-024-59750-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Accepted: 04/15/2024] [Indexed: 04/22/2024] Open
Abstract
Studying the oculomotor system provides a unique window to assess brain health and function in various clinical populations. Although the use of detailed oculomotor parameters in clinical research has been limited due to the scalability of the required equipment, the development of novel tablet-based technologies has created opportunities for fast, easy, cost-effective, and reliable eye tracking. Oculomotor measures captured via a mobile tablet-based technology have previously been shown to reliably discriminate between Parkinson's Disease (PD) patients and healthy controls. Here we further investigate the use of oculomotor measures from tablet-based eye-tracking to inform on various cognitive abilities and disease severity in PD patients. When combined using partial least square regression, the extracted oculomotor parameters can explain up to 71% of the variance in cognitive test scores (e.g. Trail Making Test). Moreover, using a receiver operating characteristics (ROC) analysis we show that eye-tracking parameters can be used in a support vector classifier to discriminate between individuals with mild PD from those with moderate PD (based on UPDRS cut-off scores) with an accuracy of 90%. Taken together, our findings highlight the potential usefulness of mobile tablet-based technology to rapidly scale eye-tracking use and usefulness in both research and clinical settings by informing on disease stage and cognitive outcomes.
Collapse
Affiliation(s)
- Nils A Koch
- Integrated Program in Neuroscience, McGill University, Montreal, QC, Canada
- Innodem Neurosciences, Montreal, QC, Canada
| | - Patrice Voss
- Montreal Neurological Institute, McGill University, 3801 University Rm 742, Montreal, QC, H3A 2B4, Canada
- Innodem Neurosciences, Montreal, QC, Canada
| | - J Miguel Cisneros-Franco
- Montreal Neurological Institute, McGill University, 3801 University Rm 742, Montreal, QC, H3A 2B4, Canada
| | | | - Fama Tounkara
- Integrated Program in Neuroscience, McGill University, Montreal, QC, Canada
| | - Simon Ducharme
- Montreal Neurological Institute, McGill University, 3801 University Rm 742, Montreal, QC, H3A 2B4, Canada
- Douglas Mental Health University Institute, Montreal, QC, Canada
| | - Daniel Guitton
- Montreal Neurological Institute, McGill University, 3801 University Rm 742, Montreal, QC, H3A 2B4, Canada
| | - Étienne de Villers-Sidani
- Montreal Neurological Institute, McGill University, 3801 University Rm 742, Montreal, QC, H3A 2B4, Canada.
- Innodem Neurosciences, Montreal, QC, Canada.
| |
Collapse
|
|
7
|
Yamada Y, Shinkawa K, Kobayashi M, Nemoto M, Ota M, Nemoto K, Arai T. Distinct eye movement patterns to complex scenes in Alzheimer's disease and Lewy body disease. Front Neurosci 2024; 18:1333894. [PMID: 38646608 PMCID: PMC11026598 DOI: 10.3389/fnins.2024.1333894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 03/22/2024] [Indexed: 04/23/2024] Open
Abstract
Background Alzheimer's disease (AD) and Lewy body disease (LBD), the two most common causes of neurodegenerative dementia with similar clinical manifestations, both show impaired visual attention and altered eye movements. However, prior studies have used structured tasks or restricted stimuli, limiting the insights into how eye movements alter and differ between AD and LBD in daily life. Objective We aimed to comprehensively characterize eye movements of AD and LBD patients on naturalistic complex scenes with broad categories of objects, which would provide a context closer to real-world free viewing, and to identify disease-specific patterns of altered eye movements. Methods We collected spontaneous viewing behaviors to 200 naturalistic complex scenes from patients with AD or LBD at the prodromal or dementia stage, as well as matched control participants. We then investigated eye movement patterns using a computational visual attention model with high-level image features of object properties and semantic information. Results Compared with matched controls, we identified two disease-specific altered patterns of eye movements: diminished visual exploration, which differentially correlates with cognitive impairment in AD and with motor impairment in LBD; and reduced gaze allocation to objects, attributed to a weaker attention bias toward high-level image features in AD and attributed to a greater image-center bias in LBD. Conclusion Our findings may help differentiate AD and LBD patients and comprehend their real-world visual behaviors to mitigate the widespread impact of impaired visual attention on daily activities.
Collapse
Affiliation(s)
- Yasunori Yamada
- Digital Health, IBM Research, Tokyo, Japan
- Department of Psychiatry, Division of Clinical Medicine, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | | | - Masatomo Kobayashi
- Digital Health, IBM Research, Tokyo, Japan
- Department of Psychiatry, Division of Clinical Medicine, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Miyuki Nemoto
- Department of Psychiatry, Division of Clinical Medicine, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Miho Ota
- Department of Psychiatry, Division of Clinical Medicine, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Kiyotaka Nemoto
- Department of Psychiatry, Division of Clinical Medicine, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Tetsuaki Arai
- Department of Psychiatry, Division of Clinical Medicine, Institute of Medicine, University of Tsukuba, Tsukuba, Ibaraki, Japan
| |
Collapse
|
|
8
|
de Belen RAJ, Eapen V, Bednarz T, Sowmya A. Using visual attention estimation on videos for automated prediction of autism spectrum disorder and symptom severity in preschool children. PLoS One 2024; 19:e0282818. [PMID: 38346053 PMCID: PMC10861059 DOI: 10.1371/journal.pone.0282818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Accepted: 12/17/2023] [Indexed: 02/15/2024] Open
Abstract
Atypical visual attention in individuals with autism spectrum disorders (ASD) has been utilised as a unique diagnosis criterion in previous research. This paper presents a novel approach to the automatic and quantitative screening of ASD as well as symptom severity prediction in preschool children. We develop a novel computational pipeline that extracts learned features from a dynamic visual stimulus to classify ASD children and predict the level of ASD-related symptoms. Experimental results demonstrate promising performance that is superior to using handcrafted features and machine learning algorithms, in terms of evaluation metrics used in diagnostic tests. Using a leave-one-out cross-validation approach, we obtained an accuracy of 94.59%, a sensitivity of 100%, a specificity of 76.47% and an area under the receiver operating characteristic curve (AUC) of 96% for ASD classification. In addition, we obtained an accuracy of 94.74%, a sensitivity of 87.50%, a specificity of 100% and an AUC of 99% for ASD symptom severity prediction.
Collapse
Affiliation(s)
- Ryan Anthony J. de Belen
- School of Computer Science and Engineering, University of New South Wales, New South Wales, Australia
| | - Valsamma Eapen
- School of Psychiatry, University of New South Wales, New South Wales, Australia
| | - Tomasz Bednarz
- School of Art & Design, University of New South Wales, New South Wales, Australia
| | - Arcot Sowmya
- School of Computer Science and Engineering, University of New South Wales, New South Wales, Australia
| |
Collapse
|
|
9
|
Pitigoi IC, Coe BC, Calancie OG, Brien DC, Yep R, Riek HC, Kirkpatrick RH, Noyes BK, White BJ, Blohm G, Munoz DP. Attentional modulation of eye blinking is altered by sex, age, and task structure. eNeuro 2024; 11:ENEURO.0296-23.2024. [PMID: 38331578 PMCID: PMC10915461 DOI: 10.1523/eneuro.0296-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 01/15/2024] [Accepted: 02/05/2024] [Indexed: 02/10/2024] Open
Abstract
Spontaneous eye blinking is gaining popularity as a proxy for higher cognitive functions, as it is readily modulated by both environmental demands and internal processes. Prior studies were impoverished in sample size, sex representation and age distribution, making it difficult to establish a complete picture of the behavior. Here we present eye-tracking data from a large cohort of normative participants (n=604, 393 F, aged 5-93 years) performing two tasks: one with structured, discrete trials (interleaved pro/anti-saccade task; IPAST) and one with a less structured, continuous organization in which participants watch movies (free-viewing; FV). Sex- and age-based analyses revealed that females had higher blink rates between the ages of 22 and 58 years in the IPAST, and 22 and 34 years in FV. We derived a continuous measure of blink probability to reveal behavioral changes driven by stimulus appearance in both paradigms. In the IPAST, blinks were suppressed near stimulus appearance, particularly on correct anti-saccade trials, which we attribute to the stronger inhibitory control required for anti-saccades compared to pro-saccades. In FV, blink suppression occurred immediately after scene changes, and the effect was sustained on scenes where gaze clustered among participants (indicating engagement of attention). Females were more likely than males to blink during appearance of novel stimuli in both tasks, but only within the age bin of 18-44 years. The consistency of blink patterns in each paradigm endorses blinking as a sensitive index for changes in visual processing and attention, while sex and age differences drive interindividual variability.Significance Statement Eye-tracking is becoming useful as a non-invasive tool for detecting preclinical markers of neurological and psychiatric disease. Blinks are understudied despite being an important supplement to saccade and pupil eye-tracking metrics. The present study is a crucial step in developing a healthy baseline for blink behavior to compare to clinical groups. While many prior blink studies suffered from small sample sizes with relatively low age- and sex-diversity (review by Jongkees & Colzato, 2016), our large cohort of healthy participants has permitted a more detailed analysis of sex and age effects in blink behavior. Furthermore, our analysis techniques are robust to temporal changes in blink probability, greatly clarifying the relationship between blinking, visual processing, and inhibitory control mechanisms on visual tasks.
Collapse
Affiliation(s)
- Isabell C Pitigoi
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Olivia G Calancie
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Rachel Yep
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Ryan H Kirkpatrick
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Blake K Noyes
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Brian J White
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Gunnar Blohm
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada K7L 3N6
| |
Collapse
|
|
10
|
Gibbs MC, Huxley J, Readman MR, Polden M, Bredemeyer O, Crawford TJ, Antoniades CA. Naturalistic Eye Movement Tasks in Parkinson's Disease: A Systematic Review. JOURNAL OF PARKINSON'S DISEASE 2024; 14:1369-1386. [PMID: 39422967 PMCID: PMC11492120 DOI: 10.3233/jpd-240092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/08/2024] [Indexed: 10/19/2024]
Abstract
Background Eye tracking assessments in the laboratory have previously highlighted clear differences in eye movements between Parkinson's disease (PD) and healthy aging. However, laboratory-based eye movement tasks are artificial and limit the ecological validity of observed results. Eye movement tasks utilizing more naturalistic scenarios may provide more accurate insight into cognitive function but research in this area is limited. Objective This systematic review aims to ascertain what naturalistic tasks have revealed about oculomotor deficits in PD and what this information may help us understand about the underlying sensorimotor and cognitive processes. Methods Adhering to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement, a literature search of PsycInfo, Medline, Scopus, and Web of Science was conducted using predetermined search terms. Articles including both individuals with PD and healthy older adults completing eye tracking tasks involving naturalistic eye movements (e.g., reading, video-watching, unrestricted visual search) or naturalistic stimuli were included. Results After screening, 30 studies were identified as matching the inclusion criteria. Results revealed consistent findings across tasks, including longer fixation durations and smaller saccadic amplitudes in PD compared to healthy aging. However, inconsistencies in the literature and a lack of standardization in tasks limit interpretation of these results. Conclusions Naturalistic eye movement tasks highlight some consistent differences in eye movements between people with PD and healthy aging. However, future research should expand the current literature in this area and strive towards standardization of naturalistic tasks that can preferably be conducted remotely.
Collapse
Affiliation(s)
- Melissa C. Gibbs
- NeuroMetrology Lab, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| | - Jenna Huxley
- NeuroMetrology Lab, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| | - Megan Rose Readman
- Department of Psychology, Lancaster University, Lancaster, UK
- Department of Primary Care and Mental Health, The University of Liverpool, Liverpool, UK
- NIHR ARC NWC, Liverpool, UK
| | - Megan Polden
- Department of Psychology, Lancaster University, Lancaster, UK
- Department of Primary Care and Mental Health, The University of Liverpool, Liverpool, UK
- NIHR ARC NWC, Liverpool, UK
| | - Oliver Bredemeyer
- NeuroMetrology Lab, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| | | | - Chrystalina A. Antoniades
- NeuroMetrology Lab, Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, UK
| |
Collapse
|
|
11
|
Kable JA, Jones KL. Identifying Prenatal Alcohol Exposure and Children Affected by It: A Review of Biomarkers and Screening Tools. Alcohol Res 2023; 43:03. [PMID: 37260694 PMCID: PMC10229137 DOI: 10.35946/arcr.v43.1.03] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/02/2023] Open
Abstract
PURPOSE Early identification of prenatal alcohol exposure (PAE) and of those in need of services resulting from this exposure is an important public health concern. This study reviewed the existing literature on potential biomarkers and screening tools of PAE and its impact. SEARCH METHODS Electronic databases were searched for articles published between January 1, 1996, and November 30, 2021, using the following search terms: ("fetal alcohol" or "prenatal alcohol" or "FASD" or "alcohol-related neurodevelopmental disorder" or "ARND" or "ND-PAE") and ("screening" or "identification" or "biomarker"). Duplicate articles were electronically eliminated. Titles and abstracts were reviewed for appropriateness, and selected articles were retrieved for further analysis. Additional articles were added that were referenced in the reviewed articles or identified from expert knowledge. Information about the characteristics of the sample, the biomarker or screening tool, and the predictive validity outcome data were abstracted. A narrative analysis of the studies was then performed on the data. SEARCH RESULTS A total of 3,813 articles were initially identified, and 1,215 were removed as duplicates. Of the remaining articles, 182 were identified as being within the scope of the review based on title and abstract inspection, and 181 articles were successfully retrieved. Of these, additional articles were removed because they were preclinical (3), were descriptive only (13), included only self-report of PAE (42), included only mean group comparison (17), were additional duplicates (2), focused on cost analysis (9), missed predictive validity data (24), or for other reasons (23). The remaining articles (n = 48) were abstracted. An additional 13 manuscripts were identified from these articles, and two more from expert knowledge. A total of 63 articles contributed to the review. DISCUSSION AND CONCLUSIONS Biomarkers and screening tools of PAE and its impact fall short of ideal predictive validity characteristics. Higher specificity than sensitivity was found for many of the biomarkers and screening tools used to identify PAE and its impact, suggesting that current methods continue to under-identify the full range of individuals impacted by PAE. Exceptions to this were found in recent investigations using microRNAs related to growth and vascular development, proteomic changes associated with PAE, and combinations of markers estimating levels of various cytokines. Replications of these findings are needed across other samples to confirm the limited data available. Future research on biomarkers and screening tools should attend to feasibility and scalability of implementation. This article also recommends a systematic process of evaluation to improve early identification of individuals impacted by PAE so that harm reduction and habilitative care efforts can be implemented.
Collapse
Affiliation(s)
- Julie A. Kable
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, Georgia
- Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia
| | - Kenneth Lyons Jones
- Department of Pediatrics, University of California San Diego, La Jolla, California
| |
Collapse
|
|
12
|
Castricum J, Tulen JHM, Taal W, Pel JJM, Elgersma Y. Visual-spatial and visuomotor functioning in adults with neurofibromatosis type 1. JOURNAL OF INTELLECTUAL DISABILITY RESEARCH : JIDR 2023; 67:362-374. [PMID: 36625000 DOI: 10.1111/jir.13005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 11/15/2022] [Accepted: 12/12/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Neurofibromatosis type 1 (NF1) is a neurodevelopmental genetic disorder associated with visual-spatial and visuomotor deficits, which have not been studied well in adults with NF1. METHODS In 22 adults with NF1 and 31 controls, visuomotor functioning was assessed by measuring eye latency, hand latency and hand accuracy during visuomotor tasks. Visual-spatial functioning was assessed by measuring eye movement responses during the Visual Threshold Task. RESULTS The NF1 group had a significantly shorter eye latency than the control group and was less accurate in their hand movements during specific visuomotor tasks. The groups showed no differences in eye movement responses during the Visual Threshold Task and in hand latency during the visuomotor tasks. CONCLUSIONS In contrast to studies in children with NF1, we found no alterations in visual-spatial information processing in adults. Impairments in eye latency and hand accuracy during specific visuomotor tasks may indicate deficits in visuomotor functioning in adults with NF1.
Collapse
Affiliation(s)
- J Castricum
- Department of Clinical Genetics, Erasmus Medical Center, Rotterdam, The Netherlands
- Department of Psychiatry, Erasmus Medical Center, Rotterdam, The Netherlands
- ENCORE Expertise Center for Neurodevelopmental Disorders, Erasmus Medical Center, Rotterdam, The Netherlands
| | - J H M Tulen
- Department of Psychiatry, Erasmus Medical Center, Rotterdam, The Netherlands
- ENCORE Expertise Center for Neurodevelopmental Disorders, Erasmus Medical Center, Rotterdam, The Netherlands
| | - W Taal
- ENCORE Expertise Center for Neurodevelopmental Disorders, Erasmus Medical Center, Rotterdam, The Netherlands
- Department of Neurology/Neuro-oncology, Erasmus Medical Center Cancer Institute, Rotterdam, The Netherlands
| | - J J M Pel
- Department of Neuroscience, Erasmus Medical Center, Rotterdam, The Netherlands
| | - Y Elgersma
- Department of Clinical Genetics, Erasmus Medical Center, Rotterdam, The Netherlands
- ENCORE Expertise Center for Neurodevelopmental Disorders, Erasmus Medical Center, Rotterdam, The Netherlands
- Department of Neurology/Neuro-oncology, Erasmus Medical Center Cancer Institute, Rotterdam, The Netherlands
| |
Collapse
|
|
13
|
Sivananthan A, Ahmed J, Kogkas A, Mylonas G, Darzi A, Patel N. Eye tracking technology in endoscopy: Looking to the future. Dig Endosc 2023; 35:314-322. [PMID: 36281784 DOI: 10.1111/den.14461] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Accepted: 10/23/2022] [Indexed: 02/08/2023]
Abstract
The visual patterns of an endoscopist, that is, what the endoscopist is looking at during luminal endoscopy, is an interesting area with an evolving evidence base. The tools required for gaze analysis have become cheaper and more easily accessible. A comprehensive literature search was undertaken identifying 19 relevant papers. Gaze analysis has been used to identify certain visual patterns associated with higher polyp detection rates. There have also been increasing applications of gaze analysis as an objective study tool to compare the effectiveness of endoscopic imaging technologies. Gaze analysis also has the potential to be incorporated into endoscopic training. Eye movements have been used to control and steer a robotic endoscope. This review presents the current evidence available in this novel and evolving field of endoscopic research.
Collapse
Affiliation(s)
- Arun Sivananthan
- Institute of Global Health Innovation, Imperial College London, London, UK.,Imperial College NHS Healthcare Trust, London, UK
| | - Jabed Ahmed
- Institute of Global Health Innovation, Imperial College London, London, UK.,Imperial College NHS Healthcare Trust, London, UK
| | - Alexandros Kogkas
- Institute of Global Health Innovation, Imperial College London, London, UK.,The Hamlyn Centre, Imperial College London, London, UK
| | - George Mylonas
- Institute of Global Health Innovation, Imperial College London, London, UK.,The Hamlyn Centre, Imperial College London, London, UK
| | - Ara Darzi
- Institute of Global Health Innovation, Imperial College London, London, UK.,Imperial College NHS Healthcare Trust, London, UK
| | - Nisha Patel
- Institute of Global Health Innovation, Imperial College London, London, UK.,Imperial College NHS Healthcare Trust, London, UK
| |
Collapse
|
|
14
|
Brien DC, Riek HC, Yep R, Huang J, Coe B, Areshenkoff C, Grimes D, Jog M, Lang A, Marras C, Masellis M, McLaughlin P, Peltsch A, Roberts A, Tan B, Beaton D, Lou W, Swartz R, Munoz DP. Classification and staging of Parkinson's disease using video-based eye tracking. Parkinsonism Relat Disord 2023; 110:105316. [PMID: 36822878 DOI: 10.1016/j.parkreldis.2023.105316] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 01/11/2023] [Accepted: 02/04/2023] [Indexed: 02/10/2023]
Abstract
INTRODUCTION 83% of those diagnosed with Parkinson's Disease (PD) eventually progress to PD with mild cognitive impairment (PD-MCI) followed by dementia (PDD) - suggesting a complex spectrum of pathology concomitant with aging. Biomarkers sensitive and specific to this spectrum are required if useful diagnostics are to be developed that may supplement current clinical testing procedures. We used video-based eye tracking and machine learning to develop a simple, non-invasive test sensitive to PD and the stages of cognitive dysfunction. METHODS From 121 PD (45 Cognitively Normal/45 MCI/20 Dementia/11 Other) and 106 healthy controls, we collected video-based eye tracking data on an interleaved pro/anti-saccade task. Features of saccade, pupil, and blink behavior were used to train a classifier to predict confidence scores for PD/PD-MCI/PDD diagnosis. RESULTS The Receiver Operator Characteristic Area Under the Curve (ROC-AUC) of the classifier was 0.88, with the cognitive-dysfunction subgroups showing progressively increased AUC, and the AUC of PDD being 0.95. The classifier reached a sensitivity of 83% and a specificity of 78%. The confidence scores predicted PD motor and cognitive performance scores. CONCLUSION Biomarkers of saccade, pupil, and blink were extracted from video-based eye tracking to create a classifier with high sensitivity to the landscape of PD cognitive and motor dysfunction. A complex landscape of PD is revealed through a quick, non-invasive eye tracking task and our model provides a framework for such a task to be used as a supplementary screening tool in the clinic.
Collapse
Affiliation(s)
- Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - Heidi C Riek
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - Rachel Yep
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - Jeff Huang
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - Brian Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - Corson Areshenkoff
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada.
| | - David Grimes
- Ottawa Hospital, uOttawa Brain and Mind Research Institute, Ottawa, ON, Canada.
| | - Mandar Jog
- PF Centre of Excellence, London Movement Disorders Centre, Lawson Health Research Institute, London, ON, Canada.
| | - Anthony Lang
- Edmond J. Safra Program in Parkinson's Disease, University Health Network and the Department of Medicine, Division of Neurology, University of Toronto, Toronto, ON, Canada.
| | - Connie Marras
- Toronto Western Hospital Movement Disorders Centre and the Edmond J Safra Program in Parkinson's Disease, University of Toronto, Toronto, ON, Canada.
| | - Mario Masellis
- Sunnybrook Health Sciences Centre, Medicine (Neurology), Toronto, ON, Canada.
| | - Paula McLaughlin
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada; Nova Scotia Health, Halifax, NS, Canada; Department of Psychology and Neuroscience, Department of Medicine (Geriatrics), Dalhousie University, Halifax, NS, Canada.
| | - Alicia Peltsch
- Faculty of Engineering and Applied Science, Queen's University, Kingston, ON, Canada.
| | - Angela Roberts
- School of Communication Sciences and Disorders, Department of Computer Science, University of Western Ontario, London, ON, Canada.
| | - Brian Tan
- Rotman Research Institute, Baycrest Health Sciences, Toronto, ON, Canada.
| | - Derek Beaton
- Data Science & Advanced Analytics (DSAA), St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada.
| | - Wendy Lou
- Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.
| | - Richard Swartz
- Hurvitz Brain Sciences Program, Sunnybrook Health Sciences Centre; Faculty of Medicine, Department of Medicine (Neurology), University of Toronto, Toronto, ON, Canada.
| | | | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada; Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada.
| |
Collapse
|
|
15
|
Gharib A, Thompson BL. Analysis and novel methods for capture of normative eye-tracking data in 2.5-month old infants. PLoS One 2022; 17:e0278423. [PMID: 36490239 PMCID: PMC9733894 DOI: 10.1371/journal.pone.0278423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Accepted: 11/15/2022] [Indexed: 12/13/2022] Open
Abstract
Development of attention systems is essential for both cognitive and social behavior maturation. Visual behavior has been used to assess development of these attention systems. Yet, given its importance, there is a notable lack of literature detailing successful methods and procedures for using eye-tracking in early infancy to assess oculomotor and attention dynamics. Here we show that eye-tracking technology can be used to automatically record and assess visual behavior in infants as young as 2.5 months, and present normative data describing fixation and saccade behavior at this age. Features of oculomotor dynamics were analyzed from 2.5-month old infants who viewed videos depicting live action, cartoons, geometric shapes, social and non-social scenes. Of the 54 infants enrolled, 50 infants successfully completed the eye-tracking task and high-quality data was collected for 32 of those infants. We demonstrate that modifications specifically tailored for the infant population allowed for consistent tracking of pupil and corneal reflection and minimal data loss. Additionally, we found consistent fixation and saccade behaviors across the entire six-minute duration of the videos, indicating that this is a feasible task for 2.5-month old infants. Moreover, normative oculomotor metrics for a free-viewing task in 2.5-month old infants are documented for the first time as a result of this high-quality data collection.
Collapse
Affiliation(s)
- Alma Gharib
- Department of Computer Science, University of Southern California, Los Angeles, California, United States of America
- Program in Developmental Neuroscience and Neurogenetics, The Saban Research Institute and Department of Pediatrics at Children’s Hospital of Los Angeles, Keck School of Medicine, University of Southern California, Los Angeles, California, United States of America
| | - Barbara L. Thompson
- Department of Pediatrics and Human Development, College of Human Medicine, Michigan State University, Grand Rapids, Michigan, United States of America
- * E-mail:
| |
Collapse
|
|
16
|
Eye movement behavior in a real-world virtual reality task reveals ADHD in children. Sci Rep 2022; 12:20308. [PMID: 36434040 PMCID: PMC9700686 DOI: 10.1038/s41598-022-24552-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 11/16/2022] [Indexed: 11/26/2022] Open
Abstract
Eye movements and other rich data obtained in virtual reality (VR) environments resembling situations where symptoms are manifested could help in the objective detection of various symptoms in clinical conditions. In the present study, 37 children with attention deficit hyperactivity disorder and 36 typically developing controls (9-13 y.o) played a lifelike prospective memory game using head-mounted display with inbuilt 90 Hz eye tracker. Eye movement patterns had prominent group differences, but they were dispersed across the full performance time rather than associated with specific events or stimulus features. A support vector machine classifier trained on eye movement data showed excellent discrimination ability with 0.92 area under curve, which was significantly higher than for task performance measures or for eye movements obtained in a visual search task. We demonstrated that a naturalistic VR task combined with eye tracking allows accurate prediction of attention deficits, paving the way for precision diagnostics.
Collapse
|
|
17
|
Lim YH, Watkins RE, Jones H, Kippin NR, Finlay-Jones A. Fetal alcohol spectrum disorders screening tools: A systematic review. RESEARCH IN DEVELOPMENTAL DISABILITIES 2022; 122:104168. [PMID: 34996007 DOI: 10.1016/j.ridd.2021.104168] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 12/27/2021] [Accepted: 12/28/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND Screening facilitates the early identification of fetal alcohol spectrum disorder (FASD) and prevalence estimation of FASD for timely prevention, diagnostic, and management planning. However, little is known about FASD screening tools. AIMS The aims of this systematic review are to identify FASD screening tools and examine their performance characteristics. METHODS Four electronic databases were searched for eligible studies that examined individuals with FASD or prenatal alcohol exposure and reported the sensitivity and specificity of FASD screening tools. The quality of the studies was assessed using the Quality Assessment of Diagnostic Studies-2 tool. RESULTS Sixteen studies were identified, comprising five fetal alcohol syndrome (FAS) and seven FASD screening tools. They varied in screening approach and performance characteristics and were linked to four different diagnostic criteria. FAS screening tools performed well in the identification of individuals at risk of FAS while the performance of FASD screening tools varied in the identification of individuals at risk of FASD. CONCLUSION AND IMPLICATIONS Results highlight the vast differences in the screening approaches performance characteristics, and diagnostic criteria linked to FASD screening tools. More research is needed to identify biomarkers unique to FASD to guide the development of accurate FASD screening tools.
Collapse
Affiliation(s)
- Yi Huey Lim
- Telethon Kids Institute, P.O. Box 855, West Perth, Western Australia 6872, Australia.
| | - Rochelle E Watkins
- Telethon Kids Institute, P.O. Box 855, West Perth, Western Australia 6872, Australia
| | - Heather Jones
- Telethon Kids Institute, P.O. Box 855, West Perth, Western Australia 6872, Australia
| | - Natalie R Kippin
- Telethon Kids Institute, P.O. Box 855, West Perth, Western Australia 6872, Australia
| | - Amy Finlay-Jones
- Telethon Kids Institute, P.O. Box 855, West Perth, Western Australia 6872, Australia; School of Psychology, Curtin University, GPO Box U1987, Perth, Western Australia 6845, Australia
| |
Collapse
|
|
18
|
Ba F, Sang TT, He W, Fatehi J, Mostofi E, Zheng B. Stereopsis and Eye Movement Abnormalities in Parkinson’s Disease and Their Clinical Implications. Front Aging Neurosci 2022; 14:783773. [PMID: 35211005 PMCID: PMC8861359 DOI: 10.3389/fnagi.2022.783773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Accepted: 01/10/2022] [Indexed: 12/01/2022] Open
Abstract
Background Parkinson’s disease (PD) is not exclusively a motor disorder. Among non-motor features, patients with PD possess sensory visual dysfunctions. Depth perception and oculomotor deficits can significantly impact patients’ motor performance. Stereopsis and eye behavioral study using 3D stimuli may help determine their implications in disease status. Objective The objective of this study is to investigate stereopsis and eye movement abnormalities in PD with reliable tools and their correlation with indicators of PD severity. We hypothesize that patients with PD exhibit different eye behaviors and that these differences may correlate to the severity of motor symptoms and cognitive status. Methods Control and PD participants were first evaluated for visual acuity, visual field, contrast acuity, and stereo perception with 2D and Titmus stereotests, followed by the assessment with a 3D active shutter system. Eye movement behaviors were assessed by a Tobii X2-60 eye tracker. Results Screening visual tests did not reveal any differences between the PD and control groups. With the 3D active shutter system, the PD group demonstrated significantly worse stereopsis. The preserved cognitive function was correlated to a more intact stereo function. Patients with PD had longer visual response times, with a higher number of fixations and bigger saccade amplitude, suggesting fixation stabilization difficulties. Such changes showed a positive correlation with the severity of motor symptoms and a negative correlation with normal cognitive status. Conclusion We assessed stereopsis with a 3D active shutter system and oculomotor behaviors with the Tobii eye tracker. Patients with PD exhibit poorer stereopsis and impaired oculomotor behaviors during response time. These deficits were correlated with PD motor and cognitive status. The visual parameters may potentially serve as the clinical biomarkers for PD.
Collapse
Affiliation(s)
- Fang Ba
- Division of Neurology, Department of Medicine, University of Alberta, Edmonton, AB, Canada
- *Correspondence: Fang Ba,
| | - Tina T. Sang
- Faculty of Science, University of Alberta, Edmonton, AB, Canada
| | - Wenjing He
- Surgical Simulation Research Lab, Department of Surgery, University of Alberta, Edmonton, AB, Canada
| | - Jaleh Fatehi
- Division of Neurology, Department of Medicine, University of Alberta, Edmonton, AB, Canada
| | - Emanuel Mostofi
- Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Bin Zheng
- Surgical Simulation Research Lab, Department of Surgery, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
|
19
|
Kulke L, Pasqualette L. Emotional content influences eye-movements under natural but not under instructed conditions. Cogn Emot 2021; 36:332-344. [PMID: 34886742 DOI: 10.1080/02699931.2021.2009446] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
ABSTRACTIn everyday life, people can freely decide if and where they would like to move their attention and gaze, often influenced by physical and emotional salience of stimuli. However, many laboratory paradigms explicitly instruct participants when and how to move their eyes, leading to unnatural instructed eye-movements. The current preregistered study compared eye-movements to peripherally appearing faces with happy, angry and neutral expressions under natural and instructed conditions. Participants reliably moved their eyes towards peripheral faces, even when they were not instructed to do so; however, eye-movements were significantly slower under natural than under instructed conditions. Competing central stimuli decelerated eye-movements independently of instructions. Unexpectedly, the emotional salience only affected eye-movements under natural conditions, with faster saccades towards emotional than towards neutral faces. No effects of emotional expression occurred when participants were instructed to move their eyes. The study shows that natural eye-movements significantly differ from instructed eye-movements and emotion-driven attention effects are reduced when participants are artificially instructed to move their eyes, suggesting that research should investigate eye-movements under natural conditions.
Collapse
Affiliation(s)
- Louisa Kulke
- Neurocognitive Developmental Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen Germany
| | - Laura Pasqualette
- Neurocognitive Developmental Psychology, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen Germany
| |
Collapse
|
|
20
|
Grubb M, Golden A, Withers A, Vellone D, Young A, McLachlan K. Screening approaches for identifying fetal alcohol spectrum disorder in children, adolescents, and adults: A systematic review. Alcohol Clin Exp Res 2021; 45:1527-1547. [PMID: 34453340 DOI: 10.1111/acer.14657] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 04/30/2021] [Accepted: 06/08/2021] [Indexed: 12/27/2022]
Abstract
BACKGROUND Fetal alcohol spectrum disorder (FASD) is a prevalent neurodevelopmental disorder that is caused by prenatal alcohol exposure (PAE) and associated with a range of cognitive, affective, and health concerns. Although the identification of FASD can facilitate the provision of interventions and support, and plays a protective role against adverse outcomes, there are high rates of missed detection. The identification of FASD via screening may improve its recognition across settings. The current systematic review examined the available evidence on FASD screening tools and approaches across age groups and settings. METHODS A systematic search was carried out for both peer-reviewed studies and gray literature sources published between January 1990 and May 2020 and was preregistered with PROSPERO (#CRD42019122077). Studies included in the review focused on human applications of FASD screening in children, adolescents, and adults. The quality of the studies was assessed using the QUADAS-2 and GRADE frameworks. RESULTS The search yielded 20 screening tools and approaches across 45 studies, broadly characterized in 2 groups. The first group included approaches currently in use that aim to identify individuals at risk of FASD using a range of markers (n = 19) or associated sentinel dysmorphic facial features (n = 6). Another group of studies, characterized as emerging, focused on identifying promising biomarkers of PAE/FASD (n = 20). Overall, we identified limited research supporting the psychometric properties of most screening approaches. The quality review provided evidence of bias due to the common use of case-control designs and lack of adequate reference standards. CONCLUSIONS Although several FASD screening tools and approaches are available for use across a range of age groups and settings, the overall evidence base supporting their psychometric properties is weak, with most studies demonstrating significant risk of bias. Service providers should exercise caution in selecting and implementing FASD screening tools given these limitations. It is critically important to accurately identify individuals with FASD across ages and settings to support healthy outcomes. Thus, there is a pressing need for additional research in this area, particularly validation studies in large and representative samples using robust methodological approaches.
Collapse
Affiliation(s)
- Melissa Grubb
- Department of Psychology, University of Guelph, Guelph, ON, Canada
| | - Ariella Golden
- Department of Psychology, University of Guelph, Guelph, ON, Canada
| | - Abigail Withers
- Department of Psychology, University of Guelph, Guelph, ON, Canada
| | - Daniella Vellone
- Department of Psychology, University of Guelph, Guelph, ON, Canada
| | - Arlene Young
- Department of Psychology, University of Guelph, Guelph, ON, Canada
| | | |
Collapse
|
|
21
|
Cade A, Jones K, Holt K, Penkar AM, Haavik H. The Effects of Spinal Manipulation on Oculomotor Control in Children with Attention Deficit Hyperactivity Disorder: A Pilot and Feasibility Study. Brain Sci 2021; 11:brainsci11081047. [PMID: 34439666 PMCID: PMC8394036 DOI: 10.3390/brainsci11081047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 07/24/2021] [Accepted: 08/04/2021] [Indexed: 11/16/2022] Open
Abstract
Attention Deficit Hyperactivity Disorder (ADHD) is a prevalent, chronic neurodevelopmental disorder that affects oculomotor (eye movement) control. Dysfunctional oculomotor control may result in reading or educational difficulties. This randomized controlled crossover study sought to investigate the feasibility of a larger scale trial and effects of a single session of spinal manipulation on oculomotor control in children with ADHD. Thirty children participated in the study and were randomized into either control-first or spinal manipulation first groups. The results indicate that the trial was feasible. Secondary outcomes showed that there was a significant decrease in reading time after the spinal manipulation intervention compared to the control intervention. Future studies of the effects of spinal manipulation on oculomotor control in children with ADHD are suggested.
Collapse
Affiliation(s)
- Alice Cade
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand; (K.H.); (A.M.P.); (H.H.)
- Correspondence:
| | - Kelly Jones
- National Institute for Stroke and Applied Neurosciences, Auckland University of Technology, Auckland 1142, New Zealand;
| | - Kelly Holt
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand; (K.H.); (A.M.P.); (H.H.)
| | - Abdul Moiz Penkar
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand; (K.H.); (A.M.P.); (H.H.)
| | - Heidi Haavik
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand; (K.H.); (A.M.P.); (H.H.)
| |
Collapse
|
|
22
|
Wolf A, Ueda K. Contribution of Eye-Tracking to Study Cognitive Impairments Among Clinical Populations. Front Psychol 2021; 12:590986. [PMID: 34163391 PMCID: PMC8215550 DOI: 10.3389/fpsyg.2021.590986] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2020] [Accepted: 05/07/2021] [Indexed: 11/29/2022] Open
Abstract
In the field of psychology, the merge of decision-theory and neuroscientific methods produces an array of scientifically recognized paradigms. For example, by exploring consumer’s eye-movement behavior, researchers aim to deepen the understanding of how patterns of retinal activation are being meaningfully transformed into visual experiences and connected with specific reactions (e.g., purchase). Notably, eye-movements provide knowledge of one’s homeostatic balance and gatekeep information that shape decisions. Hence, vision science investigates the quality of observed environments determined under various experimental conditions. Moreover, it answers questions on how human process visual stimuli and use gained information for a successful strategy to achieve certain goals. While capturing cognitive states with the support of the eye-trackers progresses at a relatively fast pace in decision-making research, measuring the visual performance of real-life tasks, which require complex cognitive skills, is tentatively translated into clinical experiments. Nevertheless, the potential of the human eye as a highly valuable source of biomarkers has been underlined. In this article, we aim to draw readers attention to decision-making experimental paradigms supported with eye-tracking technology among clinical populations. Such interdisciplinary approach may become an important component that will (i) help in objectively illustrating patient’s models of beliefs and values, (ii) support clinical interventions, and (iii) contribute to health services. It is possible that shortly, eye-movement data from decision-making experiments will grant the scientific community a greater understanding of mechanisms underlining mental states and consumption practices that medical professionals consider as obsessions, disorders or addiction.
Collapse
Affiliation(s)
- Alexandra Wolf
- JSPS International Research Fellow, Research Center for Applied Perceptual Science, Kyushu University, Fukuoka, Japan
| | - Kazuo Ueda
- Unit of Perceptual Psychology, Dept. Human Science, Research Center for Applied Perceptual Science, Division of Auditory and Visual Perception Research, Research and Development Center for Five-Sense Devices, Kyushu University, Fukuoka, Japan
| |
Collapse
|
|
23
|
Kootstra T, Teuwen J, Goudsmit J, Nijboer T, Dodd M, Van der Stigchel S. Machine learning-based classification of viewing behavior using a wide range of statistical oculomotor features. J Vis 2021; 20:1. [PMID: 32876676 PMCID: PMC7476673 DOI: 10.1167/jov.20.9.1] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Since the seminal work of Yarbus, multiple studies have demonstrated the influence of task-set on oculomotor behavior and the current cognitive state. In more recent years, this field of research has expanded by evaluating the costs of abruptly switching between such different tasks. At the same time, the field of classifying oculomotor behavior has been moving toward more advanced, data-driven methods of decoding data. For the current study, we used a large dataset compiled over multiple experiments and implemented separate state-of-the-art machine learning methods for decoding both cognitive state and task-switching. We found that, by extracting a wide range of oculomotor features, we were able to implement robust classifier models for decoding both cognitive state and task-switching. Our decoding performance highlights the feasibility of this approach, even invariant of image statistics. Additionally, we present a feature ranking for both models, indicating the relative magnitude of different oculomotor features for both classifiers. These rankings indicate a separate set of important predictors for decoding each task, respectively. Finally, we discuss the implications of the current approach related to interpreting the decoding results.
Collapse
Affiliation(s)
- Timo Kootstra
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | - Jonas Teuwen
- Radboud University Medical Center/Netherlands Cancer Institute, The Netherlands
| | | | - Tanja Nijboer
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands.,Center of Excellence for Rehabilitation Medicine, Brain Center Rudolf Magnus, University Medical Center Utrecht, Utrecht University and De Hoogstraat Rehabilitation, 3583 TM Utrecht, The Netherlands
| | | | | |
Collapse
|
|
24
|
Mei J, Desrosiers C, Frasnelli J. Machine Learning for the Diagnosis of Parkinson's Disease: A Review of Literature. Front Aging Neurosci 2021; 13:633752. [PMID: 34025389 PMCID: PMC8134676 DOI: 10.3389/fnagi.2021.633752] [Citation(s) in RCA: 102] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 03/22/2021] [Indexed: 12/26/2022] Open
Abstract
Diagnosis of Parkinson's disease (PD) is commonly based on medical observations and assessment of clinical signs, including the characterization of a variety of motor symptoms. However, traditional diagnostic approaches may suffer from subjectivity as they rely on the evaluation of movements that are sometimes subtle to human eyes and therefore difficult to classify, leading to possible misclassification. In the meantime, early non-motor symptoms of PD may be mild and can be caused by many other conditions. Therefore, these symptoms are often overlooked, making diagnosis of PD at an early stage challenging. To address these difficulties and to refine the diagnosis and assessment procedures of PD, machine learning methods have been implemented for the classification of PD and healthy controls or patients with similar clinical presentations (e.g., movement disorders or other Parkinsonian syndromes). To provide a comprehensive overview of data modalities and machine learning methods that have been used in the diagnosis and differential diagnosis of PD, in this study, we conducted a literature review of studies published until February 14, 2020, using the PubMed and IEEE Xplore databases. A total of 209 studies were included, extracted for relevant information and presented in this review, with an investigation of their aims, sources of data, types of data, machine learning methods and associated outcomes. These studies demonstrate a high potential for adaptation of machine learning methods and novel biomarkers in clinical decision making, leading to increasingly systematic, informed diagnosis of PD.
Collapse
Affiliation(s)
- Jie Mei
- Chemosensory Neuroanatomy Lab, Department of Anatomy, Université du Québec à Trois-Rivières (UQTR), Trois-Rivières, QC, Canada
| | - Christian Desrosiers
- Laboratoire d'Imagerie, de Vision et d'Intelligence Artificielle (LIVIA), Department of Software and IT Engineering, École de Technologie Supérieure, Montreal, QC, Canada
| | - Johannes Frasnelli
- Chemosensory Neuroanatomy Lab, Department of Anatomy, Université du Québec à Trois-Rivières (UQTR), Trois-Rivières, QC, Canada
- Centre de Recherche de l'Hôpital du Sacré-Coeur de Montréal, Centre Intégré Universitaire de Santé et de Services Sociaux du Nord-de-l'Île-de-Montréal (CIUSSS du Nord-de-l'Île-de-Montréal), Montreal, QC, Canada
| |
Collapse
|
|
25
|
|
|
26
|
Perkins JE, Janzen A, Bernhard FP, Wilhelm K, Brien DC, Huang J, Coe BC, Vadasz D, Mayer G, Munoz DP, Oertel WH. Saccade, Pupil, and Blink Responses in Rapid Eye Movement Sleep Behavior Disorder. Mov Disord 2021; 36:1720-1726. [PMID: 33754406 PMCID: PMC8359943 DOI: 10.1002/mds.28585] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 01/30/2021] [Accepted: 03/02/2021] [Indexed: 02/03/2023] Open
Abstract
Background Parkinson's disease (PD) patients exhibit deficits in saccade performance, pupil function, and blink rate. Isolated REM (rapid eye movement) Sleep Behavior Disorder (RBD) is a harbinger to PD making them candidates to investigate for early oculomotor abnormalities as PD biomarkers. Objectives We tested whether saccade, pupillary, and blink responses in RBD were similar to PD. Methods RBD (n = 22), PD (n = 22) patients, and healthy controls (CTRL) (n = 74) were studied with video‐based eye‐tracking. Results RBD patients did not have significantly different saccadic behavior compared to CTRL, but PD patients differed from CTRL and RBD. Both patient groups had significantly lower blink rates, dampened pupil constriction, and dilation responses compared to CTRL. Conclusion RBD and PD patients had altered pupil and blink behavior compared to CTRL. Because RBD saccade parameters were comparable to CTRL, pupil and blink brain areas may be impacted before saccadic control areas, making them potential prodromal PD biomarkers. © 2021 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society
Collapse
Affiliation(s)
- Julia E Perkins
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Annette Janzen
- Department of Neurology, Philipps-University, Marburg, Germany
| | | | - Karén Wilhelm
- Department of Neurology, Philipps-University, Marburg, Germany
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Jeff Huang
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - David Vadasz
- Department of Neurology, Philipps-University, Marburg, Germany
| | - Geert Mayer
- Department of Neurology, Philipps-University, Marburg, Germany
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Department of Biomedical and Molecular Sciences, Queen's University, Kingston, Ontario, Canada
| | | |
Collapse
|
|
27
|
Hashemi J, Dawson G, Carpenter KLH, Campbell K, Qiu Q, Espinosa S, Marsan S, Baker JP, Egger HL, Sapiro G. Computer Vision Analysis for Quantification of Autism Risk Behaviors. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 2021; 12:215-226. [PMID: 35401938 PMCID: PMC8993160 DOI: 10.1109/taffc.2018.2868196] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Observational behavior analysis plays a key role for the discovery and evaluation of risk markers for many neurodevelopmental disorders. Research on autism spectrum disorder (ASD) suggests that behavioral risk markers can be observed at 12 months of age or earlier, with diagnosis possible at 18 months. To date, these studies and evaluations involving observational analysis tend to rely heavily on clinical practitioners and specialists who have undergone intensive training to be able to reliably administer carefully designed behavioural-eliciting tasks, code the resulting behaviors, and interpret such behaviors. These methods are therefore extremely expensive, time-intensive, and are not easily scalable for large population or longitudinal observational analysis. We developed a self-contained, closed-loop, mobile application with movie stimuli designed to engage the child's attention and elicit specific behavioral and social responses, which are recorded with a mobile device camera and then analyzed via computer vision algorithms. Here, in addition to presenting this paradigm, we validate the system to measure engagement, name-call responses, and emotional responses of toddlers with and without ASD who were presented with the application. Additionally, we show examples of how the proposed framework can further risk marker research with fine-grained quantification of behaviors. The results suggest these objective and automatic methods can be considered to aid behavioral analysis, and can be suited for objective automatic analysis for future studies.
Collapse
Affiliation(s)
- Jordan Hashemi
- Department of Electrical and Computer Engineering, Duke University, Durham, NC
| | - Geraldine Dawson
- Department of Psychiatry and Behavioral Sciences, Duke Center for Autism and Brain Development, and the Duke Institute for Brain Sciences, Durham, NC
| | - Kimberly L H Carpenter
- Department of Psychiatry and Behavioral Sciences, Duke Center for Autism and Brain Development, and the Duke Institute for Brain Sciences, Durham, NC
| | | | - Qiang Qiu
- Department of Electrical and Computer Engineering, Duke University, Durham, NC
| | - Steven Espinosa
- Department of Electrical and Computer Engineering, Duke University, Durham, NC
| | - Samuel Marsan
- Department of Psychiatry and Behavioral Sciences, Durham, NC
| | | | - Helen L Egger
- Department of Child and Adolescent Psychiatry, NYU Langone Health, New York, NY. She performed this work while at Duke University
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, NC
| |
Collapse
|
|
28
|
Maurage P, Bollen Z, Masson N, D'Hondt F. A review of studies exploring fetal alcohol spectrum disorders through eye tracking measures. Prog Neuropsychopharmacol Biol Psychiatry 2020; 103:109980. [PMID: 32470497 DOI: 10.1016/j.pnpbp.2020.109980] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/02/2019] [Revised: 01/10/2020] [Accepted: 05/20/2020] [Indexed: 01/20/2023]
Abstract
The widespread cognitive and cerebral consequences of prenatal alcohol exposure have been established during the last decades, through the exploration of fetal alcohol spectrum disorders (FASD) using neuropsychological and neuroscience tools. This research field has recently benefited from the emergence of innovative measures, among which eye tracking, allowing a precise measure of the eye movements indexing a large range of cognitive functions. We propose a comprehensive review, based on PRISMA guidelines, of the eye tracking studies performed in populations with FASD. Studies were selected from the PsycINFO, PubMed and Scopus databases, and were evaluated through a standardized methodological quality assessment. Studies were classified according to the eye tracking indexes recorded (saccade characteristics, initial fixation, number of fixations, dwell time, gaze pattern) and the process measured (perception, memory, executive functions). Eye tracking data showed that FASD are mostly associated with impaired ocular perceptive/motor abilities (i.e., altered eye movements, centrally for saccade initiation), lower accuracy as well as increased error rates in saccadic eye movements involving working memory abilities, and reduced inhibitory control on saccades. After identifying the main limitations presented by the reviewed studies, we propose guidelines for future research, underlining the need to increase the standardization of diagnosis and evaluation tools, and to improve the methodological quality of eye tracking measures.
Collapse
Affiliation(s)
- Pierre Maurage
- Louvain for Experimental Psychopathology Research Group, Psychological Sciences Research Institute, UCLouvain, Louvain-la-Neuve, Belgium.
| | - Zoé Bollen
- Louvain for Experimental Psychopathology Research Group, Psychological Sciences Research Institute, UCLouvain, Louvain-la-Neuve, Belgium.
| | - Nicolas Masson
- Numerical Cognition Group, Psychological Sciences Research Institute and Neuroscience Institute, Université Catholique de Louvain, Louvain-la-Neuve, Belgium.
| | - Fabien D'Hondt
- Univ. Lille, Inserm, CHU Lille, U1172 - Lille Neuroscience & Cognition, Lille, France; CHU Lille, Clinique de Psychiatrie, Unité CURE, Lille, France; Centre National de Ressources et de Résilience Lille-Paris (CN2R), Lille, France.
| |
Collapse
|
|
29
|
Grillini A, Renken RJ, Vrijling ACL, Heutink J, Cornelissen FW. Eye Movement Evaluation in Multiple Sclerosis and Parkinson's Disease Using a Standardized Oculomotor and Neuro-Ophthalmic Disorder Assessment (SONDA). Front Neurol 2020; 11:971. [PMID: 33013643 PMCID: PMC7506055 DOI: 10.3389/fneur.2020.00971] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Accepted: 07/24/2020] [Indexed: 11/13/2022] Open
Abstract
Evaluating the state of the oculomotor system of a patient is one of the fundamental tests done in neuro-ophthalmology. However, up to date, very few quantitative standardized tests of eye movements' quality exist, limiting this assessment to confrontational tests reliant on subjective interpretation. Furthermore, quantitative tests relying on eye movement properties, such as pursuit gain and saccade dynamics are often insufficient to capture the complexity of the underlying disorders and are often (too) long and tiring. In this study, we present SONDA (Standardized Oculomotor and Neurological Disorder Assessment): this test is based on analyzing eye tracking recorded during a short and intuitive continuous tracking task. We tested patients affected by Multiple Sclerosis (MS) and Parkinson's Disease (PD) and find that: (1) the saccadic dynamics of the main sequence alone are not sufficient to separate patients from healthy controls; (2) the combination of spatio-temporal and statistical properties of saccades and saccadic dynamics enables an identification of oculomotor abnormalities in both MS and PD patients. We conclude that SONDA constitutes a powerful screening tool that allows an in-depth evaluation of (deviant) oculomotor behavior in a few minutes of non-invasive testing.
Collapse
Affiliation(s)
- Alessandro Grillini
- Laboratory for Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| | - Remco J Renken
- Department of Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| | - Anne C L Vrijling
- Royal Dutch Visio, Center of Expertise for Blind and Partially Sighted People, Huizen, Netherlands
| | - Joost Heutink
- Royal Dutch Visio, Center of Expertise for Blind and Partially Sighted People, Huizen, Netherlands.,Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, Netherlands
| | - Frans W Cornelissen
- Laboratory for Experimental Ophthalmology, University Medical Center Groningen, University of Groningen, Groningen, Netherlands
| |
Collapse
|
|
30
|
Agtzidis I, Startsev M, Dorr M. Two hours in Hollywood: A manually annotated ground truth data set of eye movements during movie clip watching. J Eye Mov Res 2020; 13. [PMID: 33828806 PMCID: PMC8005322 DOI: 10.16910/jemr.13.4.5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
In this short article we present our manual annotation of the eye movement events in a
subset of the large-scale eye tracking data set Hollywood2. Our labels include fixations,
saccades, and smooth pursuits, as well as a noise event type (the latter representing either
blinks, loss of tracking, or physically implausible signals). In order to achieve more
consistent annotations, the gaze samples were labelled by a novice rater based on
rudimentary algorithmic suggestions, and subsequently corrected by an expert rater.
Overall, we annotated eye movement events in the recordings corresponding to 50
randomly selected test set clips and 6 training set clips from Hollywood2, which were
viewed by 16 observers and amount to a total of approximately 130 minutes of gaze data.
In these labels, 62.4% of the samples were attributed to fixations, 9.1% – to saccades, and,
notably, 24.2% – to pursuit (the remainder marked as noise). After evaluation of 15
published eye movement classification algorithms on our newly collected annotated data
set, we found that the most recent algorithms perform very well on average, and even
reach human-level labelling quality for fixations and saccades, but all have a much larger
room for improvement when it comes to smooth pursuit classification. The data set is
made available at https://gin.g-node.org/ioannis.agtzidis/hollywood2_em.
Collapse
|
|
31
|
Ryan JD, Shen K, Liu Z. The intersection between the oculomotor and hippocampal memory systems: empirical developments and clinical implications. Ann N Y Acad Sci 2020; 1464:115-141. [PMID: 31617589 PMCID: PMC7154681 DOI: 10.1111/nyas.14256] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2019] [Revised: 08/29/2019] [Accepted: 09/19/2019] [Indexed: 12/28/2022]
Abstract
Decades of cognitive neuroscience research has shown that where we look is intimately connected to what we remember. In this article, we review findings from human and nonhuman animals, using behavioral, neuropsychological, neuroimaging, and computational modeling methods, to show that the oculomotor and hippocampal memory systems interact in a reciprocal manner, on a moment-to-moment basis, mediated by a vast structural and functional network. Visual exploration serves to efficiently gather information from the environment for the purpose of creating new memories, updating existing memories, and reconstructing the rich, vivid details from memory. Conversely, memory increases the efficiency of visual exploration. We call for models of oculomotor control to consider the influence of the hippocampal memory system on the cognitive control of eye movements, and for models of hippocampal and broader medial temporal lobe function to consider the influence of the oculomotor system on the development and expression of memory. We describe eye movement-based applications for the detection of neurodegeneration and delivery of therapeutic interventions for mental health disorders for which the hippocampus is implicated and memory dysfunctions are at the forefront.
Collapse
Affiliation(s)
- Jennifer D. Ryan
- Rotman Research InstituteBaycrestTorontoOntarioCanada
- Department of PsychologyUniversity of TorontoTorontoOntarioCanada
- Department of PsychiatryUniversity of TorontoTorontoOntarioCanada
| | - Kelly Shen
- Rotman Research InstituteBaycrestTorontoOntarioCanada
| | - Zhong‐Xu Liu
- Department of Behavioral SciencesUniversity of Michigan‐DearbornDearbornMichigan
| |
Collapse
|
|
32
|
Lakhlifi M, Laprevote V, Schwan R, Schwitzer T. Free viewing exploration in schizophrenia: Review of evidence from laboratory settings to natural environment. Encephale 2020; 46:115-122. [PMID: 32057409 DOI: 10.1016/j.encep.2019.11.012] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 11/26/2019] [Accepted: 11/28/2019] [Indexed: 10/25/2022]
Abstract
Several studies have investigated visual processing impairment in schizophrenia. The literature on visual exploration has described restricted scanning in schizophrenia patients. This gaze behavior is characterized by increased fixation duration, a reduced scan path length and avoidance of salient features of the face with emotional content. The aim of this paper is to give an insight on the latest update on scan path deficit. Abnormal gaze exploration was replicated in various visual stimuli. This review describes gaze patterns with stimuli that imply minimal to high cognitive process: figures, objects, faces, and scenes. Interestingly, schizophrenia patients have shown cognitive flexibility by modulating gaze scanning when they are involved in an active assignment. We will also consider scanning abnormalities in real-life environment and discuss the potential therapeutic use of eye tracking in schizophrenia. The therapeutic application of eye tracking in schizophrenia is a young emerging field in psychiatry research. The recent remediation program is based on the reorientation of visual attention on the salient features of faces. For now, this program has shown encouraging results. Further studies are needed to explore behavior in real-world situations to complement laboratory measurements to move toward a full understanding of the mechanisms underlying atypical scanning in patients with schizophrenia.
Collapse
Affiliation(s)
- M Lakhlifi
- Pôle hospitalo-universitaire de psychiatrie d'adultes du Grand-Nancy, centre psychothérapique de Nancy, Laxou, France.
| | - V Laprevote
- Pôle hospitalo-universitaire de psychiatrie d'adultes du Grand-Nancy, centre psychothérapique de Nancy, Laxou, France; Inserm U1114, fédération de médecine translationnelle de Strasbourg, département de psychiatrie, centre hospitalier régional universitaire de Strasbourg, Strasbourg, France; Maison des addictions, CHRU de Nancy, Nancy, France
| | - R Schwan
- Pôle hospitalo-universitaire de psychiatrie d'adultes du Grand-Nancy, centre psychothérapique de Nancy, Laxou, France; Inserm U1114, fédération de médecine translationnelle de Strasbourg, département de psychiatrie, centre hospitalier régional universitaire de Strasbourg, Strasbourg, France; Maison des addictions, CHRU de Nancy, Nancy, France
| | - T Schwitzer
- Pôle hospitalo-universitaire de psychiatrie d'adultes du Grand-Nancy, centre psychothérapique de Nancy, Laxou, France; Inserm U1114, fédération de médecine translationnelle de Strasbourg, département de psychiatrie, centre hospitalier régional universitaire de Strasbourg, Strasbourg, France; Maison des addictions, CHRU de Nancy, Nancy, France
| |
Collapse
|
|
33
|
Cronin DA, Hall EH, Goold JE, Hayes TR, Henderson JM. Eye Movements in Real-World Scene Photographs: General Characteristics and Effects of Viewing Task. Front Psychol 2020; 10:2915. [PMID: 32010016 PMCID: PMC6971407 DOI: 10.3389/fpsyg.2019.02915] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Accepted: 12/10/2019] [Indexed: 11/13/2022] Open
Abstract
The present study examines eye movement behavior in real-world scenes with a large (N = 100) sample. We report baseline measures of eye movement behavior in our sample, including mean fixation duration, saccade amplitude, and initial saccade latency. We also characterize how eye movement behaviors change over the course of a 12 s trial. These baseline measures will be of use to future work studying eye movement behavior in scenes in a variety of literatures. We also examine effects of viewing task on when and where the eyes move in real-world scenes: participants engaged in a memorization and an aesthetic judgment task while viewing 100 scenes. While we find no difference at the mean-level between the two tasks, temporal- and distribution-level analyses reveal significant task-driven differences in eye movement behavior.
Collapse
Affiliation(s)
- Deborah A. Cronin
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - Elizabeth H. Hall
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
- Department of Psychology, University of California, Davis, Davis, CA, United States
| | - Jessica E. Goold
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - Taylor R. Hayes
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
| | - John M. Henderson
- Center for Mind and Brain, University of California, Davis, Davis, CA, United States
- Department of Psychology, University of California, Davis, Davis, CA, United States
| |
Collapse
|
|
34
|
Startsev M, Agtzidis I, Dorr M. Characterizing and automatically detecting smooth pursuit in a large-scale ground-truth data set of dynamic natural scenes. J Vis 2019; 19:10. [DOI: 10.1167/19.14.10] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Mikhail Startsev
- Human-Machine Communication, Technical University of Munich, Munich, Germany
| | - Ioannis Agtzidis
- Human-Machine Communication, Technical University of Munich, Munich, Germany
| | - Michael Dorr
- Human-Machine Communication, Technical University of Munich, Munich, Germany
| |
Collapse
|
|
35
|
Little G, Beaulieu C. Multivariate models of brain volume for identification of children and adolescents with fetal alcohol spectrum disorder. Hum Brain Mapp 2019; 41:1181-1194. [PMID: 31737980 PMCID: PMC7267984 DOI: 10.1002/hbm.24867] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Revised: 10/29/2019] [Accepted: 11/04/2019] [Indexed: 01/17/2023] Open
Abstract
Magnetic resonance imaging (MRI) studies of fetal alcohol spectrum disorder (FASD) have shown reductions of brain volume associated with prenatal exposure to alcohol. Previous studies consider regional brain volumes independently but ignore potential relationships across numerous structures. This study aims to (a) identify a multivariate model based on regional brain volume that discriminates children/adolescents with FASD versus healthy controls, and (b) determine if FASD classification performance can be increased by building classification models separately for each sex. Three‐dimensional T1‐weighted MRI from two independent childhood/adolescent datasets were used for training (79 FASD, aged 5.7–18.9 years, 35 males; 81 controls, aged 5.8–18.5 years, 32 males) and testing (67 FASD, aged 6.0–19.6 years, 38 males; 74 controls, aged 5.2–19.5 years, 42 males) a classification model. Using FreeSurfer, 87 regional brain volumes were extracted for each subject and were used as input into a support vector machine generating a classification model from the training data. The model performed moderately well on the test data with accuracy 77%, sensitivity 64%, and specificity 88%. Regions that contributed heavily to prediction in this model included temporal lobe and subcortical gray matter. Further investigation of two separate models for males and females showed slightly decreased accuracy compared to the model including all subjects (male accuracy 70%; female accuracy 67%), but had different regional contributions suggesting sex differences. This work demonstrates the potential of multivariate analysis of brain volumes for discriminating children/adolescents with FASD and provides indication of the most affected regions.
Collapse
Affiliation(s)
- Graham Little
- Department of Biomedical Engineering, University of Alberta, Edmonton, Alberta, Canada
| | - Christian Beaulieu
- Department of Biomedical Engineering, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
|
36
|
A novel perceptual trait: gaze predilection for faces during visual exploration. Sci Rep 2019; 9:10714. [PMID: 31341217 PMCID: PMC6656722 DOI: 10.1038/s41598-019-47110-x] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Accepted: 07/10/2019] [Indexed: 01/08/2023] Open
Abstract
Humans are social animals and typically tend to seek social interactions. In our daily life we constantly move our gaze to collect visual information which often includes social information, such as others’ emotions and intentions. Recent studies began to explore how individuals vary in their gaze behavior. However, these studies focused on basic features of eye movements (such as the length of movements) and did not examine the observer predilection for specific social features such as faces. We preformed two test-retest experiments examining the amount of time individuals fixate directly on faces embedded in images of naturally occurring scenes. We report on stable and robust individual differences in visual predilection for faces across time and tasks. Individuals’ preference to fixate on faces could not be explained by a preference for fixating on low-level salient regions (e.g. color, intensity, orientation) nor by individual differences in the Big-Five personality traits. We conclude that during visual exploration individuals vary in the amount of time they direct their gaze towards faces. This tendency is a trait that not only reflects individuals’ preferences but also influences the amount of information gathered by each observer, therefore influencing the basis for later cognitive processing and decisions.
Collapse
|
|
37
|
Abstract
Vision represents the most important sense of primates. To understand visual processing, various different methods are employed—for example, electrophysiology, psychophysics, or eye-tracking. For the latter method, researchers have recently begun to step outside the artificial environments of laboratory setups toward the more natural conditions we usually face in the real world. To get a better understanding of the advantages and limitations of modern mobile eye-trackers, we quantitatively compared one of the most advanced mobile eye-trackers available, the EyeSeeCam, with a commonly used laboratory eye-tracker, the EyeLink II, serving as a gold standard. We aimed to investigate whether or not fully mobile eye-trackers are capable of providing data that would be adequate for direct comparisons with data recorded by stationary eye-trackers. Therefore, we recorded three different, commonly used eye movements—fixations, saccades, and smooth-pursuit eye movements—with both eye-trackers, in successive standardized paradigms in a laboratory setting with eight human subjects. Despite major technical differences between the devices, most eye movement parameters were not statistically different between the two systems. Differences could only be found in overall gaze accuracy and for time-critical parameters such as saccade duration, for which a higher sample frequency is especially useful. Although the stationary EyeLink II system proved to be superior, especially on a single-subject or even a single-trial basis, the ESC showed similar performance for the averaged parameters across both trials and subjects. We concluded that modern mobile eye-trackers are well-suited to providing reliable oculomotor data at the required spatial and temporal resolutions.
Collapse
|
|
38
|
Hunter MB, Yoong M, Sumpter RE, Verity K, Shetty J, McLellan A, Jones J, Quigley A, Tallur KK, Chin RFM. Neurobehavioral problems in children with early-onset epilepsy: A population-based study. Epilepsy Behav 2019; 93:87-93. [PMID: 30836323 DOI: 10.1016/j.yebeh.2019.01.019] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Revised: 01/11/2019] [Accepted: 01/11/2019] [Indexed: 11/27/2022]
Abstract
PURPOSE Neurobehavioral problems (i.e., cognitive impairment/behavior problems) are a major challenge in childhood epilepsy. Yet there are limited data in children with early-onset epilepsy (CWEOE; onset ≤4 years), the period in which the incidence of childhood epilepsy is highest. This study aimed to determine the prevalence, spectrum, and risk factors for neurobehavioral problems CWEOE. METHODS This prospective, population-based, case-controlled study identified children with newly diagnosed early-onset epilepsy in South East Scotland using active multisource capture-recapture surveillance (May 2013 - June 2015). The CWEOE and controls completed an age-appropriate neurobehavioral assessment battery across seven domains: general cognitive ability (GCA), adaptive behavior, externalizing, internalizing, executive functioning, social functioning, and Autism Spectrum Disorder (ASD) risk. RESULTS Fifty-nine CWEOE were identified with an ascertainment of 98% (95% confidence interval [CI] 94, 103). Forty-six (78% [95% CI 65.9, 86.6]) CWEOE (27 male, median age 25.5, range 1-59, months) and 37 controls (18 male, median age 31.5, range 3-59, months) consented for study entry. The CWEOE were similar to controls in gender, age, prematurity, and family history of psychopathology, but not socioeconomic status (Fisher's exact test [FET] < .001). Neurobehavioral assessments were carried out a median of 2.97 (Interquartile range [IQR] 1.51-4.95) months post epilepsy diagnosis. More CWEOE (63% [95% CI 48.6, 75.5]) had neurobehavioral problems compared with controls (27% [95% CI 15.4, 43.0]); p < 0.01. This observation was independent of socioeconomic status. Multidimensional problems were prevalent in CWEOE with 43% having two or more different domain-level problems; GCA impairment, adaptive behavior, internalizing, social functioning, and ASD risk were particularly marked. Risk factors varied by domain. DISCUSSION This novel study using comprehensive psychometric assessments found that neurobehavioral problems in CWEOE were detectable, common, and multidimensional. The degree of cooccurrence implies that problems are the norm, and multidimensional screening should be considered at epilepsy onset. The findings could aid policy development on health and educational provision in CWEOE.
Collapse
Affiliation(s)
| | - Michael Yoong
- Muir Maxwell Epilepsy Centre, University of Edinburgh, UK
| | - Ruth E Sumpter
- Muir Maxwell Epilepsy Centre, University of Edinburgh, UK
| | - Kirsten Verity
- Department of Paediatric Neurology, Royal Hospital for Sick Children, Edinburgh, UK
| | - Jay Shetty
- Department of Paediatric Neurology, Royal Hospital for Sick Children, Edinburgh, UK
| | - Ailsa McLellan
- Department of Paediatric Neurology, Royal Hospital for Sick Children, Edinburgh, UK
| | - Jeremy Jones
- Department of Radiology, Royal Hospital for Sick Children, Edinburgh, UK
| | - Alan Quigley
- Department of Radiology, Royal Hospital for Sick Children, Edinburgh, UK
| | - Krishnaraya K Tallur
- Department of Paediatric Neurology, Royal Hospital for Sick Children, Edinburgh, UK
| | - Richard F M Chin
- Muir Maxwell Epilepsy Centre, University of Edinburgh, UK; Department of Paediatric Neurology, Royal Hospital for Sick Children, Edinburgh, UK
| |
Collapse
|
|
39
|
Zhang C, Paolozza A, Tseng PH, Reynolds JN, Munoz DP, Itti L. Detection of Children/Youth With Fetal Alcohol Spectrum Disorder Through Eye Movement, Psychometric, and Neuroimaging Data. Front Neurol 2019; 10:80. [PMID: 30833926 PMCID: PMC6388649 DOI: 10.3389/fneur.2019.00080] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Accepted: 01/21/2019] [Indexed: 11/13/2022] Open
Abstract
Background: Fetal alcohol spectrum disorders (FASD) is one of the most common causes of developmental disabilities and neurobehavioral deficits. Despite the high-prevalence of FASD, the current diagnostic process is challenging and time- and money- consuming, with underreported profiles of the neurocognitive and neurobehavioral impairments because of limited clinical capacity. We assessed children/youth with FASD from a multimodal perspective and developed a high-performing, low-cost screening protocol using a machine learning framework. Methods and Findings: Participants with FASD and age-matched typically developing controls completed up to six assessments, including saccadic eye movement tasks (prosaccade, antisaccade, and memory-guided saccade), free viewing of videos, psychometric tests, and neuroimaging of the corpus callosum. We comparatively investigated new machine learning methods applied to these data, toward the acquisition of a quantitative signature of the neurodevelopmental deficits, and the development of an objective, high-throughput screening tool to identify children/youth with FASD. Our method provides a comprehensive profile of distinct measures in domains including sensorimotor and visuospatial control, visual perception, attention, inhibition, working memory, academic functions, and brain structure. We also showed that a combination of four to six assessments yields the best FASD vs. control classification accuracy; however, this protocol is expensive and time consuming. We conducted a cost/benefit analysis of the six assessments and developed a high-performing, low-cost screening protocol based on a subset of eye movement and psychometric tests that approached the best result under a range of constraints (time, cost, participant age, required administration, and access to neuroimaging facility). Using insights from the theory of value of information, we proposed an optimal annual screening procedure for children at risk of FASD. Conclusions: We developed a high-capacity, low-cost screening procedure under constrains, with high expected monetary benefit, substantial impact of the referral and diagnostic process, and expected maximized long-term benefits to the tested individuals and to society. This annual screening procedure for children/youth at risk of FASD can be easily and widely deployed for early identification, potentially leading to earlier intervention and treatment. This is crucial for neurodevelopmental disorders, to mitigate the severity of the disorder and/or frequency of secondary comorbidities.
Collapse
Affiliation(s)
- Chen Zhang
- Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, United States
| | - Angelina Paolozza
- Center for Neuroscience Studies, Queen's University, Kingston, ON, Canada
| | - Po-He Tseng
- Department of Neurobiology, Duke University, Durham, NC, United States.,Center for Neuroengineering, Duke University, Durham, NC, United States
| | - James N Reynolds
- Center for Neuroscience Studies, Queen's University, Kingston, ON, Canada.,Department of Biomedical and Molecular Science, Queen's University, Kingston, ON, Canada
| | - Douglas P Munoz
- Center for Neuroscience Studies, Queen's University, Kingston, ON, Canada.,Department of Biomedical and Molecular Science, Queen's University, Kingston, ON, Canada
| | - Laurent Itti
- Neuroscience Graduate Program, University of Southern California, Los Angeles, CA, United States.,Department of Computer Science, University of Southern California, Los Angeles, CA, United States
| |
Collapse
|
|
40
|
Hirai M, Sakurada T, Muramatsu SI. Face-to-trait inferences in patients with Parkinson's disease. J Clin Exp Neuropsychol 2018; 41:170-178. [PMID: 30198816 DOI: 10.1080/13803395.2018.1513452] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Introduction: Parkinson's disease is a progressive neurological disorder characterized by the preferential loss of dopaminergic neurons in the substantia nigra, which project to the striatum. The disease is characterized by prominent motor symptoms, which are its cardinal features. Consequently, Parkinson's disease has been primarily considered a disorder of movement. However, increasing evidence has indicated that Parkinson's disease affects not only the motor domain but also the cognitive domain. Increasing evidence indicates that patients with Parkinson's disease have an impaired ability to recognize emotional facial expressions. Recent studies have reported that other socially relevant information from faces, including face-to-trait inferences for traits such as dominance, competence, and trustworthiness, may be processed in subcortical regions, including the amygdala and caudate nucleus. However, the mechanism underlying the processing of face-to-trait inferences for these traits in patients with Parkinson's disease is still unknown. This study aimed to assess the face-to-trait inference ability in patients with Parkinson's disease. Method: Face-to-trait inference ability was assessed using a forced-choice method in patients with Parkinson's disease and age- and sex-matched healthy controls. Results: Overall correct face-to-trait inferences occurred significantly less frequently in the Parkinson's disease group than in the control group. Further analysis revealed a significant interaction between groups and the extent to which facial features were exaggerated. Conclusions: The present results suggest that the sensitivity of face-to-trait processing was linear in the Parkinson's disease group but not in the healthy controls. These deficits may have resulted from dysfunction in subcortical regions, which may also lead to impairment in other social inferential abilities in patients with Parkinson's disease.
Collapse
Affiliation(s)
- Masahiro Hirai
- a Center for Development of Advanced Medical Technology , Jichi Medical University , Tochigi , Japan.,b Centre for Brain & Cognitive Development, Birkbeck , University of London , London , UK
| | - Takeshi Sakurada
- a Center for Development of Advanced Medical Technology , Jichi Medical University , Tochigi , Japan.,c Department of Neurosurgery , Jichi Medical University , Tochigi , Japan
| | - Shin-Ichi Muramatsu
- d Division of Neurology , Jichi Medical University , Tochigi , Japan.,e Center for Gene & Cell Therapy, The Institute of Medical Science , The University of Tokyo , Tokyo , Japan
| |
Collapse
|
|
41
|
Kim E. Potential of eye tracking technology for assessment of performance and medical education in the field of anesthesia. Korean J Anesthesiol 2018; 71:253-254. [PMID: 30071712 PMCID: PMC6078873 DOI: 10.4097/kja.d.18.00177] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Affiliation(s)
- Eunsoo Kim
- Department of Anesthesia and Pain Medicine, Pusan National University School of Medicine, Busan, Korea
| |
Collapse
|
|
42
|
Detecting mental fatigue from eye-tracking data gathered while watching video: Evaluation in younger and older adults. Artif Intell Med 2018; 91:39-48. [PMID: 30026049 DOI: 10.1016/j.artmed.2018.06.005] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2017] [Revised: 05/11/2018] [Accepted: 06/26/2018] [Indexed: 11/22/2022]
Abstract
Health monitoring technology in everyday situations is expected to improve quality of life and support aging populations. Mental fatigue among health indicators of individuals has become important due to its association with cognitive performance and health outcomes, especially in older adults. Previous models using eye-tracking measures allow inference of fatigue during cognitive tasks, such as driving, but they require us to engage in specific cognitive tasks. In addition, previous models were mainly tested by user groups that did not include older adults, although age-related changes in eye-tracking measures have been reported especially in older adults. Here, we propose a model to detect mental fatigue of younger and older adults in natural viewing situations. Our model includes two unique aspects: (i) novel feature sets to better capture fatigue in natural-viewing situations and (ii) an automated feature selection method to select a feature subset enabling the model to be robust to the target's age. To test our model, we collected eye-tracking data from younger and older adults as they watched video clips before and after performing cognitive tasks. Our model improved detection accuracy by up to 13.9% compared with a model based on the previous studies, achieving 91.0% accuracy (chance 50%).
Collapse
|
|
43
|
Beltrán J, García-Vázquez MS, Benois-Pineau J, Gutierrez-Robledo LM, Dartigues JF. Computational Techniques for Eye Movements Analysis towards Supporting Early Diagnosis of Alzheimer's Disease: A Review. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2018; 2018:2676409. [PMID: 29887912 PMCID: PMC5985110 DOI: 10.1155/2018/2676409] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 11/03/2017] [Accepted: 04/03/2018] [Indexed: 12/21/2022]
Abstract
An opportune early diagnosis of Alzheimer's disease (AD) would help to overcome symptoms and improve the quality of life for AD patients. Research studies have identified early manifestations of AD that occur years before the diagnosis. For instance, eye movements of people with AD in different tasks differ from eye movements of control subjects. In this review, we present a summary and evolution of research approaches that use eye tracking technology and computational analysis to measure and compare eye movements under different tasks and experiments. Furthermore, this review is targeted to the feasibility of pioneer work on developing computational tools and techniques to analyze eye movements under naturalistic scenarios. We describe the progress in technology that can enhance the analysis of eye movements everywhere while subjects perform their daily activities and give future research directions to develop tools to support early AD diagnosis through analysis of eye movements.
Collapse
Affiliation(s)
- Jessica Beltrán
- Instituto Politécnico Nacional-CITEDI, Tijuana, BC, Mexico
- CONACYT, Ciudad de México, Mexico
| | | | | | | | | |
Collapse
|
|
44
|
Bayet L, Quinn PC, Laboissière R, Caldara R, Lee K, Pascalis O. Fearful but not happy expressions boost face detection in human infants. Proc Biol Sci 2018; 284:rspb.2017.1054. [PMID: 28878060 DOI: 10.1098/rspb.2017.1054] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Accepted: 07/28/2017] [Indexed: 01/19/2023] Open
Abstract
Human adults show an attentional bias towards fearful faces, an adaptive behaviour that relies on amygdala function. This attentional bias emerges in infancy between 5 and 7 months, but the underlying developmental mechanism is unknown. To examine possible precursors, we investigated whether 3.5-, 6- and 12-month-old infants show facilitated detection of fearful faces in noise, compared to happy faces. Happy or fearful faces, mixed with noise, were presented to infants (N = 192), paired with pure noise. We applied multivariate pattern analyses to several measures of infant looking behaviour to derive a criterion-free, continuous measure of face detection evidence in each trial. Analyses of the resulting psychometric curves supported the hypothesis of a detection advantage for fearful faces compared to happy faces, from 3.5 months of age and across all age groups. Overall, our data show a readiness to detect fearful faces (compared to happy faces) in younger infants that developmentally precedes the previously documented attentional bias to fearful faces in older infants and adults.
Collapse
Affiliation(s)
- Laurie Bayet
- LPNC, Université Grenoble-Alpes, 38000 Grenoble, France .,LPNC, CNRS, 38000 Grenoble, France
| | - Paul C Quinn
- Department of Psychological and Brain Sciences, University of Delaware, Newark, DE, USA
| | - Rafael Laboissière
- LPNC, Université Grenoble-Alpes, 38000 Grenoble, France.,LPNC, CNRS, 38000 Grenoble, France
| | - Roberto Caldara
- Eye and Brain Mapping Laboratory (iBMLab), Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Kang Lee
- Dr. Eric Jackman Institute of Child Study, University of Toronto, Toronto, ON, Canada
| | - Olivier Pascalis
- LPNC, Université Grenoble-Alpes, 38000 Grenoble, France.,LPNC, CNRS, 38000 Grenoble, France
| |
Collapse
|
|
45
|
Abstract
How people look at visual information reveals fundamental information about them; their interests and their states of mind. Previous studies showed that scanpath, i.e., the sequence of eye movements made by an observer exploring a visual stimulus, can be used to infer observer-related (e.g., task at hand) and stimuli-related (e.g., image semantic category) information. However, eye movements are complex signals and many of these studies rely on limited gaze descriptors and bespoke datasets. Here, we provide a turnkey method for scanpath modeling and classification. This method relies on variational hidden Markov models (HMMs) and discriminant analysis (DA). HMMs encapsulate the dynamic and individualistic dimensions of gaze behavior, allowing DA to capture systematic patterns diagnostic of a given class of observers and/or stimuli. We test our approach on two very different datasets. Firstly, we use fixations recorded while viewing 800 static natural scene images, and infer an observer-related characteristic: the task at hand. We achieve an average of 55.9% correct classification rate (chance = 33%). We show that correct classification rates positively correlate with the number of salient regions present in the stimuli. Secondly, we use eye positions recorded while viewing 15 conversational videos, and infer a stimulus-related characteristic: the presence or absence of original soundtrack. We achieve an average 81.2% correct classification rate (chance = 50%). HMMs allow to integrate bottom-up, top-down, and oculomotor influences into a single model of gaze behavior. This synergistic approach between behavior and machine learning will open new avenues for simple quantification of gazing behavior. We release SMAC with HMM, a Matlab toolbox freely available to the community under an open-source license agreement.
Collapse
Affiliation(s)
| | - Janet H Hsiao
- Department of Psychology, The University of Hong Kong, Pok Fu Lam, Hong Kong
| | - Antoni B Chan
- Department of Computer Science, City University of Hong Kong, Kowloon Tong, Hong Kong
| |
Collapse
|
|
46
|
Lussier AA, Morin AM, MacIsaac JL, Salmon J, Weinberg J, Reynolds JN, Pavlidis P, Chudley AE, Kobor MS. DNA methylation as a predictor of fetal alcohol spectrum disorder. Clin Epigenetics 2018; 10:5. [PMID: 29344313 PMCID: PMC5767049 DOI: 10.1186/s13148-018-0439-6] [Citation(s) in RCA: 60] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2017] [Accepted: 01/04/2018] [Indexed: 12/22/2022] Open
Abstract
Background Fetal alcohol spectrum disorder (FASD) is a developmental disorder that manifests through a range of cognitive, adaptive, physiological, and neurobiological deficits resulting from prenatal alcohol exposure. Although the North American prevalence is currently estimated at 2-5%, FASD has proven difficult to identify in the absence of the overt physical features characteristic of fetal alcohol syndrome. As interventions may have the greatest impact at an early age, accurate biomarkers are needed to identify children at risk for FASD. Building on our previous work identifying distinct DNA methylation patterns in children and adolescents with FASD, we have attempted to validate these associations in a different clinical cohort and to use our DNA methylation signature to develop a possible epigenetic predictor of FASD. Methods Genome-wide DNA methylation patterns were analyzed using the Illumina HumanMethylation450 array in the buccal epithelial cells of a cohort of 48 individuals aged 3.5-18 (24 FASD cases, 24 controls). The DNA methylation predictor of FASD was built using a stochastic gradient boosting model on our previously published dataset FASD cases and controls (GSE80261). The predictor was tested on the current dataset and an independent dataset of 48 autism spectrum disorder cases and 48 controls (GSE50759). Results We validated findings from our previous study that identified a DNA methylation signature of FASD, replicating the altered DNA methylation levels of 161/648 CpGs in this independent cohort, which may represent a robust signature of FASD in the epigenome. We also generated a predictive model of FASD using machine learning in a subset of our previously published cohort of 179 samples (83 FASD cases, 96 controls), which was tested in this novel cohort of 48 samples and resulted in a moderately accurate predictor of FASD status. Upon testing the algorithm in an independent cohort of individuals with autism spectrum disorder, we did not detect any bias towards autism, sex, age, or ethnicity. Conclusion These findings further support the association of FASD with distinct DNA methylation patterns, while providing a possible entry point towards the development of epigenetic biomarkers of FASD.
Collapse
Affiliation(s)
- Alexandre A. Lussier
- Department of Medical Genetics, Centre for Molecular Medicine and Therapeutics, British Columbia Children’s Hospital Research Institute, University of British Columbia, Vancouver, British Columbia Canada
- Department of Cellular and Physiological Sciences, Life Sciences Institute, University of British Columbia, Vancouver, British Columbia Canada
| | - Alexander M. Morin
- Department of Medical Genetics, Centre for Molecular Medicine and Therapeutics, British Columbia Children’s Hospital Research Institute, University of British Columbia, Vancouver, British Columbia Canada
| | - Julia L. MacIsaac
- Department of Medical Genetics, Centre for Molecular Medicine and Therapeutics, British Columbia Children’s Hospital Research Institute, University of British Columbia, Vancouver, British Columbia Canada
| | - Jenny Salmon
- Department of Pediatrics and Child Health, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada
- Department of Biochemistry and Medical Genetics, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada
| | - Joanne Weinberg
- Department of Cellular and Physiological Sciences, Life Sciences Institute, University of British Columbia, Vancouver, British Columbia Canada
| | - James N. Reynolds
- Department of Biomedical and Molecular Sciences, Centre for Neuroscience Studies, Queen’s University, Kingston, Ontario Canada
| | - Paul Pavlidis
- Michael Smith Laboratories, University of British Columbia, Vancouver, British Columnbia Canada
- Department of Psychiatry, University of British Columbia, Vancouver, British Columbia Canada
| | - Albert E. Chudley
- Department of Pediatrics and Child Health, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada
- Department of Biochemistry and Medical Genetics, Faculty of Medicine, University of Manitoba, Winnipeg, Manitoba Canada
| | - Michael S. Kobor
- Department of Medical Genetics, Centre for Molecular Medicine and Therapeutics, British Columbia Children’s Hospital Research Institute, University of British Columbia, Vancouver, British Columbia Canada
- Human Early Learning Partnership, University of British Columbia, Vancouver, British Columbia Canada
| |
Collapse
|
|
47
|
Kennedy DP, D'Onofrio BM, Quinn PD, Bölte S, Lichtenstein P, Falck-Ytter T. Genetic Influence on Eye Movements to Complex Scenes at Short Timescales. Curr Biol 2017; 27:3554-3560.e3. [PMID: 29129535 DOI: 10.1016/j.cub.2017.10.007] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2017] [Revised: 09/13/2017] [Accepted: 10/03/2017] [Indexed: 01/21/2023]
Abstract
Where one looks within their environment constrains one's visual experiences, directly affects cognitive, emotional, and social processing [1-4], influences learning opportunities [5], and ultimately shapes one's developmental path. While there is a high degree of similarity across individuals with regard to which features of a scene are fixated [6-8], large individual differences are also present, especially in disorders of development [9-13], and clarifying the origins of these differences is essential to understand the processes by which individuals develop within the complex environments in which they exist and interact. Toward this end, a recent paper [14] found that "social visual engagement"-namely, gaze to eyes and mouths of faces-is strongly influenced by genetic factors. However, whether genetic factors influence gaze to complex visual scenes more broadly, impacting how both social and non-social scene content are fixated, as well as general visual exploration strategies, has yet to be determined. Using a behavioral genetic approach and eye tracking data from a large sample of 11-year-old human twins (233 same-sex twin pairs; 51% monozygotic, 49% dizygotic), we demonstrate that genetic factors do indeed contribute strongly to eye movement patterns, influencing both one's general tendency for visual exploration of scene content, as well as the precise moment-to-moment spatiotemporal pattern of fixations during viewing of complex social and non-social scenes alike. This study adds to a now growing set of results that together illustrate how genetics may broadly influence the process by which individuals actively shape and create their own visual experiences.
Collapse
Affiliation(s)
- Daniel P Kennedy
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA.
| | - Brian M D'Onofrio
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA; Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Patrick D Quinn
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA
| | - Sven Bölte
- Center of Neurodevelopmental Disorders at Karolinska Institutet (KIND), Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden; Child and Adolescent Psychiatry, Center for Psychiatry Research, Stockholm County Council, Stockholm, Sweden
| | - Paul Lichtenstein
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Terje Falck-Ytter
- Center of Neurodevelopmental Disorders at Karolinska Institutet (KIND), Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden; Child and Adolescent Psychiatry, Center for Psychiatry Research, Stockholm County Council, Stockholm, Sweden; Department of Psychology, Uppsala University, Uppsala, Sweden
| |
Collapse
|
|
48
|
Thevenot J, Lopez MB, Hadid A. A Survey on Computer Vision for Assistive Medical Diagnosis From Faces. IEEE J Biomed Health Inform 2017; 22:1497-1511. [PMID: 28991753 DOI: 10.1109/jbhi.2017.2754861] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Automatic medical diagnosis is an emerging center of interest in computer vision as it provides unobtrusive objective information on a patient's condition. The face, as a mirror of health status, can reveal symptomatic indications of specific diseases. Thus, the detection of facial abnormalities or atypical features is at upmost importance when it comes to medical diagnostics. This survey aims to give an overview of the recent developments in medical diagnostics from facial images based on computer vision methods. Various approaches have been considered to assess facial symptoms and to eventually provide further help to the practitioners. However, the developed tools are still seldom used in clinical practice, since their reliability is still a concern due to the lack of clinical validation of the methodologies and their inadequate applicability. Nonetheless, efforts are being made to provide robust solutions suitable for healthcare environments, by dealing with practical issues such as real-time assessment or patients positioning. This survey provides an updated collection of the most relevant and innovative solutions in facial images analysis. The findings show that with the help of computer vision methods, over 30 medical conditions can be preliminarily diagnosed from the automatic detection of some of their symptoms. Furthermore, future perspectives, such as the need for interdisciplinary collaboration and collecting publicly available databases, are highlighted.
Collapse
|
|
49
|
Le Meur O, Coutrot A, Liu Z, Rama P, Le Roch A, Helo A. Visual Attention Saccadic Models Learn to Emulate Gaze Patterns From Childhood to Adulthood. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2017; 26:4777-4789. [PMID: 28682255 DOI: 10.1109/tip.2017.2722238] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
How people look at visual information reveals fundamental information about themselves, their interests and their state of mind. While previous visual attention models output static 2D saliency maps, saccadic models aim to predict not only where observers look at but also how they move their eyes to explore the scene. In this paper, we demonstrate that saccadic models are a flexible framework that can be tailored to emulate observer's viewing tendencies. More specifically, we use fixation data from 101 observers split into five age groups (adults, 8-10 y.o., 6-8 y.o., 4-6 y.o., and 2 y.o.) to train our saccadic model for different stages of the development of human visual system. We show that the joint distribution of saccade amplitude and orientation is a visual signature specific to each age group, and can be used to generate age-dependent scan paths. Our age-dependent saccadic model does not only output human-like, age-specific visual scan paths, but also significantly outperforms other state-of-the-art saliency models. We demonstrate that the computational modeling of visual attention, through the use of saccadic model, can be efficiently adapted to emulate the gaze behavior of a specific group of observers.
Collapse
|
|
50
|
Abbott D, Shirali Y, Haws JK, Lack CW. Biobehavioral assessment of the anxiety disorders: Current progress and future directions. World J Psychiatry 2017; 7:133-147. [PMID: 29043151 PMCID: PMC5632598 DOI: 10.5498/wjp.v7.i3.133] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/28/2017] [Revised: 06/08/2017] [Accepted: 07/03/2017] [Indexed: 02/05/2023] Open
Abstract
It is difficult to accurately assess and differentially diagnose the anxiety disorders. The current system of assessment relies heavily on the subjective measures of client self-report, clinical observation, and clinical judgment. Fortunately, recent technological advances may enable practitioners to utilize objective, biobehavioral measures of assessment in a clinical setting. The current body of literature on two of these biobehavioral tools (eye-tracking and electrocardiogram devices) is promising, but more validation and standardization research is needed to maximize the utility of these devices. Eye-tracking devices are uniquely capable of providing data that can be used to differentially diagnose anxiety disorders from both other commonly comorbid and misdiagnosed disorders. Both eye-tracking and electrocardiogram devices are able to provide change-sensitive assessment information. This objective, real-time feedback can assist clinicians and researchers in assessing treatment efficacy and symptom fluctuation. Recently developed wearable and highly portable electrocardiogram devices, like the wearable fitness and behavior tracking devices used by many consumers, may be particularly suited for providing this feedback to clinicians. Utilizing these biobehavioral devices would supply an objective, dimensional component to the current categorical diagnostic assessment system. We posit that if adequate funding and attention are directed at this area of research, it could revolutionize diagnostic and on-going assessment practices and, in doing so, bring the field of diagnosis out of the 20th century.
Collapse
Affiliation(s)
- Deah Abbott
- Department of Psychology, University of Central Oklahoma, Edmond, OK 73134, United States
| | - Yasmin Shirali
- Department of Psychology, University of Central Oklahoma, Edmond, OK 73134, United States
| | - J Kyle Haws
- Department of Psychology, University of Central Oklahoma, Edmond, OK 73134, United States
| | - Caleb W Lack
- Department of Psychology, University of Central Oklahoma, Edmond, OK 73134, United States
| |
Collapse
|