Research Summary

Our research aims to enhance our knowledge of the neural processes behind typical and atypical human behaviors through a combination of multimodal brain imaging techniques and computational methods. Specifically, we are interested in:

  • Development of integrated multimodal brain imaging algorithms (fNIRS, DOT, EEG, fMRI) for advanced brain imaging with high spatiotemporal resolution
  • Establish computational models to elucidate the brain-physiology-behavior association of human brain disorders (neuropsychiatric, neurodegenerative, and neurodevelopmental disorders)
  • Static and dynamic human brain network analyses to decode the process of human behaviors (social interaction, team collaboration)

 Multimodal brain imaging

Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG suffers from poor spatial resolution while praesenting high temporal resolution. In contrast, fNIRS offers better spatial resolution tough it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that, both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal EEG-fNIRS integration analysis approach. The main goal of this research is to develop and implement multimodal EEG/fNIRS integration methods for brain research.

Leveraging the high spatial resolution of fNIRS and high temporal resolution of EEG, we have explored feasible approaches to study the human brain dynamics related to various clinically-seen brain disorders. We developed an fNIRS-informed EEG source localization approach to investigate the brain network alterations induced by Alzheimer’s disease (Li, R., et al. 2019). We then demonstrated how the proposed fNIRS-informed EEG source localization approach can be used to characterize brain plasticity during longitudinal post-stroke rehabilitation (Li, R., et al. 2020). On the other hand, we also proposed a framework showing how EEG signals may help to enhance the fNIRS-based general linear model analysis (Li, R., et al. 2020).

  • Li, Rihui, et al. “Dynamic cortical connectivity alterations associated with Alzheimer’s disease: An EEG and fNIRS integration study.” NeuroImage: Clinical 21 (2019): 101622.
  • Li, Rihui, et al. “Multimodal neuroimaging using concurrent EEG/fNIRS for poststroke recovery assessment: an exploratory study.” Neurorehabilitation and Neural Repair 34.12 (2020): 1099-1110.
  • Li, Rihui, et al. “Enhancing fNIRS analysis using EEG rhythmic signatures: an EEG-informed fNIRS analysis study.” IEEE Transactions on Biomedical Engineering 67.10 (2020): 2789-2797.

Computational Psychiatry

Traditionally, psychiatric disorders have been defined around behavioral symptoms that are often imprecise. The advanced neuroimaging techniques developed over the past decades have drastically improved our understanding of brain-physiology-behavior association in psychiatric individuals. Our group is one of the pioneers in conducting multimodal computational research in psychiatry. Specifically, we aim to establish computational models that combine multimodal data (e.g., brain, eye tracking, heart rate)  to provide sensitive and specific tools for symptom assessment and evaluation of intervention response in clinical trials.

Currently, the main focus of our psychiatric research is Autism spectrum disorder. A series of works have been conducted using multimodal techniques (e.g., fNIRS, fMRI, eye tracking) to elucidate the brain-physiology-behavior association in children with Fragile X syndrome, the most common cause of Autism spectrum disorder (Li, R., et al. 2021, 2022, 2023). 

  • Li, Rihui, et al. “Aberrant neural response during face processing in girls with fragile X syndrome: defining potential brain biomarkers for treatment studies.” Biological Psychiatry: Cognitive Neuroscience and Neuroimaging (2021).
  • Li, Rihui, et al. “Aberrant brain network and eye gaze patterns during natural social interaction predict multi-domain social-cognitive behaviors in girls with fragile X syndrome.” Molecular Psychiatry (2022): 1-9.
  • Li, Rihui, et al. “Association of Intrinsic Functional Brain Network and Longitudinal Development of Cognitive Behavioral Symptoms in Young Girls With Fragile X Syndrome.” Biological Psychiatry (2023).

Brain dynamic networks during social interaction

Understanding how the brain adapts and organizes in a dynamic manner is critical for elucidating the neural basis of social interaction. Among various brain imaging techniques, fNIRS offers various potential advantages; it is highly portable, low cost, and more resilient to motion artifacts which, together, permit assessment of real-time brain dynamics and inter-brain synchrony (IBS) in naturalistic settings. Our group is interested in developing novel approaches to capture the static and dynamic natures of IBS during naturalistic social interaction. In a pilot study (Li, R., et al. 2021), we proposed a dynamic IBS approach to distill complex inter-brain dynamics associated with social interaction into a set of representative brain states with more fine-grained temporal resolution. Our findings demonstrate that the nature of social cooperation can potentially be characterized using a more dynamic and modular approach. That is, the process of social interaction is not only modulated by time-varying IBS networks, but also via inter-brain communication between key regions within different dynamic IBS networks. This approach allows us to gain a better understanding of the dynamic process of naturalistic social interaction.

  • Li, Rihui, et al. “Dynamic inter-brain synchrony in real-life inter-personal cooperation: A functional near-infrared spectroscopy hyperscanning study.” NeuroImage 238 (2021): 118263.

Awarded Grants

2025-2027 The Science and Technology Development Fund (FDCT) of Macau-Scientific Research and Innovation (Role: PI)

2025-2026 Multi-Year Research Grant-General Research Grant (GRG), University of Macau (Role: PI) 

2025-2026 Multi-Year Research Grant-Collaborative Research Grant (CRG), University of Macau (Role: PI)

2024-2026 National Natural Science Foundation of China (NSFC)-Young Scientists Fund (Role: PI)

2024-2025 The Science and Technology Development Fund (FDCT) of Macau-Innovation and Technology Promotion Fund (Role: PI)

2023-2025 Start-up Research Grant (SRG), University of Macau (Role: PI)

Collaborators

Stanford University

University of Miami

Washington University in St. Louis

Children’s Hospital of Fudan University

Sun Yat-sen University

Beijing Normal University

Harbin Institute of Technology

Hangzhou Dianzi University