Evidence
Adv Exp Med Biol. 2024;1437:101-119. doi: 10.1007/978-981-99-7611-9_7.
ABSTRACT
Intramodal and cross-modal perceptual grouping based on the spatial proximity and temporal closeness between multiple sensory stimuli, as an operational principle has built a coherent and meaningful representation of the multisensory event/object. To implement and investigate the cross-modal perceptual grouping, researchers have employed excellent paradigms of spatial/temporal ventriloquism and cross-modal dynamic capture and have revealed the conditional constraints as well as the functional facilitations among various correspondence of sensory properties, with featured behavioral evidence, computational framework as well as brain oscillation patterns. Typically, synesthetic correspondence as a special type of cross-modal correspondence can shape the efficiency and effect-size of cross-modal interaction. For example, factors such as pitch/loudness in the auditory dimension with size/brightness in the visual dimension could modulate the strength of the cross-modal temporal capture. The empirical behavioral findings, as well as psychophysical and neurophysiological evidence to address the cross-modal perceptual grouping and synesthetic correspondence, were summarized in this review. Finally, the potential applications (such as artificial synesthesia device) and how synesthetic correspondence interface with semantics (sensory linguistics), as well as the promising research questions in this field have been discussed.
PMID:38270856 | DOI:10.1007/978-981-99-7611-9_7
Estimated reading time: 4 minute(s)
Latest: Psychiatryai.com #RAISR4D Evidence
Cool Evidence: Engaging Young People and Students in Real-World Evidence
Real-Time Evidence Search [Psychiatry]
AI Research
Synesthetic Correspondence: An Overview
🌐 90 Days
AI Virtual Reality Related Evidence Matrix
- Cross-modal conflict deficit in children with attention-deficit/hyperactivity disorder
- Photoacoustic Tomography with Temporal Encoding Reconstruction (PATTERN) for cross-modal individual analysis of the whole brain
- A self-supervised framework for cross-modal search in histopathology archives using scale harmonization
- Differences in audiovisual temporal processing in autistic adults are specific to simultaneity judgments
- Theta phase-entrainment of single cell spiking in rat somatosensory barrel cortex and secondary visual cortex is enhanced during multisensory discrimination behavior
- Searching Reproducible Brain Features using NeuroMark: Templates for Different Age Populations and Imaging Modalities
- Neural adaptations to congenital deafness: enhanced tactile discrimination through cross-modal neural plasticity - an fMRI study
- Multi-kernel Learning Fusion Algorithm Based on RNN and GRU for ASD Diagnosis and Pathogenic Brain Region Extraction
- TMO-Net: an explainable pretrained multi-omics model for multi-task learning in oncology
- Unintentionally intentional: unintended effects of spinal stimulation as a platform for multi-modal neurorehabilitation after spinal cord injury
- Null cross-modal effects of olfactory training on visual, auditory or olfactory working memory in 6- to 9-year-old children
- Abnormal multisensory temporal discrimination in Parkinson's disease
- A Multi-modal Classification Method for Early Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease Using Three Paradigms with Various Task Difficulties
- Understanding Human Cognition Through Computational Modeling
- Adaptive spatial-temporal neural network for ADHD identification using functional fMRI
- Better in sync: Temporal dynamics explain multisensory word-action-object learning in early development
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (muCAPs)
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (μCAPs)
- Distinctive and complementary roles of default mode network subsystems in semantic cognition
- Stimulus information guides the emergence of behavior-related signals in primary somatosensory cortex during learning
- Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Balancing the senses: electrophysiological responses reveal the interplay between somatosensory and visual processing during body-related multisensory conflict
- Establishing the relationship between subjective perception and neural responses: Insights from Correlation Analysis and Representational Similarity Analysis
- A machine-learning approach for differentiating borderline personality disorder from community participants with brain-wide functional connectivity
- MEG evidence that modality-independent conceptual representations contain semantic and visual features
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Distinct forms of structural plasticity of adult-born interneuron spines in the mouse olfactory bulb induced by different odor learning paradigms
- Coactivation pattern analysis reveals altered whole-brain functional transient dynamics in autism spectrum disorder
- Modeling refined differences of cortical folding patterns via spatial, morphological, and temporal fusion representations
- Cross-sectional associations between multisensory impairment and brain volumes in older adults: Baltimore Longitudinal Study of Aging
- Atypical dynamic neural configuration in autism spectrum disorder and its relationship to gene expression profiles
- Identifying behavioral links to neural dynamics of multifiber photometry recordings in a mouse social behavior network
- Rich-club organization of whole-brain spatio-temporal multilayer functional connectivity networks
- A comparative anatomical network analysis of the human and chimpanzee brains
- Conceptual information of meaningful objects is stored incidentally
- Automated stratification of trauma injury severity across multiple body regions using multi-modal, multi-class machine learning models
- Towards complex dynamic physics system simulation with graph neural ordinary equations
- Corrective mechanisms of motion extrapolation
- Age, not autism, influences multisensory integration of speech stimuli among adults in a McGurk/MacDonald paradigm
- Validation of a computational biomechanical mouse brain model for rotational head acceleration
- Validation of a computational biomechanical mouse brain model for rotational head acceleration
- Validation of a computational biomechanical mouse brain model for rotational head acceleration
- Perceptual dimensions of wood materials
- Profiles of suicide attempted in children and adolescents
- Correspondence between the alcohol-P3 event-related potential and alcohol reward phenotypes among young adults
- Top-down biological motion perception does not differ between adults scoring high versus low on autism traits
- Phantom perception as a Bayesian Inference problem - a pilot study
- It's not distance but similarity of distance: changing stimulus relations affect the control of action sequences
- Computational limits to the legibility of the imaged human brain
- Visual Perceptual Processing Abnormalities in Body Dysmorphic Disorder
- Correspondence: Food insecurity and the risk of suicidal thoughts and behaviours
- Prior probability cues bias sensory encoding with increasing task exposure
- Behavioral Assays Dissecting NMDA Receptor Function in Zebrafish
- Reduced temporal and spatial stability of neural activity patterns predict cognitive control deficits in children with ADHD
- Developmental hearing loss-induced perceptual deficits are rescued by genetic restoration of cortical inhibition
- Correspondence: Intensity-Modulated Proton Therapy Versus Intensity-Modulated Radiotherapy for Inoperable Esophageal Squamous Cell Carcinoma: Methodologic Issues
- Cross-cohort replicable resting-state functional connectivity in predicting symptoms and cognition of schizophrenia
- Species -shared and -unique gyral peaks on human and macaque brains
- An Exploratory Study of the Associations Between Sensory Processing Patterns and Emotional/Behavioral Problems in Children with Autism Spectrum Disorder
- Enhancing Emotion Regulation Through Arousal Modulation with Modal and Amodal Virtual Food Representations
- Post-retrieval stress impairs subsequent memory depending on hippocampal memory trace reinstatement during reactivation
Evidence Blueprint
Synesthetic Correspondence: An Overview
☊ AI-Driven Related Evidence Nodes
(recent articles with at least 5 words in title)
More Evidence
Synesthetic Correspondence: An Overview
🌐 365 Days
AI Virtual Reality Related Evidence Matrix
- Neural Oscillations and Multisensory Processing
- Multisensory Integration in Body Representation
- From Multisensory Integration to Multisensory Decision-Making
- Cross-modal conflict deficit in children with attention-deficit/hyperactivity disorder
- Photoacoustic Tomography with Temporal Encoding Reconstruction (PATTERN) for cross-modal individual analysis of the whole brain
- Both stimulus-specific and configurational features of multiple visual stimuli shape the spatial ventriloquism effect
- A self-supervised framework for cross-modal search in histopathology archives using scale harmonization
- Investigating the Role of Leading Sensory Modality and Autistic Traits in the Visual-Tactile Temporal Binding Window
- Differences in audiovisual temporal processing in autistic adults are specific to simultaneity judgments
- Neurovascular Coupling in Eye-Open-Eye-Close Task and Resting State: Spectral Correspondence between Concurrent EEG and fMRI
- Theta phase-entrainment of single cell spiking in rat somatosensory barrel cortex and secondary visual cortex is enhanced during multisensory discrimination behavior
- Differences in temporal profile of brain responses by pleasantness of somatosensory stimulation in autistic individuals
- Multi-modal MRI measures reveal sensory abnormalities in major depressive disorder patients: A surface-based study
- An imbalance of excitation and inhibition in the multisensory cortex impairs the temporal acuity of audiovisual processing and perception
- Enhancing neural encoding models for naturalistic perception with a multi-level integration of deep neural networks and cortical networks
- Searching Reproducible Brain Features using NeuroMark: Templates for Different Age Populations and Imaging Modalities
- Investigating implicit emotion processing in autism spectrum disorder across age groups: A cross-modal emotional priming study
- Neural adaptations to congenital deafness: enhanced tactile discrimination through cross-modal neural plasticity - an fMRI study
- Multi-kernel Learning Fusion Algorithm Based on RNN and GRU for ASD Diagnosis and Pathogenic Brain Region Extraction
- TMO-Net: an explainable pretrained multi-omics model for multi-task learning in oncology
- Unintentionally intentional: unintended effects of spinal stimulation as a platform for multi-modal neurorehabilitation after spinal cord injury
- The representation of priors and decisions in the human parietal cortex
- Dynamic functional network connectivity analysis in schizophrenia based on a spatiotemporal CPD framework
- Null cross-modal effects of olfactory training on visual, auditory or olfactory working memory in 6- to 9-year-old children
- Abnormal multisensory temporal discrimination in Parkinson's disease
- A Multi-modal Classification Method for Early Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease Using Three Paradigms with Various Task Difficulties
- Understanding Human Cognition Through Computational Modeling
- Adaptive spatial-temporal neural network for ADHD identification using functional fMRI
- Naturalistic Developmental Behavioral Interventions for Developmental Language Disorder
- Sensory processing in humans and mice fluctuates between external and internal modes
- Shift in excitation-inhibition balance underlies perceptual learning of temporal discrimination
- Better in sync: Temporal dynamics explain multisensory word-action-object learning in early development
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (muCAPs)
- Perceptual confirmation bias and decision bias underlie adaptation to sequential regularities
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (μCAPs)
- Mapping dynamic spatial patterns of brain function with spatial-wise attention
- Disentangling sensory precision and prior expectation of change in autism during tactile discrimination
- Distinctive and complementary roles of default mode network subsystems in semantic cognition
- Stimulus information guides the emergence of behavior-related signals in primary somatosensory cortex during learning
- Lost in space(s): Multimodal neuroimaging of disorientation along the Alzheimer's disease continuum
- Latent profile analysis for health-related quality of life, sleep quality, morning and evening type, and internet addiction among medical students
- Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Cross-Modal Tinnitus Remediation: A Tentative Theoretical Framework
- Structural and functional brain patterns predict formal thought disorder's severity and its persistence in recent-onset psychosis: Results from the PRONIA Study
- Developmental changes in the visual, haptic, and bimodal perception of geometric angles
- Alpha-band Brain Dynamics and Temporal Processing: An Introduction to the Special Focus
- Emotional and Affective Disorders in Cognitive Aging
- Balancing the senses: electrophysiological responses reveal the interplay between somatosensory and visual processing during body-related multisensory conflict
- Amidst an amygdala renaissance in Alzheimer's disease
- Flying enhances viewing from above bias on ambiguous visual stimuli
- Improving causality perception judgments in schizophrenia spectrum disorder via transcranial direct current stimulation
- Quantifying decision-making in dynamic, continuously evolving environments
- Multi-Scale Dynamic Graph Learning for Brain Disorder Detection with Functional MRI
- Establishing the relationship between subjective perception and neural responses: Insights from Correlation Analysis and Representational Similarity Analysis
- A machine-learning approach for differentiating borderline personality disorder from community participants with brain-wide functional connectivity
- Identifying content-invariant neural signatures of perceptual vividness
- What Makes the Detection of Movement Different Within the Autistic Traits Spectrum? Evidence From the Audiovisual Depth Paradigm
- MEG evidence that modality-independent conceptual representations contain semantic and visual features
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Perceptual alterations in the relationship between sensory reactivity, intolerance of uncertainty, and anxiety in autistic children with and without ADHD
- Distinct forms of structural plasticity of adult-born interneuron spines in the mouse olfactory bulb induced by different odor learning paradigms