Evidence
Adv Exp Med Biol. 2024;1437:101-119. doi: 10.1007/978-981-99-7611-9_7.
ABSTRACT
Intramodal and cross-modal perceptual grouping based on the spatial proximity and temporal closeness between multiple sensory stimuli, as an operational principle has built a coherent and meaningful representation of the multisensory event/object. To implement and investigate the cross-modal perceptual grouping, researchers have employed excellent paradigms of spatial/temporal ventriloquism and cross-modal dynamic capture and have revealed the conditional constraints as well as the functional facilitations among various correspondence of sensory properties, with featured behavioral evidence, computational framework as well as brain oscillation patterns. Typically, synesthetic correspondence as a special type of cross-modal correspondence can shape the efficiency and effect-size of cross-modal interaction. For example, factors such as pitch/loudness in the auditory dimension with size/brightness in the visual dimension could modulate the strength of the cross-modal temporal capture. The empirical behavioral findings, as well as psychophysical and neurophysiological evidence to address the cross-modal perceptual grouping and synesthetic correspondence, were summarized in this review. Finally, the potential applications (such as artificial synesthesia device) and how synesthetic correspondence interface with semantics (sensory linguistics), as well as the promising research questions in this field have been discussed.
PMID:38270856 | DOI:10.1007/978-981-99-7611-9_7
Add to Google Keep
Estimated reading time: 4 minute(s)
Latest: Psychiatryai.com #RAISR4D
Cool Evidence: Engaging Young People and Students in Real-World Evidence ☀️
Real-Time Evidence Search [Psychiatry]
AI Research [Andisearch.com]
Synesthetic Correspondence: An Overview
🌐 90 Days
VR Related Evidence Matrix
- Cross-modal conflict deficit in children with attention-deficit/hyperactivity disorder
- Photoacoustic Tomography with Temporal Encoding Reconstruction (PATTERN) for cross-modal individual analysis of the whole brain
- A self-supervised framework for cross-modal search in histopathology archives using scale harmonization
- Differences in audiovisual temporal processing in autistic adults are specific to simultaneity judgments
- Theta phase-entrainment of single cell spiking in rat somatosensory barrel cortex and secondary visual cortex is enhanced during multisensory discrimination behavior
- Enhancing neural encoding models for naturalistic perception with a multi-level integration of deep neural networks and cortical networks
- Searching Reproducible Brain Features using NeuroMark: Templates for Different Age Populations and Imaging Modalities
- Investigating implicit emotion processing in autism spectrum disorder across age groups: A cross-modal emotional priming study
- Multi-kernel Learning Fusion Algorithm Based on RNN and GRU for ASD Diagnosis and Pathogenic Brain Region Extraction
- Unintentionally intentional: unintended effects of spinal stimulation as a platform for multi-modal neurorehabilitation after spinal cord injury
- Null cross-modal effects of olfactory training on visual, auditory or olfactory working memory in 6- to 9-year-old children
- Abnormal multisensory temporal discrimination in Parkinson's disease
- A Multi-modal Classification Method for Early Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease Using Three Paradigms with Various Task Difficulties
- Better in sync: Temporal dynamics explain multisensory word-action-object learning in early development
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (muCAPs)
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (μCAPs)
- Perceptual confirmation bias and decision bias underlie adaptation to sequential regularities
- Mapping dynamic spatial patterns of brain function with spatial-wise attention
- Distinctive and complementary roles of default mode network subsystems in semantic cognition
- Lost in space(s): Multimodal neuroimaging of disorientation along the Alzheimer's disease continuum
- Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Balancing the senses: electrophysiological responses reveal the interplay between somatosensory and visual processing during body-related multisensory conflict
- Identifying content-invariant neural signatures of perceptual vividness
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Distinct forms of structural plasticity of adult-born interneuron spines in the mouse olfactory bulb induced by different odor learning paradigms
- Modeling refined differences of cortical folding patterns via spatial, morphological, and temporal fusion representations
- Cross-sectional associations between multisensory impairment and brain volumes in older adults: Baltimore Longitudinal Study of Aging
- Tau accumulation and its spatial progression across the Alzheimer's disease spectrum
- Conceptual information of meaningful objects is stored incidentally
- Towards complex dynamic physics system simulation with graph neural ordinary equations
- Automated stratification of trauma injury severity across multiple body regions using multi-modal, multi-class machine learning models
- Corrective mechanisms of motion extrapolation
- Modeling the association between functional connectivity and lateralization with the activity flow framework
- Age, not autism, influences multisensory integration of speech stimuli among adults in a McGurk/MacDonald paradigm
- Validation of a computational biomechanical mouse brain model for rotational head acceleration
- Validation of a computational biomechanical mouse brain model for rotational head acceleration
- Validation of a computational biomechanical mouse brain model for rotational head acceleration
- Profiles of suicide attempted in children and adolescents
- Cerebral asymmetry representation learning based deep subdomain adaptation network for EEG-based emotion recognition
- Phantom perception as a Bayesian Inference problem - a pilot study
- It's not distance but similarity of distance: changing stimulus relations affect the control of action sequences
- Computational limits to the legibility of the imaged human brain
- Visual Perceptual Processing Abnormalities in Body Dysmorphic Disorder
- Prior probability cues bias sensory encoding with increasing task exposure
- Behavioral Assays Dissecting NMDA Receptor Function in Zebrafish
- Correspondence: Intensity-Modulated Proton Therapy Versus Intensity-Modulated Radiotherapy for Inoperable Esophageal Squamous Cell Carcinoma: Methodologic Issues
- Cross-cohort replicable resting-state functional connectivity in predicting symptoms and cognition of schizophrenia
- Intact Somatosensory Temporal Sensitivity in Adults on the Autism Spectrum: A High-Density Electrophysiological Mapping Study Using the Mismatch Negativity (MMN) Sensory Memory Paradigm
- Intact Somatosensory Temporal Sensitivity in Adults on the Autism Spectrum: A High-Density Electrophysiological Mapping Study Using the Mismatch Negativity (MMN) Sensory Memory Paradigm
- Species -shared and -unique gyral peaks on human and macaque brains
- Enhancing Emotion Regulation Through Arousal Modulation with Modal and Amodal Virtual Food Representations
- Post-retrieval stress impairs subsequent memory depending on hippocampal memory trace reinstatement during reactivation
- An Exploratory Study of the Associations Between Sensory Processing Patterns and Emotional/Behavioral Problems in Children with Autism Spectrum Disorder
- A commentary on 'The use of multilayer perceptron and radial basis function: an artificial intelligence model to predict progression of oral cancer': correspondence
- Analysis of hippocampal local field potentials by diffusion mapped delay coordinates
- A dynamic neural resource model bridges sensory and working memory
- Connected in bad times and in good times: Empathy induces stable social closeness
- Convergent and divergent genes expression profiles associated with brain-wide functional connectome dysfunction in deficit and non-deficit schizophrenia
- Autistic Traits and Eating Behaviors in Chinese Preschoolers: Role of Sensory Profiles and Home Environment
- 'Nowhere and no one is safe': spatial analysis of damage to critical civilian infrastructure in the Gaza Strip during the first phase of the Israeli military campaign, 7 October to 22 November 2023
- 'Nowhere and no one is safe': spatial analysis of damage to critical civilian infrastructure in the Gaza Strip during the first phase of the Israeli military campaign, 7 October to 22 November 2023
Evidence Blueprint
Synesthetic Correspondence: An Overview
☊ AI-Driven Related Evidence Nodes
(recent articles with at least 5 words in title)
More Evidence
Synesthetic Correspondence: An Overview
🌐 365 Days
VR Related Evidence Matrix
- Neural Oscillations and Multisensory Processing
- Multisensory Integration in Body Representation
- From Multisensory Integration to Multisensory Decision-Making
- Cross-modal conflict deficit in children with attention-deficit/hyperactivity disorder
- Photoacoustic Tomography with Temporal Encoding Reconstruction (PATTERN) for cross-modal individual analysis of the whole brain
- Both stimulus-specific and configurational features of multiple visual stimuli shape the spatial ventriloquism effect
- A self-supervised framework for cross-modal search in histopathology archives using scale harmonization
- Investigating the Role of Leading Sensory Modality and Autistic Traits in the Visual-Tactile Temporal Binding Window
- Differences in audiovisual temporal processing in autistic adults are specific to simultaneity judgments
- Neurovascular Coupling in Eye-Open-Eye-Close Task and Resting State: Spectral Correspondence between Concurrent EEG and fMRI
- Theta phase-entrainment of single cell spiking in rat somatosensory barrel cortex and secondary visual cortex is enhanced during multisensory discrimination behavior
- Differences in temporal profile of brain responses by pleasantness of somatosensory stimulation in autistic individuals
- Spatiotemporal dynamics of functional connectivity and association with molecular architecture in schizophrenia
- Multi-modal MRI measures reveal sensory abnormalities in major depressive disorder patients: A surface-based study
- Enhancing neural encoding models for naturalistic perception with a multi-level integration of deep neural networks and cortical networks
- An imbalance of excitation and inhibition in the multisensory cortex impairs the temporal acuity of audiovisual processing and perception
- Searching Reproducible Brain Features using NeuroMark: Templates for Different Age Populations and Imaging Modalities
- Investigating implicit emotion processing in autism spectrum disorder across age groups: A cross-modal emotional priming study
- Multi-kernel Learning Fusion Algorithm Based on RNN and GRU for ASD Diagnosis and Pathogenic Brain Region Extraction
- Unintentionally intentional: unintended effects of spinal stimulation as a platform for multi-modal neurorehabilitation after spinal cord injury
- The representation of priors and decisions in the human parietal cortex
- Dynamic functional network connectivity analysis in schizophrenia based on a spatiotemporal CPD framework
- Null cross-modal effects of olfactory training on visual, auditory or olfactory working memory in 6- to 9-year-old children
- Abnormal multisensory temporal discrimination in Parkinson's disease
- A Multi-modal Classification Method for Early Diagnosis of Mild Cognitive Impairment and Alzheimer's Disease Using Three Paradigms with Various Task Difficulties
- The dominance of spatial information in object identity judgments: A persistent congruency bias even amidst conflicting statistical regularities
- Naturalistic Developmental Behavioral Interventions for Developmental Language Disorder
- Shift in excitation-inhibition balance underlies perceptual learning of temporal discrimination
- Better in sync: Temporal dynamics explain multisensory word-action-object learning in early development
- Sensory processing in humans and mice fluctuates between external and internal modes
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (muCAPs)
- Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (μCAPs)
- Perceptual confirmation bias and decision bias underlie adaptation to sequential regularities
- Multisensory perception and decision-making with a new sensory skill
- Mapping dynamic spatial patterns of brain function with spatial-wise attention
- Disentangling sensory precision and prior expectation of change in autism during tactile discrimination
- Distinctive and complementary roles of default mode network subsystems in semantic cognition
- Lost in space(s): Multimodal neuroimaging of disorientation along the Alzheimer's disease continuum
- Latent profile analysis for health-related quality of life, sleep quality, morning and evening type, and internet addiction among medical students
- Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Augmenting locomotor perception by remapping tactile foot sensation to the back
- Cross-Modal Tinnitus Remediation: A Tentative Theoretical Framework
- Structural and functional brain patterns predict formal thought disorder's severity and its persistence in recent-onset psychosis: Results from the PRONIA Study
- Diffuse Optical Tomography Spatial Prior for EEG Source Localization in Human Visual Cortex
- Developmental changes in the visual, haptic, and bimodal perception of geometric angles
- Predicting U.S. county opioid poisoning mortality from multi-modal social media and psychological self-report data
- Alpha-band Brain Dynamics and Temporal Processing: An Introduction to the Special Focus
- Balancing the senses: electrophysiological responses reveal the interplay between somatosensory and visual processing during body-related multisensory conflict
- Emotional and Affective Disorders in Cognitive Aging
- Amidst an amygdala renaissance in Alzheimer's disease
- Flying enhances viewing from above bias on ambiguous visual stimuli
- Improving causality perception judgments in schizophrenia spectrum disorder via transcranial direct current stimulation
- Quantifying decision-making in dynamic, continuously evolving environments
- Multi-Scale Dynamic Graph Learning for Brain Disorder Detection with Functional MRI
- Identifying content-invariant neural signatures of perceptual vividness
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- Olfactory categorization is shaped by a transmodal cortical network for evaluating perceptual predictions
- What Makes the Detection of Movement Different Within the Autistic Traits Spectrum? Evidence From the Audiovisual Depth Paradigm
- Perceptual alterations in the relationship between sensory reactivity, intolerance of uncertainty, and anxiety in autistic children with and without ADHD
- Distinct forms of structural plasticity of adult-born interneuron spines in the mouse olfactory bulb induced by different odor learning paradigms
- A Modal Interpretation of Quantum Spins and Its Application to Freudian Theory
- Modeling refined differences of cortical folding patterns via spatial, morphological, and temporal fusion representations
- Autistic traits and ARFID-associated eating behaviors in preschoolers: Mediating effects of sensory processing patterns