||This article may be too technical for most readers to understand. (November 2012)|
Crossmodal attention refers to the distribution of attention to different senses. Attention is the cognitive process of selectively emphasizing and ignoring sensory stimuli. According to the crossmodal attention perspective, attention often occurs simultaneously through multiple sensory modalities. These modalities process information from the different sensory fields, such as: visual, auditory, spatial, and tacitiled. While each of these is designed to process a specific type of sensory information, there is considerable overlap between them which has led researchers to question whether attention is modality-specific or the result of shared “cross-modal” resources. Cross-modal attention is considered to be the overlap between modalities that can both enhance and limit attentional processing. The most common example given of crossmodal attention is the Cocktail Party Effect, which is when a person is able to focus and attend to one important stimulus instead of other less important stimuli. This phenomena allows deeper levels of processing to occur for one stimuli while others are then ignored.
A primary concern for cognitive psychologists researching attention is to determine whether directing attention to one specific sensory modality occurs at the expense of others. Previous research has often examined how directing attention to different modalities can affect the efficiency of performance in various tasks. Studies have found that the interplay between attentional modalities exists at the neurological level  providing evidence for the influences of cross-modal attention. However a greater number of studies have emphasized the deficits in attention caused by the shifting between modalities.
Deficits caused by crossmodal attention
As cross-modal attention requires attending to two or more types of sensory information simultaneously, attentional resources are typically divided unequally. It has been suggested by most research that this divided attention can result in more attentional deficits than benefits. This has raised the question as to the effectiveness of multitasking and the potential dangers associated with it. Significant amounts of delay in reaction times are present when various distractions across modalities occur. In real-life situations these slower reaction times can result in dangerous situations. Recent concerns in the media on this topic revolve around the topic of cellphone usage while driving. Studies have found that processing, and therefore attending to, auditory information can impair the simultaneous processing of visual information. This suggests that attending to the auditory information from cellphone usage while driving will impair a driver’s visual attention and ability to drive. This would result in the endangering of the driver, passengers of the driver, pedestrians, and other drivers and their passengers. Similar studies have examined how visual attention is affected by auditory stimuli as it relates to hemispatial neglect, responses to cuing, and general spatial processing. The majority of this research suggests that multitasking and dividing attention, while possible, degrade the quality of the directed attention. This also suggests that attention is a limited resource that cannot be infinitely divided between modalities and tasks.
Benefits of crossmodal attention
While research on cross-modal attention has found that deficits in attending often occur, this research has led to a better understanding of attentional processing. Some studies have used positron emission tomography (PET) to examine the neurological basis for how we selectively attend to information using different sensory modalities. Event related potentials (ERPs). have also been used to help researchers measure how humans encode and process attended information in the brain. By increasing our understanding of modality-specific and cross-modal attention, we are better able to understand how we think and direct our attention.
In addition to greater general understanding of attention, other benefits of crossmodal attention have been found. Studies show that reinforcing information through more than one modality can increase learning. This would support the traditional theory that pairing auditory and visual stimuli that communicate the same information improves processing and memory.
- Cocktail party effect
- Human multitasking
- Mobile phones and driving safety
- Stimulus modality
- Rapp, B; Hendel, SK (2003). "Principles of cross-modal competition: Evidence from deficits of attention". Psychonomic bulletin & review 10 (1): 210–9. doi:10.3758/BF03196487. PMID 12747510.
- MacAluso, E.; Frith, CD; Driver, J (2002-04-01). "Directing Attention to Locations and to Sensory Modalities: Multiple Levels of Selective Processing revealed with PET". Cerebral Cortex 12 (4): 357–68. doi:10.1093/cercor/12.4.357. PMID 11884351.
- Driver, Jon; Spence, Charles (1998). "Crossmodal attention". Current Opinion in Neurobiology 8 (2): 245–53. doi:10.1016/S0959-4388(98)80147-5. PMID 9635209.
- Van Vleet, TM; Robertson, LC (2006). "Cross-modal interactions in time and space: Auditory influence on visual attention in hemispatial neglect". Journal of cognitive neuroscience 18 (8): 1368–79. doi:10.1162/jocn.2006.18.8.1368. PMID 16859421.
- Prime, David J.; McDonald, John J.; Green, Jessica; Ward, Lawrence M. (2008). "When cross-modal spatial attention fails". Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale 62 (3): 192. doi:10.1037/1196-1918.104.22.168.
- Driver, J; Spence, C (1998). "Cross-modal links in spatial attention". Philosophical transactions of the Royal Society of London. Series B, Biological sciences 353 (1373): 1319–31. doi:10.1098/rstb.1998.0286. PMC 1692335. PMID 9770225.
- Kida, T.; Inui, K.; Tanaka, E.; Kakigi, R. (2010). "Dynamics of Within-, Inter-, and Cross-Modal Attentional Modulation". Journal of Neurophysiology 105 (2): 674–86. doi:10.1152/jn.00807.2009. PMID 21148089.
- Herdman, Chris M.; Friedman, Alinda (1985). "Multiple resources in divided attention: A cross-modal test of the independence of hemispheric resources". Journal of Experimental Psychology: Human Perception and Performance 11: 40. doi:10.1037/0096-1522.214.171.124.
- CHEN, X. (2012). “Interaction between endogenous and exogenous orienting in crossmodal attention”. Scandinavian Journal of Psychology, 53(4), 303-308.
- Gherri, E; Eimer, M (2011). "Active listening impairs visual perception and selectivity: An ERP study of auditory dual-task costs on visual attention". Journal of cognitive neuroscience 23 (4): 832–44. doi:10.1162/jocn.2010.21468. PMID 20465407.
- Robinson, C. W., & Sloutsky, V. M. (2013). “When audition dominates vision: Evidence from cross-modal statistical learning”. Experimental Psychology, 60(2), 113-121. doi:10.1027/1618-3169/a000177