||This article may be too technical for most readers to understand. (January 2014) (Learn how and when to remove this template message)|
The salience (also called saliency) of an item – be it an object, a person, a pixel, etc. – is the state or quality by which it stands out relative to its neighbors. Saliency detection is considered to be a key attentional mechanism that facilitates learning and survival by enabling organisms to focus their limited perceptual and cognitive resources on the most pertinent subset of the available sensory data.
Saliency typically arises from contrasts between items and their neighborhood, such as a red dot surrounded by white dots, a flickering message indicator of an answering machine, or a loud noise in an otherwise quiet environment. Saliency detection is often studied in the context of the visual system, but similar mechanisms operate in other sensory systems. What is salient can be influenced by training: for example, for human subjects particular letters can become salient by training.
When attention deployment is driven by salient stimuli, it is considered to be bottom-up, memory-free, and reactive. Attention can also be guided by top-down, memory-dependent, or anticipatory mechanisms, such as when looking ahead of moving objects or sideways before crossing streets. Humans and other animals have difficulty paying attention to more than one item simultaneously, so they are faced with the challenge of continuously integrating and prioritizing different bottom-up and top-down influences.
The hippocampus participates in the assessment of salience and context using past memories to filter new incoming stimuli; placing those that are most important into long term memory. The entorhinal cortex is the pathway into and out of the hippocampus and is damaged early on in Alzheimer's disease.
The nucleus accumbens shell assigns incentive salience ("want" and "desire") to rewarding stimuli, where reward is the attractive and motivational property of a stimulus that induces appetitive behavior – also known as approach behavior – and consummatory behavior.
The term is widely used in the study of perception and cognition to refer to any aspect of a stimulus that, for any of many reasons, stands out from the rest. Salience may be the result of emotional, motivational or cognitive factors and is not necessarily associated with physical factors such as intensity, clarity or size. Although salience is thought to determine attentional selection, salience associated with physical factors does not necessarily influence selection of a stimulus.
Aberrant salience hypothesis of schizophrenia
Kapur (2003) proposed that a hyperdopaminergic state, at a "brain" level of description, leads to an aberrant assignment of salience to the elements of one's experience, at a "mind" level. Dopamine mediates the conversion of the neural representation of an external stimulus from a neutral bit of information into an attractive or aversive entity, i.e. a salient event. Symptoms of schizophrenia may arise out of 'the aberrant assignment of salience to external objects and internal representations', and antipsychotic medications reduce positive symptoms, by attenuating aberrant motivational salience, via blockade of the dopamine D2 receptors (Kapur, 2003).
Visual saliency modeling
In the domain of psychology, efforts have been made in modeling the mechanism of human attention, including the learning of prioritizing the different bottom-up and top-down influences.
In the domain of computer vision, efforts have been made in modeling the mechanism of human attention, especially the bottom-up attentional mechanism. Such a process is also called visual saliency detection.
Generally speaking, there are two kinds of models to mimic the bottom-up saliency mechanism. One way is based on the spatial contrast analysis. For example, in "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis", a center-surround mechanism is used to define saliency across scales, which is inspired by the putative neural mechanism. The other way is based on the frequency domain analysis. This method was first proposed by Hou et al. While they used the amplitude spectrum to assign saliency to rarely occurring magnitudes, Guo et al. use the phase spectrum instead. Recently, Li et al. introduced a system that uses both the amplitude and the phase information.
A key limitation in many such approaches is their computational complexity which produces less than real-time performance, even on modern computer hardware. Some recent work attempts to overcome these issues but at the expense of saliency detection quality under some conditions. Other work suggests that saliency and associated speed-accuracy phenomena may be a fundamental mechanisms of recognition determined during recognition through gradient descent and does not have to be spatial in nature.
- Schneider, W. & Shiffrin, R. M. (1977). "Controlled and automatic human information processing: I. detection, search, and attention". Psychological Review. 84 (1): 1–66. doi:10.1037/0033-295x.84.1.1.
- Shiffrin, R. M. & Schneider, W. (1977). "Controlled and automatic human information processing: II perceptual learning, automatic attending and a general theory". Psychological Review. 84 (2): 127–190. doi:10.1037/0033-295x.84.2.127.
- Snow JC; Allen HA; Rafal RD; Humphreys GW (March 2009). "Impaired attentional selection following lesions to human pulvinar: evidence for homology between human and monkey". Proc. Natl. Acad. Sci. U.S.A. 106 (10): 4054–9. doi:10.1073/pnas.0810086106. PMC . PMID 19237580.
- Malenka RC, Nestler EJ, Hyman SE (2009). Sydor A, Brown RY, eds. Molecular Neuropharmacology: A Foundation for Clinical Neuroscience (2nd ed.). New York: McGraw-Hill Medical. pp. 147–148, 367, 376. ISBN 978-0-07-148127-4.
VTA DA neurons play a critical role in motivation, reward-related behavior (Chapter 15), attention, and multiple forms of memory. This organization of the DA system, wide projection from a limited number of cell bodies, permits coordinated responses to potent new rewards. Thus, acting in diverse terminal fields, dopamine confers motivational salience (“wanting”) on the reward itself or associated cues (nucleus accumbens shell region), updates the value placed on different goals in light of this new experience (orbital prefrontal cortex), helps consolidate multiple forms of memory (amygdala and hippocampus), and encodes new motor programs that will facilitate obtaining this reward in the future (nucleus accumbens core region and dorsal striatum). In this example, dopamine modulates the processing of sensorimotor information in diverse neural circuits to maximize the ability of the organism to obtain future rewards. ...
The brain reward circuitry that is targeted by addictive drugs normally mediates the pleasure and strengthening of behaviors associated with natural reinforcers, such as food, water, and sexual contact. Dopamine neurons in the VTA are activated by food and water, and dopamine release in the NAc is stimulated by the presence of natural reinforcers, such as food, water, or a sexual partner. ...
The NAc and VTA are central components of the circuitry underlying reward and memory of reward. As previously mentioned, the activity of dopaminergic neurons in the VTA appears to be linked to reward prediction. The NAc is involved in learning associated with reinforcement and the modulation of motoric responses to stimuli that satisfy internal homeostatic needs. The shell of the NAc appears to be particularly important to initial drug actions within reward circuitry; addictive drugs appear to have a greater effect on dopamine release in the shell than in the core of the NAc.
- Schultz W (2015). "Neuronal reward and decision signals: from theories to data" (PDF). Physiological Reviews. 95 (3): 853–951. doi:10.1152/physrev.00023.2014. Archived from the original (PDF) on 6 September 2015. Retrieved 24 September 2015.
Rewards in operant conditioning are positive reinforcers. ... Operant behavior gives a good definition for rewards. Anything that makes an individual come back for more is a positive reinforcer and therefore a reward. Although it provides a good definition, positive reinforcement is only one of several reward functions. ... Rewards are attractive. They are motivating and make us exert an effort. ... Rewards induce approach behavior, also called appetitive or preparatory behavior, and consummatory behavior. ... Thus any stimulus, object, event, activity, or situation that has the potential to make us approach and consume it is by definition a reward. ... Rewarding stimuli, objects, events, situations, and activities consist of several major components. First, rewards have basic sensory components (visual, auditory, somatosensory, gustatory, and olfactory) ... Second, rewards are salient and thus elicit attention, which are manifested as orienting responses (FIGURE 1, middle). The salience of rewards derives from three principal factors, namely, their physical intensity and impact (physical salience), their novelty and surprise (novelty/surprise salience), and their general motivational impact shared with punishers (motivational salience). A separate form not included in this scheme, incentive salience, primarily addresses dopamine function in addiction and refers only to approach behavior (as opposed to learning) ... Third, rewards have a value component that determines the positively motivating effects of rewards and is not contained in, nor explained by, the sensory and attentional components (FIGURE 1, right). This component reflects behavioral preferences and thus is subjective and only partially determined by physical parameters. Only this component constitutes what we understand as a reward. It mediates the specific behavioral reinforcing, approach generating, and emotional effects of rewards that are crucial for the organism’s survival and reproduction, whereas all other components are only supportive of these functions. ... These emotions are also called liking (for pleasure) and wanting (for desire) in addiction research (471) and strongly support the learning and approach generating functions of reward.
- Tsakanikos, E. (2004). Latent inhibition, visual pop-out and schizotypy: is disruption of latent inhibition due to enhanced stimulus salience? Personality and Individual Differences, 37, 1347-1358. 
- Kapur, S. (2003). Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. American Journal of Psychiatry,160, 13–23.
- Berridge, K.C. & Robinson, T.E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Research Review, 28, 309-369. 
- van de Laar, P., Heskes, T. and Gielen S. (August 1997). "Task-Dependent Learning of Attention". Neural Networks. 10 (6): 981–992. doi:10.1016/S0893-6080(97)00031-2.
- Frintrop S., Rome E. & Christensen H.I. (2010). "Computational Visual Attention Systems and their Cognitive Foundation: A Survey". ACM Transactions on Applied Perception. 7 (1).
- Itti L.; Koch C.; Niebur E. (1998). "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis". IEEE Trans Pattern Anal Mach Intell. 20 (11): 1254–1259. doi:10.1109/34.730558.
- Hou X; Zhang L (2007). "Saliency Detection: A Spectral Residual Approach". IEEE CVPR.
- Guo C., Ma Q. & Zhang L. (2008). "Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform". IEEE Conference on Computer Vision and Pattern Recognition.
- Li J; Levine MD; An X; Xu X; He H (2012). "Visual Saliency Based on Scale-Space Analysis in the Frequency Domain" (PDF). IEEE Trans Pattern Anal Mach Intell. 35 (4): 996–1010. doi:10.1109/TPAMI.2012.147. PMID 22802112.
- Katramados, I., Breckon, T.P. (September 2011). "Real-time Visual Saliency by Division of Gaussians". Proc. International Conference on Image Processing (PDF). IEEE. pp. 1741–1744. doi:10.1109/ICIP.2011.6115785. Retrieved 8 April 2013.
- Achler T. (2013). "Supervised Generative Reconstruction: An Efficient Way To Flexibly Store and Recognize Patterns". arXiv:.
- Itti L; Koch C (March 2001). "Computational modelling of visual attention". Nat. Rev. Neurosci. 2 (3): 194–203. doi:10.1038/35058500. PMID 11256080.
- iLab at the University of Southern California
- Scholarpedia article on visual saliency by Prof. Laurent Itti
- Huang, J-B; Ahuja, Narendra (2012). "Saliency Detection via Divergence Analysis: An Unified Perspective]" (PDF). ICPR.
- Saliency map at Scholarpedia