Eye–hand coordination

From Wikipedia, the free encyclopedia
  (Redirected from Hand-eye coordination)
Jump to navigation Jump to search

Eye–hand coordination (also known as hand–eye coordination) is the coordinated control of eye movement with hand movement and the processing of visual input to guide reaching and grasping along with the use of proprioception of the hands to guide the eyes. Eye–hand coordination has been studied in activities as diverse as the movement of solid objects such as wooden blocks, archery, sporting performance, music reading, computer gaming, copy-typing, and even tea-making. It is part of the mechanisms of performing everyday tasks; in its absence, most people would be unable to carry out even the simplest of actions such as picking up a book from a table or playing a video game. While it is recognized by the term hand–eye coordination, without exception, medical sources, and most psychological sources, refer to eye–hand coordination.[citation needed]

Evolution of eye–hand coordination[edit]

The eye–forelimb hypothesis[edit]

The eye–forelimb (EF) hypothesis suggests that the primate visual system changed in parallel with the specialization of the hand through a common evolutionary mechanism. The ultimate result became accurate depth perception, speed and exactness of the hand when it is gripping.

Why do primates have their eyes directed forward and why uncrossed nerves from the eyes?[edit]

Why do all primates including humans have their eyes directed straight ahead? And why do primates have an optic chiasm (OC), with almost half (45 percent) made up of uncrossed nerves? The traditional idea is that such vision combined with high-grade binocularity to promote deep vision.[1] However, an overview article in Brain, Behavior and Evolution [2] presents a new "Eye–forelimb hypothesis" (EF hypothesis) that suggests that the neural architecture of primates´ visual system evolved for a totally different purpose. The EF hypothesis postulates that it has selective value to have short neural pathways between areas of the brain that receive visual information about the hand and the motor nuclei that control the coordination of the hand. The heart of the EF hypothesis is that evolutionary transformation in OC will affect the length of these neural pathways.

A way to test the hypothesis is comparing the precision and speed of, let say, the left hand when performing tasks in the left and right field of view respectively. Several such experiments have been carried out. Although, they were not done primarily to test the EF hypothesis the results are clearly in accordance with the hypothesis: a higher precision and speed as long as the hand works in the ipsilateral field of vision.[3] Berlucchi et al [4]believes that the hand's reactions to visual stimuli that are presented in the ipsilateral field of vision are integrated into the contralateral hemisphere, which results in fewer synapses for the signals to pass, resulting in faster motor skills than with visual stimuli presented counter-laterally.

Primates skillfully use their hands under supervision of the eye[edit]

Primates and cats skillfully use their anterior limbs under supervision of the eye. Primates and felines (cat), have a high proportion of ipsilateral retinal projections (IRP) (45% respectively 30% IRP). The fact that crocodiles, most birds and fishes lack IRP is also accommodated by the EF hypothesis.[5] For anatomical/functional reasons, crocodiles, birds and fishes have little use of the anterior limb in their frontal space. The African claw frog Xenopus laevis has only crossed projections before the metamorphosis, thereafter it develops binocular vision and anterior extremities with claws. Xenopus laevis uses its claws when it catches prey situated in front of the frog. Dolphins lack IRP, which is consistent with the hypothesis because the anterior extremity of the dolphin (the pectoral fin) is used only laterally. Among marsupials, three tree-climbing species have a high proportion of IRP. Vombater (Vombatidae), has very few IRP, which is in accordance with the EF hypothesis since it is a terrestrial herbivore. That kind of foraging reduces the need of excellent visual control of the forefoot. The other marsupials fall between these extremes [6].

The EF hypothesis offers new perspectives on human evolution. Virtuous eye hand controll are typical features of primates.[7][8] Fossil evidence suggests that the first actual primates appeared about 55 million years ago. Even then, the hand seems to have been specialized to grip with. Early primate ancestors may have developed this special grip to achieve and eat flowers, nectar and leaves in the distal branches of trees.[9] Bloch and Boyer claim that the hand's grip ability evolved before the visual specialization of the primates.[10] The EF hypothesis, in contrary, indicates that the primate vision system evolved in parallel with the specialization of the hand through a common evolutionary mechanism. In principle that an increase in IRP has selective value in animals that regularly use the anterior limb in the frontal field of vision.[11]

Behavior and kinematics[edit]

Neuroscientists have extensively researched human gaze behavior, with studies noting that the use of the gaze is very task-specific,[12] but that humans typically exhibit proactive control to guide their movement. Usually, the eyes fixate on a target before the hands are used to engage in a movement, indicating that the eyes provide spatial information for the hands.[13] The duration that the eyes appear to be locked onto a goal for a hand movement varies—sometimes the eyes remain fixated until a task is completed. Other times, the eyes seem to scout ahead toward other objects of interest before the hand even grasps and manipulates the object.

Eye-guided hand movement[edit]

When eyes and hands are used for core exercises, the eyes generally direct the movement of the hands to targets.[14] Furthermore, the eyes provide initial information of the object, including its size, shape, and possibly grasping sites that are used to determine the force the fingertips need to exert to engage in a task.

For sequential tasks, eye-gaze movement occurs during important kinematic events like changing the direction of a movement or when passing perceived landmarks.[15] This is related to the task-search-oriented nature of the eyes and their relation to the movement planning of the hands and the errors between motor signal output and consequences perceived by the eyes and other senses that can be used for corrective movement. The eyes have a tendency to "refixate" on a target to refresh the memory of its shape, or to update for changes in its shape or geometry in drawing tasks that involve the relating of visual input and hand movement to produce a copy of what was perceived.[16] In high accuracy tasks, when acting on greater amounts of visual stimuli, the time it takes to plan and execute movement increases linearly, per Fitts's law.[17]

Hand-guided saccades[edit]

Humans have demonstrated the ability to aim eye movement toward the hand without vision, using the sense of proprioception, with only minor errors related to internal knowledge of limb position.[18] It has been shown the proprioception of limbs, in both active and passive movement, result in eye saccade overshoots when the hands are being used to guide eye movement. These overshoots result from the control of eye saccades rather than previous movement of the hands in experiments.[citation needed] This implies that limb-based proprioception is capable of being transformed into ocular motor coordinates to guide eye saccades, which allows for the guidance of the saccades by hands and feet.[citation needed]

Neural mechanisms[edit]

The neural control of eye–hand coordination is complex because it involves every part of the central nervous system involved in vision: eye movements, touch, and hand control. This includes the eyes themselves, the cerebral cortex, subcortical structures (such as the cerebellum, basal ganglia, and brain stem), the spinal cord, and the peripheral nervous system. Other areas involved in eye–hand coordination that have been studied most intensely are the frontal and parietal cortex areas for the control of eye saccades and hand-reach. Both of these areas are believed to play a key role in eye–hand coordination and the planning of movements during tasks.[citation needed]

A more specific area, the parieto occipital junction, is believed to be involved in the transformation of peripheral visual input for reaching with the hands, as found via fMRI.[19] This region in particular has subdivisions for reach, grasp, and saccades. In addition to the parieto–occipital junction, the posterior parietal cortex is believed to play an important role in relating proprioception and the transformation of motor sensory input to plan and control movement with regard to visual input.[20]

Many of these areas, in addition to controlling saccades or reach, also show eye position signals that are required for transforming visual signals into motor commands. In addition, some of the areas involved in reach, like the medial intraparietal cortex, show a gaze-centered remapping of responses during eye movements in both monkeys and humans. However, when single neurons are recorded in these areas, the reach areas often show some saccade-related responses and the saccade areas often show some reach related responses. This may aid in eye–hand coordination or hint at the ability of cells to wire together as they're used more frequently.[citation needed]

Clinical syndromes[edit]

Numerous disorders, diseases, and impairments have been found to result in disruption to eye–hand coordination, owing to damage to the brain itself, degeneration of the brain due to disease or aging, or an apparent inability to coordinate senses completely.


Impairments to eye–hand coordination have been shown in older adults, especially during high-velocity and precise movements. This has been attributed to the general degeneration of the cortex, resulting in a loss of the ability to compute visual inputs and relate them to hand movements.[21] However, while older adults tend to take more time for these sorts of tasks, they are still able to remain just as accurate as younger adults, but only if the additional time is taken.[citation needed]

Bálint's syndrome[edit]

Bálint's syndrome is characterized by a complete lack of eye–hand coordination and has been demonstrated to occur in isolation to optic ataxia.[20] It is a rare psychological condition resulting most often from damage bilaterally to the superior parieto-occipital cortex.[22] One of the most common causes is from strokes, but tumours, trauma, and Alzheimer's disease can also cause damage. Balint's syndrome patients can suffer from 3 major components: optic apraxia, optic ataxia, and simultanagnosia.[23] Simultanagnosia is when patients have difficulty perceiving more than one object at a time.[22] There have been three different approaches for rehabilitation. The first approach is the adaptive or functional approach. It involves functional tasks that use a patient's strengths and abilities. The second approach is remedial approach and involves restoration of the damaged central nervous system by training perceptual skills. The last approach is multicontext approach and this approach involves practising a targeted strategy in a multiple environment with varied tasks and movement demands, along with self-awareness tasks.[24]

Optic apraxia[edit]

Optic apraxia is a condition that results from a total inability of a person to coordinate eye and hand movements. Although similar to optic ataxia, its effects are more severe and do not necessarily come from damage to the brain, but may arise from genetic defects or degeneration of tissue.[citation needed]

Optic ataxia[edit]

Optic ataxia or visuomotor ataxia is a clinical problem associated with damage to the occipital–parietal cortex in humans, resulting in a lack of coordination between the eyes and hand. It can affect either one or both hands and can be present in part of the visual field or the entire visual field.[25] Optic ataxia has been often considered to be a high-level impairment of eye–hand coordination resulting from a cascade of failures in the sensory to motor transformations in the posterior parietal cortex. Visual perception, naming, and reading are still possible, but visual information cannot direct hand motor movements.[25] Optic ataxia has been often confused with Balint's syndrome, but recent research has shown that optic ataxia can occur independently of Balint's syndrome.[20] Optic ataxia patients usually have troubles reaching toward visual objects on the side of the world opposite to the side of brain damage. Often these problems are relative to current gaze direction, and appear to be remapped along with changes in gaze direction. Some patients with damage to the parietal cortex show "magnetic reaching": a problem in which reaches seem drawn toward the direction of gaze, even when it is deviated from the desired object of grasp.[citation needed]

Parkinson's disease[edit]

Adults with Parkinson's disease have been observed to show the same impairments as normal aging, only to a more extreme degree, in addition to a loss of control of motor functions as per normal symptoms of the disease.[21] It is a movement disorder and occurs when there is degeneration of dopaminergic neurons that connect the substantia nigra with the caudate nucleus. A patient's primary symptoms include muscular rigidity, slowness of movement, a resting tremor, and postural instability.[26] The ability to plan and learn from experience has been shown to allow adults with Parkinson's to improvement times, but only under conditions where they are using medications to combat the effects of Parkinson's. Some patients are given L-DOPA, which is a precursor to dopamine. It is able to cross the blood-brain barrier and then is taken up by dopaminergic neurons and then converted to dopamine.[26]

See also[edit]


  1. ^ Heesy, C. P. (2009). Seeing in Stereo: The Ecology and Evolution of Primate Binocular Vision and Stereopsis. Evol. Anthropol. 18, 21-35. doi: 10.1002/evan.20195.
  2. ^ Larsson, M. (2011). Binocular vision and ipsilateral retinal projections in relation to eye and forelimb coordination. Brain Behav. Evol. 77, 219-230. doi: 10.1159/000329257.
  3. ^ Larsson, M. (2013). The optic chiasm: a turning point in the evolution of eye/hand coordination. Front. zool. 10, 41. doi: 10.1186/1742-9994-10-41.
  4. ^ Berlucchi, G., Heron, W., Hyman, R., Rizzolat.G, and Umilta, C. (1971). Simple reactions times of ipsilateral and contralateral hand to lateralized visual stimuli. Brain 94, 419-430.
  5. ^ Larsson, M. (2011). Binocular vision and ipsilateral retinal projections in relation to eye and forelimb coordination. Brain Behav. Evol. 77, 219-230. doi: 10.1159/000329257.
  6. ^ Larsson, M. (2011). Binocular vision and ipsilateral retinal projections in relation to eye and forelimb coordination. Brain Behav. Evol. 77, 219-230. doi: 10.1159/000329257.
  7. ^ Heesy, C. P. (2009). Seeing in Stereo: The Ecology and Evolution of Primate Binocular Vision and Stereopsis. Evol. Anthropol. 18, 21-35. doi: 10.1002/evan.20195.
  8. ^ Larsson, M. (2011). Binocular vision and ipsilateral retinal projections in relation to eye and forelimb coordination. Brain Behav. Evol. 77, 219-230. doi: 10.1159/000329257.
  9. ^ Bloch JI, Boyer DM (2002): Grasping primate origins. Science 298:1606–1610.
  10. ^ Bloch JI, Boyer DM (2002): Grasping primate origins. Science 298:1606–1610.
  11. ^ Larsson M, Binocular vision, the optic chiasm, and their associations with vertebrate motor behavior. Frontiers in Ecol. Evol. 2015 - DOI: 10.3389/fevo.2015.00089
  12. ^ Vidoni, E. D.; McCarley, J. S.; Edwards, J. D.; Boyd, L. A. (2009). "Manual and oculomotor performance develop contemporaneously but independently during continuous tracking". Experimental Brain Research. 195 (4): 611–620. doi:10.1007/s00221-009-1833-2. PMID 19436998.
  13. ^ Johansson, R. S.; Westling, G; Bäckström, A.; Flanagan, J. R. (2001). "Eye–hand co-ordination in object manipulation". Journal of Neuroscience. 21 (17): 6917–6932. CiteSeerX doi:10.1523/JNEUROSCI.21-17-06917.2001. PMC 6763066. PMID 11517279.
  14. ^ Liesker, H.; Brenner, E.; Smeets, J. (2009). "Combining eye and hand in search is suboptimal" (PDF). Experimental Brain Research. 197 (4): 395–401. doi:10.1007/s00221-009-1928-9. PMC 2721960. PMID 19590859.
  15. ^ Bowman, M. C.; Johannson, R. S.; Flanagan, J. R. (2009). "Eye–hand coordination in a sequential target contact task". Experimental Brain Research. 195 (2): 273–283. doi:10.1007/s00221-009-1781-x. PMID 19357841.
  16. ^ Coen-Cagil, R.; Coraggio, P.; Napoletano, P.; Schwartz, O.; Ferraro, M.; Boccignone, G. (2009). "Visuomotor characterization of eye movements in a drawing task". Vision Research. 49 (8): 810–818. doi:10.1016/j.visres.2009.02.016. PMID 19268685.
  17. ^ Lazzari, S.; Mottet, D.; Vercher, J. L. (2009). "Eye–hand coordination in rhythmical pointing". Journal of Motor Behavior. 41 (4): 294–304. doi:10.3200/JMBR.41.4.294-304. PMID 19508956.
  18. ^ Ren, L.; Crawford, J. D. (2009). "Coordinate transformations for hand-guided saccades". Experimental Brain Research. 195 (3): 455–465. doi:10.1007/s00221-009-1811-8.
  19. ^ Gomi, H. (2008). "Implicit online corrections in reaching movements". Current Opinion in Neurobiology. 18 (6): 558–564. doi:10.1016/j.conb.2008.11.002.
  20. ^ a b c Jackson, S. R.; Newport, R.; Husain, M.; Fowlie, J. E.; O'Donoghue, M.; Bajaj, N. (2009). "There may be more to reaching than meets the eye: re-thinking optic ataxia". Neuropsychologia. 47 (6): 1397–1408. doi:10.1016/j.neuropsychologia.2009.01.035. PMID 19428405.
  21. ^ a b Boisseau, E.; Scherzer, P.; Cohen, H. (2002). "Eye–hand coordination in aging and in Parkinson's disease". Aging, Neuropsychology, and Cognition. 9 (4): 266–275. doi:10.1076/anec.
  22. ^ a b Jackson; Swainson, G. M.; Mort, R.; Husain, D.; Jackson, M. (2009). "Attention, competition, and the parietal lobes: insights from Balint's syndrome". Psychol. Res. 73 (2): 263–270. doi:10.1007/s00426-008-0210-2. PMID 19156438.
  23. ^ Udesen, H. (1992). "Balint's syndrome: visual disorientation". Ugeskrift for Lægerer. 154 (21): 1492–94. PMID 1598720.
  24. ^ Al-Khawaja, I. Haboubi (2001). "Neurovisual rehabilitation in Balint's syndrome". J. Neurol. Neurosurg. Psychiatry. 70 (3): 416. doi:10.1136/jnnp.70.3.416. PMC 1737281. PMID 11248903.
  25. ^ a b Bravo-Marques, J. M.; -1#Ferro, J. M. Castro-Caldas (1983). "Crossed optic ataxia: possible role of the dorsal splenium". J. Neurol. Neurosurg. Psychiatry. 46 (6): 533–9. doi:10.1136/jnnp.46.6.533. PMC 1027444. PMID 6875586.
  26. ^ a b Carlson, N.R. (2012). Physiology of behavior (11th ed.). Boston: Pearson. ISBN 978-0-205-23939-9.[page needed]

Further reading[edit]