An EyeTap is a device that is worn in front of the eye that acts as a camera to record the scene available to the eye as well as a display to superimpose computer-generated imagery on the original scene available to the eye. This structure allows the user's eye to operate as both a monitor and a camera as the EyeTap intakes the world around it and augments the image the user sees allowing it to overlay computer-generated data over top of the normal world the user would perceive. The EyeTap is a hard technology to categorize under the three main headers for wearable computing (constancy, augmentation, mediation) for while it is in theory a constancy technology in nature it also has the ability to augment and mediate the reality the user perceives.
In order to capture what the eye is seeing as accurately as possible, an EyeTap uses a beam splitter to send the same scene (with reduced intensity) to both the eye and a camera. The camera then digitizes the reflected image of the scene and sends it to a computer. The computer processes the image and then sends it to a projector. The projector sends the image to the other side of the beam splitter so that this computer-generated image is reflected into the eye to be superimposed on the original scene. Stereo EyeTaps modify light passing through both eyes, but many research prototypes (mainly for reasons of ease of construction) only tap one eye.
An EyeTap is somewhat like a head-up display (HUD). The important difference is that the scene available to the eye is also available to the computer that projects the head-up display. This enables the EyeTap to modify the computer generated scene in response to the natural scene. One use, for instance, would be a sports EyeTap: here the wearer, while in a stadium, would be able to follow a particular player in a field and have the EyeTap display statistics relevant to that player as a floating box above the player. Another practical use for the EyeTap would be in a construction yard as it would allow the user to reference the blueprints, especially in a 3D manner, to the current state of the building, display a list of current materials and their current locations as well perform basic measurements. Or, even in the business world, the EyeTap has great potential, for it would be capable of delivering to the user constant up to date information on the stock market, the user's corporation, and meeting statuses. On a more day-to-day basis some of Steve Mann's first uses for the technology was using it to keep track of names of people and places, his to-do lists, and keeping track of his other daily ordeals. The EyeTap Criteria[clarification needed] are an attempt to define how close a real, practical device comes to such an ideal. EyeTaps could have great use in any field where the user would benefit from real-time interactive information that is largely visual in nature. This is sometimes referred to as computer-mediated reality, commonly known as augmented reality.
Eyetap has been explored as a potential tool for individuals with visual disabilities due to its abilities to direct visual information to parts of the retina that function well. As well, Eyetap's role in sousveillance has been explored by Mann, Jason Nolan and Barry Wellman.
Possible side effects
Users may find that they experience side effects such as headaches and difficulty sleeping if usage occurs shortly before sleep. Mann finds that due to his extensive use of the device that going without it can cause him to feel "nauseous, unsteady, naked" when he removes it.
Cyborglogs & EyeTaps
The EyeTap has applications in the world of cyborg logging, as it allows the user the ability to perform real-time visual capture of their daily lives from their own point of view. In this way, the EyeTap could be used to create a lifelong cyborg log or “glog” of the user's life and the events they participate in, potentially recording enough media to allow producers centuries in the future to present the user's life as interactive entertainment (or historical education) to consumers of that era.
Steve Mann created the first version of the EyeTap, which consisted of a computer in a backpack wired up to a camera and its viewfinder which in turn was rigged to a helmet. Ever since this first version, it has gone through multiple models as wearable computing evolves, allowing the EyeTap to shrink down to a smaller and less weighty version.
Currently the EyeTap consists of the eyepiece used to display the images, the keypad which the user can use to interface with the EyeTap and have it perform the desired tasks, a CPU which can be attached to most articles of clothing and in some cases even a Wi-Fi device so the user can access the Internet and online data.
Principle of operation
The Eyetap functions by redirecting light from the user's eye using a diverter (the previously mentioned beam splitter) into a sensor. The sensor then processes the collected light rays and the data after having the computer image super-imposed on it is sent to the aremac, a display device capable of displaying data at any fitting depth. The output rays from the aremac are reflected off the diverter back into the eye of the user along with the original light rays.
A conceptual diagram of an EyeTap;
In these cases, the EyeTap views infrared light, as well as the overall design schematic of how the EyeTap manipulates lightrays.
- "Seattle band has already benefited by using ringtone". The Seattle Times. 18 April 2005. Retrieved 3 September 2009.
- "Why life as a cyborg is better". Daily Times. 19 January 2004. Retrieved 3 September 2009.
- Bergstein, Brian (12 January 2004). "Professor's 25 years of cyborg life mirrors tech advances". USA Today. Associated Press. Retrieved 2 September 2009.
- "The ultimate wearable computer". USA Today. 25 June 2001. Retrieved 3 September 2009.
- Grieser, Andy (20 June 2001). "Now computers are built to suit Wearable technology has a few wrinkles, but usage is expanding". Chicago Tribune. Retrieved 3 September 2009.
- "Being Steve Mann: Cyberwear pioneer alters his reality". The Atlanta Journal-Constitution. 26 March 2000. p. A17. Retrieved 3 September 2009.
- Brad King (12 March 2002). "Part Man, Part Film, All Mann". Wired.com. Retrieved 3 September 2009.
- "Cyborg genius claims he's the next step in human evolution". The Jamaica Observer. 3 September 2009. Retrieved 24 February 2013.
- Schechter, Bruce (25 September 2001). "SCIENTIST AT WORK: STEVE MANN; Real-Life Cyborg Challenges Reality With Technology". The New York Times. Retrieved 3 September 2009.
- Shinn, Eric (8 July 2001). "Part man, part machine – all nerd ; 'Wearable computer' pioneer Steve Mann keeps one eye locked on the future". Toronto Star. Retrieved 3 September 2009.
- Mann, Steve; James Fung; Chris Aimone; Anurag Sehgal; Daniel Chen. "Designing EyeTap Digital Eyeglasses for Continuous Lifelong Capture and Sharing of Personal Experiences" (PDF). EyeTap Personal Imaging Lab. Retrieved 14 March 2012.
- McCullagh, Declan (27 August 2003). "Newsmaker: Cyborgs unite!". CNET News. Retrieved 6 September 2009.
- Brian, Bergstein (15 January 2004). "Computer's eye view". CJOnline.com. Retrieved 3 September 2009.
- McCullagh, Declan (26 October 2004). "Snap photo first, answer questions later". CNET News. Retrieved 6 September 2009.
- Nolan, Jason. "Blind photographer Arun Blake consulting on Eyetap and blindness in 2004". Lemmingworks.org. Retrieved 6 September 2009.
- Butler, Don (5 February 2009). "Part VI: Everyone's watching". Ottawa Citizen. Retrieved 2 September 2009.
- Mann, Steve; Jason Nolan; Barry Wellman (2003). "Sousveillance: Inventing and Using Wearable Computing Devices for Data Collection in Surveillance Environments" (PDF). Surveillance & Society. 1 (3). ISSN 1477-7487. Retrieved 6 September 2009.
- Haines, Lester (15 January 2004). "Captain Cyborg faces Canadian challenge". The Register. Retrieved 2 September 2009.
- "EyeTap: The eye itself as display and camera". EyeTap Personal Imaging Lab. 2004. Retrieved 14 March 2012.