Touch user interface
A touch user interface (TUI) is a computer-pointing technology based upon the sense of touch (haptics). Whereas a graphical user interface (GUI) relies upon the sense of sight, the TUI enables not only the sense of touch to innervate and activate computer-based functions, it also allows the user, particularly those with visual impairments, an added level of interaction based upon tactile or Braille input.
Generally, the TUI requires pressure or presence with a switch located outside of the printed paper. Not to be confused with electronic paper endeavors, the TUI requires the printed pages to act as a template or overlay to a switch array. By interacting with the switch through touch or presence, an action is innervated. The switching sensor cross-references with a database. The database retains the correct pathway to retrieve the associated digital content or launch the appropriate application.
TUI icons may be used to indicate to the reader of the printed page what action will occur upon interacting with a particular position on the printed page.
Turning pages and interacting with new pages that may have the same touch points as previous or subsequent pages, a z-axis may be used to indicate the plane of activity. Z-axis can be offset around the boundary of the page. When the unique z-axis is interacted with, x,y-axis can have identical touch points as other pages. For example, 1,1,1 indicates a z-axis of 1 (page 1) and the x,y-axis is 1,1. However, turning the page and pressing a new z-axis, say page 2, and then the same x,y-axis content position as page 1, gains the following coordinate structure: 2,1,1.
An integrated circuit (IC) is located either within the printed material or within an enclosure that cradles the printed material. This IC receives a signal when a switch is innervated. The firmware located within the IC communicates via Universal Serial Bus (USB) either connected to a cable, or using a wireless protocol adapter to a reference database that can reside on media within a computer or appliance. Upon receipt of the coordinate structure from the firmware, the database correlates the position with a pre-determined link or pathway to digital content or execution command for an application. After correlating the link with the pathway, a signal is sent to retrieve and render the terminal of the path.
Implications for use
The TUI technology has some interesting implications. For example, it can provide a solution similar to Public key infrastructure (PKI) where the printed page and its associated database serve as a digital rights management (DRM) solution without the need for usernames, passwords, or digital certificates. Presumably, if readers have the printed page and the technology, they are entitled to access the referenced and linked digital content.
The TUI technology may also be a facilitator for bridging the digital divide. Those with special requirements can use touch with fingers or pointer to gain access to the digital environment. Typing, currently a traditional method for accessing the digital world, can be replaced for users who are missing fingers or are not capable of typing. Touching a link on printed paper takes advantage of the ubiquitous presence of printed paper while it removes barriers of entry to the digital world. Further, removing the need to type pathways removes errors from the entry process, potentially protecting companies and organizations that have potential users going to a cybersquatting site due to a misspelling. Typing is also time consuming. A touch interface provides a reduction in time to get where the reader wants to go in the digital world.
The coupling of printed advertising with online advertising is promising. A reader can touch a printed advertisement and connect directly to the online experience provided by the advertiser. This can include initiating a Voice over Internet Protocol (VoIP), Instant Messaging (IM), or Electronic Mail (e-mail) by simply touching the page. Further, electronic commerce (e-commerce) transactions can be initiated and completed with the TUI. This type of interaction can also exist in the Television Commerce (tcommerce) space with a magazine, catalog, or television guide.
The TUI technology applied to the printed world serves to converge the printed world with the digital world. This provides an alternative to the either print or digital paradigm shift currently experienced by today's users. It also serves to facilitate the vast majority of the world's peoples to a linguistic and culturally non-specific experience that can provide an on-ramp to the digital world.
In the United States, legislation took effect in December 2006, that requires educational publishers in the K-12 education industry to provide a National Instructional Materials Accessibility Standard (NIMAS). In essence, educational publishers must provide an inclusive experience to those students who are blind. If they are unable to provide this experience, they are required to provide the digital content source files to a clearing house that will convert the materials into an accessible experience for the student. The TUI has the promise of enabling the publishers to maintain control of their content while providing an inclusive, tactile, or Braille experience to students who are visually impaired. Further, using a Braille approach may serve to help enhance Braille literacy while meeting the mandates of NIMAS.
- Gesture recognition
- Human-Computer Interaction
- Multi-touch gestures
- Natural User Interface
- Surface Computing
- Golshani, Forouzan, TUI or GUI -- It's a Matter of Somatics, IEEE Computer Society 2007
- Mott, M.S. and Benus, M.A., Digital Books with Media-rich Paper: Enhancing Reading Comprehension through Touch User Interface Technology The Journal of Literacy and Technology, Volume 7, Number 2, 2006
- Mott, M., & Barkeloo, J., Developmental Phonics Instruction with Touch User Interface Technology: Moving Toward a Multi-Sensory Approach for Grades Pre-K-2, Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2004 (p. 1395). Norfolk, VA: AACE., 2004
- Bartholow, J.M., Touch Screen Web Interface: 2008