Hearables or Smart headphones are technically advanced, electronic in-ear-devices designed for multiple purposes ranging from wireless transmission to communication objectives, medical monitoring and fitness tracking. Hearables are therefore a manifestation of the concept of ubiquitous computing.
The neologism "hearable" is a hybrid of the terms wearable and headphone, as hearables combine major assets of wearable technology with the basic principle of audio-based information services, conventional rendition of music and wireless telecommunication. The term was introduced in April 2014 simultaneously by Apple in the context of the company's acquisition of Beats Electronics and product designer and wireless application specialist Nick Hunn in a blogpost for a wearable technologies internet platform.
Hearables are often referenced as a subset of wearables. Sometimes the terms "smart headphones" or "smart advisors" are also used to denominate hearables. It is also noteworthy that the term "hearable" is occasionally used with a stronger focus on the primary communication pattern rather than its physical implementation. In this sense news agency Reuters in its "Journalism media and technology predicitions 2015" ranked voice driven virtual assistants in general as an important field of innovation, including voice recognition software like Apple's Siri, Amazon's Echo, or Me-OS on Vinci headphones.
Concept and use
The first description of a wearable ear-worn multimedia platform for health monitoring, heart rate monitoring, entertainment, guidance, and cloud-based communications was described by Valencell in 2006. Current advancements in the development of hearables aim at feature integration, size reduction, and covering a diverse range of applications. Controlled by touch, movement, thought or voice (or any combination of the mentioned control mechanisms) these miniaturized in ear computers are designed primarily for the purposes of mobile communication, real time information services, activity tracking and various monitoring applications focussing on the wearers health conditions and body performance, mostly in combination with a wireless media player. The concept of hearables thus strongly follows an holistic technological approach, targeting (at least in the long run) the consolidation of different major state of the art communication and information technologies in one single device, discreetly concealed in a small earbud. Among the predominant future uses intended for hearables are therefore advisory services currently only provided by conventional web applications (weather forecasts, news blogs, proximity searches) or by dedicated devices (such as stand alone route planners), while current developments strongly focus on the implementation of hearables as health monitors, Activity Trackers and fitness trackers.
The hardware architecture of "Hearables" or "Smart Headphones" typically comprises
- Speakers, to convert analog signals to sound
- Bluetooth IC, to communicate with other devices typically a smartphone
- Sensors, to track heart rate, cadence, or to detect proximity
- Microphones, to take or make phone calls, or take voice commands
Most of the "Hearables" seen to date are Bluetooth devices that use phones or PCs as the central computing unit. Vinci smart headphones, announced in 2016, incorporated a dual-core CPU, local storage, WiFi and 3G connectivity that allow users to use without a phone.
One important benefit of placing the entire interaction unit in-ear and addressing users purely through acoustic signals is the lower grade of overall distraction compared to vision based augmented reality tools or wearables with tactile signal, measuring and interaction mechanismns. At the same time acoustic warning signals – for example in case of an otherwise unnoticed medical crisis – are, as experiments have shown, more effective and immediate than visual indicators. Furthermore, the measurement of biometric data such as temperature, heart rate or oxygen saturation can be monitored through via PPG with significantly higher reliability and better response times through in ear monitoring than contact devices placed on wrist or torso.
A substantial amount of research around hearables is dedicated to aiding the hearing impaired and the increasing number of elderly people struggling with conventional input/output devices such as keyboard, mouse or touchscreen, as it is reflected for instance by the recent cooperation between the EHIMA (European Hearing Industry Manufacturer's Association) and the Bluetooth Special Interest Groupworks on the enhancement of conventional hearing aids by applying the newest bluetooth generation for additional streaming of music, telecommunication and audio notifications. The European Commission has initiated a similar research project in mid 2013, with a projected runtime until summer 2016. This so-called "AAL Joint Programme" also involves the "Austrian Ministry of Traffic, Innovation and Technology", the Austrian Society for Research Funding and several privately owned technology companies. A somewhat more ambitious project is the inclusion of EEG in hearables, making it an example of ear-EEG.
Most systems in development are designed for binaural use and share a basic set of desired functionalities. Currently the deployment of hearables is on the agenda of many consumer technology manufacturers. The first hearable product to enter the marketplace was the iriverON Bluetooth headset, launched in late 2013, which integrated biometric sensor technology into a Bluetooth audio headset. Other biometric have since followed in the market, including the Jabra Sport Pulse, the Sony B-Trainer, the LG HR Earphone, and other biometric Bluetooth headsets. The core technology behind these products has been independently validated by Duke University. In the summer of 2014 "Earin", a headphone firm based in Lund (Sweden), started a crowdfunding campaign for their "Minuscule" earbuds, claiming them to become the smallest in ear headphones ever.Earin the Truly Wireless Earbuds</ref></ref> However, the design details known as of today hint at „Minuscule“ being deployed as bluetooth headphones and as such the earbuds will not completely comply with the definition of hearables in a broader sense. If they are to be seen as but an interim stage in the development of a multi-purpose in ear-piece is yet uncertain. A similar approach was chosen by headphone company OwnPhones, which is currently working on wireless, Bluetooth triggered earbuds, which can be fitted individually to the user's ear by a smartphone based measuring application triggering a 3D-printing device. The earphones will be fully compatible with all major smartphone and tablet manufactures as well as notebooks and desktop computers. However an independent use of the earbuds is not yet projected, OwnPhones-earbuds will, for now, be controlled by primary electronic devices.
Apart from "Earin" and "Ownphones," the Munich-based technology company Bragi has advertised developments towards truly wireless smart earphones according to different publications such as Wired Magazine (10/2014), the Dutch daily newspaper De Telegraaf, and The Huffington Post. In early 2014 "Bragi" set up a crowdfunding campaign for "The Dash", claiming to realize the world’s first wireless performance tracking earbud which would eventually become the most successful crowd-sourcing campaign in Europe to date with a total revenue of roughly 3.3 million dollars. "The Dash", which according to public company announcements will reach start of production in autumn 2015, is projected to enable wearers to listen to music while tracking physical activity (speed, time, distance, cadence, elevation gain, etc.) and at the same time measure key data on body performance (heart rate, energy turnover, oxygen saturation, etc.). In January 2015 "The Dash" was awarded the "Innovation Award" of the CES (Consumer Electronic Show). held in Las Vegas. The preceding CES had already witnessed the release of LG's "Heart Rate Earphones", a device that connects wirelessly to the company's product "Lifeband Touch" and arbitrary smart devices via a "data processing medallion", which is attached to the earpieces applying a conventional wire connection.
Already in autumn 2014 "FreeWavz" was announced, a bluetooth triggered headset developed by Florida-based ENT physician and fitness enthusiast Dr. Eric Hensen. The earpieces can be controlled independently and give acoustic updates on heart rate, oxygen saturation, calories burned, distance, speed and duration. However, unlike the approach chosen by Bragi, the FreeWavz headphones as yet fully depend on the interlinking with a smartphone or tablet via a dedicated app.
Several other companies are currently also investing development capacities in hearables. Among them are "Elbee", "Waverly Labs" and "Motorola", who with the "Moto Hint" already offer a hands-free, voice controlled earbud for bluetooth enabled smartphones.
In May 2014 the British daily newspaper The Guardian reported on an information leak claiming that Apple Inc. had recently started to break into the wearables market by equipping their standard headphones with health monitoring features. However the article uncovered the unofficial source's information as totally fabricated. In September 2016, Apple made several announcements that could further propel the hearables market. One was the removal of the 3.5mm audio jack from the iPhone, which was denigrated by many. However, it fundamentally changed the dynamics of the market for wireless headphones. Two additional announcements were a new wireless chip allowing them to enter the world of hearables by launching their own brand of earbuds, known as Airpods.
A company, "United Sciences", founded in 2009, has developed a digital ear scanner which is used to make custom shaped hearables. Every individual has differently shaped ears and a custom shaped hearable provides comfort for long term wear. They are rumored to have partnered with Google to develop custom shaped hearable for measuring pulse oxygenation, EEG, heart rate and for Brain computer interface.
In November, 2016, Vinci smart headphones were first seen on Kickstarter and successfully raised nearly $1M. The Vinci smart headphones integrate AI virtual assistant that manages users' music requests and other online services such as Spotify, Amazon Music, navigation on maps and search on Wiki. It also supports direct call for Amazon Alexa for voice services. It is the first of kind that combines a HiFi music player, a 32G local storage, voice recognition, activity tracking and biometric sensors (like heart rate). The Vinci smart headphones use a combination of touch, gesture and voice to provide a streamlined music listening experience. Vinci headphones carry an internal dual-core CPU thus no phones are needed when users go for a run or work out in a gym.
The NPD Group, which tracks retail sales in the US, has reported in June 2016 that the overall value of wireless headphone sales in the US overtook that of wired headphones, paving the way for a major hearable explosion. Now more than 50 hearable devices exist or are in crowdfunding stages to be brought to market.
- Nick Hunn: "Hearables – The new Wearables", Wearable Technologies online (April 4, 2014)
- Nic Newman: "Journalism media and technology predicitions 2015", Reuters Institute online (January 12, 2015)
- UberGizmo. "Vinci Smart Hearable Reinvents Headphones". ubergizmo.com.
- Pankaj Avhad: Hearables the new wearables in Healthcare using context n capture, article retrieved October 10th 2015
- Kickstarter. "Vinci - First Smart Headphones with Artificial Intelligence".
- Engadget. "Vinci's smart headphones play music, no phone required".
- Dieter Klebelsberg: Verkehrspsychologie, Berlin | Heidelberg | New York 1982, p. 83 [German] (with references to "Robert S. Woodworth" | Harold H. Schlosberg: Experimental Psychology (1954))
- Nick Hunn: "Hearables the new Wearables", Wearable Technology online (April 4, 2014)
- Scott Snyder (Senior Fellow MACK Institute for Innovation Management, University of Pennsylvania): "The ear happens to be a good place to pick up blood flow as it moves consistently in and out of the ear, and the membrane is relatively thin. We can pick up heart rate, blood flow and even oxygen levels at an accuracy rate comparable to the chest strap." Quoted from: "Are Hearables the next big thing in fitness?", US News and World Report online (April 8, 2014)
- On the high accuracy of estimates on total energy expenditure and oxygen consumption during exercise through in ear devices also see: Steven Francis Leboeuf | Michael E. Aumer | William E. Kraus | Johanna L. Johnson | Brian Duscha: Earbud-based sensor for the adjustment of energy expenditure, HR and VO2 Max, in: Medicine & Science in Sport & Exercise, Vol. 46, Issue 5 (May 2014), pp. 1046–1052
- An overview on the advantages of in ear health monitoring is also given by: O. Brodersen | D. Römhild | D. Starke | A. Steinke & S. Vogel: In-Ear acquisition of vital signs discloses new chances for preventous continuous cardiovascular monitoring, in: IFMBE Proceedings, Vol. 13 (4th International Workshop on Wearable and Implantable Body Sensor Networks), Berlin | Heidelberg | New York 2007, pp. 189-194, particularly p. 189
- Homepage EHIMA
- "Bluetooth SIG and EHIMA Partner to Advance Hearing Instrument Technology to Improve the Lives of the Hearing Impaired", bluetooth.com (April 12, 2014)
- Homepage AAL Joint Programme
- Austrian Ministry of Traffic, Innovation and Technology
- Austrian Society for Research Funding
- Lutz Reum: "Wearables: Hype oder nützliches Gimmick?", "Deutsches Ärzteblatt Supplement" online [German] (2015)
- Leboeuf, SF; Aumer, ME; Kraus, WE; Johnson, JL; Duscha, B (2014). "Earbud-based sensor for the assessment of energy expenditure, HR, and VO2max". Med Sci Sports Exerc. 46: 1046–52. doi:10.1249/MSS.0000000000000183. PMC 3996514. PMID 24743110.
- Manufacturer's homepage
- Manufacturer's homepage: "OwnPhones"
- Company Website of OwnPhones
- Manufacturer's homepage
- Stephen Brown: "Wearable fatigue? Stick it in your ear", "Wired Magazine" online (October 2014)
- "Kleinere sensoren laten wearables verdwijnen", "De Telegraaf" online (May 1, 2015)
- "The Dash: Die Kopfhörer der Zukunft sind das erfolgreichste Crowdfunding-Projekt Europas", "The Huffington Post" online [German] (February 2, 2014)
- Also see Nyshka Chandran: "Hearables – the next big thing in wearable tech", "CNBC" online (December 29, 2014)
- "Crowdfunding platform kickstarter.com"
- "Bragi’s The Dash wins CES Best of Innovation Award 2015 (PDF)" Archived 2015-04-19 at the Wayback Machine (November 1, 2014)
- Samuel Gibbs: "CES 2014: the best wearable smartwatches and fitness gadgets", "The Guardian" online (January 7, 2014)
- Manufacturer's homepage: FreeWavz
- For details see Randy Rieland: "These Ear Buds Will Play Music and Track Your Heart Rate", "The Smithsonian Institution Magazine" online (August 11, 2014)
- Manufacturers homepage: Elbee Archived 2015-08-21 at the Wayback Machine
- Manufacturer's homepage: Waverly Labs
- Manufacturer's homepage: Motorola
- Charles Arthur: "Apple's next headphones to track heart rate and blood pressure, leak claims", The Guardian online (May 1, 2014)
- Company homepage: / United Sciences
- Press article : / Project Aura updates
- "VINCI smart headphones". Kickstarter.
- Slash Gear. "Vinci smart headphones offer Alexa and standalone Spotify".
- UberGizmo. "Vinci Smart Hearable Reinvents Headphones".
- Wareable. "Vinci smart headphones: Would you wear these to play music without your phone?".
- Engadget. "Vinci's smart headphones play music, no phone required".
- Nick Hunn: "The Market For Hearables 2016-2020"
- Rachel Feltman: "The next big thing in wearables may be ear computers", from "Quartz" (April 10, 2014)
- Hearing Healthcare, What Effect Hearables?, from http://justaudiologystuff.com (January 9, 2015)
- David Z. Morris: "Forget the iWatch. Headphones are the original wearable tech", Fortune Magazine (June 24, 2014)
- Jen Quinlan: "Hearables and Energy harvesting. Oh my.", from mutualmobile (July 17, 2014)
- Article from the online edition of German weekly newspaper "Der Spiegel" (July 16, 2014): SMS Audio Biosport: Diese Kopfhörer schauen aufs Herz (German)
- "The year of the Hearable", from wearables.com (September 24, 2014)
- Amir Khan: "Are 'Hearables' the next big thing in fitness?", from U.S. News and world report (October 8, 2014)
- Luigi Lugmayr: "Hearables are biggest threat to Apple watch", from I4U News (January 13, 2015)