Face ID
Face ID is a facial recognition system designed and developed by Apple Inc. for the iPhone and iPad Pro. The system allows biometric authentication for unlocking a device, making payments, and accessing sensitive data, as well as providing detailed facial expression tracking for Animoji and other features. Initially released in September 2017 with the iPhone X, it has since been updated and introduced to all new iPhone and iPad Pro models.
The Face ID hardware consists of a sensor with two modules; one projects a grid of small infrared dots onto a user's face, and another module reads the resulting pattern and generates a 3D facial map. This map is compared with the registered face using a secure subsystem, and the user is authenticated if the two faces match sufficiently. The system can recognize faces with glasses, clothing, makeup, and facial hair, and adapts to changes in appearance over time.
Face ID has sparked a number of debates about security and privacy. Apple claims it is significantly more advanced than Touch ID and has far fewer false positives in general, though Face ID has shown mixed results when trying to separate identical twins. Multiple security features largely limit the risk of the system being bypassed using photos or masks, and only one proof-of-concept attempt using detailed scans has succeeded. Debate continues over the lack of legal protections offered by biometric systems as compared to passcode authentication in the United States. Privacy advocates have also expressed concern about third-party app developers' access to "rough maps" of user facial data, despite rigid requirements by Apple of how developers handle facial data.
History
Apple announced Face ID during the unveiling of the iPhone X on September 12, 2017.[1] The system was presented as the successor to Touch ID, Apple's previous fingerprint-based authentication technology embedded in the home button of the iPhone 8 and earlier devices.[2] On September 12, 2018, Apple introduced the iPhone XS and XR with faster neural network processing speeds, providing a significant speed increase to Face ID. On October 30, 2018, Apple introduced the third generation iPad Pro, which brings Face ID to the iPad and allows face recognition in any orientation.[3]
Technology
Face ID is based on a facial recognition sensor that consists of two parts: a dot projector module that projects more than 30,000 infrared dots onto the user's face, and an infrared camera module that reads the pattern.[4] The pattern is encrypted and sent to a local "Secure Enclave" in the device's CPU to confirm a match with the registered face.[5][6] The stored facial data is a mathematical representation of key details of the face, and it is inaccessible to Apple or other parties.[5] To avoid involuntary authentication, the system requires the user to open their eyes and look at the device to attempt a match, although this can be disabled through an accessibility setting.[5] Face ID is temporarily disabled and the user's passcode is required after 5 unsuccessful scans, 48 hours of inactivity, restarting the device, or if two of the device's side buttons are held briefly.[7]
Apple claimed the probability of someone else unlocking a phone with Face ID is 1 in 1,000,000 as opposed to Touch ID at 1 in 50,000.[2][8] During initial setup, the user's face is scanned several times from a number of angles to create a complete reference map. As the system is used, it learns about typical variations in a user's appearance, and will adjust its registered face data to match aging, facial hair growth, and other changes. The system will recognize a face wearing hats, scarves, glasses, many sunglasses,[9] facial hair or makeup.[10] It also works in the dark by invisibly illuminating the whole face with a dedicated infrared flash module.[11]
Authentication with Face ID is used to enable a number of iOS features, including unlocking the phone automatically on wake, making payments with Apple Pay, and viewing saved passwords. Apps by Apple or third party developers can protect sensitive data with a system framework; the device will verify the user's identity and return success or failure without sharing face data with the app. Additionally, Face ID can be used without authentication to track over 50 aspects of a user's facial expression and positioning, which can be used to create live effects such as Animoji or camera filters.
Issues
Twins and close relatives
Inconsistent results have been shown when testing Face ID on identical twins, with some tests showing the system managing to separate the two,[12] while other tests have failed.[13] The system has additionally been fooled by close relatives.[14] Apple states that the probability of a false match is different for twins and siblings, as well as children under 13 years of age, as "their distinct facial features may not have fully developed".[15]
Law enforcement access
Face ID has raised concerns regarding the possibility of law enforcement accessing an individual's phone by pointing the device at the user's face.[16] United States Senator Al Franken asked Apple to provide more information on the security and privacy of Face ID a day after the announcement,[17] with Apple responding by highlighting the recent publication of a security white paper and knowledge base detailing answers.[18][19]
The Verge noted that courts in the United States have granted different Fifth Amendment rights in the United States Constitution to biometric unlocking systems as opposed to keycodes. Keycodes are considered "testimonial" evidence based on the contents of users' thoughts, whereas fingerprints are considered physical evidence, with some suspects having been ordered to unlock their phones via fingerprint.[20]
Infiltration
Many people have attempted to fool Face ID with sophisticated masks, though most have failed.[21] In November 2017, Vietnamese security firm Bkav announced in a blog post that it had created a $150 mask that successfully unlocked Face ID, but WIRED noted that Bkav’s technique was more of a "proof-of-concept" rather than active exploitation risk, with the technique requiring a detailed measurement or digital scan of the iPhone owner’s face, putting the real risk of danger only to targets of espionage and world leaders.[22][23]
Third-party developers
If the user explicitly grants a third-party app permission to use the camera, the app can also access basic facial expression and positioning data from Face ID for features such as precise selfie filters or game characters mirroring real-world user facial expressions. The data accessible to third parties is not sufficient to unlock a device or even identify a user, and Apple prohibits developers from selling the data to others, creating profiles on users, or using the data for advertising. The American Civil Liberties Union and the Center for Democracy and Technology raised privacy questions about Apple’s enforcement of the privacy restrictions connected to third-party access, with Apple maintaining that its App Store review processes were effective safeguards. Jay Stanley, a senior policy analyst with the ACLU, has stated that the overall idea of letting developers access sensitive facial information was still not satisfactorily handled, with Stanley telling Reuters that "the privacy issues around of the use of very sophisticated facial recognition technology for unlocking the phone have been overblown. The real privacy issues have to do with the access by third-party developers".[24][25]
See also
References
- ^ Savov, Vlad (September 12, 2017). "iPhone X announced with edge-to-edge screen, Face ID, and no home button". The Verge. Vox Media. Retrieved December 13, 2017.
- ^ a b Tepper, Fitz (September 12, 2017). "Face ID is replacing Touch ID on the new iPhone X". TechCrunch. Oath Inc. Retrieved December 13, 2017.
- ^ "Apple's new iPad Pro has Face ID, USB-C, and slimmer bezels than ever before". The Verge. Retrieved 2018-11-20.
- ^ Kubota, Yoko (September 27, 2017). "Apple iPhone X Production Woe Sparked by Juliet and Her Romeo". The Wall Street Journal. Archived from the original on September 28, 2017. Retrieved September 27, 2017.
{{cite news}}
: Unknown parameter|dead-url=
ignored (|url-status=
suggested) (help) - ^ a b c Brandom, Russell (September 12, 2017). "The five biggest questions about Apple's new facial recognition system". The Verge. Vox Media. Archived from the original on November 15, 2017. Retrieved November 9, 2017.
{{cite web}}
: Unknown parameter|deadurl=
ignored (|url-status=
suggested) (help) - ^ Ng, Alfred (September 27, 2017). "Is Face ID secure? Apple takes on lingering questions". CNET. CBS Interactive. Archived from the original on October 2, 2017. Retrieved November 9, 2017.
{{cite web}}
: Unknown parameter|deadurl=
ignored (|url-status=
suggested) (help) - ^ Panzarino, Matthew (September 15, 2017). "Interview: Apple's Craig Federighi answers some burning questions about Face ID". TechCrunch. Oath Inc. Retrieved December 13, 2017.
- ^ Warren, Tom (October 25, 2017). "Apple's Face ID struggles detailed in new iPhone X report". The Verge. Vox Media. Retrieved December 13, 2017.
- ^ Clover, Juli (September 13, 2017). "Apple's New Face ID Biometric System Works in the Dark and When Your Face is Obscured by Hats and Beard". MacRumors. Retrieved December 13, 2017.
- ^ Clover, Juli (September 14, 2017). "Apple's Face ID Feature Works With Most Sunglasses, Can Be Quickly Disabled to Thwart Thieves". MacRumors. Retrieved December 13, 2017.
- ^ Heisler, Yoni (November 3, 2017). "Infrared video shows off the iPhone X's new Face ID feature in action". BGR. Penske Media Corporation. Retrieved December 19, 2017.
- ^ Ocbazghi, Emmanuel (October 31, 2017). "We put the iPhone X's Face ID to the ultimate test with identical twins — and the results surprised us". Business Insider. Axel Springer SE. Retrieved December 4, 2017.
- ^ Ulanoff, Lance (October 31, 2017). "The iPhone X can't tell the difference between identical twins". Mashable. Retrieved December 4, 2017.
- ^ Deahl, Dani (November 14, 2017). "This 10-year-old was able to unlock his mom's iPhone using Face ID". The Verge. Vox Media. Retrieved December 13, 2017.
- ^ Hall, Zac (September 27, 2017). "Apple explains how iPhone X facial recognition with Face ID works (and fails) in security paper". 9to5Mac. Retrieved December 13, 2017.
- ^ Kircher, Madison Malone (September 12, 2017). "Yes, You Can Unlock the New iPhone With Your Face. Here's How It Works". Select All. New York. Archived from the original on October 13, 2017. Retrieved November 9, 2017.
{{cite web}}
: Italic or bold markup not allowed in:|publisher=
(help); Unknown parameter|deadurl=
ignored (|url-status=
suggested) (help) - ^ Romm, Tony (September 13, 2017). "Apple is facing questions from the U.S. Senate on the privacy protections in iPhone X and Face ID". Recode. Vox Media. Archived from the original on November 10, 2017. Retrieved November 9, 2017.
{{cite web}}
: Unknown parameter|deadurl=
ignored (|url-status=
suggested) (help) - ^ Lomas, Natasha (October 17, 2017). "Apple responds to Senator Franken's Face ID privacy concerns". TechCrunch. Oath Inc. Archived from the original on November 9, 2017. Retrieved November 9, 2017.
{{cite web}}
: Unknown parameter|deadurl=
ignored (|url-status=
suggested) (help) - ^ Shah, Saqib (October 18, 2017). "Apple responds to Sen. Al Franken's Face ID concerns in letter". Engadget. Oath Inc. Archived from the original on November 10, 2017. Retrieved November 9, 2017.
{{cite web}}
: Unknown parameter|deadurl=
ignored (|url-status=
suggested) (help) - ^ Robertson, Adi (September 12, 2017). "Why Face ID won't give you the legal protection of a passcode". The Verge. Vox Media. Retrieved December 4, 2017.
- ^ Greenberg, Andy (November 3, 2017). "We tried really hard to beat Face ID - and failed (so far)". Wired. Condé Nast. Retrieved December 4, 2017.
- ^ Greenberg, Andy (November 12, 2017). "Hackers say they've broken Face ID a week after iPhone X release". Wired. Condé Nast. Retrieved December 4, 2017.
- ^ Ong, Thuy (November 13, 2017). "This $150 mask beat Face ID on the iPhone X". The Verge. Vox Media. Retrieved December 4, 2017.
- ^ Nellis, Stephen (November 2, 2017). "App developer access to iPhone X face data spooks some privacy experts". Reuters. Thomson Reuters. Retrieved December 4, 2017.
- ^ Statt, Nick (November 2, 2017). "Apple will share face mapping data from the iPhone X with third-party app developers". The Verge. Vox Media. Retrieved December 4, 2017.