Categories: MobilitySmartphones

Apple Using Face ID Data For Far More Than Unlocking Your iPhone

When I look at my iPhone X that glance alone is usually enough to unlock the phone so I can use it. Apple has created Face ID as a way to identify me by my face alone using 30,000 infrared dots projected on my face to create a 3D digital model, which the phone uses to compare with my actual face when it’s time to unlock the phone again.

Apple has said that Face ID has a million to one chance of making an incorrect identification, except in unusual situations. Those situations, as we’ve seen on a regular basis include identical twins, parents and their children and even a mask created for that purpose.

While Face ID may be more secure than its predecessor, Touch ID that used fingerprints, it’s not infallible.

Face ID

Now, Apple has begun sharing the Face ID data with app developers who can then use it for a variety of purposes that might make use of your face, or the data that represents your face. Initially, Face ID was largely used in apps in the same way that Apple used it with iOS and its own apps, which was to use it as an alternate to a pass code. If you have an iPhone X, you’ve probably noticed that it can now use Face ID to provide access to your banking or shopping apps.

But the Face ID data can be accessed and used for other purposes as well. You can run an app that creates live emojis, for example. There are a few augmented reality apps that are starting to use your facial data to make characters that look like you. But the potential is far greater.

The data that Apple provides includes a wireframe representation of your face and it includes detailed data on your facial expressions in real time (which is how you create those emojis). To get an idea what the wireframe is, imagine if you drew a line between each of those 30,000 infrared dots projected by the Face ID Dot Projector. What you’d have is a contour map of your face.

Apple allows app developers to download the map of your face and store it on their own servers, along with the data that represents your expressions. The idea is to use the Face ID camera and data to provide input to a wide variety of apps for any number of different functions. And herein lies the rub when it comes to personal privacy.

Your face, even in wireframe, and your expressions expressed as data, could be seriously valuable to marketers, because knowledge of micro-expressions is a good indicator of your emotions. A marketer could tell in a second or two whether you liked a specific product or not. Effectively, you can be sharing your emotions with someone without realizing it.

If you’d like to see exactly what the facial data that Apple provides to app developers looks like, download an app called MeasureKit from the App Store. Measure Kit is actually designed to be an AR measuring tool and it’s surprisingly useful for that. But one of the things it will measure is your face, and the micro expressions that go with it. The result is a wireframe image of the data representing your face.

But, the privacy concerns go far beyond that. Geoffrey Fowler writes in The Washington Post of potential misuse of this information to discern your health, gender and perhaps even your sexual orientation, your mood and state of mental health.

Does IoT security concern you?

  • Yes (89%)
  • No (11%)

Loading ...

AI Future

While that’s not being done yet, it appears that this data coupled with artificial intelligence and machine learning could indeed peer deeply within a person.

But there’s another risk as well and that’s security. While Apple has said many times, defeating Face ID is highly unlikely, suppose you have that wireframe representation of a person’s face? Could that data, along with the expression data, provide enough information to 3D print a mask and give it realistic movement? If so, would it be good enough to fool Face ID?

The problem with the facial data that Apple provides is that it has to be good enough to be useful to app developers. But that also means it’s probably good enough to be misused. It’s not hard to imagine an app that transmits the wireframe and expression data to a server, perhaps for more app development or other research. But then, supposed that hackers gain access to that data?

While Apple has policies that limit what developers and others can do with the Face ID data, that doesn’t mean those developers will pay attention to those rules. You can be sure that a malicious hacker who gets that data isn’t going to be paying attention to Apple’s rules.

Unfortunately, Apple doesn’t really have a way to set security standards for storing the Face ID data that developers get, but even if they do, keeping hackers from getting it will be problematic.

So the question that needs to be asked is what to do about protecting that data? Does Apple have a way to require that it be encrypted or otherwise protected and if it does, will there be a means of enforcement?

These are questions that Apple and its developers need to answer and questions that users of such data need to find answers for.

Originally published on eWeek

Quiz: What do you know about the iPhone?

Wayne Rash

Wayne Rash is senior correspondent for eWEEK and a writer with 30 years of experience. His career includes IT work for the US Air Force.

Recent Posts

Boeing Starliner Launches Successfully, On Route To International Space Station

Boeing's crewless space taxi, CST-100 Starliner, one step closer to NASA certification, as it enters…

2 days ago

Apple Accused By Union Of Staff Law Violations At NY Store

Staff at Apple's World Trade Centre store in New York are allegedly being questioned and…

2 days ago

Canada To Join Five Eyes 5G Ban On Huawei/ZTE

Making it official. Canada is to turn its unofficial ban on 5G kit from Huawei…

2 days ago

Twitter To Hide Tweets That Share False Information During A Crisis

Potentially risking Elon's wrath over free speech, Twitter says it will hide tweets spreading misinformation…

2 days ago

Boeing Starliner Test Flight Readied For Tonight

Third time the charm? Main rival to SpaceX's Dragon capsule, the embattled Boeing Starliner spacecraft,…

2 days ago

September 13 Slated For iPhone 14 Launch – Report

No surprise there. Apple is slated to launch the iPhone 14 on 13 September according…

2 days ago