What Is LiDAR, and How Will It Work on the iPhone?

Apple’s first smartphone with a Light Detection and Ranging ( LiDAR) detector on the rear is the iPhone 12 Pro. But what is LiDAR, and what are Apple’s plans to use it in the future?

What is LiDAR?

Image credits: Apple

A LiDAR scanner quantifies the distance between itself and an object. This is done by checking the amount of time required for a pulse of light to reflect. This light pulse is regularly a laser. That is like radar, but it uses infrared light instead of radio waves.

Though radar is intended to be used over wide distances, LiDAR performs on a smaller scale. That’s due to the way objects in its path absorb light. LiDAR scanners can figure out distances and target sizes with relative precision over short distances. This is done by transmitting hundreds of thousands of light pulses per second.

This knowledge will then be used to create 3D models. This is one of LiDAR’s key applications in building and engineering projects. You’ve also heard of 3D laser scanning being used to draw up LiDAR construction plans.

In reality, LiDAR has many applications in almost all industries. It is used by archaeologists to plan excavation sites. Autonomous vehicles rely on it to create 3D real-time maps of their world. LiDAR has also been used in computer games to create extremely realistic and precise maps of racing tracks. LiDAR is even used for police speed weapons.

And now, much like the iPad Pro in March 2020, Apple’s flagship iPhone 12 Pro has earned a LiDAR scanner.

Usage of LiDAR in the iPhone 12 Pro

LiDAR is used a bit differently by Apple than a building site or speed gun. It’s the same underlying idea, but on a smaller scale: bouncing light to determine size. The iPhone 12 Pro (and iPad Pro) LiDAR scanner has an effective range of about 5 meters (16 feet).

The primary aim of the iPhone’s LiDAR is to enhance the application of augmented reality ( AR). A faster, more accurate AR will give apps more helpful and detailed details about their world.

AR helps developers to fuse abstract objects and the physical world if you’re unfamiliar with the technology. It uses your smartphone camera. This helps you play games and add immersive filters (such as those on Snapchat.) You can also preview the furniture and other objects’ positioning.

One example of a popular AR game is Pokémon Go. The game enables you to catch imaginary monsters in the physical world. Plus with Ikea’s wildly popular Position app. You can see how much of the company’s catalog will look in your house.

LEGO is one of several companies that have also released stand-alone products. In this case, they were construction sets. These, when you have a compatible smartphone, will “come alive” with AR features.

The scanner on the iPhone 12 Pro and iPad Pro is not precise enough to reliably scan objects. But LiDAR is also used to scan buildings and other objects. While developing a proof of concept named Esper, Sebastiaan de With discovered this. He is the same personality who created the famous iPhone camera app Halide.

There are two key aspects that LiDAR scanners are likely to improve on. These include virtual object positioning (like shopping apps) and AR gaming. On non-LiDAR iPhones, these are still feasible. But it provides an additional layer of precision to things. These include dimensions and the exact distance to an object in space.

When putting virtual objects in the physical world, you should also expect a more smooth AR experience. The iPhone 12 Pro, for instance, should be able to distinguish real-world objects in the foreground better. This can make encounters between simulated and physical objects more practical.

To maximize camera performance in low light, Apple also plans to use LiDAR. In Apple’s phase-detect autofocus (PDAF) brand, the iPhone XS, “focus pixels” are introduced. This technology also relies on light. This is why even the new developments in autofocus do not work all that well in the dark.

Apple will tell the camera at what distance it can aim to achieve the best results. This is done by feeling the distance between your iPhone and the subject you’re taking a shot off. This should make it much easier. When paired with Night mode, it will be easier to take better photos with your iPhone in the dark.

Is LiDAR going to become a big deal?

Image credits: Apple

Just two Apple devices have a sensor at present. Both are still priced at a premium and feature the moniker “Pro,” but right now, LiDAR is a niche feature. That doesn’t mean tech is going to be slow to catch on, however. ARKit, revised to version 4.0 in June 2020, is included in Apple’s extensive catalog of software development kits (SDKs).

This upgrade added new capabilities that leverage LiDAR into ARKit. This enables developers to take advantage of the new sensor for the iPad Pro and iPhone 12 Pro. SDKs like this make it easier for developers to reach whole device families even though the new bells and whistles are not rocking.

The strategy for Apple possibly includes placing LiDAR sensors over time in more units. That’s because developers are busy developing applications that take advantage of enhanced performance. Apple seems to be betting big on AR. This can be observed by the company’s revived interest in technology over the last few product launches.

However, Apple’s biggest plans for LiDAR could go far beyond tablets and smartphones. At least, when rumors swell about the company’s alleged AR glasses, that’s the view held by many observers. If such a project were to come to life, correct AR would be central to the experience. And this definitely makes sense.

Apple will accelerate product availability on a new wearable device by motivating developers to adopt AR. With past iPhone features, including haptic feedback, facial recognition, and different cameras, a few high-end models’ sluggish launches continue Apple’s trend.

Apple also has the ability to fine-tune it before releasing a model that relies more heavily on the technology. Apple incorporated hardware that specifically supports AR into select products.

Is LiDAR Worth an Upgrade?

LiDAR is impossible to sway you when choosing between the iPhone 12 or the iPhone 12 Pro. You would not have any advantages in the short term. This is because you use a lot of applications that take advantage of AR. Or maybe you love to shoot loads of photographs at night.

Even if you’re a keen AR player or flat-pack user, AR implementation in existing non-LiDAR-enabled iPhones has improved significantly in only a few years. LiDAR does boost this much better. But it’s definitely not worth the $300 price Apple is demanding for the iPhone 12 Pro.

Most individuals may not be too optimistic about LiDAR right now. But in years to come, the device will filter down and boost the overall iPhone experience. MagSafe attachments, 5G support, and Dolby Vision recording are also not the only major developments in the 2020 iPhone lineup.

Leave a Comment