Craig Federighi today announced ARKit 2 at WWDC 2018, which will give developers access to improved face tracking, realistic rendering, 3D object detection, persistent experiences, and shared experiences. The company gave a demo of two users sharing a virtual environment using ARKit 2, playing on a table with wooden toys and trying to knock down the other player's objects.

Apple says that ARKit 2 is a more powerful platform than the original ARKit, since it can allow multiple users to play a game or collaborate on projects together. There is also support for a "spectator mode" so that friends and family can see AR gameplay from another iOS device without participating.

arkit 2 lego
With "persistent AR," you'll be able to leave virtual objects in the real world and come back to them later. For example, you can start a puzzle on a table and come back to it another day and discover it in the same state that you left it.

ARKit 2 also extends support for image detection and tracking, making it possible to detect 3D objects like toys or sculptures, and adds the ability to automatically apply reflections of the real world onto AR objects. This makes the AR experience an even more realistic mix of the virtual and real world.

One of the notable demos at WWDC this year saw Apple bring Martin Sanders, Director of Innovation at LEGO, on stage to demonstrate a new LEGO AR iOS app that will integrate with ARKit 2 features and connect to physical LEGO sets. An entire LEGO city was shown off in the demo, allowing users to build objects, place characters, go on quests, open sets to see inside, and play with friends in the same world.

Up to four friends can play in the same set on four different iOS devices, and notably all of the virtual aspects of the LEGO AR app will be connected to physical LEGO sets. "We can save our entire world back into our physical set, and pick up where we left off later," Sanders said.

In other augmented reality news, Apple has created its own measuring app called "Measure," which can provide the dimensions of objects automatically. The company also collaborated with Pixar to create a new open file format called usdz, which enables AR experiences in many apps, like Messages and Mail.

All of these advanced ARKit 2 features will be available when iOS 12 launches this fall.

Top Rated Comments

DJTaurus Avatar
80 months ago
Is it just me or was the physical part of that Lego game completely useless?
Completely useless, gimicky and waste of time.
Score: 2 Votes (Like | Disagree)

Popular Stories

iPhone 16 Pro Sizes Feature

iPhone 16 Series Is Less Than Two Months Away: Everything We Know

Thursday July 25, 2024 5:43 am PDT by
Apple typically releases its new iPhone series around mid-September, which means we are about two months out from the launch of the iPhone 16. Like the iPhone 15 series, this year's lineup is expected to stick with four models – iPhone 16, iPhone 16 Plus, iPhone 16 Pro, and iPhone 16 Pro Max – although there are plenty of design differences and new features to take into account. To bring ...
Apple Intelligence General Feature

Apple Intelligence Now Available in New iOS 18.1, iPadOS 18.1, and macOS Sequoia Developer Betas

Monday July 29, 2024 10:07 am PDT by
Apple is today providing developers with the first betas of iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1, with the new software introducing an early version of the Apple Intelligence features. These new betas will be in testing alongside the current iOS 18, iPadOS 18, and macOS Sequoia 15 betas. Developers can choose whether to opt into the new betas with Apple Intelligence, or stay on the ...
Apple Intelligence General Feature

Report: Apple Intelligence Delayed to iOS 18.1 in October

Sunday July 28, 2024 11:52 am PDT by
Apple Intelligence will miss its initial expected launch date to give Apple more time to fix bugs, Bloomberg's Mark Gurman reports. According to individuals with knowledge about Apple's plans, the company now plans to start rolling out Apple Intelligence in software updates by October, arriving several weeks after the launch of iOS 18, iPadOS 18, and macOS Sequoia. This means that Apple...
T Mobile Generic Feature Pink 1

T-Mobile Sued for Breaking Lifetime Price Guarantees

Friday July 26, 2024 2:44 pm PDT by
T-Mobile customers have filed a lawsuit [PDF] against the carrier, alleging that it failed to honor a guarantee not to raise the prices of select cellular plans. The lawsuit, first spotted by Wired, claims that back in 2017, T-Mobile advertised several of its plans with a price lock, but then went on to increase prices starting in May 2024. "T-Mobile ONE customers keep their price until...