Craig Federighi from Apple on stage talking about shared experiences on ARKit2

Screenshot taken from Apple WWDC event by Chad Curry.

Note: For an overview of augmented reality/mixed reality and virtual reality, read our post here.

On Monday, Apple kicked off it’s annual WWDC and it was full of less flash and shiny objects than in the past. What it did have were some very interesting announcements around their software, especially their augmented reality software, called ARKit.

Real estate stands to be greatly impacted by augmented reality.

Imagine the following scenarios:

  • Bring virtual representations of your furniture with you to a showing of a home and stage each room to see how this new place could look with your furniture.
  • Listing details for the home could show up as you walk through a property. Information about how new the flooring or tile is shows up when you point your camera at it.
  • From your phone, you could see the distance and direction to work, school, parks or other locations as you stand in a property.
  • Measure all aspects of the space with your phone and have actionable measurements before you move in.

With ARKit2 we are closer than ever to making that a possibility.

ARKit is the development framework for building augmented/mixed reality apps. It makes it easier to just build and get results. There were four changes that are key to AR becoming more prevalent in real estate applications:

  1. New File Format
  2. Object Detection
  3. Shared AR Experience
  4. Measure App

New File Format

This one is most exciting to me. The new file format called USDZ (Universal Scene Description) was developed by Pixar and allows for you to build assets and use them in various apps. You can send and share these assets and they can be used with anyone using an iDevice. Now, if you’re using Android, you might feel like I’m forgetting about you. I’m not. I anticipate this coming to the Android platform shortly. The reason I’m optimistic is because tools like Adobe’s Creative Cloud Suite are supporting this format.

This new file format means you can share AR objects with other apps and users. So, in the future, I could take a pic of my couch and render it as an AR object, and send it along to my wife who wants to see how it looks in a house we are looking at. We could even try out new furntiure.

Object Detection

ARKit2 can detect and allow you to virtually interact with real objects. Lego gave a demo with one of their Lego sets and how it can be detected to create an augmented reality experience:

What’s cool about this is that a specific object could be used to initiate a program or app. For example, I bring a vase from my house that I’ve set as an object to use for this app, set it in the middle of a room in the house, point my camera at it and all my living room furniture appears on my screen placed throughout the room.

Shared AR Experience

This is what makes ARKit2 a big possibility in real estate. Shared experiences let you interact with other users in a virtual/augmented plane. In the video above, the two guys from Lego are interacting in a game. But in real estate. what if you and your partner could interact in a house with our furniture as a team and move things around in the room and make sure it looks how we want it? Having shared experiences means that doing a virtual, real-time staging using your own furniture helps you as a buyer and the REALTOR understand how this house could work.

Measure App

The Measure app is deceptively simple. It allows you to take measurements of objects easily. The trick it plays is that it can measure 3D objects rather simply. In the demo below, you’ll see Craig Federighi from Apple point his camera at a few things and dimensions just appear. Imagine what this means for trying to figure out how to shop for your home:

Having this functionality built right into the phone serves the purpose of giving you a practical tool on your phone. But I believe it’s being built for the future. As it’s learning to create these dimensions and do so accurately, it will make it easier to capture 3D renderings of real world objects and import them into the phone.

There are already some pretty cool apps out there that do some of these things, but the fact that Apple has now integrated all of these features under one system makes it extremely powerful. How else can you see this being useful in real estate? Next we will look at ARCore from Google to give you a sense of what’s to come on the Android side.

Leave comments below.