If you want a vision of the future, imagine your arm holding up your iPhone — forever
It has been truly delightful to see all the imaginative augmented reality prototypes made by developers playing around with Apple’s new ARKit framework. It’s only been available for a couple of months, but developers have already gone to town with all sorts of fun ideas:
Amid the excitement, it’s easy to forget that we’ve been here before, many, many times. Back in 2015, Apple acquired Metaio, a German company that provided an SDK (software development kit) that allowed other developers to easily make augmented reality experiences. Two years on, ARKit is no doubt far more powerful and far easier to use than Metaio’s SDK, but the principle is the same.
And so are many of the applications. We’ve seen 3D objects superimposed on the real world on iOS device before, powered by Metaio:
And we’ve seen people plopping down inexpensive furniture into their homes before:
I don’t mean to rain on ARKit’s parade. The ease of use, lack of licensing fees, and sheer power means that we’ll be seeing a greater variety of ideas than we ever did in Metaio’s time, and so it’s entirely possible that someone will figure out an idea that makes phone-based augmented reality really take off. This ARKit-powered measuring tape prototype is actually very neat and useful:
But I don’t think this time is different.
All of these videos you see are incredibly misleading — not because they’re faked (they aren’t), but because they make it seem as if your field of view will be filled with the digital reality.
We usually don’t have to worry about this for videos taken by smartphones because in those cases, it’s actually true: when you watch a video on Snapchat or Instagram, you’re seeing what you’d really see if you were there. But when you watch an augmented reality video, you’re definitely not: instead, you have to imagine you’re holding up a phone at arm’s length, and seeing the video on that phone.
Looking at the world through a 5″ window is never going to be comfortable for longer than a minute. I’m sure there will be specific, short experiences like the measuring tape app that do well, along with some tourism and instructional apps, but I very much doubt we’ll see experiences even as long as 5 minutes, let alone 15 minutes.
As for games, so many of the prototypes are basically placing 3D objects on top of real world 2D planes, like your coffee table:
Forget about accessibility or comfort. I fail to see how this is more fun than a non-AR game that isn’t tied to a flat plane. It would be more innovative for AR games to involve manipulating of objects in the real world to influence the digital world, but that’s decidedly tricky when you’re holding up a phone or tablet.
Before you say “Pokémon Go”, let’s be clear — literally the first thing any decent player does in that game is turn off the augmented reality layer (where the monsters are superimposed on top of the real world camera view) because it eats up your battery and makes the game harder to play.
I don’t buy it. And I don’t think Apple does, either. Unlike Google’s shameful boosting of the dreadful Google Glass, Apple has thus far been comparatively quiet about ARKit. I’m sure they realise that most people don’t want to develop their shoulder muscles by using AR all the time.
No, this is all preparation for their future heads-up display — one that really will fill up your field of vision, be perfectly comfortable to use, utterly desirable, and only barely affordable.