Over the past several years, I’ve followed pretty much every new thing in the technology space, and written about many of them. But it’s hard not to get cynical when so much of what’s out there is not only not revolutionary, it’s often not even evolutionary. Instead, much of what I see is simply derivative and quite frankly, boring. But every once in a while something crops up that is truly game-changing. And it restores my faith in technology. That’s the best way to describe what I saw when I met with Oblong Industries. The technologies that Oblong is working on are anything but derivative or boring — they are absolutely revolutionary. And they will shape the future of computing.
I understand that such statements sound like absolute hyperbole, especially from a guy who has written about the death of the mouse a number of times. But I would encourage you to skip to the bottom of this post and check out the videos. I’m going to attempt to explain what I saw and talked with Oblong CEO Kwindla Hultman Kramer and Chief Scientist John Underkoffler about. But the only way to truly do the technology justice (beyond using it) is to see it in action. See More After Cut>>>
If you recognize Underkoffler’s name, it’s perhaps because you saw his TED presentation last year. He wowed the audience by showing off the g-speak SOE (spatial operating environment) technology that Oblong has built. And if that looked familiar, it’s because Underkoffler was also the guy who advised the filmmakers behind Steve Spielberg’s 2002 film Minority Report. Yes, all of those kickass gesture computing scenes are his work. And over the past decade or so, he’s been working to bring that technology to the real world with Oblong. And they’re getting close. Really close.
Following the TED talk last year, I wrote a post noting that I had seen a brief demonstration in 2008 in Spain that I wasn’t allowed to talk about. The demonstration was of Oblong’s technology. And it was awesome. But it was just a video demonstration. Two days ago, I got to actually see and use the first system Oblong has built. The product is called Mezzanine, and it’s what Kramer calls “Oblong’s first shrink-wrapped turn-key system”. “It’s the first slice through the technology stack we’ve been developing over the years,” he says.
So what is it?
Mezzanine is a spatial operating environment meant to be used in conference rooms and other large meeting areas. The peripherals vary, but the system I used consisted of three large screens front and center, two vertically-aligned screen on a wall to the right, a whiteboard to the wall on the left, and two cameras (one in front pointing at you, and one to the side pointing at the whiteboard). The main points of interaction are two “wands”, which I’ll explain more about in a bit. And the system works in concert with any device — meaning laptop, iPhone, iPad, etc — that is in the room and connected to the network as well.
The idea for Mezzanine is to get people in a room together in order to synthesize information in the most collaborative way imaginable. “We want to get everyone’s pixels in a shared workspace, where they collide,” Kramer says. “The key is to give everyone control over what’s happening,” he continues. And that means interacting with the data on the three main screens from your laptop, iPhone, iPad, directly on the screen with the wands, or even remotely via a device with a web browser.
Using these controls, anyone can rearrange data, push new data into the flow, highlight specific things, and queue stuff up to talk about later. Perhaps the best way to think about it is as a symphony of information that everyone in the room can conduct. Again, it’s a bit hard to describe, but when you see it, it just makes sense.
And it just works, to borrow from the Apple-esque way of thinking about products. I picked up one of the wands and within two minutes I knew exactly what I was doing. I could transfer data around the screens. I could zoom in to certain data. I could crop and manipulate other data. I could zoom out for a full view of all the information available. It’s unbelievable how natural it all feels. The next time I have to use PowerPoint for a presentation, I’m going to want to shoot myself.
Speaking of the wand accessory, the best way to think about it is to think of a Nintendo Wiimote on steroids. It’s a bit like a Wiimote that is much more accurate and insanely more functional. It has three sides that, depending on which is facing upwards in your hand, does different things. You move it around in your hand, switching the sides, to do different things. One side allows you to grab data for example, while another allows you to take control of the data. For example, maybe you have Photoshop open on a computer attached to the Mezzanine system — you can use the wands to directly manipulate it right on the big screens in front of you.
And the wand is a fully spatial device. You can point it upwards and use it as a push/pull lever of sorts. It’s really cool.
But why use a wand and not your hands, a-la Minority Report? Because we’re not quite there yet, Underkoffler explains. Well, let me rephrase that. The technology is there, but it’s still too expensive to implement on a large scale. And it still requires gloves to ensure pinpoint accuracy. Yes, the Microsoft Kinect does some of this, but that’s fairly rudimentary compared to what Oblong is aiming for. “As a company, philosophically, we’re absolutely commited to high fidelity and high-end experience. The commoditized stuff isn’t there yet,” Kramer says.
Still, both Kramer and Ubderkoffler agree that consumer technologies like the Wii and the Kinect are perfect in helping to transition people over to these future concepts of computing. Kramer also singles out the multi-touch first used in the iPhone and now on display in the iPad. “We really do think the mouse goes away over the next few years,
EmoticonEmoticon