Category: augmented reality

AR with Yelp

Posted by – August 27, 2009

Yelp Brings First US Augmented Reality App to iPhone Store

Tried this on my iPhone tonight.  The compass reading were really off.  But interesting to see that they’ve managed to sneak in an AR overlay app – for some reason I thought that required the 3.1 SDK and OS. It’s similar to the other apps.  Floating information registered roughly to the compass, based on GPS location.  It’s exciting to see this hitting the main stream.

Layar for Plants

Posted by – August 21, 2009

Looks like the Layar folks have built a layer for the Purdue University Arboretum.  Details are here on page 40.  I’d be curious to see how well the system works for actually finding a specific species or identifying a species that is in front of the user.  I like the use of horizontal lines to show distance.  It reminds me of work show by Mark Livingston (I believe) at VR 2009.  Of course, they’re also having an occlusion issue in this example but the image looks nice and green.

AR on iPhone

Posted by – December 8, 2008

Living in an Augmented Reality » a little iPhone AR demo

Looks like one of Blair’s students got the video working on the iPhone.  Very nice.

Tasty Fiducials

Posted by – December 8, 2008

i love the whimsy in this.  Making fiducials out of cookies:

Augmented Reality XMas Cookies

More details on MAking the Visible Invisible

Posted by – September 8, 2008

I received a nice letter from Jamais asking about the references.  I didn’t give a history of the world but mentioned some highlights like the following:

Short version – references are at the very end. Note that CGUI refers to the Computer Graphics and User Interfaces Lab run by Steve Feiner, where I’m currently conducting research on augmented reality and visualization related to the environment. More on that as www.cs.columbia.edu/~swhite

Thanks for writing – I’ve just started blogging, mainly for myself, and didn’t quite realize that I’d get any responses.  I’d be happy to help you with the references and appreciate your openness and interest. I could give you the long history of mixed and augmented reality but let me start with the references I mentioned.  Keep in mind that this is from a more academic point of view but thus far, much of the research has come from academia.

First, there are a lot of terms that get thrown around about how we combine the physical and the virtual to create the real. Milgram and Kishino described a simple continuum of “mixed reality” that moves across virtual environment, augmented virtuality, augmented reality, and the real environment. It’s meaningful because some writers don’t distinguish amongst mixed, virtual, and augmented reality.
Now Steve Mann actually came up with the term”mediated” reality to emphasize that we can change and transform reality, not just mix the virtual and the physical.  Thad Starner, having worked with Steve, extended this notion more fully to wearable computing and the idea that you could mediate your reality to, for instance, remove advertising.  Then later, Mann actually built a system to experiment with removing advertising – calling it diminished reality.   I write about the opposite in my chapter on AR and Mobile Persuasion in BJ Fogg’s edited book – using AR to bring our attention to things that are important.

Tobias Hollerer, a CGUI graduate now at UC Santa Barbara, together with several others including Feiner developed interesting early work on filtering mechanisms under the assumption that there’ll be too much data for us to visualize in a scene using AR. He uses a combination of context and location but also explores a social model originally developed by Benford that has a notion of an aura and nimbus for filtering. And he’s not the last to address the issue. It comes up often at ISMAR, the main conference for augmented reality.
If you can’t access any of these, let me know and I’ll get you a copy.  And let me know if you have further questions or want a better outline of the evolution of AR and framework for the topics.  There are a couple good surveys on the subject as well, mainly by Ron Azuma, but they’re a little out of date.

P. Milgram and F. Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Trans. Information Systems, vol. E77-D, no. 12, 1994, pp. 1321-1329.

Mann, S. Mediated Reality. Technical Report 260, MIT Media Lab. Perceptual Computing Group. 1995

Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., and Pentland, A. (1997), “Augmented Reality Through Wearable Computing.” PRESENCE, 6(4), MIT Press.

Mann, S. and Fung, J., “EyeTap Devices for Augmented, Deliberately Diminished, or Otherwise Altered Visual Perception of Rigid Planar Patches of Real-World Scenes,” Presence: Teleoperators & Virtual Environments, vol. 11, pp. 158-175, 2002.

Höllerer, T., Feiner, S., Hallaway, D., Bell, B., Lanzagorta, M., Brown, D., Julier, S., Baillot, Y., and Rosenblum, L., “User interface management techniques for collaborative mobile augmented reality,” Computers & Graphics, vol. 25, pp. 799-810, 2001.

Augmented Reality in Sportscasting

Posted by – September 8, 2008

I’ve seen this in a couple of places – looks like an AR overlay of Madden Football on sports commentators so they can talk about possible scenarios, using it as a simulator more than a game. Pretty nice. I wonder if they’ll deal with occlusions and shadows on the commentator?

IEEE Article on AR

Posted by – September 4, 2008

An article by Jay Bolter and Blair MacIntyre on AR in the IEEE Spectrum magazine.

ISMAR 2008

Posted by – September 4, 2008

I’ve been for the last two years but this year, I won’t be going to ISMAR. I imagine there will be more excitement than ever.

Gartner Analyst give AR a shoutout

Posted by – September 4, 2008

I didn’t hear the actual talk but it sounds like Mark Raskino from Gartner have a shout out to augmented reality.

Nice AR visual imagery

Posted by – September 4, 2008

This fellow has done a nice job of visualizing different AR interfaces for search. I wonder if he’s seen any of our research on identifying leaves and using augmented reality and mobile devices?

Mobile version future search mobile #3-2