Tag: augmented reality

AR Annotation on the iPhone

Posted by – September 9, 2008

VentureBeat has an article about Tonchidot presenting their Sekai Camera at TechCrunch50 and it apparently has some kind of augmented reality annotation functionality on the iPhone. Looking at the video, it’s not clear if this is all Wizard of Oz or if they’re doing some kind of real localization and registration using features (like SIFT), tags (probably not), or positioning of some sort. My guess is that this isn’t really annotating the real world but I’d love for them to prove me wrong. Then maybe they’d go either further and use Blaine Bell’s view management algorithms to make it look nice.

httpv://jp.youtube.com/watch?v=KgTwSXK_5dg

More details on MAking the Visible Invisible

Posted by – September 8, 2008

I received a nice letter from Jamais asking about the references.  I didn’t give a history of the world but mentioned some highlights like the following:

Short version – references are at the very end. Note that CGUI refers to the Computer Graphics and User Interfaces Lab run by Steve Feiner, where I’m currently conducting research on augmented reality and visualization related to the environment. More on that as www.cs.columbia.edu/~swhite

Thanks for writing – I’ve just started blogging, mainly for myself, and didn’t quite realize that I’d get any responses.  I’d be happy to help you with the references and appreciate your openness and interest. I could give you the long history of mixed and augmented reality but let me start with the references I mentioned.  Keep in mind that this is from a more academic point of view but thus far, much of the research has come from academia.

First, there are a lot of terms that get thrown around about how we combine the physical and the virtual to create the real. Milgram and Kishino described a simple continuum of “mixed reality” that moves across virtual environment, augmented virtuality, augmented reality, and the real environment. It’s meaningful because some writers don’t distinguish amongst mixed, virtual, and augmented reality.
Now Steve Mann actually came up with the term”mediated” reality to emphasize that we can change and transform reality, not just mix the virtual and the physical.  Thad Starner, having worked with Steve, extended this notion more fully to wearable computing and the idea that you could mediate your reality to, for instance, remove advertising.  Then later, Mann actually built a system to experiment with removing advertising – calling it diminished reality.   I write about the opposite in my chapter on AR and Mobile Persuasion in BJ Fogg’s edited book – using AR to bring our attention to things that are important.

Tobias Hollerer, a CGUI graduate now at UC Santa Barbara, together with several others including Feiner developed interesting early work on filtering mechanisms under the assumption that there’ll be too much data for us to visualize in a scene using AR. He uses a combination of context and location but also explores a social model originally developed by Benford that has a notion of an aura and nimbus for filtering. And he’s not the last to address the issue. It comes up often at ISMAR, the main conference for augmented reality.
If you can’t access any of these, let me know and I’ll get you a copy.  And let me know if you have further questions or want a better outline of the evolution of AR and framework for the topics.  There are a couple good surveys on the subject as well, mainly by Ron Azuma, but they’re a little out of date.

P. Milgram and F. Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Trans. Information Systems, vol. E77-D, no. 12, 1994, pp. 1321-1329.

Mann, S. Mediated Reality. Technical Report 260, MIT Media Lab. Perceptual Computing Group. 1995

Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., and Pentland, A. (1997), “Augmented Reality Through Wearable Computing.” PRESENCE, 6(4), MIT Press.

Mann, S. and Fung, J., “EyeTap Devices for Augmented, Deliberately Diminished, or Otherwise Altered Visual Perception of Rigid Planar Patches of Real-World Scenes,” Presence: Teleoperators & Virtual Environments, vol. 11, pp. 158-175, 2002.

Höllerer, T., Feiner, S., Hallaway, D., Bell, B., Lanzagorta, M., Brown, D., Julier, S., Baillot, Y., and Rosenblum, L., “User interface management techniques for collaborative mobile augmented reality,” Computers & Graphics, vol. 25, pp. 799-810, 2001.

Augmented Reality in Sportscasting

Posted by – September 8, 2008

I’ve seen this in a couple of places – looks like an AR overlay of Madden Football on sports commentators so they can talk about possible scenarios, using it as a simulator more than a game. Pretty nice. I wonder if they’ll deal with occlusions and shadows on the commentator?

VRST 2008

Posted by – September 4, 2008

The program for VRST 2008 is now online. Steve Henderson will be presenting his work on ARMAR there so we should be able to get a good report on the conference.

Second Annual Workshop on Mobile Geospatial Augmented Reality

Posted by – September 4, 2008

I’m not sure how this workshop went but the topics seem relevant.  I’ll see if I can find someone who attended.

Parallel SLAM

Posted by – September 4, 2008

Georg Klein has posted his code for the work he presented at ISMAR 2007 on parallel tracking and mapping.  The demonstrations he gave were some of the best I’ve seen at ISMAR and really provided a good example of how tracking should work.  I spoke to Georg at ISMAR and then later via email and it sounds like there are some interesting possibilities for extending this source.

levelHead

Posted by – September 4, 2008

Julian Oliver has developed a very beautiful and simple AR game called levelHead based on overlaying a small world on a cube.

httpv://www.youtube.com/watch?v=5ks1u0A8xdU