Month: September 2008

AR Annotation on the iPhone

Posted by – September 9, 2008

VentureBeat has an article about Tonchidot presenting their Sekai Camera at TechCrunch50 and it apparently has some kind of augmented reality annotation functionality on the iPhone. Looking at the video, it’s not clear if this is all Wizard of Oz or if they’re doing some kind of real localization and registration using features (like SIFT), tags (probably not), or positioning of some sort. My guess is that this isn’t really annotating the real world but I’d love for them to prove me wrong. Then maybe they’d go either further and use Blaine Bell’s view management algorithms to make it look nice.

httpv://jp.youtube.com/watch?v=KgTwSXK_5dg

More details on MAking the Visible Invisible

Posted by – September 8, 2008

I received a nice letter from Jamais asking about the references.  I didn’t give a history of the world but mentioned some highlights like the following:

Short version – references are at the very end. Note that CGUI refers to the Computer Graphics and User Interfaces Lab run by Steve Feiner, where I’m currently conducting research on augmented reality and visualization related to the environment. More on that as www.cs.columbia.edu/~swhite

Thanks for writing – I’ve just started blogging, mainly for myself, and didn’t quite realize that I’d get any responses.  I’d be happy to help you with the references and appreciate your openness and interest. I could give you the long history of mixed and augmented reality but let me start with the references I mentioned.  Keep in mind that this is from a more academic point of view but thus far, much of the research has come from academia.

First, there are a lot of terms that get thrown around about how we combine the physical and the virtual to create the real. Milgram and Kishino described a simple continuum of “mixed reality” that moves across virtual environment, augmented virtuality, augmented reality, and the real environment. It’s meaningful because some writers don’t distinguish amongst mixed, virtual, and augmented reality.
Now Steve Mann actually came up with the term”mediated” reality to emphasize that we can change and transform reality, not just mix the virtual and the physical.  Thad Starner, having worked with Steve, extended this notion more fully to wearable computing and the idea that you could mediate your reality to, for instance, remove advertising.  Then later, Mann actually built a system to experiment with removing advertising – calling it diminished reality.   I write about the opposite in my chapter on AR and Mobile Persuasion in BJ Fogg’s edited book – using AR to bring our attention to things that are important.

Tobias Hollerer, a CGUI graduate now at UC Santa Barbara, together with several others including Feiner developed interesting early work on filtering mechanisms under the assumption that there’ll be too much data for us to visualize in a scene using AR. He uses a combination of context and location but also explores a social model originally developed by Benford that has a notion of an aura and nimbus for filtering. And he’s not the last to address the issue. It comes up often at ISMAR, the main conference for augmented reality.
If you can’t access any of these, let me know and I’ll get you a copy.  And let me know if you have further questions or want a better outline of the evolution of AR and framework for the topics.  There are a couple good surveys on the subject as well, mainly by Ron Azuma, but they’re a little out of date.

P. Milgram and F. Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Trans. Information Systems, vol. E77-D, no. 12, 1994, pp. 1321-1329.

Mann, S. Mediated Reality. Technical Report 260, MIT Media Lab. Perceptual Computing Group. 1995

Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., and Pentland, A. (1997), “Augmented Reality Through Wearable Computing.” PRESENCE, 6(4), MIT Press.

Mann, S. and Fung, J., “EyeTap Devices for Augmented, Deliberately Diminished, or Otherwise Altered Visual Perception of Rigid Planar Patches of Real-World Scenes,” Presence: Teleoperators & Virtual Environments, vol. 11, pp. 158-175, 2002.

Höllerer, T., Feiner, S., Hallaway, D., Bell, B., Lanzagorta, M., Brown, D., Julier, S., Baillot, Y., and Rosenblum, L., “User interface management techniques for collaborative mobile augmented reality,” Computers & Graphics, vol. 25, pp. 799-810, 2001.

Augmented Reality in Sportscasting

Posted by – September 8, 2008

I’ve seen this in a couple of places – looks like an AR overlay of Madden Football on sports commentators so they can talk about possible scenarios, using it as a simulator more than a game. Pretty nice. I wonder if they’ll deal with occlusions and shadows on the commentator?

IEEE Article on AR

Posted by – September 4, 2008

An article by Jay Bolter and Blair MacIntyre on AR in the IEEE Spectrum magazine.

Externalities: Wilderness and its Others

Posted by – September 4, 2008

EcoArtTech (Christine Nadir & Cary Peppermint) has a performance this Friday that “will examine the conditions of possibility for getting back to “nature”. I’m a big fan of their work and plan to go. From their Facebook page:

On September 5 from 7pm to 10pm, OTO kicks off our second season with EcoArtTech’s “Externalities: Wilderness and its Others”

EcoArtTech
(Christine Nadir & Cary Peppermint) continue to rethink relations
between humans, technics, technology, and the environment with
“Externalities: Wilderness and its Others” a networked, video-based
performance piece. The performance will examine the conditions of
possibility for getting back to “nature”

Co-founded in 2005 by
Christine Nadir and Cary Peppermint, EcoArtTech works with digital,
networked, and sustainable technologies and contemporary environments
to create art about the environmentality of modern life. Drawing on a
wide range of literary, artistic, and theoretical fields, our aim is to
imagine new, healthy, and sustainable relationships between animals,
humans, and their environments and technologies.

ISMAR 2008

Posted by – September 4, 2008

I’ve been for the last two years but this year, I won’t be going to ISMAR. I imagine there will be more excitement than ever.

Gartner Analyst give AR a shoutout

Posted by – September 4, 2008

I didn’t hear the actual talk but it sounds like Mark Raskino from Gartner have a shout out to augmented reality.

Nice AR visual imagery

Posted by – September 4, 2008

This fellow has done a nice job of visualizing different AR interfaces for search. I wonder if he’s seen any of our research on identifying leaves and using augmented reality and mobile devices?

Mobile version future search mobile #3-2

AR on the iPhone

Posted by – September 4, 2008

The folks over at ARToolWorks look like they’ve got a version of their software running on an iPhone. Since the iPhone SDK doesn’t provide access to the camera for video, I assume they’ve done it using a hacked phone. Speaking of ARToolWorks, they’ve got quite the team over there. Mark Billinghurst has always been an evangelist and Philip Lamb does great wpork with the actual code and infrastructure. Daniel Belcher and Raphael Grasset are both talented AR researchers and developers, too.

httpv://www.youtube.com/watch?v=5M-oAmBDcZk

Jamais Cascio reinvents mediated reality

Posted by – September 4, 2008

Open the Future: Making the Visible Invisible is Jamais Cascio’s essay/article on augmented reality. He’s made some interesting observations about SPAM (yes, it’ll be in AR too) and such but my sense is that he’s not particularly familiar with the field or research. He uses the notion of making the visible invisible but probably isn’t aware of Thad Starner’s Mediated Reality work. Nor is aware of (or at least he doesn’t mention) Tobias Hollerer’s filtering research from back in his MARS and CGUI days.

e does, however, have some nice imagery and I’m glad to see a thoughtful essay on the topic. I just hope he spends a little more time getting familiar with the subject. 🙂

google-rep-mgr.jpg