The building is detected in real time by its shape. Characters are then superimposed over the live video. Twitter feed comments are located via GPS tagging. Store information, reservations and other infrastructure is part of the iPhone application.
see more here…
(via twitter)
In this research project by Taehee Lee and Tobias Hollerer from the UCSB “Four Eyes Lab”, you see a desktop augmented by computer graphics in real time using a markerless camera tracking algorithm. The method uses landmark (SIFT) features and sparse optical flow. Even though SIFT detection is slow (~0.5s on our laptop), we achieve realtime performance thanks to a special multi-threaded software design. We use our HandyAR hand tracking methodology for the Augmented Reality interaction. See http://ilab.cs.ucsb.edu/projects/taehee/HandyAR/
