The augmented reality climbing wall, according to its creators, Raine Kajastila and Perttu Hämäläinen of Finland’s Aalto University, comprises a projector, a depth camera and a computer system that continually analyzes climbers movements. That system is in charge of providing feedback regarding the performance of the climbers, and it adds interesting tasks and challenges for them when they’re ready.
Kajastila and Hämäläinen created the AR climbing wall you just saw for an ongoing Aalto University research project.
“We aim to study how to give meaningful AFB (augmented feedback) during climbing (and other challenging activities) visually or aurally, including (analyzing center of mass (COM) body movements) and arm trajectories, projections that follow the natural focus of attention, training of specific climbing moves, and quality of movement,” they say.
See the full story here: http://anewdomain.net/first-ever-augmented-reality-climbing-wall-how-it-works/