The developers hope the new system, called Portal-ble, could be a tool for artists, designers, game developers and others to experiment with augmented reality (AR). The team will present the work later this month at the ACM Symposium on User Interface Software and Technology (UIST 2019) in New Orleans. The source code for Andriod is freely available for download on the researchers' website, and iPhone code will follow soon.
The platform makes use of a small infrared sensor mounted on the back of a phone. The sensor tracks the position of people's hands in relation to virtual objects, enabling users to pick objects up, turn them, stack them or drop them. It also lets people use their hands to virtually "paint" onto real-world backdrops. As a demonstration, Huang and his students used the system to paint a virtual garden into a green space on Brown's College Hill campus.
The team also added sensory feedback -- visual highlights on objects and phone vibrations -- to make interactions easier.
See the full story here: https://www.sciencedaily.com/releases/2019/10/191016153703.htm