philip lelyveld The world of entertainment technology

Teach-U: VR uses virtual reality to let anyone learn piano or drums

Kelly and Shi used Google’s Cardboard VR device with an infrared sensor from PMD added to enable hand gestures into the virtual environment. So beyond merely observing via Cardboard, users can reach out, touch and play their virtual instruments. They also adapted the setup — which was developed using Unity, Carnival’s SDK and good ol’ fashioned tinkering — to allow two concurrent users in the same virtual reality space: the teacher and the student.