“The use of only visual provides average success rate of 43%. But, the augmentation of visual with raw audio, and visual with pitch provides average success rates of 87% and 86%, respectively,” wrote the researchers. “Similarly, the average required number of steps to reach the target using only visual information is 1420. But, the addition of complementary raw audio and pitch to the visual reduces the number of steps to 751 and 614, respectively.”
The team leaves to future work experiments in different environments and tests other than video games.
See the full story here: https://venturebeat.com/2019/05/13/adding-audio-data-helps-ai-navigate-3d-mazes/