philip lelyveld The world of entertainment technology

1Oct/16Off

My opening keynote – Audio Engineering Society’s Audio in Virtual and Augmented Reality Conference

Here is the Sept. 30, 2016 presentation, compressed and minus the videos.

160930-lelyveld-audio-eng-soc-deck-copy

1Oct/16Off

ILMxLAB is working on a VR film with Alejandro G. Iñárritu

revenant-gallery-05-gallery-imageThere’s not much we know about the untitled Iñárritu collaboration with ILM’s experimental VR and MR immersive filmmaking unit, but Slashfilm has a few details, including that it’s going to be a short film which involves Oscar-winner Emmanuel Lubezki (who worked on Gravity) helping with cinematography. The general plot will focus on the “intense and excruciating experience of a group of immigrants and refugees crossing the border between Mexico and the United States,” Slashfilm reports.

See the full story here: https://techcrunch.com/2016/09/29/ilmxlab-is-working-on-a-vr-film-with-alejandro-g-inarritu/

29Sep/16Off

A look inside how Here Be Dragons is pioneering VR storytelling

The VR production studio is aiming to continue rediscovering storytelling techniques for the immersive medium. With filmmaker Chris Milk taking the role of Creative Director at the company, they’ve already positioned themselves well within the industry and have built partnerships with Apple, United Nations, The New York Times, Nike, Vice, NBC, Conservation International and U2.

Here Be Dragons is dealing with many of the same hardware problems surfacing in the VR storytelling space, mainly the fact that there is currently no one-size-fits-all solution for capturing spherical video.

See the full story here: https://techcrunch.com/2016/09/28/a-look-inside-how-here-be-dragons-is-pioneering-vr-storytelling/

29Sep/16Off

Microsoft forms new AI Research Group led by Harry Shum

The tech giant announced that it is creating a new AI business unit, the Microsoft AI and Research Group, which will be led by Microsoft Research EVP Harry Shum. Shum will oversee 5,000 computer scientists, engineers and others who will all be “focused on the company’s AI product efforts,” the company said in an announcement. The unit will be working on all aspects of AI and how it will be applied at the company, covering agents, apps, services and infrastructure.

Products that will fall under the new unit will include Information Platform, Cortana and Bing, and Ambient Computing and Robotics teams led by David Ku, Derrick Connell and Vijay Mital, respectively. The Microsoft AI and Research Group will encompass AI product engineering, basic and applied research labs, and New Experiences and Technologies (NExT), Microsoft said.

See the full story here: https://techcrunch.com/2016/09/29/microsoft-forms-new-ai-research-group-led-by-harry-shum/

29Sep/16Off

What the Associated Press has learned from a year of VR

virtual-reality-2AP said one of the big lessons is understanding when VR and 360 video won’t work. For example, a reporter went to New York’s recent fashion week to try to shoot a piece of VR, when they realized it wouldn’t work for the medium because the viewer, positioned as a member in the audience, is focused on one point: straight ahead. When the viewer would turn around, they’d see other cameras towering over them.

“Most events are not designed for VR,” said Marconi. A similar situation occurred at the Oscar’s for which AP did a 360 video. “If you look at the front you see red carpet but if you look back you see cameras and journalists towering over you. You have to ask how do you create an experience to immerse the user,” he said.

“The rule of thumb is ‘would you look around you in a certain situation?’ if the answer is yes, then maybe there is an opportunity to create a VR experience,” echoed Cheung.

“The key will be to compliment coverage and not inundate consumers with too much information. It’ll be a fine balance and we as an industry need to be careful and focused when it’s right to use technology.”

See the full story here: http://digiday.com/publishers/aps-learned-vr-360-videos/

29Sep/16Off

Augment’s Essential Guide to Augmented Reality Prepares you for our Next AR Hack

Augment’s Essential Guide to Augmented Reality, a complete ebook overview of what AR is and how it will revolutionize business. We, at the AT&T Developer Program, are taking the time to highlight this developer book because we believe that AR is a transformative technology which that can be applied to many markets. In fact, we stated our own view on the top AR uses cases in a recent blog post. While the Augment ebook does a great job of laying out the current landscape, what makes the content standout is the detail to which it outlines the technical process behind AR. Creating an AR experience is a multi-step process and Augment’s guide outlines the critical steps in that process:

See the full story and download the book here: https://developer.att.com/blog/augments-essential-guide-to-augmented-reality-prepares-you-for-our-next-ar-hack

27Sep/16Off

FOVE Eye-tracking Headset Gets Final Specs and Pre-order Date

fove-0-vr-headset-2-680x382

[Philip Lelyveld comment: human subject testing recently found that high resolution and a lot of motion in the periphery can be bad and induce sim sickness. Eye tracking and foviated rendering may be key to avoiding sim sickness.]

FOVE 0 Specifications

  • Display: WQHD OLED (2560×1440)
  • Display Refresh Rate: 70Hz
  • Field of View: 90 ~ 100 degrees
  • Tracking:
    • Head Tracking
      • Rotational
      • Positional
    • Eye Tracking
      • 120FPS infrared x2 (accuracy <1 degree)
  • Weight: 520g
  • Audio: 3.5mm audio jack
  • Connections: HDMI 1.4, USB 3.0, USB 2.0
  • Accessories: Positional tracking camera, face cushion

See the full story here: http://www.roadtovr.com/fove-0-eye-tracking-vr-headset-final-specs-pre-order-date/

27Sep/16Off

Forget VR. The Future of Roller Coasters Is About Maglev

sfear-mountain-1SOME PEOPLE THINK the future of the amusement is all about virtual reality. I think it’s about a mix of electromagnetic acceleration, free falls, and untethered jumps into water.

But what if there was no friction at all? What if there were no rails or wheels? What if electro magnets propelled the cars? This is the idea behind the Sfrear Mountain Coaster.

The concept would mark an entirely new rider experience, combining a cushy ride, incredible speed, free falls, underground tunnels, water diving, and heart-racing turns and loops.

A 6-foot-wide, transparent sphere replaces the traditional open-top car. All three passengers, strapped in with conventional padded restraints, would get a clear view of their fellow riders’ gawking faces, along with the world spinning by.

The majority of the track would be tubular with an open top, to keep the sphere on the right path.

See the full story here: https://www.wired.com/2016/09/forget-vr-future-roller-coasters-maglev/

27Sep/16Off

Singularity University Global Summit – Phil Lelyveld Keynote presentation

160830-singularity-u-summit

26Sep/16Off

How Japan Studio created the first virtual reality “couch multiplayer” game with The Playroom VR

29904646676_3caa59657c_oThe Playroom contains six unique virtual reality games designed to be enjoyed by friends and families. The particularity of our title is that it mixes VR play with classic TV play to become the first ever sofa multiplayer experience released on VR.

However, what makes us different is that PS VR sits in the living room, and we know that all PS4 systems have a television screen nearby as well. If only those TV screens could also be used in conjunction with VR, perhaps new avenues would open up?

So we set ourselves a goal: to offer an inclusive VR experience where friends and families would be shouting and laughing together in the same room.

See the full story here: https://blog.eu.playstation.com/2016/09/26/how-japan-studio-created-the-first-virtual-reality-couch-multiplayer-game-with-the-playroom-vr/