Google shows off stunning new AR features coming to web and mobile apps soon
Part of a ARCore’s new Depth API in the works
Google has been quietly working to improve its augmented reality platform, ARCore, since its official launch early last year. Now, the company says it’s ready to unveil some of the next-generation upgrades to depth detection and physics it’s achieved, which promise to make AR experiences seem much more realistic in the future.
The upgrades, part of ARCore’s all-new Depth API, will soon allow developers to perform what’s known as occlusion, which is when an artificial object can be blocked from view by other real-world objects in a scene.
Google says it’s able to do this through optimizing existing software, so you won’t need a phone with a specific sensor or type of processor. It’s also all happening on the device itself, and not relying on any help from the cloud. So long as you have a phone that supports ARCore, which is pretty much every new Android phone released in the last few years, you’ll be able to access these new features.
These go beyond occlusion and into more realistic physics and 3D mapping. Google has developed a way for AR objects to interact with the real world more realistically, move through an environment the way a real-world 3D object would, and interact with surfaces like you might expect physical matter would. For instance, in the demo I got to experience, I was able to create colorful shaped blocks out of thin air that could bounce off virtually any surface, even the handlebars of an exercise bike.
See the full story here: https://www.theverge.com/2019/12/9/20999646/google-arcore-augmented-reality-updates-occlusion-physics-depth
Immersive Virtual Reality at UC San Diego Takes Researchers to Far Away Worlds
The SunCAVE, which stands for Cave Automated Virtual Environment, is made up of 70 4K, 3D screens connected to 35 computer nodes.
“The computers get used for image segmentation, that’s how we do the organ detection. They get used for looking at NASA weather data so we can try to come up with predictive models. Also, a lot of these computers are getting used for the WiFIRE project, where they’re actually doing simulations of wildfires when they happen,” Polizzi said.
See the full story here: https://www.nbcsandiego.com/news/local/immersive-virtual-reality-at-uc-san-diego-takes-researchers-to-far-away-worlds/2228161/
Report: Magic Leap One Sales Are Horrible, New Version ‘Years Away’
Six months after its release, Magic Leap has reportedly sold only 6,000 augmented reality headsets. Now, the well-funded startup could be "years away" from releasing an upgraded model.
The Magic Leap One made its global debut in August 2018. It's available for $2,295, which appears to be a price that most consumers aren't comfortable with due to augmented reality's limited history. Now, with consumers hesitant to invest in Magic Leap's ecosystem, the well-funded startup doesn't have a clear path forward.
Magic Leap has begun development on an upgraded model. Called the 'Magic Leap Two' behind closed doors, it features a simplified design along with a wider field of view and 5G connectivity. The report claims Magic Leap is running into "fundamental technology constraints," though.
See the full story here: https://www.pcmag.com/news/372429/report-magic-leap-one-sales-are-horrible-new-version-year
Sony Surrenders Handheld Video Game Market to Nintendo
Sony (NYSE:SNE) was once a major player in handheld gaming consoles. Its first handheld, the PSP (PlayStation Portable), sold 81 million units between 2004 and 2014. But its successor, the PS Vita, only sold 16 million units between its launch in late 2011 and its discontinuation earlier this year.
The PS Vita failed due to a lack of compelling titles, weak marketing efforts, its use of pricey proprietary memory cards, and tough competition from Nintendo's (OTC:NTDOY) 3DS, which used weaker hardware but dazzled gamers with its dual screens and stereoscopic 3D effects.
Why Sony isn't interested in challenging Nintendo
For now, Sony seems more interested in next-gen gaming platforms, like cloud gaming and virtual reality, than handheld gaming consoles.
That isn't surprising, for three reasons: Smartphones disrupted the handheld console market, its main rival Microsoft (NASDAQ:MSFT) isn't interested in handheld games, and Nintendo consistently dominated that niche since it launched the original Game Boy 30 years ago.
See the full story here; https://www.fool.com/investing/2019/12/07/sony-surrenders-this-video-game-market-to-nintendo.aspx
Oculus Quest Hand-tracking Starts Rolling Out Today, Developer SDK Next Week
Oculus announced today that hand-tracking on Quest is rolling out starting today with basic functionality. A hand-tracking SDK will be made available next week, giving developers the ability to create third-party applications which use the new feature.
Oculus announced earlier this year that hand-tracking was heading to Quest, though initially they didn’t expect the feature to launch until early 2020. They’ve accelerated that schedule—apparently to get the initial release out the door in time for the holidays—which means that hand-tracking is headed to Quest headsets starting today with the release of v12 software.
See the full story here: https://www.roadtovr.com/oculus-quest-hand-tracking-update/?fbclid=IwAR2ZTv-8wEQi4AWnYiKN-TmJfYzszKOp5XPZgHnQj0habOk_CZ3Of7rUpjY
Top 10 Predictions For Media & Entertainment In 2020
PREDICTION #9 – Real, not virtual, live “experiences” also increasingly find their way into multi-platform media strategies, driven by a growing counter-movement to digital’s frequently heads down isolation. Live experiences, and their more lasting “soul” (not to mention selfie-worthy moments) deepen brand engagement and monetization. They also drive ever grander “offline” experiments and M&A.
Think of Madison Square Garden’s audacious Sphere project here, a $1.2 billion project that aims to reinvent the venue experience. The first MSG Sphere is rising up from the desert floor in Las Vegas right now to blow minds. At smaller scale, but equal mind-blowing impact, Woolf & The Wondershow’s Cages music experience in downtown Los Angeles’s Arts District demonstrates how technology can expand and enhance the possibilities without overpowering the underlying story. It is a “must.”
PREDICTION #10 – “Fake news” (including AI-driven “deepfakes”) overrun 2020’s U.S. elections and cause unprecedented societal disruption. The White House hangs its hat on disinformation campaigns actively promoted by major media and social media players, and claims victory no matter what the actual outcome.
The country is divided and threatened like never before in generations. Hacking headlines add to an increasing sense of mass insecurity. But in the face of daunting forces, optimism survives and social activism rises up. 2020’s fear transitions to 2021’s brave new redemptive possibilities.
Facebook sells off Medium, a 3D sculpting tool, to Adobe
Facebook is selling Oculus Medium — a 3D virtual reality sculpting tool for creatives — to Adobe. The team was an expensive effort for Oculus and its sale signifies a broader rethinking within Facebook in what virtual reality projects they tackle in-house.
It’s clear that Oculus pumped an awful lot of money into Medium over the years and the sale probably isn’t great for the Oculus Medium team, if only because there is now a proper price tag attached to the effort that will be looming for the fairly niche software. Terms of the deal weren’t shared so who knows what kind of deal Adobe got.
See the full story here: https://techcrunch.com/2019/12/07/facebook-sells-off-oculus-medium-to-adobe/
Brace for the Digital-Money Wars
The digital yuan China is planning is in fact a complete inversion of the bitcoin model. All of the data created would be centrally housed and become part of China’s surveillance state.
...it’s an example of the leverage China would have over every transaction on its system. The only question is how heavy-handed the Chinese would be in using it.
While the Chinese model might be the far end of the spectrum, cryptocurrency has been moving in that direction. While bitcoin was designed to mimic the anonymity of cash in a digital setting, all its transactions are public, and therefore trackable. And Facebook’s libra would log transaction data, while recording user identities in a separate database. A central concern in Congress is what Facebook would do with that information.
Say the Federal Reserve digitized the U.S. currency. It could track how every dollar in circulation is spent. That might give it a great advantage in trying to figure out how the economy is growing, and where stimulus efforts would best be directed. But say people in government wanted to lock down some group or activity.
People need to start thinking about this now, Harvard’s Ms. Kumar said. China’s digital yuan will be a real-world proof of concept. The West will need to respond in some way. “Are we prepared for that?” she said. “Not just technically, but legally? Can we protect privacy in this new world?”
See the full story here: https://www.wsj.com/articles/brace-for-the-digital-money-wars-11575694806
Wanted: Virtual reality headsets that aren’t made in China
The U.S. Air Force wants to tap into the augmented and virtual reality technologies that are proliferating in the commercial market, but the service has run into a problem: Many have parts from China, limiting their ability to be used by the U.S. military in operational environments.
“Can we not have an AR [augmented reality] solution that’s made in China? I don’t think that’s good for us,” Col. Gerard Ryan, chief of the Air Force’s operational training infrastructure division, said during a panel discussion Tuesday at the Interservice/Industry, Training, Simulation and Education Conference.
“I don’t think the security policy is going to pass. And I say that sarcastically, but it’s true. If we’re going to use a gaming engine, let’s make sure it’s not made by a foreign country that we don’t like,” he added.
An unclassified environment like basic pilot training is a perfect place for the Air Force to use the augmented and virtual reality devices currently on the market. But for such products to ever see use by fighter and bomber pilots — or any operator that deals with secure information — the service must be sure that no part of the device is made by China, or any other foreign entity that could insert technology that allows for data collection.
See the full story here: https://www.defensenews.com/digital-show-dailies/itsec/2019/12/06/wanted-virtual-reality-headsets-that-arent-made-in-china/
China Announces New Regulations To Combat Fake News Created Using Deepfake Technology
In an effort to deter the rampant spread of “fake news,” Chinese regulators working on behalf of the Cyberspace Administration of China (CAC) have announced new rules that will ban the use of “deepfake” technology to produce and distribute fictional news stories. The upcoming regulations will also require any video and audio content created using VR or AI technology to be marked.
In September, face-swapping app Zao went viral in China, establishing itself as the #1 free app on the App Store and sparking the CAC’s initial anxiety over deepfakes. The worry is that deepfake technology could be used to create hyper-realistic renditions of established figureheads, which could then be used to spread potentially harmful misinformation. According to the transcript published to the CAC website, deepfake technology could “endanger national security, disrupt social stability, disrupt social order, and infringe upon the legitimate rights and interests of others.”
These new regulations, published by three Chinese government agencies, will take effect beginning January 1st, 2020; failure to adhere to the rules will be considered a criminal offense.
Just a month-and-a-half ago, California legislatures introduced their own system for combating deepfake news, banning the distribution of any deepfakes of established political figures within 60 days of an election.
Pages
- About Philip Lelyveld
- Mark and Addie Lelyveld Biographies
- Presentations and articles
- Trustworthy AI – A Market-Driven approach
- Tufts Alumni Bio