Scene-aware Sound Rendering in Virtual and Real Worlds
Abstract:Modern computer graphics applications including virtual reality (VR) and augmented reality (AR) have adopted techniques for both visual rendering and audio rendering. While visual rendering can already synthesize virtual objects into the real world seamlessly, it remains difficult to correctly blend virtual sound with real-world sound using state-of-the-art audio rendering. When the virtual sound is generated unaware of the scene, the corresponding application becomes less immersive, especially for AR. In this position paper, we present our current work on generating scene-aware sound using ray-tracing based simulation combined with deep learning and optimization.Published in: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
See the full story here: https://ieeexplore.ieee.org/abstract/document/9090553
Gucci built a persistent town inside of Roblox
Gucci is making its presence inside of Roblox a little more permanent. The fashion brand previously collaborated with the virtual world for more short-lived experiences, like the surreal Gucci Garden from last year, and is now releasing a more persistent space called Gucci Town. The space features a central garden that links together various areas, including a space for mini-games, a cafe, and a virtual store where players can, of course, purchase virtual Gucci gear for their Robloxavatar. (The company says the virtual outfits make use of Roblox’s new “layered clothing” tech.)
Gucci says that more than 20 million players visited the garden last year, despite it only being available for two weeks, and it expects the new space to steadily evolve over time. ...
See the full story here: https://www.theverge.com/2022/5/27/23143404/gucci-town-roblox

Antarctic virtual reality coming to Katikati
... Through VR, you’ll get to step inside Sir Edmund Hillary's hut, discover what it took to be an Antarctic explorer, and see what life was like living in the coldest place on Earth back in 1957.
This free event will be on 10am-4pm for three days only and is best suited for those aged nine years and older. Places are limited so bookings are essential - head to eventbrite.co.nz to book your session. ...
See the full story here: https://www.sunlive.co.nz/news/302922-antarctic-virtual-reality-coming-to-katikati.html
World’s First A.I. Crossword Game Introduced By Guinness World Records Puzzle Master
The Guinness World Records Puzzle Master has recently launched the world’s first A.I.-powered crossword game that is uniquely designed to solve up to 50% of the puzzle for solvers while learning their solving habits to help them eventually reach Grand Master Solver status. The more you play, the faster you improve.
Simply titled “A.I. Crossword,” the innovative puzzle introduces several never-played-before crossword-solving experiences among daily crossword offerings. Among them is in-game commentary while a player solves the crossword, a reward of “stunnable” facts, and clever comedic video analysis of one’s performance.

Midjourney founder says ‘the world needs more imagination’
... David Holz’s version of this technology, known as Midjourney, quickly rose to prominence, and everyone who got their hands on this text-to-image generatorwas thoroughly impressed. Most recently, the Colorado State Fair’s annual art competition awarded its blue ribbon to emerging digital artists to Jason M. Allen, who had used Midjourney to create an artwork called “Théâtre D’opéra Spatial.” ...
... 1. Could Midjourney replace human designers? ...
“It’s kind of like the moment humans invented cars. Just because cars can go faster than humans, doesn’t mean we cut our legs off. You are going to use cars to get someplace faster. It’s basically augmenting our speed,” he said.
2. Does it plagiarize or violate content policies? ...
Holz claims that the AI engine is designed to only “take inspiration” from the data and ensure that the output is entirely novel, that is, unlike any image that’s publicly available. Oddly enough, Holz claims to have received multiple requests from artists to double down on Midjourney’s ability to take inspiration from their own work as well as others. ...
3. Will it produce results that demonstrate gender biases, reinforce racial stereotypes — or contain anything explicit? ...
As Midjourney is intended to be open by default, it has strict policies on ensuring that content is PG-13. It automatically blocks text inputs that are inherently disrespectful, aggressive, abusive or sexual, Holz confirmed Most importantly, the rules are enforced for all content, including interactions in private mode. ...
“I feel like there are people in technology who basically act like we have no past, and there’s a lot of people in the world in fear of not having a future. But I feel like the truth is we’re actually very much mid-journey,” Holz said. ...
See the full story here: https://venturebeat.com/ai/midjourney-founder-says-the-world-needs-more-imagination/

What The Merge Means
The Merge – the major Ethereum upgrade that happened early Thursday morning – will go down as one of the most important moments in the history of open source. It’s hard to think of a cooler example of a community of hundreds of developers across many organizations driving years of open-ended research and hard technical development.
Many people don’t realize: Transitioning Ethereum to “proof-of-stake” (PoS) – an alternative to “proof-of-work” (PoW) mining for reaching consensus on blocks of transactions – was an insane feat. The update involved hot-swapping the most important component of Ethereum’s architecture – its consensus mechanism – *while it was running*. All this occurred while maintaining perfect uptime for millions of users, thousands of decentralized applications (dapps), and hundreds of billions of dollars secured. ...
- Energy Efficiency
- Security
- Fairness and Decentralization
- Finality
See the full story here: https://a16zcrypto.com/what-the-merge-means/?fbclid=IwAR2bdqgs20wqh-eHB9eAtKkZtG_gPg-HfnSf0yp_A65qQ8uCFqUXJOkvZOY
The Boom and the Bust: How NFTs Went the Way of Beanie Babies
...While NFTs continue to be obnoxious, the bad news is that they will be slow to die off completely. After funneling huge money into the space, venture capitalists will want to see returns on their investments—even if it means throwing good money after bad.
In May, the venture-capital firm Andreessen Horowitz announced it had raised a $4.5 billion crypto fund, the industry’s largest to date. That money has to go somewhere.
The only thing that might make a difference in how the world views NFTs is that Ethereum, the blockchain that most NFTs live on, is shifting to a more energy-efficient proof of stake, so that the network will no longer consume the energy of a small country. The CO2 projection of Ethereum was one of the biggest public objections to NFTs. ...
After raising $450 million in an Andreessen Horowitz-led round in March, Yuga Labs, the company behind Bored Apes Yacht Club, has shifted to creating a massively multiplayer game, which it is now tasked with getting off the ground.
Even when common sense says that NFTs have gone the way of Beanie Babies, venture capitalists, and their over-funded projects, will still be shilling them long past the point where we’ve all stopped listing.
See the full story here: https://news.artnet.com/market/nfts-boom-bust-and-backlash-2176451
The National Building Museum’s Augmented Reality Exhibit Exploring Notre-Dame de Paris Extended to October 9
... The exhibition at the Building Museum begins with the 2019 fire, then takes a trip backward through time to 1163, when the cathedral’s construction began. Or, more precisely, the exhibition begins with visitors being handed a device for virtual time travel called a “HistoPad,” a digital tablet developed by Histovery, which displays augmented reality (AR) recreations of the site of Notre-Dame, replete with 360-degree rotational capabilities and touch-activated historical notations and video animations. 
Notre-Dame's western rose window. Photo © Gigascope
Standing in front of large-scale, high-resolution photographs of the building displayed on 10-foot-high vertical panels, visitors use the tablets to scan each of 21 stops, demarcated by HistoPad-specific images (most akin to a circular QR code), along the way of their AR time-travel experience; these populate the devices with facts and information about the image shown, with options to learn more about builders and craftspeople, construction techniques, and various events through videos and animations that span the cathedral’s nine centuries of use. Interspersed with these images, along a circulation path lined in vinyl recreations of the cathedral’s tile floor, are smaller architectural models and life-sized replicas of Notre-Dame’s statuary, including an imposing gargoyle guarding a room housing an enlarged detail of Jacques-Louis David’s 1807 painting, The Coronation of Napoleon—one of the many historic events to take place within the cathedral. The exhibition’s final room focuses on reconstruction following the 2019 fire, including views of rebuilding efforts as of last year. ...
See the full story here: https://www.architecturalrecord.com/articles/15621-the-national-building-museums-augmented-reality-exhibit-exploring-notre-dame-de-paris-extended-to-october-9
Spoons and bowls that use electricity to make food taste saltier to go on sale in 2023
... This new tableware uses a simple, mild electrical current to enhance the salty flavors of food. This works by passing a specific wavelength of electricity from the surface of the utensil to the food which keys into the ions such as sodium chloride that trigger our sense of saltiness. In doing so these ions all get bunched together when they touch your tongue, for a heightened salty taste without actually adding any more salt. ...
See the full story here: https://soranews24.com/2022/09/12/spoons-and-bowls-that-use-electricity-to-make-food-taste-saltier-to-go-on-sale-in-2023/


Researchers develop a new way to see how people feel about artificial intelligence
... Their study involved carrying out an online survey in Japan, the United States, and Germany, asking respondents to look at four different AI scenarios and answer three questions about each of them, taking into consideration the Ethical, Legal, and Social Issues (ELSI). The first scenario involved using AI for AI-generated singers, the second scenario, AI customer purchases, the third, AI autonomous weapons, and lastly AI predictions of criminal activities. About 1,000 respondents in each country were chosen, reflecting their own country's population for age, gender and location. ...
After analyzing their results, the researchers were able to separate responses into four groups: people with optimistic views, people with negative views, people concerned about legal issues, and those not concerned about legal issues. The team have named this the AI and ELSI segment. ...
In the team's most recent study, they found that overall, the older the respondent, the more concern they had about AI and ELSI issues, while respondents more familiar with AI said they were most concerned about the legal issues.
In regard to each scenario, German and U.S. respondents were most concerned about ethical and social issues regarding AI-generated singers. ...
Details of their study were published in AI and Ethics on September 1.
See the full story here: https://techxplore.com/news/2022-09-people-artificial-intelligence.html
Pages
- About Philip Lelyveld
- Mark and Addie Lelyveld Biographies
- Presentations and articles
- Trustworthy AI – A Market-Driven approach
- Tufts Alumni Bio