The ‘Nonsense Language’ That Could Subvert Image Synthesis Moderation Systems
New research from Columbia university suggests that the safeguards that prevent image synthesis models such as DALL-E 2, Imagen and Parti from being able to output damaging or controversial imagery are susceptible to a kind of adversarial attack that involves ‘made up’ words.
The author has developed two approaches that can potentially override the content moderation measures in an image synthesis system, and has found that they are remarkably robust even across different architectures, indicating that the weakness is more than just systemic, and may key on some of the most fundamental principle of text-to-image synthesis. ...
The first, and the stronger of the two, is called macaronic prompting. The term ‘macaronic’ originally refers to a mixture of multiple languages, as found in Esperanto or Unwinese. Perhaps the most culturally-diffused example would be Urdu-English, a type of ‘code mixing’ common in Pakistan, which quite freely mixes English nouns and Urdu suffixes. ...
Cryptic Language in DALL-E 2
It has been suggested before that the gibberish that DALL-E 2 outputs whenever it tries to depict written language could in itself be a ‘hidden vocabulary’. However the prior research into this mysterious language has not offered any way to develop nonce strings that can summon up specific imagery. ...
See the full story here: https://www.unite.ai/the-nonsense-language-that-could-subvert-image-synthesis-moderation-systems/
Nvidia Unveils Virtual Human Builder for Metaverse Characters
Nvidia has introduced a new platform for building virtual beings to interact with in the digital realms of the metaverse, which Nvidia refers to as its Omniverse. The Nvidia Omniverse Avatar Cloud Engine (ACE) provides a collection of AI models and related tools for users to design the AI creations that will populate their virtual worlds, including synthetic voices and visual media.
ACE SYNTHESIZED
The cloud-based ACE catalog streamlines building virtual beings and applies Nvidia’s computing power to setting up and embedding the AI avatars in digital worlds. ...
POPULATING THE OMNIVERSE
ACE is the next step in Nvidia’s metaverse project. The Omniverse began with scene-setting and building out the virtual landscape. Ace will help Nvidia and its partners populate it with the AI characters that make it more than just an empty digital wasteland. ...
See the full story here: https://voicebot.ai/2022/08/09/nvidia-unveils-virtual-human-builder-for-metaverse-characters/
This is how Snap is fostering the future of augmented reality
... Dominguez, who has spent her career popularizing virtual and augmented reality and wearable tech, is helping to build a developer community interested in using AR in increasingly ambitious domains, including education, information, and gaming. To this end, she’s helped roll out several tools in 2022, including Custom Landmarkers, which let third parties tie their Snapchat lenses to specific real-world locations, and Lens Cloud, a suite of cloud-based services for speeding AR creation.
A few hundred content creators also have access to the latest version of Snap’s Spectacles smart glasses, which incorporate dual 3D waveguide displays to weave AR right into the world people see before them....
See the full story here: https://www.fastcompany.com/90764936/sophia-dominguez-snap-most-creative-people-2022
18 Best Open-World Games That Support VR
1 Modbox
In the rush of VR integration, not a lot of games take into account how fun the technical sandbox formula is with new hardware. Where apps like Kingspray and Tilt Brush push the artistic envelope, Modbox is sort of a breakout experimental system on-par with what Garry's Mod was to PC users in the early 2000s.
Modbox allows players tools to create and explore with their own game mechanics in an open sandbox, with several pre-made examples that give players a fun experience with their friends, including an asymmetrical titan-battle mode.
See the full story here: https://gamerant.com/best-open-world-games-virtual-reality-vr/
The iRobot Deal Would Give Amazon Maps Inside Millions of Homes
... Those Roombas work in part by using sensors to map the homes they operate in. In a 2017 Reuters interview, iRobot CEO Colin Angle suggested the company might someday share that data with tech companies developing smart home devices and AI assistants.
Combined with other recent acquisition targets, Amazon could wind up with a comprehensive look at what’s happening inside people’s homes. ...
“People tend to think of Amazon as an online seller company, but really Amazon is a surveillance company. That is the core of its business model, and that’s what drives its monopoly power and profit,” says Evan Greer, director of the nonprofit digital rights organization Fight for the Future. “Amazon wants to have its hands everywhere, and acquiring a company that’s essentially built on mapping the inside of people’s homes seems like a natural extension of the surveillance reach that Amazon already has.” ...
See the full story here: https://www.wired.com/story/amazon-irobot-roomba-acquisition-data-privacy/?ck_subscriber_id=1646162133&utm_source=convertkit&utm_medium=email&utm_campaign=Amazon+Mapping+Your+Life%20-%208721407
Why the future of connected IoT in homes is child-centric
- AI-enabled IoT devices in homes shape and will shape the individual and societal development of the youngest generation.
- Matter – the upcoming interconnectivity standard – will enable diverse IoT devices to connect in homes while their inherent risks will affect children the most and put age-appropriate design requirements and standards to the test.
- Measures such as pretraining AI systems with synthetic data und using large open source databases are components that could form essential pillars in a child-centric IoT governance framework.
See the full story here: https://www.weforum.org/agenda/2022/08/why-the-future-of-connected-iot-in-homes-is-children-centric/
MSG Sphere’s Immersive Sound Technology to Debut in New York
When Las Vegas’ $1.8 Billion MSG Sphere opens, one of the venue’s calling cards will be its cutting-edge concert audio system, dubbed Sphere Immersive Sound. While the venue won’t open until the second half of 2023, concertgoers will be able to experience Sphere Immersive Sound much sooner, thanks to a new permanent installation of the technology inside New York City’s Beacon Theatre. The new system will make its debut on August 19 and 20, 2022, with a pair of acoustic concerts by Trey Anastasio. ...
The Beacon’s installation will be based around five arrays inside the venue, arranged to direct sound throughout four sections—orchestra, loge, lower balcony and upper balcony. ...
With approximately 17,500 seats—including 10,000 “immersive seats”—and a scalable capacity up to around 20,000 guests, MSG Sphere at The Venetian will employ a multi-layered audio system equipped with more than 160,000 speakers that will utilize the beamforming technology. The venue will also feature a variety of multi-sensory technologies such as immersive seating, scents and changing temperatures. ...
