philip lelyveld The world of entertainment technology

Why Olympic venues are using digital twins

See the 4 minute video here: https://www.bbc.com/reel/video/p0jbsxq6/why-olympic-venues-are-using-digital-twins

Hacker group says it leaked Disney data over the company’s ‘approach to AI’

A group of hackers says it recently leaked internal communications at Walt Disney Co. over the company’s handling of “artist contracts, its approach to AI, and its pretty blatant disregard for the consumer.” ...

California lawmakers are also trying to regulate AI through legislation, and tech companies have responded by urging caution against overregulation. ...

See the full story here: https://www.latimes.com/entertainment-arts/business/story/2024-07-16/disney-leak-hack-nullbulge-ai-artificial-intelligence

These IATSE Artists Are Voting ‘No’ on Their Next Contract, and AI Is to Blame

...

While actors “were able to maintain the rights to their own images and identities and to choose to be replicated or not,” the memo read, “in the new contract language, we have not been given any protections relating to our individual processes when designing, building models, illustrating or creating documents.” ...

Zach Berger, the lead creature designer of the in “Avatar: The Way of Water,” also published a social media thread outlining why he was voting against the contract. Berger explained he was part of the AI task force for the ADG that constructed “proposals that both acknowledged AI’s proliferation, but attempted to protect members’ jobs.”

To his dismay, he did not find any trace of the proposals the task force had assembled in the tentative agreement. ...

“If a producer wants to effectively pre-design the movie for themselves before it even gets to an art department…they want to have the power to do that,” Saunders said. “It’s a huge, huge, huge cost savings. I don’t believe for a second that it’s an accident that stuff was left out.” ...

“We can’t say, ‘Well, this work would normally have taken 10 illustrators three months, and now you’re having two illustrators do it in three weeks,’ Saunders said. “The displacement doesn’t come from the prompts. The selling point of these AI systems is that it means fewer people need to be hired to start with, and that will lead to the credits lists getting shorter on films.” ...

See the full story here: https://www.yahoo.com/entertainment/iatse-artists-voting-no-next-132200635.html

IT’S THE CREATOR ECONOMY

... By Hollywood standards, Dax Shepard is not a huge star. He started this podcast, in his attic on a lark, on his own, after a recent movie, CHiPS, failed. I don’t italicize “on his own” because starting a podcast is either hard or brave. Five million available podcasts is proof that starting a podcast is neither of those. I use italics because podcasting is the perfect example of a large and influential Media segment that almost no one thinks is part of the Creator Economy. And that proves the core thesis of this piece: The Creator Economy is both very different and much bigger than most people think. ...

Yes, Joe Rogan is a millionaire. But he wasn’t when he started his podcast - now the biggest in the world - and he was making $30 million per year on that indie podcast long before Spotify came along. Which is precisely why Spotify wanted him so badly, and why so many huge Media companies are clamoring to do enormous deals with similar Creators like the Smartless guys. They know something I’ve been professing for a while: Increasingly, Creators are generating audiences just as large, and far more engaged, as gatekeeper-led content. ...

See the full story here: https://eshap.substack.com/p/its-the-creator-economy

Here’s how OpenAI will determine how powerful its AI systems are

OpenAI has created an internal scale to track the progress its large language models are making toward artificial general intelligence, or AI with human-like intelligence, a spokesperson told Bloomberg.

Today’s chatbots, like ChatGPT, are at Level 1. OpenAI claims it is nearing Level 2, defined as a system that can solve basic problems at the level of a person with a PhD. Level 3 refers to AI agents capable of taking actions on a user’s behalf. Level 4 involves AI that can create new innovations. Level 5, the final step to achieving AGI, is AI that can perform the work of entire organizations of people. ...

In May, OpenAI dissolved its safety team after the group’s leader, OpenAI cofounder Ilya Sutskever, left the company. Jan Leike, a key OpenAI researcher, resigned shortly after claiming in a post that “safety culture and processes have taken a backseat to shiny products” at the company. While OpenAI denied that was the case, some are concerned about what this means if the company does in fact reach AGI. ...

See the full story here; https://www.theverge.com/2024/7/11/24196746/heres-how-openai-will-determine-how-powerful-its-ai-systems-are

The AI-focused COPIED Act would make removing digital watermarks illegal

PhilNote: I like that it appears to have teeth, but there is a good chance that, as a slow-moving NIST process, by the time it is developed and deployed industry will say the market is too big to implement it and it is unenforceable anyway. Oh yeah, also it will "stifle innovation."

A bipartisan group of senators introduced a new bill to make it easier to authenticate and detect artificial intelligence-generated content and protect journalists and artists from having their work gobbled up by AI models without their permission.

The Content Origin Protection and Integrity from Edited and Deepfaked Media Act (COPIED Act) would direct the National Institute of Standards and Technology (NIST) to create standards and guidelines that help prove the origin of content and detect synthetic content, like through watermarking. It also directs the agency to create security measures to prevent tampering and requires AI tools for creative or journalistic content to let users attach information about their origin and prohibit that information from being removed. Under the bill, such content also could not be used to train AI models.

Content owners, including broadcasters, artists, and newspapers, could sue companies they believe used their materials without permission or tampered with authentication markers. State attorneys general and the Federal Trade Commission could also enforce the bill, which its backers say prohibits anyone from “removing, disabling, or tampering with content provenance information” outside of an exception for some security research purposes. ...

See the full story here: https://www.theverge.com/2024/7/11/24196769/copied-act-cantwell-blackburn-heinrich-ai-journalists-artists?mc_cid=442e730f2e&mc_eid=3ce5196977

OpenAI’s new superalignment

...

OpenAI's new superalignment team, which (over the next four years) will dedicate 20% of OpenAI’s compute resources to solving alignment challenges, will be co-led by Ilya Sutskever and Jan Leike. The team will focus on developing scalable training methods, validating alignment models, and conducting adversarial testing to ensure the AI systems align with human intent and do not go rogue.

Additionally, OpenAI is collaborating with industry leaders like Anthropic, Google, and Microsoft through the Frontier Model Forum. This initiative aims to advance AI safety research, identify best practices, and facilitate information sharing among policymakers, academia, and civil society. The Forum will focus on developing standardized evaluations and benchmarks for frontier AI models to ensure their responsible development and deployment. ...

July 12, 2024 issue https://shellypalmer.com/blog/

Will K-pop’s AI experiment pay off?

...

The music video features an AI-generated scene, and the record might well include AI-generated lyrics too. At the launch of the album in Seoul, one of the band members, Woozi, told reporters he was "experimenting" with AI when songwriting.

“We practised making songs with AI, as we want to develop along with technology rather than complain about it," he said.

...

Her worry though, is that a whole album of AI generated lyrics means fans will lose touch with their favourite musicians.

"I love it when music is a reflection of an artist and their emotions," she says. "K-pop artists are much more respected when they’re hands on with choreographing, lyric writing and composing, because you get a piece of their thoughts and feelings. ...

“What I've learned by hanging out in Seoul is that Koreans are big on innovation, and they're very big on ‘what's the next thing?’, and asking, ‘how can we be one step ahead?’ It really hit me when I was there,” he says.

“So, to me, it's no surprise that they're implementing AI in lyric writing, it's about keeping up with technology.” ...

See the full story here: https://www.bbc.com/news/articles/c4ngr3r0914o

AI’s understanding and reasoning skills can’t be assessed by current tests

PhilNote: this is a really nerdy paper on the various approaches that researchers are taking to determine whether and when an AI "understands" what it was doing. It goes into the flaws of each technique. The conclusion is that an 'understanding test' is a complex moving target that we may never fully solve. For me the most interesting and disturbing finding from one of their evaluations was "Surprisingly, when the researchers investigated the models’ answers at each sub-step, they found that even when the final answers were right, the underlying calculations and reasoning — the answers at each sub-step — could be completely wrong."

... But “AI surpassing humans on a benchmark that is named after a general ability is not the same as AI surpassing humans on that general ability,” computer scientist Melanie Mitchell pointed out in a May edition of her Substack newsletter. ...But “AI surpassing humans on a benchmark that is named after a general ability is not the same as AI surpassing humans on that general ability,” computer scientist Melanie Mitchell pointed out in a May edition of her Substack newsletter. ... But “AI surpassing humans on a benchmark that is named after a general ability is not the same as AI surpassing humans on that general ability,” computer scientist Melanie Mitchell pointed out in a May edition of her Substack newsletter. ...

The Winograd Schema Challenge, or WSC, was proposed in 2011 as a test for intelligent behavior of a system. Though many people are familiar with the Turing test as a way to evaluate intelligence, researchers had begun to propose modifications and alternatives that weren’t as subjective and didn’t require the AI to engage in deception to pass the test (SN: 6/15/12).

Instead of a free-form conversation, WSC features pairs of sentences that mention two entities and use a pronoun to refer to one of the entities. Here’s an example pair:

Sentence 1: In the storm, the tree fell down and crashed through the roof of my house. Now, I have to get it removed.

Sentence 2: In the storm, the tree fell down and crashed through the roof of my house. Now, I have to get it repaired.

A language model scores correctly if it can successfully match the pronoun (“it”) to the right entity (“the roof” or “the tree”). The sentences usually differ by a special word (“removed” or “repaired”) that when exchanged changes the answer. Presumably only a model that relies on commonsense world knowledge and not linguistic clues could provide the correct answers.

But it turns out that in WSC, there are statistical associations that offer clues. Consider the example above. Large language models, trained on huge amounts of text, would have encountered many more examples of a roof being repaired than a tree being repaired. A model might select the statistically more likely word among the two options rather than rely on any kind of commonsense reasoning. ...

For some researchers, the fact that LLMs are passing benchmarks so easily simply means that more comprehensive benchmarks need developing. For instance, researchers might turn to a collection of varied benchmark tasks that tackle different facets of common sense such as conceptual understanding or the ability to plan future scenarios. ...

But others are more skeptical that models performing great on the benchmarks necessarily possesses the cognitive abilities in question. If a model tests well on a dataset, it just tells us that it performs well on that particular dataset and nothing more, Elazar says.  ...

Taking a different approach to testing

Systematically digging into the mechanisms required for understanding may offer more insight than benchmark tests, Arakelyan says. That might mean testing AI’s underlying grasp of concepts using what are called counterfactual tasks. In these cases, the model is presented with a twist on a commonplace rule that it is unlikely to have encountered in training, say an alphabet with some of the letters mixed up, and asked to solve problems using the new rule. ...

To try to get a better sense of language understanding, the team compared how a model answered the standard test with how it answered when given the same premise sentence but with slightly paraphrased hypothesis sentences. A model with true language understanding, the researchers say, would make the same decisions as long as the slight alteration preserves the original meaning and logical relationships. ...

But for a sizable number of sentences, the models tested changed their decision, sometimes even switching from “implies” to “contradicts.” When the researchers used sentences that did not appear in the training data, the LLMs changed as many as 58 percent of their decisions.

“This essentially means that models are very finicky when understanding meaning,” Arakelyan says. This type of framework, unlike benchmark datasets, can better reveal whether a model has true understanding or whether it is relying on clues like the distribution of the words. ...

Surprisingly, when the researchers investigated the models’ answers at each sub-step, they found that even when the final answers were right, the underlying calculations and reasoning — the answers at each sub-step — could be completely wrong. This confirms that the model sometimes relies on memorization, Dziri says. Though the answer might be right, it doesn’t say anything about the LLM’s ability to generalize to harder problems of the same nature — a key part of true understanding or reasoning. ...

In truth, a perfect AI evaluation might never exist. The more language models improve, the harder tests will have to get to provide any meaningful assessment. ...

See the full paper here: https://www.sciencenews.org/article/ai-understanding-reasoning-skill-assess

Stop Trying to Sell Gamers What They Don’t Want

...

Every year, the Game Developers Conference in San Francisco has a main floor filled with every manner of game development tools and platforms. Among these are inevitably Web3 companies trying to explain to an audience of completely uninterested Web2 developers how easy it is to tokenize in-game items and how many transactions per second their layer 2 scaling solution has. But never once has a single of these developers heard from their communities “I really wish my magic spells were NFTs.” ...

Video game players do not care about NFTs. They don’t care about ownership of in-game assets. They don’t care about faster and cheaper blockchains. They fundamentally don’t care at all about the underlying tech stack behind the games they play. ...

Since Web3 developers care about decentralization and ownership of assets, they mistakenly believe everyone else must as well. But the average gamer doesn’t have a clue they don’t “own” the video game skins or items they have bought or received through gameplay.  ...

Then, what do gamers care about? Well, playing an enjoyable game goes without saying. Beyond that, they actually care about many of the same things that those in Web3 care about. The most important of these being community, data, and extensibility. Fortunately, these are all problems Web3 technologies are perfectly set up to solve. ...

One only needs to glance at things like esports tournaments or speed-running stats to see how important data is for players. ... Developers use analytics for in-game activity like balancing or tracking player behaviors, but also for finding what demographics and marketplaces are best for advertising and selling. ..

Finally we have extensibility, or the ability of these systems to be expanded upon. Gamers adore user-generated content. They love every aspect of it, from community tournaments to fan art, to custom maps to secondary marketplaces. ...

See the full story here: https://www.coindesk.com/consensus-magazine/2024/07/10/stop-trying-to-sell-gamers-what-they-dont-want/