In an essay published to his personal website, Anthropic CEO Dario Amodei announced plans to create a robust "MRI on AI" within the next decade. The goal is not only to figure out what makes the technology tick, but also to head off any unforeseen dangers associated with what he says remains its currently enigmatic nature.
"When a generative AI system does something, like summarize a financial document, we have no idea, at a specific or precise level, why it makes the choices it does — why it chooses certain words over others, or why it occasionally makes a mistake despite usually being accurate," the Anthropic CEO admitted. ...
The whole thing is driven by ingested human creative works, not from first principles of machine intelligence.
"This lack of understanding," Amodei wrote, "is essentially unprecedented in the history of technology." ...
See the full story here; https://futurism.com/anthropic-ceo-admits-ai-ignorance