... These language models are trained in English, but there’s 13 Indian scripts, and within that there’s probably a couple of hundred languages or language variants. So the cultural context for these languages is different. We do think it deserves an effort to have cultural context and nuances, like in India: You don’t speak Hindi and you don’t speak English, you mix the two, what’s sometimes called Hinglish. So those kinds of things have to be taken into account. Then you go to the other level. Will India rely on something that the technology could be banned, like a U.S. model? ...
Jamali: “Diversity in the kinds of algorithms.” What kind of diversity are we talking about?
Khosla: If you take the human brain, sometimes we do pattern matching, and there’s all kinds of emergent behavior that emerge from that. And [large language models] are going to keep going. ... But it’s possible there’s other approaches, what’s called sometimes neurosymbolic computing. ...
See the full story here: https://www.marketplace.org/shows/marketplace-tech/what-it-means-for-nations-to-have-ai-sovereignty/