... The hardest question ever asked is: What is truth? GPT-4’s programmers think they have the answer. That’s what disturbs me the most. It turns out that the biggest problem of all is philosophical rather than technical, and I get the impression that the researchers have put little thought into this. The researchers’ perspective appears to be that all questions do have “right” answers, hence the model just needs to be trained and properly queried to say the right thing.
But this entirely misses the point that in human society “right” answers and “socially acceptable” answers often aren’t the same thing. ...