philip lelyveld The world of entertainment technology

12Apr/19Off

A leading AI conference is trying to fix the field’s reproducibility crisis

reproducibilityLast week, organizers of the Neural Information Processing Systems Conference (NeurIPS), one of the world’s largest annual AI research conferences, updated their policy for paper submissions to require what they’re calling a reproducibility checklist. It’s a small shift in a grander fight to curb the growing “reproducibility crisis” in science, where a disconcerting number of research findings are not successfully being replicated by other researchers, casting doubt on the validity of the initial findings.

In February, a statistician from Rice University warned that machine-learning techniques are likely fueling that crisis because the results they produce are difficult to audit. It’s a worrying problem as machine learning is increasingly being applied in important areas such as health care and drug research.

As the “world's most significant AI conference,” wrote Jack Clark, the policy director of the nonprofit OpenAI, in his weekly newsletter Import AI, “NeurIPS 2019 policy will have [a] knock-on effect across [the] wider AI ecosystem.”

See the full story here: https://www.technologyreview.com/the-download/613297/the-biggest-ai-conference-is-trying-to-fix-the-fields-reproducibility-crisis/?fbclid=IwAR0FVhzvXuqUaRZMng5uEXDdG45AYuxFPQoUOQ0RdIAKv92BK5z_l1SXnOs

Comments (0) Trackbacks (0)

Sorry, the comment form is closed at this time.

Trackbacks are disabled.