Facebook aims to help AI models forget with Expire-Span
By forgetting, AI will be able to retain more information at scale because it will be able to memorize the most critical items.
The company introduced a tool called Expire-Span, which enables AI models, to forget. Today, AI models including neural networks memorize information and data without distinction. By forgetting, AI will be able to retain more information at scale because it will be able to memorize the most critical items.
Expire-Span evaluates each piece of information in a model and predicts what will be more important to return. The training data is based on context as the model learns.
In a blog post, Facebook explained that processing information indiscriminately can work on a small scale. But once models take on more data the computational costs surge.
Aside from the computation and storage savings, Expire-Scan processes can enable models to optimize over time.
Facebook said Expire-Scan was inspired by the way humans retain memories.
See the full story here: https://www.zdnet.com/article/facebook-aims-to-help-ai-models-forget-with-expire-span/
