... Samsung is reportedly reassessing various aspects of chip architecture to significantly reduce the power consumption required to run LLMs. The company's targets for enhancement include memory design, lightweight model optimization, high-speed interconnects, and advanced packaging.
Additionally, Samsung plans to introduce new chip designs from the AGI Computing Lab through rapid iterations. These designs aim to provide sufficient performance for continuously growing models while helping to save power consumption and costs. ...
See the full story here: https://www.digitimes.com/news/a20240325PD210/agi-google-ai-device-solutions-division-east-asia-ic-design-distribution-it+ce-meta-openai-samsung-server-ipc-cloud-computing-iot-software-big-data-south-korea.html