MediaTek Boosts On-Device AI with Meta's Llama 2
MediaTek, a leading global fabless semiconductor company powering over two billion connected edge devices annually, has partnered with Meta's Llama 2, the next-gen open-source Large Language Model (LLM). This collaboration aims to create a comprehensive edge computing ecosystem by integrating Meta's LLM with MediaTek's advanced APUs and NeuroPilot AI Platform. The goal is to accelerate AI application development for edge devices like smartphones, IoT, vehicles, and smart homes.
Unlike the conventional approach of cloud-based Generative
AI processing, MediaTek's use of Llama 2 models allows generative AI
applications to run directly on-device. This offers benefits like improved
performance, privacy, security,
lower latency, and reduced operational costs. MediaTek's 5G smartphone SoCs are
equipped with APUs capable of executing various Generative AI features. The
upcoming flagship chipset will feature a software stack optimized for Llama 2
and an upgraded APU, enhancing on-device Generative AI capabilities.
JC Hsu, Corporate Senior VP and GM of Wireless Communications
Business Unit at MediaTek, states, "Through our partnership with Meta, we
can deliver hardware and software with far more capability in the edge than
ever before." MediaTek anticipates Llama 2-based AI applications to be
available for smartphones with the next-gen flagship SoC by year-end.
Comments
Post a Comment