MediaTek uses Meta Llama 2 language model to empower terminal devices to generate AI applications.
MediaTek today announced that it is leveraging Meta's next-generation open source large language model (LLM) Llama 2 and MediaTek's advanced AI processor (APU) and complete AI development platform (NeuroPilot) to build a complete end-side AI computing ecology that accelerates AI application development on smartphones, Internet of things, automotive, smart home and other edge devices, providing a more secure, reliable and differentiated experience for end devices. Smartphones using MediaTek's new generation of Tianji's flagship mobile chip are expected to support AI applications developed by the Llama 2 model by the end of the year, bringing users an exciting generative AI application experience.
Dr. Xu Jingquan, Senior Deputy General Manager of MediaTek and General Manager of Wireless Communications, said, "the growing popularity of generative AI is one of the important trends in the digital transformation. Our vision is to provide Llama 2 developers and end users with tools to bring more exciting AI innovation opportunities and product experiences. Through its partnership with Meta, MediaTek provides a more powerful overall hardware and software solution that brings far more functionality and experience to end devices than ever before. "
At present, most generative AI rely on cloud computing, and MediaTek successfully runs generative AI applications directly on terminal devices based on Llama 2 model. This will provide developers and users with unique advantages, including a seamless user experience, stronger user information security and reliability, lower latency, offline computing capabilities and lower operating costs, so that everyone can enjoy the convenience and innovation brought about by generative AI.
To unleash the full potential of spanning AI on end devices, device manufacturers need to adopt high-computing, low-power AI processors (APU) and enhance the overall computing power of devices through faster and more reliable network connections. Today, every MediaTek 5G smartphone SoC is equipped with an AI processor, and a wide range of successful spanning AI applications have been implemented, such as AI noise reduction (AI-NR), AI Super Resolution (AI-SR) and AI Motion compensation (AI-MEMC).
MediaTek will launch a new generation of flagship mobile chips at the end of the year, which will adopt a software stack (NeuroPilot) optimized for the Llama 2 model, and an upgraded AI processor (APU) that supports Transformer model for backbone network acceleration, which can reduce the read and write consumption and bandwidth consumption of dynamic random access memory (DRAM), further enhance the performance of large language models and generative AI applications, and help developers create amazing AI applications. Accelerate the development of AI applications for terminal devices.
