MediaTek’s Breakthrough: Empowering Smartphones with On-Device Generative AI using Dimensity 9300


The era of generative AI is unfolding with remarkable innovations, promising to reshape our daily lives. Merely a month after Meta’s announcement of the open-source generative AI model, Llama 2, the next-generation AI has already found its way into an essential device we can’t do without, our smartphones. Let’s delve into how MediaTek is integrating Generative AI into its chipsets.

Utilizing Meta’s Llama 2 for MediaTek Dimensity 9300

In an official blog post, MediaTek has revealed its” collaboration” with Meta to employ the Llama 2 Large Language Model (LLM) for incorporating on-device generative AI capabilities into its upcoming flagship chipset, potentially the Dimensity 9300, slated for later this year. This signifies that soon you might own a top-tier smartphone featuring a MediaTek Dimensity chipset, offering AI prowess on the go.

You might question, “What sets this apart from our current usage of generative AI?” The distinction lies in the approach. Most generative AI tasks today rely on cloud computing. In contrast, MediaTek’s partnership with Meta aims to perform AI processing directly on your device, bypassing the cloud. Essentially, AI will become an integral part of your smartphone’s processor.

This shift not only promises faster interactions with generative AI but could also redefine how we engage with AI in the future. Moreover, this development holds a significant aspect of user privacy. Since the on-device implementation will handle AI data locally within your smartphone, it bolsters security and empowers users with better control over their personal data.

MediaTek envisions that offering Generative AI through its chipsets will result in “seamless performance, enhanced privacy, improved security and reliability, lower latency, the ability to operate in low-connectivity areas, and reduced operational costs.”

While details about MediaTek’s upcoming flagship mobile SoC remain scarce, leaks suggest that the Dimensity 9300 chipset will incorporate ARM Cortex-X4 and A720 CPU cores alongside the Immortalis-G720 GPU.

However, MediaTek isn’t the sole semiconductor player venturing into the AI realm. Qualcomm has also joined forces with Meta to integrate on-device generative AI capabilities into its next flagship chipset, leveraging Llama 2’s capabilities. It’s likely that the Snapdragon 8 Gen 3 will become the pioneer mobile chipset to harness Llama 2.

So, how do you perceive this development? Do you believe on-device AI will reshape our smartphone usage patterns? Share your thoughts in the comments section below.


What's Your Reaction?

hate hate
600
hate
confused confused
333
confused
fail fail
133
fail
fun fun
66
fun
geeky geeky
666
geeky
love love
466
love
lol lol
533
lol
omg omg
333
omg
win win
133
win

0 Comments

Your email address will not be published. Required fields are marked *