Aizip Teams Up with Renesas to Demonstrate First-of-Its-Kind Ultra-Efficient Small Language Models (SLMs) and AI Agents for On-Device Arm-based Applications
23 Julio 2024 - 10:10AM
Business Wire
Aizip, in close collaboration with Renesas, announced today the
demonstration of ultra-efficient small language models (SLMs) and
compact AI agents on Arm-based micro-processor units (MPUs) for a
wide range of applications in edge markets. This advancement paves
the way for efficient and effective human-AI interactions in home
appliances, enterprise kiosks, and many other edge devices.
Large language models (LLMs) have revolutionized the AI
landscape, endowing AI systems with logic and reasoning
capabilities beyond simple sensing and perception. By leveraging
LLMs and recent advancements in multi-modal representation, AI
agents can now interact with their environments to utilize tools or
perform tasks based on complex and often ambiguous human commands.
However, these advanced AI systems typically require substantial
effort to train and significant resources to deploy.
Considerable research has therefore been directed towards
developing compact models for on-device edge applications.
On-device models offer advantages that include enhanced privacy
protection, resilient operation, and cost savings. While several
companies have successfully reduced the size of language models for
mobile phones, ensuring accurate tool calling for automation
applications on low-cost edge devices remains a significant
challenge for these SLMs.
Aizip’s mission is to enable pervasive intelligence by building
ultra-efficient, robust, and scalable AI models that can be
deployed anywhere, anytime. Aizip pushes the boundaries of
efficient AI, uncovering key insights such as data-centric
efficiency and AI-design automation. Leveraging its expertise in
developing efficient and robust edge models, Aizip has now created
a series of ultra-efficient small language models (SLMs) and AI
agents, named Gizmo, ranging in size from 300 million to 2 billion
parameters. These models support diverse platforms, including MPUs
and application processors for a broad range of applications.
Recently, Aizip teamed up with Renesas and Arm to demonstrate
the most compact and efficient AI agents to date on MPUs. These
remarkably small and efficient models have been deployed on Renesas
RZ/G2L and RZ/G3S boards. Built on Arm® Cortex®-A55, the Renesas MPUs are now available
for commercial use. Despite their compactness, these SLMs and
SLM-based AI agents achieve robustness and accuracy comparable with
cloud-based large models for domain-specific applications.
Utilizing an AI design automation pipeline, these SLMs and
SLM-based AI agents can be rapidly generated for new
applications.
“We’re witnessing a pivotal moment in efficient AI where
on-device AI agents can truly make everything think,” described
Weier Wan, a founding member of Aizip and head of Aizip’s SLM and
AI-agent development. According to Weier, on the RZ/G2L with a
single A55 core running at 1.2 GHz, they can achieve a response
time of less than 3 seconds. “With Renesas’s readily available IC,
we can offer the AI SLM and agents right now. Renesas devices are
known for their high quality and mature development environment,
and we’re excited to team up with them in offering this
breakthrough solution.”
Renesas, a global leader in MPUs and MCUs, has been aggressively
pushing the envelope in the edge and endpoint markets. “We see AI
moving rapidly in our direction, and we are ready for it,” said
Kaushal Vora, Sr. Director of Business Acceleration and Ecosystem
of Renesas. “We are particularly excited about Aizip implementing
an on-device agent on our MPU. We can envision, for example,
RealityCheck HVAC could predict a potential issue with a component
in a heat pump; the AI agent acts on this real-time operational
information, looking up the appropriate OEM part and scheduling a
service call with the technician for replacement. Aizip has been an
excellent strategic partner, and we have achieved multiple
milestones together,” Vora further commented.
“To address the rapid growth of AIoT applications, devices
require higher performance and intelligence at the edge,” said
Lionel Belnet, Senior Director HW Product Management, IoT Line of
Business at Arm. “Arm is the platform of choice for AI solutions
from cloud to edge, and running Aizip’s new SLMs and AI Agents on
Arm-based technologies will provide the performance and efficiency
needed to scale the edge AI opportunity even further.”
“Efficiency is critical for AI systems,” explained Yubei Chen,
co-founder of Aizip and assistant professor at UC Davis. “Natural
intelligence demonstrates remarkable efficiency. From a scientific
perspective, there’s immense potential for AI to improve, and
efficiency is the key to achieving human-level intelligence.” The
Aizip Intelligent Language (AIL) model series, including AI agents,
is an extension of Aizip’s efforts to bring efficiency and
sustainability to real-world applications. “Aizip is excited to be
a part of the Arm ecosystem, utilizing industry-leading design
solutions to deliver new AI use cases worldwide.”
The partnership between Aizip and Renesas has led to successful
tinyML models in audio, vision, and time-series. Now, they are
collaborating in the rapidly growing market of SLMs and agents for
on-device applications. This reflects the commitment of these
companies to providing low-cost, high-performance solutions that
benefit society at large. For additional information, please
contact info@aizip.ai.
About Aizip, Inc.
Situated in the heart of Silicon Valley, Aizip, Inc. specializes
in developing superior AI models tailored for endpoint and edge
device applications. Aizip stands out for its exemplary model
performance, swift deployment, and remarkable return on investment.
These models are versatile, catering to a spectrum of intelligent,
automated, and interconnected solutions. Discover more at
www.aizip.ai.
View source
version on businesswire.com: https://www.businesswire.com/news/home/20240723463718/en/
Nathan Francis, Nathan@aizip.ai