Bringing AI into embedded systems with intelligent endpoints

Renesas Electronics is expanding its range of embedded artificial intelligence (e-AI) solutions for incorporating AI into embedded systems by bringing intelligence to endpoints. Approximately 150 companies in more than ten countries worldwide are already conducting trials based on this technology, and there are more than 30 actual e-AI use cases underway. Renesas has now developed a new RZ/A2M MPU to expand the use of e-AI solutions to high end applications.

The new MPU delivers ten times the image processing performance (Note 1) of its predecessor, the RZ/A1, and incorporates Renesas’ exclusive Dynamically Reconfigurable Processor, which achieves real time image processing at low power consumption.

This allows applications incorporating embedded devices – such as smart appliances, service robots, and compact industrial machinery – to carry out image recognition employing cameras and other AI functions while maintaining low power consumption, and accelerating the realization of intelligent endpoints.

Currently, there are several challenges to using AI in the Operational Technology (OT) field, such as difficulty transferring large amounts of sensor data to the cloud for processing, and delays waiting for AI judgments to be transferred back from the cloud.

Renesas already offers AI unit solutions that can detect previously invisible faults in real time by minutely analyzing oscillation waveforms from motors or machines. To accelerate the adoption of AI in the OT field, Renesas has developed the RZ/A2M with DRP, which makes possible image-based AI functionality requiring larger volumes of data and more powerful processing performance than achievable with waveform measurement and analysis.

Since real time image processing can be accomplished while consuming very little power, battery-powered devices can perform tasks such as real time image recognition based on camera input, biometric authentication using fingerprints or iris scans, and high speed scanning by handheld scanners. This solves several issues associated with cloud-based approaches, such as the difficulty of achieving real-time performance, assuring privacy, and maintaining security.

“The adoption of e-AI will bring incalculable advances in convenience, safety, and production efficiency,” said Yoshikazu Yokota, Executive Vice President and General Manager, Industrial Solution Business Unit at Renesas.

“We have successfully improved production yields at our own factories through the use of e-AI, proving the usefulness of AI for endpoints. We will continue expanding the scope of e-AI applications from simple attributes such as colors, shapes, and waveforms to complex image processing in real time. Renesas will also offer e-AI solutions that anyone can use, and lead the way in bringing intelligence to endpoints.”

Main features of the new RZ/A2M with DRP

The RZ/A2M with DRP is a new addition to the RZ/A Series lineup of MPUs equipped with large capacity on-chip RAM, which eliminates the need for external DRAM. The RZ/A Series MPUs address applications employing Human-Machine Interface (HMI) functionality, and the RZ/A2M adds to this capability with features suitable for applications using cameras.

It supports the MIPI camera interface, widely used in mobile devices, and is equipped with a DRP for high speed image processing. Renesas has also boosted network functionality with the addition of two-channel Ethernet support, and enhanced secure functionality with an on-chip hardware encryption accelerator.

These features enable safe and secure network connectivity, making the new RZ/A2M well suited for a wide range of systems employing image recognition, from home appliances to industrial machinery.

Renesas intends to continue advancing its range of e-AI solutions based on DRP technology. In the second half of 2019, Renesas will release an AI accelerator incorporating a DRP with AI processing performance 100 times faster than software processing, and the ability to perform real time inference execution through embedded AI.

In 2021, Renesas will release a next-gen AI accelerator 1,000 times as powerful as a conventional MPU. These Renesas AI innovations will add value to embedded devices and usher in the possibility of endpoints capable not only of inference execution but of learning as well.