Made for the IoT: The Qualcomm Vision Intelligence Platform

Smart Blog

Made for the IoT: The Qualcomm Vision Intelligence Platform

Qualcomm presented a new platform that demonstrates the companies commitment to the Internet of Things. It is providing a solution intended to serve as a launch pad for OEMs with Qualcomm Vision Intelligence Platform.

The platform, anchored by the Qualcomm QCS605 and Qualcomm QCS603 SoC, is imbued with Qualcomms latest developments in camera and AI. The two 10nm SoCs include advanced camera processing software, machine learning and computer vision software development kits (SDKs), and proven connectivity and security technologies — all of which are designed explicitly for next-generation IoT devices.
The Vision Intelligence Platform combines cutting-edge processing and AI with superior imaging, which is key because so many IoT applications utilize visual information. This goes beyond security cameras, including devices like ovens, robotic vacuum cleaners and drones.
The processing of that information can be done in the cloud, but that takes resources and time. A camera that has the intelligence itself can decide how to respond based on what it knows instead of waiting for video data to be sent to the cloud and analyzed. This is what’s known as edge computing — using smart devices to make decisions and take actions where the action is. The advantages of edge computing include faster processing, local control, better security and privacy, and the use of less network bandwidth. The integration of this technology in the new Platform will push the IoT ecosystem forward, as developers move away from the cloud and focus on the capabilities of the device.

Qualcomm: Vision Intelligence Platform

The Vision Intelligence Platform features a 8-core, 64-bit Qualcomm Kryo 300 CPU, Qualcomm Adreno 615 GPU, Qualcomm Hexagon 685 Vector Processor, Qualcomm Spectra 270 ISP, as well as DSPs for sensors and audio. With these components, and support for up to 2×2 802.11ac Wi-Fi with MU-MIMO, Bluetooth 5.1, the Qualcomm 3D Audio Suite, Qualcomm Aqstic Audio technologies, and Qualcomm aptX audio, developers have the cutting-edge tools needed to build IoT applications that can see, hear, and connect to the world around them.
The Vision Intelligence Platform also integrates an AI Engine, which includes the hardware listed above and software, such as the Qualcomm Snapdragon Neural Processing Engine (NPE), that support on-device AI. The NPE boasts analysis, optimization, and debugging capabilities that help developers and OEMs port trained networks into the platform. The AI Engine is compatible with Tensorflow, Caffe and Caffe2 frameworks, Open Neural Network Exchange interchange format, Android Neural Networks API, and the Qualcomm Hexagon Neural Network library, so developers have the freedom to use their preferred framework.

The Qualcomm QCS603 and QCS605 SoCs are currently sampling. A QCS605-based VR/360 camera reference design from Altek, an original design manufacturer for cameras, is available today. A QCS603 based industrial security camera reference designs will be available later in 2018.

Author: Tim Cole
Image Credit: Qualcomm


Leave a Reply

Your email address will not be published. Required fields are marked *