In the dynamic field of robotics, perception and awareness are key factors that determine a robot’s effectiveness. Multi-camera systems integrated with the Qualcomm Robotics RB5 Development Kit offer a solution to enhance the visual capabilities of robots. By leveraging high computing power – with low power consumption and low thermal dissipation – developers can unleash a new era of robotic applications.
In this blog post, you’ll discover the benefits and applications of multi-camera systems in robotics, highlighting how this Kit enables robots to perceive, navigate, and interact with their environments. You’ll also get to know why e-con Systems’ multi-camera solutions can play a big role in maximizing the Kit’s performance.
What is the Qualcomm Robotics RB5 Development Kit?
The Qualcomm Robotics RB5 Development Kit is the result of a joint venture between Thundercomm, a top technology company, and Qualcomm – a leader in delivering innovative digital wireless communications products and services. It is built around the Qualcomm QRB5165 processor, a chipset capable of delivering an impressive 15 Tera Operations Per Second (TOPS) of compute power.
Key capabilities of the RB5 Kit:
- Heterogamous processing for robots to handle complex algorithms and tasks
- Various connectivity options, including Wi-Fi, Bluetooth, etc.
- Popular robotics frameworks and operating systems, such as ROS
- Machine Learning and Natural Language Processing to help make intelligent decisions
- Real-time processing capabilities to quickly process sensor data and respond to the environment
- Low power consumption
- Reduced time-to-commercialization
Popular robotic applications supported by the RB5 Kit:
- Autonomous Mobile Robots (AMR)
- Inventory robots
- Retail robots
- Pick-sort-place robots
- Delivery robots
- Industrial & manufacturing robots
- Healthcare robots
- Delivery drones
Limitations of the RB5 Dev Kit from Thundercomm:
While the RB5 Development Kit from Thundercomm provides a great foundation for robotic applications, it is important to note there are limitations regarding the range of camera support, such as a fewer number of cameras. It is not enough for advanced use cases like Automated Guided Vehicles, industrial robots, self-driving vehicles, and even drones – despite these applications being targeted for the QRB5165 processor.
However, you can work with an embedded vision specialist like e-con Systems to circumnavigate past such challenges and build truly revolutionary robotic applications in industries, such as:
Before getting to how e-con Systems’ multi-camera systems can help maximize the potential and performance of this Kit, let’s look at the benefits of doing so.
Benefits of using a Multi-Camera System with the Qualcomm Development Kit
Thermal Efficiency and Low Power Consumption
Qualcomm, originating from the mobile industry, incorporates thermal management techniques into the QRB5165 to ensure effective heat dissipation and minimize the risk of overheating. This optimized thermal performance enhances system reliability, prolongs the lifespan of the cameras, and there is no need for an excessively powerful cooling system.
The Qualcomm QRB5165 processor leverages its extensive experience in mobile technology to integrate advanced power optimization capabilities. These features reduce power consumption, resulting in extended battery life for robots. This will enhance the portability and durability by minimizing the need for frequent recharging, thereby improving the usability of the multi-camera system.
Enhanced Perception and Spatial Awareness
Multi-camera systems provide robots with enhanced perception and spatial awareness. By capturing multiple viewpoints simultaneously, robots can gather a comprehensive understanding of their surroundings. Each camera can be strategically positioned to cover specific angles, enabling the robot to detect obstacles, identify objects, and accurately navigate its environment. The Qualcomm Development Kit’s QMMF (Qualcomm Multi Media Framework), with its advanced processing capabilities, facilitates the real-time processing of data from multiple cameras, enabling robots to make informed decisions swiftly.
Object Recognition and Tracking
One of the key advantages of a multi-camera system is the ability to perform object recognition and tracking. By analyzing images from different angles and perspectives, robots can accurately identify and track objects in their environment. This capability is particularly valuable in applications such as warehouse automation, where robots need to locate and manipulate specific items. With the Qualcomm Development Kit, robots can leverage their cutting-edge processing capabilities of the SNPE (Snapdragon Neural Processing Engine) to perform complex object recognition algorithms in real-time, ensuring accurate tracking and manipulation of objects.
Depth Sensing and 3D Mapping
Multi-camera systems, in conjunction with the Qualcomm Development Kit, enable robots to capture depth information and create detailed 3D maps of their surroundings. By leveraging stereo vision or depth-sensing cameras, robots can estimate the distance to objects and build a depth map, enabling them to navigate and interact with their environment more effectively. This capability is particularly valuable in applications such as autonomous navigation and collaborative robotics. With the processing power of the Qualcomm Development Kit, with the help of highly efficient Adreno GPUs and Hexagon DSPs, robots can generate accurate and real-time 3D maps, enabling them to avoid obstacles, plan optimal paths, and perform complex tasks with precision.
vSLAM (Visual Localization and Mapping)
A multi-camera system integrated with the Qualcomm RB5 Development Kit offers significant advantages for Visual Simultaneous Localization and Mapping (vSLAM) applications. With ROS2 integration capabilities, it allows for stereo vision, enabling precise depth perception and accurate environment mapping. By capturing visual data from multiple cameras with varying viewpoints, robots equipped with the RB5 Kit can generate detailed 3D maps of their surroundings. This enhanced mapping capability, along with improved depth perception, enables more accurate localization and navigation for autonomous systems. So, robots can better understand and interact with their environment, making it a valuable tool for a wide range of applications, including autonomous vehicles, drones, and industrial automation.
Maximize the RB5 Kit with e-con Systems’ Multi-Camera Solutions
Backed by two decades of experience, e-con Systems has built an adapter board that equips the RB5 Kit with superior multi-camera capabilities. This enables users to connect up to 6 cameras (MIPI, GMSL2, or both) simultaneously – making it a breeze to capture detailed images and videos from various angles.
Many of our cameras are designed to support the RB5 Development Kit – from Full HD to 20MP, global shutter to rolling shutter, monochrome or color, and more. These include:
Interested in integrating our cameras into your products? Please write to camerasolutions@e-consystems.com
Check out the Camera Selector to know more about the products we offer.
Suresh Madhu is the product marketing manager with 16+ years of experience in embedded product design, technical architecture, SOM product design, camera solutions, and product development. He has played an integral part in helping many customers build their products by integrating the right vision technology into them.