The ZED SDK 5.0, powered by TERRA AI, our most advanced vision model yet. This release redefines AI perception with 5× faster sensing performance, up to 300% load reduction on Jetson, and unmatched depth quality—even in challenging conditions.
Today, we unveil the ZED SDK 5.0, powered by TERRA AI, our most advanced vision model yet. This release redefines AI perception with 5× faster sensing performance, up to 300% load reduction on Jetson, and unmatched depth quality—even in challenging conditions.
TERRA AI is simply the world’s most accurate, fastest and lightweight vision-based sensing AI available today for various robotic applications such as AMRs, delivery robots, robotic lawn mowers, robotic arms, agricultural vehicles, and wide industrial applications like warehouse and factory automation, as well as stationary digital twin applications.
At Stereolabs, we have believed in the power of human vision since day one. We pioneered 3D computer vision 10 years ago, and we are doing it again today. Over the past five years, we have been developing a new, efficient architecture for AI vision perception, codenamed “TERRA”, and today, we are proud to unveil ZED SDK 5.0, powered by TERRA AI—a unified foundation model that represents a breakthrough in spatial perception.
TERRA AI is a multi-task vision model that can estimate depth, semantic, objects, occupancy in real-time on embedded GPU and NPUs. TERRA AI operates at high resolution, producing 2-megapixel depth maps in 30 milliseconds on an NVIDIA Jetson Orin Nano 8GB.
TERRA AI dramatically outperforms all prior work in depth estimation performance and robustness, delivering up to 5× lower latency and achieving superior accuracy than state-of-the-art networks, especially in challenging industrial environments such as low-light, reflective warehouses and factories, or fog and rain in outdoor farms.
This next-gen perception model further solidifies Stereolab's position as a leader in vision AI solutions for off-road and industrial robotics, enabling surround perception for any application through a broad portfolio of cameras, ECUs, and software.
ZED RGB Image
SDK 5.0, powered by TERRA AI, depth map
ZED SDK 5.0 brings significant enhancements to depth perception using TERRA , while introducing a powerful new option for even faster performance. This release also introduces Magellan™, our third-generation vision-based localization technology, enabling precise positioning both indoors and outdoors with centimeter-level accuracy.
Next-gen AI sensing delivers significantly faster depth computation while reducing Jetson compute load by up to 300%, enabling real-time 360° multi-camera operation on constrained platforms like Orin Nano, making vision-based automation more accessible and efficient.
Performance comparison of depth processing on an NVIDIA Jetson Orin Nano, showcasing up to 5× speed improvement in ZED SDK 5.0.
GPU load comparison on an NVIDIA Jetson AGX, highlighting up to 300% reduction in computational load for improved efficiency in ZED SDK 5.0.
TERRA AI generates high-resolution 2MP depth maps with unmatched sharpness and fine detail, achieving a level of scene understanding and spatial awareness way beyond what competitive sensors or LiDAR can achieve.
Now, users can choose from three modes, each tailored to different application needs:
RGB images
ZED Depth Maps
Conventional Sensor Depth Map
With ZED SDK 5.0, depth sensing capabilities have been significantly enhanced to detect objects from as close as 0.1 meters to as far as 40 meters. This expanded range eliminates blind spots in close-range perception, ensuring safe and reliable operation in a variety of autonomous applications. Far range perception has also been improved, with more accurate edges and point cloud accuracy, enabling ZED cameras to provide unparalleled depth perception across all operating conditions.
Close-range scene
Far-range scene
TERRA AI delivers high-quality perception even in low-light or challenging conditions with texture-less surfaces, repetitive patterns and high-exposure scenes. These improvements set a new benchmark in passive vision-based perception, unlocking the general use of cameras in any environment.
Low-light scene
ZED Depth Map
The new ZED SDK 5.0 introduces intelligent perception capabilities, enabling robots to assess real-time depth confidence and adapt their operation accordingly. TERRA technology has been trained to see through rain and fog, allowing robots to detect and recognize objects in adverse weather conditions. This market-leading 3D camera technology significantly expands robot usability across diverse weather scenarios.
Rainy environment
ZED Depth Map
Magellan™ is Stereolabs' third-generation localization system, engineered to deliver high-precision and reliable positioning for autonomous platforms in industrial environments. By fusing stereo vision, IMU, and optional GNSS data, Magellan™ achieves centimeter-level accuracy across both structured and unstructured environments. This multi-sensor fusion approach ensures robust performance in GPS-denied areas, enabling autonomous systems to navigate with confidence.
Magellan™ is designed for developers and engineers building autonomous solutions in off-road environments, agriculture, logistics, and industrial automation, providing accurate, high-frequency positioning even in challenging environments:
The new SDK enables precise 3D SLAM mapping indoors and outdoors, accurately reconstructing large-scale environments such as roads, farms, warehouses, and ports with georeferenced coordinates.
With ZED SDK 5.0, the capture pipeline architecture has been improved, improving stability, reducing drop frames and lowering video latency below 60ms (just 3 frames), allowing to provide latencies among the lowest in the industry. Beyond depth perception, ZED SDK 5.0 introduces a range of enhancements designed to streamline data handling, improve diagnostics, and boost overall 3D vision performance. Key new functionalities include:
For a detailed breakdown of all new features and improvements, check out the ZED SDK 5.0 Release Notes.
Thanks to the ZED extension in Isaac Sim, users can seamlessly transition from virtual simulation to real-world deployment, accelerating the development and testing of AI vision applications.
Isaac Sim simulator
ZED Depth Viewer
The new ZED SDK 5.0 is designed to transform robotics and machine automation. With tens of thousands of industrial businesses actively integrating ZED cameras and its SDK worldwide, we are set to democratize camera-based vision perception even further. Paired with our new ZED Box Mini and Autonomy Kits, OEMs and developers can now build the next generation of intelligent machines, leveraging cameras as a high-performance, cost-effective, and scalable alternative to LiDAR and traditional active sensors.
“TERRA AI provides a quantum leap in vision sensing performance for roboticists and developers, paving the way for automation applications that were previously impossible. With up to 5× the performance of the previous generation, TERRA AI and ZED SDK 5 are setting a new standard for the industry.” said Cecile Schmollgruber, Stereolabs’ CEO and founder.
ZED SDK 5.0 is more than just an upgrade—it’s a game-changing advancement in AI-powered perception. By combining breakthrough efficiency, enhanced AI depth sensing, and seamless multi-camera support, Stereolabs is empowering developers and enterprises to build the next generation of intelligent machines—at a fraction of the cost of LiDAR or other sensors.
ZED SDK 5.0 with TERRA AI is now available for download. Visit stereolabs.com/developers to learn more and start building the future of AI vision.
To learn more about Stereolabs and its vision-based perception technology, visit stereolabs.com.
