Orbbec is an industry-leading company in robotics vision and AI vision technology, dedicated to building a central platform for robotics and AI vision industry and crafting the eyes for robots. Pulse 2.0 interviewed Orbbec Head of Products David Chen to learn more about the company.
David Chen’s Background
What is David Chen’s background? David said:
“I’m David Chen, and I hold a Ph.D. in Mechanical Engineering with a focus on Optical Inspection. Since co-founding Orbbec in 2013, I’ve been dedicated to advancing innovative RGB+Depth camera technology, contributing to over ten successful product launches worldwide. One of the most rewarding experiences was Orbbec’s transition to a publicly traded company in 2022. Leading collaborations with industry leaders like Microsoft and NVIDIA on flagship products, including the Femto Mega camera, has also been a significant highlight.
Currently based in North America, I oversee a diverse portfolio spanning operations, global sales, partner development, and technical support. However, my true passion lies in product design and development. The rapid evolution of AI, robotics, and industrial automation—fields where 3D vision technology is crucial—continues to inspire me. I believe that my expertise will drive meaningful innovation in these transformative areas.”
Formation Of Orbbec
How did the idea for the company come together? Chen shared:
“The idea for Orbbec stemmed from a desire to democratize cutting-edge vision technology. We envisioned a future where advancements in visual technology weren’t restricted to research labs, but accessible and impactful for a wide audience across diverse industries, especially where robotics applications are being adopted.”
Favorite Memory
What has been Chen’s favorite memory working for the company so far? Chen reflected:
“One of my most valuable memories goes back to 2014. Despite having no prior experience in chip design, our team successfully integrated our 3D algorithms into an ASIC chip. This paved the way for the creation of Orbbec’s first-generation vision chip and the development of our first-generation 3D camera.”
Core Products
Screenshot
What are the company’s core products and features? Chen explained:
“Orbbec focuses exclusively on computer vision, utilizing all three major depth camera technologies with a common SDK. The cameras feature custom ASICs, robust optical frame designs, and multi-point calibration for enhanced performance. As a vertically integrated company, we ensure high-quality products and services from design to manufacturing, providing a comprehensive solution for various applications.”
“Our core products and features include:
1.) Stereo Depth Cameras:
a.) Indoor and outdoor operations
b.) Reliable performance in dynamic environments
c.) Wide field of view
d.) (Gemini 335L and Gemini 336L) IP65 dust and water protection
2.) ToF Cameras:
a.) Compact, high-performance device using Microsoft’s industry-proven ToF technology
b.) Depth camera with 1 Mega Pixel ToF and 120° Field of View
c.) 4K RGB with HDR
d.) (Femto Mega I) IP65 dust and water protection
e.) PoE
3.) Structured Light Cameras:
a.) UXGA depth
b.) FHD RGB
c.) Compact form factor, low-cost
Orbbec cameras are integrated across applications in several industries, bringing superior vision capabilities for navigation, object manipulation, and human-robot interaction and enhancing functionality and safety. Some key verticals include:
1.) Robotics & Automation: Our cameras enhance automation and quality control by providing precise depth sensing and object recognition, improving efficiency and accuracy on production lines. Use cases include object detection, segmentation, identification, and empty space detection for object placement.
2.) Healthtech: The 3D vision technology supports advanced medical imaging and diagnostics, enabling more accurate patient monitoring and innovative healthcare solutions. Depth cameras are used for tracking body movements and monitoring patient health..
3.) Fitness: Our cameras integrate with fitness applications by tracking body movements and providing real-time feedback, helping users improve their workout routines. Depth cameras enable accurate body tracking and form analysis.
4.) Logistics: One type of camera enables accurate dimensioning and sorting of packages, streamlining operations for warehousing and logistics. Meanwhile depth cameras assist in mapping, obstacle detection, and collision avoidance.
5.) Retail & Consumer Industries: 3D vision boosts customer experiences through applications such as virtual try-ons, interactive displays, and automated checkout systems. Depth cameras provide accurate measurements and interactive capabilities.”
Challenges Faced
What challenges have Chen and the team faced in building the company? Chen acknowledged:
“Our primary challenge was navigating a fragmented market where 3D vision technology was relatively unfamiliar, compounded by a proliferation of innovative but varying customer products. Some products proved effective while others did not, resulting in market fragmentation. In response, we introduced a range of standardized 3D cameras designed to cater to diverse industries. Additionally, we established a dedicated custom service team to deliver tailored solutions, thereby facilitating clearer pathways for industry adoption. This strategic approach has significantly improved our ability to meet diverse market demands and streamline the adoption of 3D vision technology.”
Evolution Of Orbbec’s Technology
How has the company’s technology evolved since launching? Chen noted:
“Our company’s core technological innovations are reflected in two main areas. First, our self-developed 3D algorithm chip has evolved significantly. It started with a simple structured light algorithm and has since advanced to an efficient stereo depth algorithm, now supporting deep learning and other advanced algorithms. Second, our product line has expanded from a single structured light camera to include stereo depth + structured light cameras and promising technologies like ToF and Lidar.”
Significant Milestones
What have been some of the company’s most significant milestones? Chen cited:
“The company has achieved significant milestones, including the successful launch of their first-generation structured light 3D computing chip, commencement of mass production for their first-generation stereo vision chip, and securing an exclusive partnership with Microsoft for Azure Kinect. We have also successfully completed their initial public offering.”
“Moreover, Orbbec’s integration with the NVIDIA Isaac Perceptor represents a notable advancement. Our Gemini 330 series Stereo Vision 3D cameras, integrated with NVIDIA’s autonomous mobile robot workflow, enhance depth accuracy and extend sensing capabilities in diverse lighting conditions. This integration equips autonomous mobile robots with precise Depth+RGB vision, significantly enhancing their operational reliability across various sectors.”
Customer Success Stories
When asking Chen about customer success stories, he highlighted:
“At Orbbec, we are committed to transforming industries with our advanced 3D vision technology. Here are three customer success stories that highlight the significant impact of our solutions across different industries:
- Pelican Robotics: Fully Automated Loading and Unloading Palletizing
Pelican Robotics is a company that originated from the U.S. Department of Defense, specializing in robotic solutions for pick-and-place cargo operations. Currently, the company has integrated the use of the 3D camera, Femto Mega, developed by Orbbec, into its latest mechanical arm depalletizing and palletizing processes. This integration enables a fully autonomous workflow for loading and unloading goods onto pallets, significantly boosting logistics cargo handling efficiency and propelling customers’ warehouse management into the era of AI automation.
Our depth sensors enable precise spatial recognition, allowing robots to handle a variety of pallet sizes and configurations with remarkable accuracy. This automation not only enhances efficiency but also significantly reduces the risk of workplace injuries, ensuring a safer and more productive environment for workers. By integrating Orbbec’s technology, Pelican Robotics has set a new standard in logistics automation, showcasing the power of our 3D vision systems in streamlining complex industrial processes.
- Moverse: Simplifying Marker-Based Motion Capture
Headquartered in Thessaloniki, Greece, Moverse is a deep technology startup in the 3D animation-related media and entertainment industry. Moverse’s end-to-end 3D animation workflow uses Orbbec Femto Mega devices in sparse (from 4 to 8 cameras) spatiotemporally aligned setups to provide high-quality 3D character animation outcomes in a fast and easy way.
Traditionally, motion capture required complex setups with multiple cameras and markers. Our Femto Mega, developed using Microsoft’s Time of Flight (TOF) technology, simplifies marker-based motion capture (MoCap). By utilizing infrared and depth streams from a single device, even in sparse setups of 3-4 calibrated and synchronized cameras, 3D marker positions can be accurately detected and extracted. Additionally, the integration of our software development kit (SDK) enables seamless utilization of multiple Orbbec Femto Mega or Bolt Devices within Moverse’s motion capture workflow. This innovation demonstrates Orbbec’s commitment to making sophisticated technology more accessible and practical for various industries.
- Velogicfit: Enhancing Sports Biomechanics Solutions
Velogicfit stands at the forefront of sports biomechanics and retail, embodying innovation with a mission to revolutionize human motion analysis. By harnessing cutting-edge technology, Velogicfit transforms data into actionable insights, redefining customer experiences in sports equipment and service purchases. Their approach delivers essential insights, empowering customers to make informed decisions, whether selecting the perfect golf club or receiving expert bicycle coaching.
Velogicfit has integrated Orbbec’s Femto Mega cameras to elevate their advanced sports biomechanics solutions. By utilizing our high-precision depth sensors, Velogicfit has developed a system that provides detailed motion analysis for athletes, helping them optimize their performance and reduce the risk of injury. Our sensors deliver exceptional accuracy and responsiveness, capturing even the most subtle movements. This technology has been instrumental in offering athletes and coaches valuable insights into biomechanics, allowing for data-driven improvements in training and performance.
Additionally, Velogicfit’s integration of Orbbec’s technology was showcased in a BBC documentary, highlighting the real-world applications and benefits of our 3D vision systems in enhancing sports science and biomechanics. The depth cameras enabled Velogicfit to develop a solution that significantly aided Paralympic cyclist Samantha Bosco in her rehabilitation and training by providing precise biomechanical analysis and personalized feedback to enhance her performance. Samantha graciously shares her amazing journey and her pursuit of excellence in the documentary.
These success stories illustrate how Orbbec’s innovative 3D vision technology is driving significant advancements across various industries, improving efficiency, safety, and performance. We are proud to collaborate with visionary companies like Pelican Robotics, Moverse, and Velogicfit, and we remain committed to pushing the boundaries of what’s possible with 3D vision.”
Total Addressable Market
What total addressable market (TAM) size is the company pursuing? Chen assessed:
“We are pursuing the 3D Camera Market, which had a global size of $3.6 billion in 2022 and is projected to hit around $37.92 billion by 2032, with a registered CAGR of 26.6%.”
Differentiation From The Competition
What differentiates the company from its competition? Chen affirmed:
“What differentiates Orbbec from its competition is our world-class manufacturing and supply chain management. Since 2013, we have been dedicated to all things 3D vision technology, from sensors to silicon, algorithms to AI, design to production, supply chain to manufacturing, and from product sales to customer support. We also provide extensive customization options for embedded applications through our ODM (Original Design Manufacturer) and CM (Contract Manufacturer) services. Additionally, our cameras deliver high quality vision at a more accessible price point to competitors and our research and development team continues to iterate our technology to stay ahead of the curve and deliver on the needs of growing robotics applications.”
Future Company Goals
What are some of the company’s future goals? Chen pointed out:
“Our company’s future goals include providing visual hardware and related ODM and CM services for various new intelligent systems amid the ongoing technological revolution driven by modern AI. There are not many companies like ours that have long been dedicated to the design and manufacturing of consumer 3D vision technology. We hope to remain at the forefront in the future.”
Additional Thoughts
Any other topics you would like to discuss? Chen concluded:
As a developer, I personally hope more people will try to use 3D vision systems in new intelligent robots and automated equipment, accelerating the productivity revolution and allowing everyone to enjoy the benefits it brings.
