Home        Store        Learn        Blog

New 4K+stereo ML camera (OpenCV Kickstarter)

Hey everyone,

Just letting people know there’s a kickstarter that’s just begun for a pretty awesome new 4K@30fps + stereo camera with ML capabilities and on-chip encoding (H264/H265/MJPEG). It’s by a partnership between OpenCV and Luxonis, with first units expected to ship in December :smiley:

It builds on the OpenCV-AI Kit Depth (OAK-D) variant they kickstarted for last year and released this year, but is lower cost, lower weight, and smaller, which makes it better suited for applications like robotics. The campaign page has heaps of application videos, along with specs (easiest to find in the FAQs):

If it’s relevant/of interest, they’ve provided a 3D model of it on their github.

A couple of disclaimers:

  • I have personally backed this campaign (it’s already fully funded, so any additional incentive is just to achieve stretch goals).
  • Kickstarter campaigns always come with some risk, particularly given the widespread logistics issues in the technology industry at the moment. For some context, the initial OpenCV AI Kit kickstarter last year had some significant delays in delivery (due pretty much entirely to those logistics issues), so note that while it’s very likely the devices in this campaign will get made and shipped, it’s possible they’ll be later than estimated.
    From the Comments section it seems like they started sourcing components for this at the start of this year, which is why they’re expecting the early backer rewards to be deliverable in December, and once the backer pledge numbers go past what they’ve pre-stocked for they’ll have a new offer for ones that are expected to arrive at some point in 2022 (not yet determined when).

This looks quite interesting. I image that you could place this behind a 4" flat port and scale the results to account for refraction.

I’m curious if there are projects that have used other stereo cameras behind a flat port in projects? How have the results been?

1 Like

That’s what I’m planning to try in my own testing :slight_smile:

I haven’t yet looked into other systems like that, so not sure if they exist / how the results have been if they do. Interested if others have some experience with it :slight_smile:

At this point I’ve played around a bit with simulating the distortion to determine how best to adjust for it, but there’s a few months yet before it’s particularly relevant for that investigating to be completed. It’s also interesting to consider that the refraction is slightly different depending on how salty the water is, so depending on how significant the effects of that are it might need to be calibrated for each dive to get the lowest decimals of accuracy. One positive if salinity refraction is actually significant enough to be detectable is that it would allow visually estimating salinity levels, which would be a super neat application.