Multiple Synced Cameras with Timestamping Options?

I want to have multiple (2-4) cameras synced for 3D position estimation detecting Fiducial markers.
The camera system will be estimating the tool pose of a 6DOF robot, likely mounted to the end of arm.
This is desired while the arm is moving and preferably have time-stamping option to sync with an IMU.
I was looking at using the USB3.0 Shield Plus to capture images from 2 OV2311 or OV9281 sensors.

The definition of the USB3.0+ says that the “two cameras cannot be used at the same time” but also that they can be used to achieve “dual-lane synthesis”/“Double column resolution”, which is a bit confusing to me.
Am I right to understand that 2 MIPI cameras can be used (synced) simultaneously but not DVP?

I am on a tight budget, so multiple USB3.0+ shields can’t be purchased easily. But if I wanted 4 cameras or more, what’s my options?

Can I for example use the one 3.0+ shield for timestamping, and sync an external trigger with multiple UVC cameras?

I read that a stereo camera/multicam hat could be connected to the USB3+ shield? Is there an option for multiple different direction cameras, like the multicam hat, without a Raspberry Pi?

Am I right to understand that 2 MIPI cameras can be used (synced) simultaneously but not DVP?

Yes, USB3.0 Plus has two MIPI ports. It can combine two identical cameras into one image output (fully synchronized), but it requires a modified camera.

I am on a tight budget, so multiple USB3.0+ shields can’t be purchased easily. But if I wanted 4 cameras or more, what’s my options?

Maybe you can use USB3.0 Plus and 1MP*4 Quadrascopic Monochrome Camera Bundle Kit, but please note that it does not support automatic exposure, and the exposure of the four cameras can only be set to the same value. (And need a special version)

Can I for example use the one 3.0+ shield for timestamping, and sync an external trigger with multiple UVC cameras?

In theory, it is feasible, but you need to pay attention to whether your UVC camera supports external trigger.

I read that a stereo camera/multicam hat could be connected to the USB3+ shield? Is there an option for multiple different direction cameras, like the multicam hat, without a Raspberry Pi?

Refer to the answer to the second question.

Thank you,

This is great information.

What do you mean by combining the two images into one image output?
Is it 1 image with two layers? Or something different?

Yea, with the UVC Cameras I was looking at the 2 models with support (OV9281 and OV2311).

Would the USB3+ Shield have a connection point I could directly wire to the UVC Cameras as a source of the external trigger or would an Arduino still be needed to send the pulse?

The pictures of two cameras are combined into one picture, side by side.
For example, the image of one camera is 640x480 and the two combined is 1280x480.

USB3.0 doesn’t care what the trigger source is, it only needs to meet the pulse requirements for camera triggering.

Thanks.

I mean, can the USB3.0+ Shield be the trigger source?
For instance is there a pin on the usb shield that can send the trigger pulse to the other cameras, when the 3.0+ shield captures an image normally?

Sorry, I misunderstood,
Just confirmed with our hardware engineer that USB3.0 Plus does not provide the function of sending signals.

1 Like