IMX519 driver support for Jetson Xavier NX AR helmet stereo at 1440p60

Hi, I’m working on an AR helmet project and I need drivers for the Jetson so I can use the IMX519 camera. My setup is a Jetson Xavier NX with a pair of the Arducam kickstarter IMX519 cameras running in dual for stereo vision. Ideally I’d love to get 1440p@60fps out of these if that’s at all possible. Do you have even preliminary drivers I could try on the Jetson? Happy to go one-on-one if that’s easier - I’ve sent a note about timing privately if you can check your messages.

Quick status on the IMX519 driver side for Jetson: the driver for Jetson Nano on L4T32.6.1 has already been released. The Xavier NX L4T32.6.1 driver is coming within the next few days. Just to set expectations though - the current frame rate performance is the same as it is on the Raspberry Pi. Right now the driver only supports limited frame rates: max resolution runs at ~9fps, and 1080p runs at 60fps. So 1440p@60fps isn’t achievable yet. Frame rate increases are planned but they’ll take some time. Once the Xavier NX driver is out I’ll follow up.

In the meantime here’s how to install the driver once you want to set it up. Grab the full installer and run it targeting the imx519 module:

wget https://github.com/ArduCAM/MIPI_Camera/releases/download/v0.0.3/install_full.sh
chmod +x install_full.sh
./install_full.sh -m imx519

That’s the ArduCAM MIPI_Camera v0.0.3 install script, aimed at the imx519 camera model. Let me know how it goes.

Thanks, I’ll check that out this evening. One question while I’m at it - does auto-focus have any control, or is it fully automatic? I’d like to know if I can drive it manually for the stereo setup.

There’s an example for the focusing functionality of the IMX519 on Jetson - I just uploaded it. Have a look here:

It walks through how to focus the IMX519, so it should give you something to start from for controlling it.

Got it, thanks. Also - do you happen to know when the IR-cut version of this camera will be available? For my setup I’ll probably try the install on a Jetson Nano first and then move it over to the Xavier NX once I get things working.

One more thing - what Nano Jetpack release are you targeting for this release?

Okay, small update. I upgraded my Jetson Nano to the latest JetPack and the camera is now working on the Nano. Autofocus appears to work too. But the image has a green hue to it - is there some color correction that needs to be done? Also going to need to convert the Python code over to C eventually.

About the green hue - that’s related to ISP (Image Signal Processor) tuning. The catch is NVIDIA hasn’t opened up the ISP tuning tools to us yet, so we can’t adjust or tune the ISP effect right now. There’s no workaround on our side at the moment because we simply don’t have access to the tools needed to correct the color. Sorry it’s not better news - if that changes I’ll update here.

Just following up to check in - has there been any resolution on the color issue with this camera since the last update?