Quad Camera Kit IMX519 produces broken frames

My goal is to record video with Quad Camera Kit IMX519. However, it produces broken frames.

config

sensorID=0
compositionMode=4-Channel
sku=B0388
captureWidth=3840
captureHeight=2160

# (0): none - Identity (no rotation) 
# (2): rotate-180 - Rotate 180 degress
# (6): vertical-flip - Flip vertically
flipMethod=2

frameRate=4
displayWidth=3840
displayHeight=2160

# if 1 CSI interface is connected
# NOTE: use CAM1 instead of CAM0
# CAM1; sensorID=0; i2cBus=9
#
# if 2 CSI interface are connected
# CAM1; sensorID=0; i2cBus=9
# CAM0; sensorID=1; i2cBus=10
i2cBus=9

roiCamID=0

GStreamer Pipeline

    pipeline << "nvarguscamerasrc sensor-id=" << sensorID << " ! "
             << "video/x-raw(memory:NVMM),width=(int)" << captureWidth << ",height=(int)" << captureHeight << ",format=(string)NV12,framerate=(fraction)" << frameRate << "/1 ! "
             // Enable hardware acceleration. This will use the Jetson's hardware encoder to accelerate video processing.
             << "nvvidconv flip-method=" << flipMethod << " ! "
             << "video/x-raw,width=(int)" << displayWidth << ",height=(int)" << displayHeight << ",format=(string)BGRx ! "
             << "videoconvert ! "
             << "video/x-raw,format=(string)BGR ! "
             << "appsink";

Is this because of frameRate=4 ? However, what confuses me is that I can use frameRate=3 but not frameRate=2 when using the default mode.