This is a problem that occurred during the NEXTCHIP N4 (NVP6324, CSI) video decoder test on IMX8MM.
It uses mx6s_capture.c and mxc_mipi_csi.c drivers based on Linux 4.14.78-GA1.0.0 version.
There is a problem that the captured video frame shifts like the attached file.