Pull RTSP stream failed on i.MX 8MP

[noway]

hi,  community

# iMX 8MP

@ Harvey021

I missed an issue during pull rtsp stream.

The "RTSP_URL" has has been verified using VLC.

Video coding: H264

command: gst-launch-1.0 rtspsrc location=$RTSP_URL queue ! rtph264depay ! v4l2h264dec ! autovideosink

target image version: linux6.6.36 full

target machine: i.MX 8mp

[Zhiming_Liu]

Hi,

Please try to use below command.

gst-launch-1.0 -v rtspsrc location=$RTSP_URL protocols=tcp latency=100 ! rtph264depay ! avdec_h264 ! autovideosink

Best Regards,
Zhiming

[noway]

He indicated that the avdec_h264 was not found. 

And then I try the v4l2h264dec, Nor was it successful. Please refer to the attachment for the error log.

trying command:  gst-launch-1.0 -v rtspsrc location=$RTSP_URL protocols=tcp latency=100 ! rtph264depay ! v4l2h264dec ! autovideosink > pull.log 2>&1

[Zhiming_Liu]

Hi,

Please try below command to split audio and video configuration.

gst-launch-1.0 -v rtspsrc location=xxxxx name=src protocols=tcp latency=100 \
  src. ! queue ! application/x-rtp,media=video,encoding-name=H264,payload=96  ! rtph264depay ! h264parse ! v4l2h264dec! videoconvert ! autovideosink \
  src. ! queue ! application/x-rtp,media=audio,encoding-name=MPEG4-GENERIC,payload=97 ! rtpmp4gdepay ! aacparse ! avdec_aac ! audioconvert ! audioresample ! autoaudiosink

Best Regards,
Zhiming

[noway]

Thank you for your reply, the decoding is now working. However, I still have two issues:

1. When I change the video resolution from 1080p to 2K, it cannot decode

         Please refer to the attached file "pull.log" for the log.

      2. When decoding with Python, I found it takes 0.4 seconds to get one frame of data - why is it so slow? Please refer to the attached file "rtsp.py" for the code.

[Zhiming_Liu]

Hi @noway 

If you want to decode video for 60FPS, the maximum resolution is 1080p, the gstreamer has limited maximum resolution. The performance will decrease as the resolution increases on VPU.

For the opencv, you can try below configuration.

gst = f"rtspsrc location={RTSP_URL} protocols=tcp latency=50 ! " \
     f"rtph265depay ! h265parse config-interval=-1 ! " \
     f"decodebin ! videoconvert ! video/x-raw,format=BGR ! " \
     f"queue max-size-buffers=1 leaky=downstream ! " \
     f"appsink drop=true max-buffers=1 sync=false"
cap = cv2.VideoCapture(gst, cv2.CAP_GSTREAMER)

Best Regards,
Zhiming

[noway]

The video's fps is 10. The following is the detailed information.

[Zhiming_Liu]

Hi,

Is there more information?

Best Regards,
Zhiming