A customer I.MX8M mini board GST command can not use vpudec plugin

[刘国华]

Dear 

 We are help a customer to design a I.MX8M mini SOM board for the production . For the customer production application , we capture the picture from  a usb network(RTSP) camera , and then feed the picture data to algorithm for data processing . 

The RTSP camera connected with imx8m mini with USB interface and recognize as a RNDIS ethernet device(IP address:192.168.2.100).

     I tied to use some gstreamer commands to get the RTSP camera video data streaming, tested with NXP offical imx8m mini EVK with RTSP camera no those below issues:

Right now we encounter the problem . 

1. gst-launch-1.0  rtspsrc location=rtsp://user:pass@192.168.2.100:6667/blinkhd,when using this command with shell or opencv c++ code by videocapture(), the results are working well.
2. gst-launch-1.0 rtspsrc location=rtsp://192.168.2.100:6667/blinkhd ! queue ! rtph264depay ! h264parse ! appsink, when using this command with shell, the results is OK; BUT when runing the same command with opencv c++ code by videocapture(), the code will make the console halt, ​and it can use ctrl + C to terminate the application.

1. gst-launch-1.0 rtspsrc location=rtsp://192.168.2.100:6667/blinkhd ! queue ! rtph264depay ! h264parse ! vpudec ! appsink, when using this command with shell or opencv c++ code by videocapture(), the results are the same.

   the console will halt and NO response can't terminate the application by ctrl +  C. I find that the gstreamer plugins "vpudec" will make the shell or opencv c++ code by videocapture(),

root@imx8mmevk:~# gst-launch-1.0  rtspsrc location=rtsp://user:pass@192.168.2.100:6667/blinkhd

Setting pipeline to PAUSED ...

Pipeline is live and does not need PREROLL ...

Progress: (open) Opening Stream

Progress: (connect) Connecting to rtsp://user:pass@192.168.2.100:6667/blinkhd

Progress: (open) Retrieving server options

Progress: (open) Retrieving media info

Progress: (request) SETUP stream 0

Progress: (request) SETUP stream 1

Progress: (open) Opened Stream

Setting pipeline to PLAYING ...

New clock: GstSystemClock

Progress: (request) Sending PLAY request

Progress: (request) Sending PLAY request

Progress: (request) Sent PLAY request

^Chandling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 0:00:02.093551375

Setting pipeline to PAUSED ...

Setting pipeline to READY ...

Setting pipeline to NULL ...

Freeing pipeline ...

root@imx8mmevk:~# gst-launch-1.0 rtspsrc location=rtsp://192.168.2.100:6667/blinkhd ! queue ! rtph264depay ! h264parse ! appsink

Setting pipeline to PAUSED ...

Pipeline is live and does not need PREROLL ...

Progress: (open) Opening Stream

Progress: (connect) Connecting to rtsp://192.168.2.100:6667/blinkhd

Progress: (open) Retrieving server options

Progress: (open) Retrieving media info

Progress: (request) SETUP stream 0

Progress: (request) SETUP stream 1

Progress: (open) Opened Stream

Setting pipeline to PLAYING ...

New clock: GstSystemClock

Progress: (request) Sending PLAY request

Progress: (request) Sending PLAY request

Progress: (request) Sent PLAY request

^Chandling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 0:00:03.725918875

Setting pipeline to PAUSED ...

Setting pipeline to READY ...

Setting pipeline to NULL ...

Freeing pipeline ...

root@imx8mmevk:~# gst-launch-1.0 rtspsrc location=rtsp://192.168.2.100:6667/blinkhd ! queue ! rtph264depay ! h264parse ! vpudec ! appsink

Setting pipeline to PAUSED ...

====== VPUDEC: 4.5.7 build on Apr 20 2021 08:27:54. ======

        wrapper: 3.0.0 (VPUWRAPPER_ARM64[  221.822105] audit: type=1701 audit(1615450431.744:3): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=577 comm="gst-launch-1.0" exe="/usr/bin/gst-launch-1.0" sig=4 res=1

[  221.838967] audit: type=1701 audit(1615450431.744:4): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=250 comm="systemd-journal" exe="/lib/systemd/systemd-journald" sig=6 res=1

[  221.854738] audit: type=1701 audit(1615450431.748:5): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=578 comm="systemd" exe="/lib/systemd/systemd" sig=6 res=1

[  221.869003] audit: type=1701 audit(1615450431.748:6): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=532 comm="sh" exe="/bin/bash.bash" sig=11 res=1

[  221.869013] audit: type=1701 audit(1615450431.748:7): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=513 comm="login" exe="/bin/login.shadow" sig=11 res=1

[  221.869020] audit: type=1701 audit(1615450431.764:8): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=480 comm="systemd-logind" exe="/lib/systemd/systemd-logind" sig=6 res=1

[  221.869026] audit: type=1701 audit(1615450431.776:9): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=415 comm="syslogd" exe="/sbin/syslogd" sig=6 res=1

[  221.885643] printk: systemd: 32 output lines suppressed due to ratelimiting

[  221.949117] audit: type=1701 audit(1615450431.872:10): auid=4294967295 uid=997 gid=996 ses=4294967295 pid=379 comm="dbus-daemon" exe="/usr/bin/dbus-daemon" sig=4 res=1

[  221.964236] audit: type=1701 audit(1615450431.872:11): auid=0 uid=0 gid=0 ses=1 pid=525 comm="systemd" exe="/lib/systemd/systemd" sig=11 res=1

[  221.977082] audit: type=1701 audit(1615450431.872:12): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=522 comm="wpa_supplicant" exe="/usr/sbin/wpa_supplicant" sig=4 res=1

[  229.399684] kauditd_printk_skb: 7 callbacks suppressed

[  229.399690] audit: type=1701 audit(1615450439.324:20): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=266 comm="systemd-udevd" exe="/lib/systemd/systemd-udevd" sig=4 res=1

[  231.851242] audit: type=1701 audit(1615450441.776:21): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=369 comm="crond" exe="/usr/sbin/crond" sig=11 res=1

[  245.890303] audit: type=1701 audit(1615450455.816:22): auid=4294967295 uid=993 gid=990 ses=4294967295 pid=419 comm="rpcbind" exe="/usr/sbin/rpcbind" sig=11 res=1

[  316.380770] EXT4-fs (mmcblk1p2): error count since last fsck: 4

[  316.386713] EXT4-fs (mmcblk1p2): initial error at time 1615450233: ext4_mb_generate_buddy:744

[  316.395237] EXT4-fs (mmcblk1p2): last error at time 1615450234: ext4_mb_generate_buddy:744

The application source code , i have attached below . 

For the different bettween customer I.MX8M mini SoM board and NXP I.MX8M min EVK :

kernel : 5.4.70_2.3.0

Ref board: NXP i.MX8MM DDR4 with PMIC:BD71837   

Customer board: i.MX8MM DDR4  with PMIC: PCA 9450  no HDMI , no audio