topic Re: Memory leak when gstreamer playing RTSP with libgstvpu in i.MX Processors

Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Tue, 29 Jan 2019 01:52:59 GMT

Command：

gst-launch-1.0 playbin uri=rtsp://192.168.1.88:556/vga

The memory of gst-launch-1.0 will increase more than 30M every hour， then the video stop， but audio soud ok。

Delete the libgstvpu.so , use the same commad. memory will not increase, but play the high resolution (1920x1080) not smooth.

Anybody has faced the same problem and resolved? Please help

karinavalencia‌

I do more test.

Compare playing local video file and RTSP:

1) play 1920x1080 (（MPEG4\AVC_H_L3）local files, that seems not has memory leak. (log file : gplay-test-AVC_H_L3_Schindlers.log、gplay-test-MPEG4_Schindlers.log)

2) play 1920x1080 (AVC_H) RTSP, memory increase about 16M. (log file: gplay-test-AVC_H_RTSP.log)

Compare playing RTSP(960x540 AVC_H) with vpudec and avdec_h264 lib:

a) use vpudec , memory increase about 10M in 20 mins.( log file: gplay-test-AVC_H_RTSP_with_VPU.log)

b) use avdec_h264(delete /usr/lib/gstreamer-1.0/libgstvpu.so) , memory not increase. (log file: gplay-test-AVC_H_RTSP_with_avdec_h264.log)

CPU: IMX6DL

Kernel: 4.1.15

BSP: 2.0.1 GA

vpudec: imx-gst1.0-plugin-4.1.4

avdec_h264:gst-libav-1.8.1

Re: Memory leak when gstreamer playing RTSP with libgstvpu

b36401 — Wed, 30 Jan 2019 02:32:31 GMT

Please try to apply this patch:

https://community.nxp.com/docs/DOC-335878

It may help with gstreamer memory leak.

Have a great day,
Victor

-----------------------------------------------------------------------------------------------------------------------
Note: If this post answers your question, please click the Correct Answer button. Thank you!
-----------------------------------------------------------------------------------------------------------------------

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Wed, 30 Jan 2019 06:32:59 GMT

Thanks for your replay.

I follow the patch patch_v4l2_issue.zip , but not find any about v4l2 in arch/arm/mach-imx/mach-imx6q.c.

So I just modify videobuf-dma-contig.c, drivers/media/video/mxc/output/mxc_vout.c and drivers/mxc/vpu/mxc_vpu.c.

But the memory still increase more than 40M per hour.

VSZ %VSZ CPU %CPU COMMAND

396m 39.5 1 21.1 gst-launch-1.0 playbin uri=rtsp://192.168.1.98:8554/vga

The memory is start from 335M to 396M.

CPU: IMX6DL

Kernel: 4.1.15

BSP: 2.0.1 GA

GST: imx-gst1.0-plugin-4.1.4

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Mon, 11 Mar 2019 09:20:34 GMT

I have already use the new version with yocto imx-yocto-L4.14.78_1.0.0_ga， still face the same problem.

Does anyone can give some advice?

Play command is "gst-launch-1.0 playbin uri=rtsp://192.168.1.98:8554/vga"

Memory start from 358m to 391m jus use 2hours.

[03-11-15:01:03.121] 1226 499 root S 358m

[03-11-17:03:58.730] 1226 499 root S 391m

CPU: IMX6DL

Kernel: 4.14.78

BSP: imx-yocto-L4.14.78_1.0.0_ga

GST: gstreamer 1.14

imx-gst1.0-plugin-4.4.4

@Juan Antonio Gutierrez RosasYocto BSP for SCM-i.MX L4.1.15-2.0.0_ga

Qiang_FSL‌

i.MX Processors‌

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Tue, 12 Mar 2019 11:35:34 GMT

又对比测试了gstreamer0.10 的版本，使用mfw_vpudec解码，是没有内存泄漏的。

内核是使用相同的4.1.15，所以应该跟硬件没有关系。

我们的产品已经出货1年多，最近测试高分辨率的流媒体才测试出来了，如果重新换回gstreamer0.10，工作量有点大（而且好像yocto无法同时编译gstreamer0.10和qt5），请帮忙分析和解决gstreamer1.0下的libgstvpu.so内存泄漏问题。

Re: Memory leak when gstreamer playing RTSP with libgstvpu

karina_valencia — Tue, 12 Mar 2019 17:55:58 GMT

b36401‌, can you continue with the follow up here?

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Fri, 15 Mar 2019 01:46:03 GMT

thanks for reply, but this problem is still there.

b36401‌ please give more help.

The problem is urgent, because this product has been mass-produced for more than 1 years.

CPU: IMX6DL

Kernel: 4.1.15

BSP: 2.0.1 GA

GST: imx-gst1.0-plugin-4.1.4

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Tue, 19 Mar 2019 09:33:34 GMT

karinavalencia‌

Qiang_FSL‌

I found the memory increase immediately when play with http scream if show this log "gst_base_sink_is_too_late:<overlaysink0> warning: A lot of buffers are being dropped."

Was this problem cause when vpudec fail not but free the memory about frame?

I'm not familiar with vpudec follow, please give me some advice.

Wait for your reply.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

karina_valencia — Fri, 22 Mar 2019 16:51:29 GMT

b36401, do you have an update about this case?

Re: Memory leak when gstreamer playing RTSP with libgstvpu

b36401 — Mon, 25 Mar 2019 09:25:39 GMT

Karina,

I escalated it to Experts Team.

Then internal ticket was created last monday.

Let's wait for the answer.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Thu, 28 Mar 2019 01:07:47 GMT

HI, Victor，

Did the Experts Team repeat this problem？ Is there any good news？

karinavalencia‌

Qiang_FSL‌

Re: Memory leak when gstreamer playing RTSP with libgstvpu

qiang_li-mpu_se — Thu, 28 Mar 2019 02:43:16 GMT

No update yet.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

b36401 — Fri, 29 Mar 2019 04:05:19 GMT

R&D Team will provide an update next week due an urgent task for this week.
Sorry for the delay.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Fri, 29 Mar 2019 06:41:04 GMT

Thanks， waitting for your good news.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

b36401 — Mon, 01 Apr 2019 06:06:39 GMT

They did not reproduce the issue by VLC as the RTSP server.

Please provide us more details.
If the issue occurs only with your special RTSP sender, it is hard to identy the root cause.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Mon, 01 Apr 2019 06:40:30 GMT

Hi, Victor.

I found use this commad for VLC server will cause this issue.

vlc -vvv \\192.168.1.253\work\mynfs\AVC_H_L3_Schindlers.list.1993.HDTV.mkv --loop :sout=#transcode{vcodec=h264,vb=1024,acodec=mpga,ab=128,channels=2,samplerate=44100}:rtp{mux=ts,sdp=rtsp://:8554/vga} :sout-keep

I do not know the "mux=ts" meaning, but your team can try it.

Our RTSP sender is https://detail.tmall.com/item.htm?id=521274714573

When the RTSP_Format choose TS, gstreamer1.0 will cause memory leak, but ES will not.

But using the TS format, the memory will not increase when playing by gstream0.10(kernel is use the same one).

Also playing good with gstreamer1.0 by using libav_h264_dec.

I found mfw_gst_avc_fix_nalheader function /* size of SPS&PPS in NALs */in src/video/vpu_dec.full/src/mfw_gst_vpu_decoder.c(gst-fsl-plugins-4.0.3 in gstreamer0.10), but gstreamer1.0's vpudec didn't

Qiang_FSL‌

Re: Memory leak when gstreamer playing RTSP with libgstvpu

qiang_li-mpu_se — Thu, 04 Apr 2019 09:54:54 GMT

Hi Liang JiaXing ,

Please try with attached libgstvpu.so, there is a known issue on memory alignment.

Can you replace the original vpu library on board with command "cp libgstvpu.so /usr/lib/gstreamer-1.0/ " to see if can still reproduce memory leak issue?

The HDMI encoder had been received, but the test condition is not ready yet.

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Thu, 04 Apr 2019 11:14:41 GMT

Hi，Li，

thanks for replay. but this lib is not work for our board.

root@imx6dlsabresd:/home# gst-inspect-1.0 vpudec

(gst-plugin-scanner:14042): GStreamer-WARNING **: Failed to load plugin '/usr/lib/gstreamer-1.0/libgstvpu.so': libunwind.so.8: cannot open shared object file: No such file or directory
No such element or plugin 'vpudec'

my BSP is : BSP: 2.0.1 GA

bitbake config is :

===================================

MACHINE ??= 'imx6dlsabresd'
DISTRO ?= 'upt-mx6dl-eglfs'
PACKAGE_CLASSES ?= "package_rpm"
EXTRA_IMAGE_FEATURES ?= "debug-tweaks"
USER_CLASSES ?= "buildstats image-mklibs"
PATCHRESOLVE = "noop"
BB_DISKMON_DIRS = "\
STOPTASKS,${TMPDIR},1G,100K \
STOPTASKS,${DL_DIR},1G,100K \
STOPTASKS,${SSTATE_DIR},1G,100K \
STOPTASKS,/tmp,100M,100K \
ABORT,${TMPDIR},100M,1K \
ABORT,${DL_DIR},100M,1K \
ABORT,${SSTATE_DIR},100M,1K \
ABORT,/tmp,10M,1K"
PACKAGECONFIG_append_pn-qemu-native = " sdl"
PACKAGECONFIG_append_pn-nativesdk-qemu = " sdl"
CONF_VERSION = "1"

PACKAGECONFIG_append_pn-qtbase = " sql-sqlite"

IMAGE_INSTALL_append += " \
gstreamer1.0 \
gstreamer1.0-plugins-base \
gstreamer1.0-plugins-bad \
qtmultimedia \
qtmultimedia-plugins \
qtmultimedia-qmlplugins \
qtbase-plugins \
tslib \
tslib-calibrate \
tslib-conf \
tslib-tests \
"

DL_DIR ?= "${BSPDIR}/downloads/"
ACCEPT_FSL_EULA = "8"

Re: Memory leak when gstreamer playing RTSP with libgstvpu

qiang_li-mpu_se — Thu, 11 Apr 2019 02:53:28 GMT

Please apply the patch to your BSP and test it, thanks!

Re: Memory leak when gstreamer playing RTSP with libgstvpu

jiaxingliang — Thu, 11 Apr 2019 08:30:51 GMT

HI，Li：

The memory still increase.

and the video will pause for a while untill got the message: