i.MX Processors中的主题 Re: Problem with gstreamer 1.0 when decoding video and audio

Problem with gstreamer 1.0 when decoding video and audio

francoisrey — Thu, 26 May 2016 14:58:41 GMT

Hi,

I try to display over hdmi a video encoded in H.264 with a bitrate of 499kbps and an audio stereo track encoded in MPEG-4 AAC with a bitrate of 93 kbps with gstreamer 1.0 on my iMX6Q.

When I use a pipeline without audio, I have no problem :

gst-launch-1.0 filesrc location=/media/mmcblk1p1/FILE0_5MinSyncTest.mp4 ! video/quicktime ! aiurdemux ! vpudec ! imxv4l2sink

But when I add audio in the pipeline :

gst-launch-1.0 filesrc location=/media/mmcblk1p1/FILE0_5MinSyncTest.mp4 ! video/quicktime ! aiurdemux name=demux demux. ! queue ! vpudec ! imxv4l2sink demux. ! queue ! beepdec ! alsasink

I have timestamping proble :

There may be a timestamping problem, or this computer is too slow.

If I add sync="false" to imxv4l2sink element there is no more timestamping problem but the sound is offset from the video.

I can play video with bigger bitrate without audio, I have no timestamping problem.

Is there a solution to fix this timestamping problem ?

Re: Problem with gstreamer 1.0 when decoding video and audio

joanxie — Tue, 31 May 2016 09:12:54 GMT

try to use the command "gst-launch-1.0 playbin uri=file:///", still has timestamp issue? if yes, pls send the log file to me.

Re: Problem with gstreamer 1.0 when decoding video and audio

francoisrey — Thu, 02 Jun 2016 07:30:16 GMT

This command failed with the following log :

gst-launch-1.0 playbin uri=file:///media/mmcblk1p1/FILE0_5MinSyncTest.mp4

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...

====== AIUR: 4.0.8 build on May 25 2016 08:46:26. ======

Core: MPEG4PARSER_06.09.17 build on Aug 13 2015 10:41:12

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.2

------------------------

Track 00 [video_0] Enabled

Duration: 0:05:00.267008000

Language: und

Mime:

video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format=(string)avc, width=(int)640, height=(int)480, framerate=(fraction)30000/1001, codec_data=(buffer)014d401effe10

------------------------

Track 01 [audio_0] Enabled

Duration: 0:05:00.350016000

Language: und

Mime:

audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)44100, bitrate=(int)93588, stream-format=(string)raw, codec_data=(buffer)1208

------------------------

display(/dev/fb0) resolution is (1920x1080).

====== OVERLAYSINK: 4.0.8 build on May 25 2016 08:46:41. ======

display(/dev/fb0) resolution is (1920x1080).

[INFO] bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0

====== BEEP: 4.0.8 build on May 25 2016 08:46:30. ======

Core: AAC decoder Wrapper build on Apr 22 2014 09:43:50

file: /usr/lib/imx-mm/audio-codec/wrap/lib_aacd_wrap_arm12_elinux.so.3

CODEC: BLN_MAD-MMCODECS_AACD_ARM_03.09.00_CORTEX-A8 build on Jun 19 2014 18:30:32.

display(/dev/fb0) resolution [ 467.220340] mxc_v4l2_output v4l2_out.34: Bypass IC.

is (1920x1080).

[ 467.229116] mxc_v4l2_output v4l2_out.34: Bypass IC.

gst-launch-1.0: ../imxvpuapi/imxvpuapi_vpulib.c:2349: imx_vpu_dec_mark_framebuffer_as_displayed: Assertion `framebuffer != ((void *)0)' failed.

Aborted

Re: Problem with gstreamer 1.0 when decoding video and audio

francoisrey — Fri, 10 Jun 2016 13:50:40 GMT

No News ?

Re: Problem with gstreamer 1.0 when decoding video and audio

francoisrey — Mon, 13 Jun 2016 08:10:38 GMT

I set "max-size-time=0" to queues and it solve the problem.

It miss some frame but the result is quite good.

Re: Problem with gstreamer 1.0 when decoding video and audio

coilnpark — Mon, 24 Jun 2019 17:22:47 GMT

I had the same problem and I could also solve it by using our solution.

gst-launch-1.0 playbin uri=file:///

It is good~!!!

Thank you very much!!!!