Problem with gstreamer 1.0 when decoding video and audio

[francoisrey]

Hi,

I try to display over hdmi a video encoded in H.264 with a bitrate of 499kbps and an audio stereo track encoded in MPEG-4 AAC with a bitrate of 93 kbps with gstreamer 1.0 on my iMX6Q.

When I use a pipeline without audio, I have no problem :

gst-launch-1.0 filesrc location=/media/mmcblk1p1/FILE0_5MinSyncTest.mp4 ! video/quicktime ! aiurdemux ! vpudec ! imxv4l2sink

But when I add audio in the pipeline :

gst-launch-1.0 filesrc location=/media/mmcblk1p1/FILE0_5MinSyncTest.mp4 ! video/quicktime ! aiurdemux name=demux demux. ! queue ! vpudec ! imxv4l2sink demux. ! queue ! beepdec ! alsasink

I have timestamping proble :

There may be a timestamping problem, or this computer is too slow.

If I add sync="false" to  imxv4l2sink element there is no more timestamping problem but the sound is offset from the video.

I can play video with bigger bitrate without audio, I have no timestamping problem.

Is there a solution to fix this timestamping problem ?

[francoisrey · Accepted solution]

I set "max-size-time=0" to queues and it solve the problem.

It miss some frame but the result is quite good.

[coilnpark]

I had the same problem and I could also solve it by using our solution.

gst-launch-1.0 playbin uri=file:/// 

It is good~!!!

Thank you very much!!!!

[joanxie]

try to use the command "gst-launch-1.0 playbin uri=file:///", still has timestamp issue? if yes, pls send the log file to me.

[francoisrey]

No News ?

[francoisrey]

This command failed with the following log :

gst-launch-1.0 playbin uri=file:///media/mmcblk1p1/FILE0_5MinSyncTest.mp4

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...

====== AIUR: 4.0.8 build on May 25 2016 08:46:26. ======

        Core: MPEG4PARSER_06.09.17  build on Aug 13 2015 10:41:12

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.2

------------------------

    Track 00 [video_0] Enabled

        Duration: 0:05:00.267008000

        Language: und

    Mime:

        video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format=(string)avc, width=(int)640, height=(int)480, framerate=(fraction)30000/1001, codec_data=(buffer)014d401effe10

------------------------

------------------------

    Track 01 [audio_0] Enabled

        Duration: 0:05:00.350016000

        Language: und

    Mime:

        audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)44100, bitrate=(int)93588, stream-format=(string)raw, codec_data=(buffer)1208

------------------------

display(/dev/fb0) resolution is (1920x1080).

====== OVERLAYSINK: 4.0.8 build on May 25 2016 08:46:41. ======

display(/dev/fb0) resolution is (1920x1080).

[INFO]  bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0

====== BEEP: 4.0.8 build on May 25 2016 08:46:30. ======

        Core: AAC decoder Wrapper  build on Apr 22 2014 09:43:50

file: /usr/lib/imx-mm/audio-codec/wrap/lib_aacd_wrap_arm12_elinux.so.3

CODEC: BLN_MAD-MMCODECS_AACD_ARM_03.09.00_CORTEX-A8  build on Jun 19 2014 18:30:32.

display(/dev/fb0) resolution [  467.220340] mxc_v4l2_output v4l2_out.34: Bypass IC.

is (1920x1080).

[  467.229116] mxc_v4l2_output v4l2_out.34: Bypass IC.

gst-launch-1.0: ../imxvpuapi/imxvpuapi_vpulib.c:2349: imx_vpu_dec_mark_framebuffer_as_displayed: Assertion `framebuffer != ((void *)0)' failed.

Aborted