topic gplay hangs playing a video with audio in i.MX Processors

gplay hangs playing a video with audio

bearq — Mon, 07 Mar 2016 03:40:25 GMT

Hi,

We are testing videos on the i.MX6DL with Linux version 3.14.52. If we play a video without audio, it play very well, but playing a video with audio, gplay will hangs up, but I can see first frame showed on the display. Some Info show below:

//====================================================================================

//==== command: gst-launch-0.10 playbin uri=file:///harddisk/maiken1.mpg

//===================================================================================

export GST_DEBUG=filesrc:4

mx6qsabresd:/harddisk# gst-launch-0.10 playbin uri=file:///harddisk/maiken1.mpg

Setting pipeline to PAUSED ...

0:00:00.061378333 553 0x1518380 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:374:gst_file_src_set_location: filename : /harddisk/maiken1.mpg

0:00:00.061536333 553 0x1518380 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:375:gst_file_src_set_location: uri : file:///harddisk/maiken1.mpg

0:00:00.065732000 553 0x1518380 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

0:00:00.065909667 553 0x1518380 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

(gst-launch-0.10:553): GStreamer-CRITICAL **: gst_debug_log_valist: assertion 'category != NULL' failed

0:00:00.087778000 553 0x1518380 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

0:00:00.087915000 553 0x1518380 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

Pipeline is PREROLLING ...

Aiur: 4.0.3

Core: BLN_MAD-MMLAYER_MPG2PARSER_04.04.40 build on Nov 11 2015 08:09:41

mime: video/mpeg, mpegversion=(int)[1,2]; video/mpegts, systemstream=true; video/x-cdxa

file: /usr/lib/imx-mm/parser/lib_mpg2_parser_arm11_elinux.so.3.1

Content Info:

URI:

file:///harddisk/maiken1.mpg

Idx File:

/home/root/.aiur/.harddisk.maiken1.mpg.aidx

Seekable : Yes

Size(byte): 17670148

Mpeg2CreateParser:parser created successfully

Movie Info:

Seekable : Yes

Live : No

Duration : 0:00:31.272000000

ReadMode : File

programs : 1

Track : 2

Track 00 [video_000000] Enabled

ppid: 0, ppid 0

Duration: 0:00:31.240000000

Language: und

Mime:

video/mpeg, systemstream=(boolean)false, parsed=(boolean)true, mpegversion=(int)

2, width=(int)720, height=(int)576, framerate=(fraction)25/1, codec_data=(buffer

)000001b32d02403309c423811011111212121313131314141414141515151515151616161616161

6171717171717171718181818181818191a191a1a191b1b1b1a1b1c1c1c1c1e1e1e1f1f21000001b

5148200010000000001b8001909c0

[INFO] Product Info: i.MX6Q/D/S

vpudec versions :smileyhappy:

plugin: 4.0.3

wrapper: 1.0.62(VPUWRAPPER_ARM_LINUX Build on Feb 21 2016 01:52:14)

vpulib: 5.4.32

firmware: 3.1.1.46070

Track 01 [audio_000001] Enabled

ppid: 0, ppid 1

Duration: 0:00:31.272000000

Language: und

Mime:

audio/mpeg, mpegversion=(int)1, framed=(boolean)true, channels=(int)2, rate=(int

)48000, bitrate=(int)384

[INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0

MFW_GST_V4LSINK_PLUGIN 4.0.3 build on Feb 21 2016 02:58:35.

Beep: 4.0.3

Core: MP3 decoder Wrapper build on Mar 21 2014 15:04:50

mime: audio/mpeg, mpegversion = (int)1

file: /usr/lib/imx-mm/audio-codec/wrap/lib_mp3d_wrap_arm12_elinux.so.3

CODEC: BLN_MAD-MMCODECS_MP3D_ARM_02.13.00_CORTEX-A8 build on Apr 10 2014 15:26:15.

set v4l rotate sucessfully

>>V4L_SINK: Actually buffer status:

hardware buffer : 10

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1920x1080

[V4L Update Display]: left=0, top=0, width=1920, height=1080

set v4l display crop sucessfully

New clock: GstAudioSinkClock

//====================================================================================

//==== ctrl+c

//===================================================================================

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

(gst-launch-0.10:553): GLib-CRITICAL **: Source ID 75 was not found when attempting to remove it

Execution ended after 134436192350 ns.

Setting pipeline to PAUSED ...

//====================================================================================

//==== ctrl+c

//===================================================================================

mx6qsabresd:/harddisk#

//====================================================================================

//==== command: gplay maiken1.mpg

//===================================================================================

gplay maiken1.mpg

playbin2 is employed!

fsl_player_init(): Successfully initialize!

fsl_player_set_media_location(): filename=maiken1.mpg

[Stopped ][Vol=01][00:00:00/00:00:00][fps:0]0:00:00.077219333 507 0xf0ce20 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:374:gst_file_src_set_location: filename : /harddisk/maiken1.mpg

0:00:00.077372666 507 0xf0ce20 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:375:gst_file_src_set_location: uri : file:///harddisk/maiken1.mpg

0:00:00.079879333 507 0xf0ce20 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

0:00:00.080044333 507 0xf0ce20 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

(gplay:507): GStreamer-CRITICAL **: gst_debug_log_valist: assertion 'category != NULL' failed

0:00:00.105827000 507 0xf0ce20 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

0:00:00.105965666 507 0xf0ce20 INFO filesrc /home/ubuntu/yocto/build-fb/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/plugins/elements/gstfilesrc.c:969:gst_file_src_start:<source> opening file /harddisk/maiken1.mpg

Aiur: 4.0.3

Core: BLN_MAD-MMLAYER_MPG2PARSER_04.04.40 build on Nov 11 2015 08:09:41

mime: video/mpeg, mpegversion=(int)[1,2]; video/mpegts, systemstream=true; video/x-cdxa

file: /usr/lib/imx-mm/parser/lib_mpg2_parser_arm11_elinux.so.3.1

Content Info:

URI:

file:///harddisk/maiken1.mpg

Idx File:

/home/root/.aiur/.harddisk.maiken1.mpg.aidx

Seekable : Yes

Size(byte): 17670148

Mpeg2CreateParser:parser created successfully

Movie Info:

Seekable : Yes

Live : No

Duration : 0:00:31.272000000

ReadMode : File

programs : 1

Track : 2

Track 00 [video_000000] Enabled

ppid: 0, ppid 0

Duration: 0:00:31.240000000

Language: und

Mime:

video/mpeg, systemstream=(boolean)false, parsed=(boolean)true, mpegversion=(int)

2, width=(int)720, height=(int)576, framerate=(fraction)25/1, codec_data=(buffer

)000001b32d02403309c423811011111212121313131314141414141515151515151616161616161

6171717171717171718181818181818191a191a1a191b1b1b1a1b1c1c1c1c1e1e1e1f1f21000001b

5148200010000000001b8001909c0

[INFO] Product Info: i.MX6Q/D/S

vpudec versions :smileyhappy:

plugin: 4.0.3

wrapper: 1.0.62(VPUWRAPPER_ARM_LINUX Build on Feb 21 2016 01:52:14)

vpulib: 5.4.32

firmware: 3.1.1.46070

Track 01 [audio_000001] Enabled

ppid: 0, ppid 1

Duration: 0:00:31.272000000

Language: und

Mime:

audio/mpeg, mpegversion=(int)1, framed=(boolean)true, channels=(int)2, rate=(int

)48000, bitrate=(int)384

FOUND GST_MESSAGE_TAG!

codec: MPEG2

language code: und

bitrate: 4000000

FOUND GST_MESSAGE_TAG!

container format: MPEG

video codec: MPEG2

frame rate: 25

video bitrate: 4000000

image width: 720

image height: 576

FOUND GST_MESSAGE_TAG!

codec: MP3

language code: und

bitrate: 384

MFW_GST_V4LSINK_PLUGIN 4.0.3 build on Feb 21 2016 02:58:35.

Beep: 4.0.3

Core: MP3 decoder Wrapper build on Mar 21 2014 15:04:50

mime: audio/mpeg, mpegversion = (int)1

file: /usr/lib/imx-mm/audio-codec/wrap/lib_mp3d_wrap_arm12_elinux.so.3

CODEC: BLN_MAD-MMCODECS_MP3D_ARM_02.13.00_CORTEX-A8 build on Apr 10 2014 15:26:15.

[INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0

FOUND GST_MESSAGE_TAG!

audio codec: MPEG 1 Audio, Layer 2

nominal bitrate: 384000

FOUND GST_MESSAGE_TAG!

has crc: FALSE

channel mode: stereo

FOUND GST_MESSAGE_TAG!

number of channels: 2

bitrate: 384000

sampling frequency (Hz): 48000

audio codec: MPEG-1 Layer 2

FOUND GST_MESSAGE_TAG!

image width: 720

image height: 576

set v4l rotate sucessfully

>>V4L_SINK: Actually buffer status:

hardware buffer : 10

software buffer : 0

FOUND GST_MESSAGE_TAG!

minimum bitrate: 384000

maximum bitrate: 384000

full screen size:1920x1080

[V4L Update Display]: left=0, top=0, width=1920, height=1080

set v4l display crop sucessfully

fsl_player_play()

FSL_PLAYER_01.00_LINUX build on Feb 21 2016 02:59:27

[h]display the operation Help

[p]Play

[s]Stop

[e]Seek

[a]Pause when playing, play when paused

[v]Volume

[m]Switch to mute or not

[>]Play next file

[<]Play previous file

[r]Switch to repeated mode or not

[f]Set full screen or not

[z]resize the width and height

[t]Rotate

[c]Setting play rate

[i]Display the metadata

[x]eXit

get GST_MESSAGE_ELEMENT playbin2-stream-changed, uri=(string)file:///harddisk/maiken1.mpg;

[Playing ][Vol=01][00:00:00/00:00:31][fps:0]

[Playing ][Vol=01][00:00:00/00:00:31][fps:0]^C Aborted by signal[2] Interrupt...

FSL_PLAYER_UI_MSG_EXIT

^C Aborted by signal[2] Interrupt...

Can any body give me some advise? Thanks.

Re: gplay hangs playing a video with audio

igorpadykov — Mon, 07 Mar 2016 06:53:26 GMT

Hi bear

Linux version 3.14.52 provides only GStreamer 1.0 as

mentioned in attached Release Notes sect.6 Multimedia.

Please follow sect.7.3.1.3 Audio/Video file playback attached Linux Guide.

Best regards

igor

-----------------------------------------------------------------------------------------------------------------------

Note: If this post answers your question, please click the Correct Answer button. Thank you!

-----------------------------------------------------------------------------------------------------------------------

Re: gplay hangs playing a video with audio

bearq — Tue, 08 Mar 2016 04:01:11 GMT

Hi Igor

Thanks for your reply. I test as "sect.7.3.1.3 Audio/Video file playback" say. But it didn't work.

Actually, I have do some tests using aplay.

//====================================================================================

//==== I Can hear some voice

//===================================================================================

imx6qsabresd:/usr/local/drivers# aplay -D plughw:0,0 /harddisk/audio8k16S.w

Playing WAVE '/harddisk/audio8k16S.wav' : Signed 16 bit Little Endian, Rate 8000 Hz, Stereo

Re: gplay hangs playing a video with audio

bearq — Tue, 08 Mar 2016 04:10:28 GMT

//====================================================================================

//==== I Can't hear some voice

//===================================================================================

imx6qsabresd:/usr/local/drivers# aplay -D plughw:0,0 /usr/share/sounds/alsa//Front_Center.wav

Playing WAVE '/usr/share/sounds/alsa/Front_Center.wav' : Signed 16 bit Little Endian, Rate 48000 Hz, Mono

//====================================================================================

//==== aplay -l

//===================================================================================

root@imx6qsabresd:/usr/local/drivers# aplay -l

**** List of PLAYBACK Hardware Devices ****

card 0: imxspdif [imx-spdif], device 0: S/PDIF PCM snd-soc-dummy-dai-0 []

Subdevices: 1/1

Subdevice #0: subdevice #0

Do the diffrent of Stereo/Mono cause that problem?

Do the setting of ALSA cause that problem?

Can you give me some advise?

Best Regards

Bear

Re: gplay hangs playing a video with audio

igorpadykov — Tue, 08 Mar 2016 06:13:48 GMT

Hi Bear

what board are you using, could you try with Sabre board and Demo Images on :

Board Support Packages (29)

L3.14.52_1.1.0_MX6QDLSOLO (REV L3.14.52_1.1.0)

http://www.nxp.com/products/microcontrollers-and-processors/arm-processors/i.mx-applications-processors-based-on-arm-cores/i.mx-6-processors/i.mx6qp/sabre-board-for-smart-devices-reference-design-based-on-the-i.mx-6-series:RDIMX6SABREBRD?fpsp=1&tab=Design_Tools_Tab

Best regards

igor

Re: gplay hangs playing a video with audio

bearq — Wed, 09 Mar 2016 05:22:05 GMT

Hi Igor

I use a custom board almost same with Sabre board. If my board run Linux version 3.0.35, the audios play very well.

But I update Linux version to version 3.14.52, Problems about audios occur :

(1). I use command:

root@imx6qsabresd:/harddisk# aplay -D plughw:0,0 /usr/share/sounds/alsa/Front_Center.wav

aplay will be stuck,It can never play to the ends. I need to press "ctrl+c" to stop it.

root@imx6qsabresd:/harddisk# aplay -vv -D plughw:0,0 /usr/share/sounds/alsa/Front_Center.wav

Playing WAVE '/usr/share/sounds/alsa/Front_Center.wav' : Signed 16 bit Little Endian, Rate 48000 Hz, Mono

Plug PCM: Route conversion PCM (sformat=S16_LE)

Transformation table:

0 <- 0

1 <- 0

Its setup is:

stream : PLAYBACK

access : RW_INTERLEAVED

format : S16_LE

subformat : STD

channels : 1

rate : 48000

exact rate : 48000 (48000/1)

msbits : 16

buffer_size : 16384

period_size : 4096

period_time : 85333

tstamp_mode : NONE

period_step : 1

avail_min : 4096

period_event : 0

start_threshold : 16384

stop_threshold : 16384

silence_threshold: 0

silence_size : 0

boundary : 1073741824

Slave: Hardware PCM card 0 'imx-spdif' device 0 subdevice 0

Its setup is:

stream : PLAYBACK

access : MMAP_INTERLEAVED

format : S16_LE

subformat : STD

channels : 2

rate : 48000

exact rate : 48000 (48000/1)

msbits : 16

buffer_size : 16384

period_size : 4096

period_time : 85333

tstamp_mode : NONE

period_step : 1

avail_min : 4096

period_event : 0

start_threshold : 16384

stop_threshold : 16384

silence_threshold: 0

silence_size : 0

boundary : 1073741824

appl_ptr : 0

hw_ptr : 0

########## + | 46%

root@imx6qsabresd:/harddisk#

It seems aplay have been play first frame.,but never play to second frame.

(2). I use command:

root@imx6qsabresd:/harddisk# aplay -vv -D plughw:0,0 audio8k16S.wav

aplay will play to the end,and i can hear some sound form the S/PDIF

root@imx6qsabresd:/harddisk# aplay -vv -D plughw:0,0 audio8k16S.wav

Playing WAVE 'audio8k16S.wav' : Signed 16 bit Little Endian, Rate 8000 Hz, Stereo

Plug PCM: Rate conversion PCM (32000, sformat=S16_LE)

Converter: linear-interpolation

Protocol version: 10002

Its setup is:

stream : PLAYBACK

access : RW_INTERLEAVED

format : S16_LE

subformat : STD

channels : 2

rate : 8000

exact rate : 8000 (8000/1)

msbits : 16

buffer_size : 4000

period_size : 1000

period_time : 125000

tstamp_mode : NONE

period_step : 1

avail_min : 1000

period_event : 0

start_threshold : 4000

stop_threshold : 4000

silence_threshold: 0

silence_size : 0

boundary : 524288000

Slave: Hardware PCM card 0 'imx-spdif' device 0 subdevice 0

Its setup is:

stream : PLAYBACK

access : MMAP_INTERLEAVED

format : S16_LE

subformat : STD

channels : 2

rate : 32000

exact rate : 32000 (32000/1)

msbits : 16

buffer_size : 16000

period_size : 4000

period_time : 125000

tstamp_mode : NONE

period_step : 1

avail_min : 4000

period_event : 0

start_threshold : 16000

stop_threshold : 16000

silence_threshold: 0

silence_size : 0

boundary : 2097152000

appl_ptr : 0

hw_ptr : 0

## + | 07%

root@imx6qsabresd:/harddisk#

root@imx6qsabresd:/harddisk# aplay -l

**** List of PLAYBACK Hardware Devices ****

card 0: imxspdif [imx-spdif], device 0: S/PDIF PCM snd-soc-dummy-dai-0 []

Subdevices: 1/1

Subdevice #0: subdevice #0

root@imx6qsabresd:/harddisk#

root@imx6qsabresd:/harddisk# aplay -L

null

Discard all samples (playback) or generate zero samples (capture)

sysdefault:CARD=imxspdif

imx-spdif,

Default Audio Device

Best Regards

Bear

Re: gplay hangs playing a video with audio

ambika — Mon, 27 Jun 2016 14:02:53 GMT

Hi Bear,

Whether the issue is solved??

Let me know the solution if solved, else whether u got any clues for the issue??

Hi all,

I'm also facing the same issue, below are test environment.

Processor : imx6q

BSP : Yocto

Kernel : 3.14.28

Movie player : gplay-1.0

Audio interface :S/PDIF

I have 2 movies with audio sample rate 44.1K and 48K, I'm playing movie using the below command line,

gplay-1.0 /movie_file

1. When with 48K movie, audio seems fine and video also coming.

2. But when in the case of 44.1K movie, only the 1st frame of the movie can be seen and audio is not coming.

Is anyone faced and solved the issue???

Any suggestions to solve the issue is appreciated.

Thanks in advance.

Regards,

Ambika.

Re: gplay hangs playing a video with audio

ambika — Thu, 30 Jun 2016 10:08:06 GMT

The problem was with selecting root clock for playing the movie. The root clock selecting as MLB clock input in failure case, where as other working audio/video was selecting tx_clk input from SPDIF0_CLK_ROOT.

The issue is solved on applying the below patch in dtsi file.

- <&clks IMX6QDL_CLK_IPG>, <&clks IMX6QDL_CLK_MLB>,

+ <&clks IMX6QDL_CLK_IPG>, <&clks IMX6QDL_CLK_DUMMY>,

Regards,

Ambika.