jojo rong

error play video via gstreamer with "mfw_isink" in IMX6QSD

Discussion created by jojo rong on Oct 9, 2013
Latest reply on Aug 26, 2015 by Andrea Picaro

I collect much more detail of this issue about for play video streaming with gstreamer with plugin "mfw_isink" in yocto branch dora,

 

* video pipe line

 

pipleline: appsrc is-live=true do-timestamp=true caps="image/jpeg, width=1920, height=800" name="appsrc" ! decodebin2 ! mfw_isink name="appsink" disp-width=1910 disp-height=795 axis-top=153 axis-left=5

 

set color key

MFW_GST_ISINK_PLUGIN 3.0.8 build on Oct  9 2013 10:34:59.

[INFO]  Product Info: i.MX6Q/D/S

vpudec versions

        plugin: 3.0.8

        wrapper: 1.0.38(VPUWRAPPER_ARM_LINUX Build on Oct  8 2013 18:01:07)

        vpulib: 5.4.15

        firmware: 2.3.10.40778

[INFO]  bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0

hwbuf allocator zone(2306048) created

can not create threadmfw_gst_isink_setcaps:1489

VS0 created. in fmt[I420] win(0,0-1920,800:1920x800) out win(5,153-1915,948:1910x795)

set deinterlace mode 0

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

 

 

* build version

Build Configuration:

BB_VERSION        = "1.20.0"

BUILD_SYS         = "i686-linux"

NATIVELSBSTRING   = "Ubuntu-12.04"

TARGET_SYS        = "arm-poky-linux-gnueabi"

MACHINE           = "imx6qsabresd"

DISTRO            = "poky"

DISTRO_VERSION    = "1.5"

TUNE_FEATURES     = "armv7a vfp neon callconvention-hard cortexa9"

TARGET_FPU        = "vfp-neon"

meta             

meta-yocto        = "(nobranch):4d8ab87d25ea6e59dc88375813ef88ee0ac813d0"

meta-oe           = "(nobranch):8aafddccb03f54923927e9d1c8c80223baf581de"

meta-fsl-arm      = "(nobranch):2076ae7530a7ed2aa40678502598e74b0f533def"

meta-fsl-arm-extra = "(nobranch):cc64dc7e894915e9be4e6ac34e01a4f5c123b7b4"

meta-fsl-demos    = "(nobranch):393b0119d513f9abf7b0570ab0d32b81583dedca"

 

* local.conf

DL_DIR = "${TOPDIR}/../../downloads"

 

*boot cmd

mmcargs=setenv bootargs console=${console},${baudrate} root=${mmcroot} video=mxcfb1:off video=mxcfb0:dev=hdmi,1920x1080M@60,if=RGB24 dmfc=3

 

*startup script

echo 2 > /proc/cpu/alignment

export VSALPHA=1

 

 

* relatived hints which i searched from FREESCALE imx community:

 

** i think about this issue is reported because of my operation on X server at the same time with gstreamer pipe line with "mfw_isink" as description of bellow thread

https://community.freescale.com/message/322666#322666

 

 

  For a more simple case,

 

  I use the "get-launch" to play video with X server:

 

  pipe line : gst-launch filesrc location=/var/volatile/transformers3-mjpeg.mp4 typefind=true ! aiurdemux ! vpudec ! mfw_isink disp-width=1910 disp-height=795 axis-top=153 axis-left=5

 

set color key

MFW_GST_ISINK_PLUGIN 3.0.8 build on Oct  9 2013 10:34:59.

Setting pipeline to PAUSED ...

[INFO]  Product Info: i.MX6Q/D/S

vpudec versions

        plugin: 3.0.8

        wrapper: 1.0.38(VPUWRAPPER_ARM_LINUX Build on Oct  8 2013 18:01:07)

        vpulib: 5.4.15

        firmware: 2.3.10.40778

Pipeline is PREROLLING ...

Aiur: 3.0.8

Core: MPEG4PARSER_06.06.03  build on Jul  3 2013 01:47:47

  mime: video/quicktime; audio/x-m4a; application/x-3gp

  file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.1

Content Info:

        URI:

              file:///var/volatile/transformers3-mjpeg.mp4

        Idx File:

              /home/root/.aiur/.var.volatile.transformers3-mjpeg.mp4.aidx

        Seekable  : Yes

        Size(byte): 356249742

 

Movie Info:

        Seekable  : Yes

        Live      : No

        Duration  : 0:02:27.883008000

        ReadMode  : File

        Track     : 2

 

Track 00 [video_000000] Enabled

        Duration: 0:02:27.872992000

        Language: eng

        Mime:

              image/jpeg, width=(int)1920, height=(int)800, framerate=(fraction)1199/50

Track 01 [audio_000000] Enabled

        Duration: 0:02:27.882000000

        Language: eng

        Mime:

              audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)48000, bitrate=(int)1

              24665, framed=(boolean)true, stream-format=(string)raw, codec_data=(buffer)11905

              6e500

[INFO]  bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0

hwbuf allocator zone(2306048) created

can not create threadmfw_gst_isink_setcaps:1489

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

VS0 created. in fmt[I420] win(0,0-1920,800:1920x800) out win(5,153-1915,948:1910x795)

New clock: GstSystemClock

set deinterlace mode 0

hwbuf allocator zone(61440imx-ipuv3 imx-ipuv3.0: IDMAC12's EBA0 is not 8-byte aligned

0) created

imx-ipuv3 imx-ipuv3.0: IDMAC11's EBA0 is not 8-byte aligned

hwbuf allocator zone(614400) destroied.

hwbuf allocator zone(614400) created

imx-ipuv3 imx-ipuv3.0: IDMAC12's EBA0 is not 8-byte aligned

imx-ipuv3 imx-ipuv3.0: IDMAC11's EBA0 is not 8-byte aligned

hwbuf allocator zone(614400) destroied.

hwbuf allocator zone(614400) created

imx-ipuv3 imx-ipuv3.0: IDMAC12's EBA0 is not 8-byte aligned

imx-ipuv3 imx-ipuv3.0: IDMAC11's EBA0 is not 8-byte aligned

hwbuf allocator zone(614400) destroied.

 

the following WARNing is reported when you active the X server window, looks like menu of mouse right is active,

 

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

 

 

The screen is black about for 2 ~ 3 seconds when the one Warning is reported, and then restore normal display,

that is said Warning is reported once, black screen once

 

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

  After much more Warning later, the bellow Error is reported, the HDMI screen is black complete, display no signal i need to reset the system to restore

 

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

vss/mfw_gst_vss_common.c:1003 ioctl error, return -1

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_5 = 0x88800000

imx-ipuv3 imx-ipuv3.0: IPU Warning - IPU_INT_STAT_10 = 0x00080000

mxc_sdc_fb mxc_sdc_fb.0: timeout when waiting for flip irq

Outcomes