i.MX ProcessorsのトピックRe: Distorted Video i.MX6 gStreamer

Distorted Video i.MX6 gStreamer

ryanerb — Thu, 05 Jun 2014 00:23:43 GMT

Hello,

I am having problems with distorted video. I have done quite a bit of testing.

Attached is a picture of the issue (toward bottom)

My gStreamer pipelines must be correct because other resolutions work fine.

The problem only occurs when you play a video that has the same resolution as the display.

Display is HDMI.

For instance, a 1920x1080p video played on a 1280x720p video plays perfect. A 1280x720p video played on a 1920x1080p video plays perfect.

But a 1280x720p video played on a 1280x720p Display plays distorted. Also a 1920x1080p video played on a 1920x1080p display plays distorted.

I have tested Yocto 1.5 (3.10.17) and Yocto 1.3 (kernel 3.0.35)

Below is some snippets of information from my system that may help.

I am using the Big Buck Bunny Video for testing as well as video test source (free download HERE)

I am not sure if the issue is in the driver or the gstreamer plugin?

___________________________________

INFO BELOW:

PIPELINE:

gst-launch videotestsrc ! video/x-raw-yuv,width=1280,height=720 ! mfw_v4lsink device=/dev/video16

Other info:

root@ventana:~# cat /sys/class/graphics/fb0/mode

S:1280x720p-60

root@ventana:~# cat /sys/class/graphics/fb0/modes

S:1920x1080p-60

S:1920x1080p-50

S:1280x720p-60

S:1280x720p-50

S:720x576p-50

S:720x480p-60

V:640x480p-60

D:1280x720p-60

V:640x480p-60

Poky 8.0.2 (Yocto Project 1.3.2 Reference Distro) 1.3.2 ventana ttymxc1

ventana login: root

root@ventana:~# uname -a

Linux ventana 3.0.35-4.4.0-gateworks+yocto+gaabbed9 #1 SMP PREEMPT Fri May 2 09:54:05 PDT 2014 armv7l GNU/Linux

root@ventana:~# gst-inspect | grep imx

vpu.imx: vpudec: VPU-based video decoder

vpu.imx: vpuenc: VPU-based video encoder

v4lsink.imx: mfw_v4lsink: v4l2 video sink

isink.imx: mfw_isink: IPU-based video sink

tvsrc.imx: tvsrc: v4l2 based tv src

mp3enc.imx: mfw_mp3encoder: mp3 audio encoder

v4lsrc.imx: mfw_v4lsrc: v4l2 based camera src

audiopeq.imx: mfw_audio_pp: audio post equalizer

amrdec.imx: mfw_amrdecoder: amr audio decoder

aiur.imx: webm: webm

aiur.imx: aiurdemux: aiur universal demuxer

beep.imx: ac3: ac3

beep.imx: 3ca: ac3

beep.imx: beepdec: beep audio decoder

beep.imx: beepdec.vorbis: Vorbis decoder

beep.imx: beepdec.ac3: AC3 decoder

beep.imx: beepdec.wma: WMA decoder

beep.imx: beepdec.mp3: MP3 decoder

beep.imx: beepdec.aac: AAC LC decoder

ipucsc.imx: mfw_ipucsc: IPU-based video converter

aacdec.imx: mfw_aacdecoder: aac audio decoder

vorbisdec.imx: mfw_vorbisdecoder: vorbis audio decoder

Console output after running command:

root@ventana:~# gst-launch videotestsrc ! video/x-raw-yuv,width=1280,height=720 ! mfw_v4lsink device=/dev/video16

this is powerful mx6q

MFW_GST_V4LSINK_PLUGIN 3.0.1 build on Apr 29 2014 02:30:21.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...

[ 409.674205] mxc_v4l2_output mxc_v4l2_output.0: Bypass IC.

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1280x720

[V4L Update Display]: left=0, top=0, width=1280, height=720

New clock: GstSystemClock

Here is some more console output for a simple gplay with a Big Buck Bunny Video:

root@ventana:~# gplay /media/sda1/big_buck_bunny_720p_h264.mov

playbin2 is employed!

fsl_player_init(): Successfully initialize!

fsl_player_set_media_location(): filename=/media/sda1/big_buck_bunny_720p_h264.mov

[Stopped ][Vol=01][00:00:00/00:00:00][fps:0]Aiur: 3.0.1

Core: MPEG4PARSER_06.04.22 build on Aug 22 2012 09:58:20

mime: video/quicktime; audio/x-m4a; application/x-3gp

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so

Content Info:

URI:

file:///media/sda1/big_buck_bunny_720p_h264.mov

Idx File:

/home/root/.aiur/.media.sda1.big_buck_bunny_720p_h264.mov.aidx

Seekable : Yes

Size(byte): 416751190

Movie Info:

Seekable : Yes

Live : No

Duration : 0:09:56.461696000

ReadMode : File

Track : 3

Track 00 [video_0000] Enabled

Duration: 0:09:56.458304000

Language: und

Mime:

video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=

(fraction)24/1, codec_data=(buffer)00000001274d401fa9180a00b7600d4040406db0ad7bd

f010000000128de09c8

[INFO] Product Info: i.MX6Q/D/S

vpudec versions :smileyhappy:

plugin: 3.0.1

wrapper: 1.0.24(VPUWRAPPER_ARM_LINUX Build on Apr 29 2014 02:05:43)

vpulib: 5.4.6

firmware: 2.1.5.32515

Track 01 [subtitle]: Disabled

Codec: 0, SubCodec: 0

Track 02 [audio_0000] Enabled

Duration: 0:09:56.480000000

Language: und

Mime:

audio/mpeg, mpegversion=(int)4, channels=(int)6, rate=(int)48000, bitrate=(int)4

48000, framed=(boolean)true, codec_data=(buffer)11b0

BLN_MAD-MMCODECS_AACD_ARM_03.07.00 build on Jul 17 2012 17:47:46.

MFW_GST_AAC_PLUGIN 3.0.1 build on Apr 29 2014 02:30:35.

FOUND GST_MESSAGE_TAG!

codec: AAC

language code: und

bitrate: 448000

FOUND GST_MESSAGE_TAG!

container format: MOV/MP4/3GP

FOUND GST_MESSAGE_TAG!

codec: H.264/AVC

language code: und

this is powerful mx6q

MFW_GST_V4LSINK_PLUGIN 3.0.1 build on Apr 29 2014 02:30:21.

[INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0

FOUND GST_MESSAGE_TAG!

audio codec: AAC decoder

bitrate: 448000

sampling frequency (Hz): 48000

number of channels: 6

[WARN] VPU iram is less than needed, some parts don't use iram

[ 486.470340] mxc_v4l2_output mxc_v4l2_output.0: Bypass IC.

>>V4L_SINK: Actually buffer status:

hardware buffer : 13

software buffer : 0

[Stopped ][Vol=01][00:00:00/00:09:56][fps:0]get GST_MESSAGE_ELEMENT prepare-xwindow-id;

get GST_MESSAGE_ELEMENT playbin2-stream-changed, uri=(string)file:///media/sda1/big_buck_bunny_720p_h264.mov;

full screen size:1280x720

[V4L Update Display]: left=0, top=0, width=1280, height=720

fsl_player_play()

FSL_PLAYER_01.00_LINUX build on Apr 29 2014 02:31:04

[h]display the operation Help

[p]Play

[s]Stop

[e]Seek

[a]Pause when playing, play when paused

[v]Volume

[m]Switch to mute or not

[>]Play next file

[<]Play previous file

[r]Switch to repeated mode or not

[f]Set full screen or not

[z]resize the width and height

[t]Rotate

[c]Setting play rate

[i]Display the metadata

[x]eXit

[Playing ][Vol=01][00:00:25/00:09:56][fps:24]^C Aborted by signal Interrupt...

Running time 0:00:26.922666666 render fps 23.995

Total rendered:647

[Playing ][Vol=01][00:00:00/00:00:00][fps:24]

arpan_chakravarty KevinWong

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Wed, 18 Jun 2014 18:03:54 GMT

Can you, please share how are you changing the display resolution? And what is the display? (HDMI? LVDS?)

From your log, I see MFW_GST_V4LSINK_PLUGIN 3.0.1 which is quite old. I assume this log is from YP1.3 (denzil? dylan?) Is the log and the result using daisy with 3.10.17 exactly the same (the latest MM version is 3.0.11)

What happens when you use gplay to playback exactly the same movie?

Re: Distorted Video i.MX6 gStreamer

ryanerb — Thu, 19 Jun 2014 16:37:48 GMT

Hello Daiane,

Thank you for the response.

The display is HDMI.

To run the tests, we do not need to change the resolution. But if you needed to, you can do a 'echo S:1280x720p-60 > /sys/class/graphics/fb0/mode'

Yes, the MFW_GST_V4LSINK_PLUGIN 3.0.1 was for 1.3.

On the 3.10.17 kernel I am showing MFW_GST_V4LSINK_PLUGIN 3.0.9 build on Feb 25 2014 14:23:55.

In my original post, I noted I had also tested in 1.5 Yocto with the 3.10.17 kernel and had the same problems.

Can you point me to where I can view the revision logs between 3.0.1 and 3.0.9 and also see the latest for MFW_GST_V4LSINK_PLUGIN?

Also note that my original post used gplay to run the commands.

At this point we are trying to eliminate all variables and therefore only testing with videotestsrc.

Are you able to reproduce this at your office?

Please let me know what other information I can provide.

Thank you,

Ryan

Here is my log from 3.10.17 (Yocto 1.5) on a 1920x1080p display (the problem still exists):

root@ventana:~# cat /sys/class/graphics/fb0/mode S:1920x1080p-60

root@ventana:~# gst-launch videotestsrc ! video/x-raw-yuv,width=1920,height=1080 ! mfw_v4lsink device=/dev/video16

MFW_GST_V4LSINK_PLUGIN 3.0.9 build on Feb 25 2014 14:23:55.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...[ 1573.179469] mxc_v4l2_output v4l2_out.30: Bypass IC.

set v4l rotate sucessfully

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1920x1080

[V4L Update Display]: left=0, top=0, width=1920, height=1080

set v4l display crop sucessfully

New clock: GstSystemClock

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

/usr/src/ventana/yocto/yocto-1.5/build/tmp/work/cortexa9hf-vfp-neon-poky-linux-gnueabi/gstreamer/0.10.36-r2/gstreamer-0.10.36/libs/gst/base/gstbasesink.c(2875): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0:

There may be a timestamping problem, or this computer is too slow.

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

There may be a timestamping problem, or this computer is too slow.

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

There may be a timestamping problem, or this computer is too slow.

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

There may be a timestamping problem, or this computer is too slow.

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

There may be a timestamping problem, or this computer is too slow.

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

There may be a timestamping problem, or this computer is too slow.

WARNING: from element /GstPipeline:pipeline0/MFW_GST_V4LSINK_INFO_T:mfw_gst_v4lsink_info_t0: A lot of buffers are being dropped.

Additional debug info:

There may be a timestamping problem, or this computer is too slow.

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 10022147334 ns.

Setting pipeline to PAUSED ...

Running time 0:00:10.023227334 render fps 0.798

Setting pipeline to READY ...

Setting pipeline to NULL ...

Total rendered:8

Freeing pipeline ...

[--->FINALIZE v4l_sink

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Fri, 20 Jun 2014 21:09:48 GMT

If it´s HDMI, yes, you must set the resolution on kernel command line. There is a known issue in kernel regarding HDMI resolution when using FSL Community BSP (it was not properly upstreamed by Freescale yet, a workaround is available in meta-fsl-bsp-release)

I´m available to reproduce it, and, in fact, there is a similar bug reported here https://bugzilla.yoctoproject.org/show_bug.cgi?id=5202 that I´m working with. Can you, please, take a look if they are actually the same?

I missed the gplay, i´m sorry

Re: Distorted Video i.MX6 gStreamer

ryanerb — Sat, 21 Jun 2014 00:12:57 GMT

Hello,

I tested this and the problem still occurs.

The problem happens whether or not we set the resolution on the kernel command line. (in the bootloader) (see logs below)

This does not seem to be a work around.

root@ventana:~# cat /sys/class/graphics/fb0/mode

S:1280x720p-60

root@ventana:~# cat /proc/cmdline

console=ttymxc1,115200 root=ubi0:rootfs ubi.mtd=2 rootfstype=ubifs video=mxcfb0:dev=hdmi,1280x720M@60,if=RGB24 video=mxcfb1:off video=mxcfb2:off video=mxcfb3:off

root@ventana:~# gst-launch videotestsrc ! video/x-raw-yuv,width=1280,height=720 ! mfw_v4lsink device=/dev/video16

MFW_GST_V4LSINK_PLUGIN 3.0.9 build on Feb 25 2014 14:23:55.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...[ 312.499551] mxc_v4l2_output v4l2_out.30: Bypass IC.

set v4l rotate sucessfully

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1280x720

[V4L Update Display]: left=0, top=0, width=1280, height=720

set v4l display crop sucessfully

New clock: GstSystemClock

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 335418118373 ns.

Setting pipeline to PAUSED ...

Running time 0:05:35.419081373 render fps 29.986

Setting pipeline to READY ...

Setting pipeline to NULL ...

Total rendered:10058

Freeing pipeline ...

[--->FINALIZE v4l_sink

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Mon, 23 Jun 2014 17:01:35 GMT

full screen size:1920x1080

(...)

root@imx6qsabresd:~# cat /proc/cmdline

console=ttymxc0,115200 root=/dev/mmcblk0p2 rootwait rw video=mxcfb0:dev=hdmi,1920x1080M@60,if=RGB24

root@imx6qsabresd:~# fbset

mode "1920x1080-60"

    # D: 148.500 MHz, H: 67.500 kHz, V: 60.000 Hz

    geometry 1920 1080 1920 1080 16

    timings 6734 148 88 36 4 44 5

    hsync high

    vsync high

    rgba 5/11,6/5,5/0,0/0

endmode

I was not able to reproduce the issue with 1080p HDMI resolution + 1080p resolution movie.

          video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=

          (fraction)2997/125

root@imx6qsabresd:~# fbset

mode "1280x720-50"

    # D: 74.250 MHz, H: 37.500 kHz, V: 50.000 Hz

    geometry 1280 720 1280 720 16

    timings 13468 220 440 20 5 40 5

    hsync high

    vsync high

    rgba 5/11,6/5,5/0,0/0

endmode

Or with 1280x720

With both movies I can see it clear in my HDMI.

Can you, please, help me to reproduce it?

At first log you can see my /proc/cmd

First movie (1080p) is big buck bunny, second is another trailer. Do you think it may be caused by the media file?

I used gplay for both.

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Mon, 23 Jun 2014 17:10:10 GMT

I just thought about something....

what is your board revision? And what's the TO of your chip?

Daiane

Re: Distorted Video i.MX6 gStreamer

ryanerb — Mon, 23 Jun 2014 17:13:34 GMT

Hello Daiane,

Can you please test with videotestsrc.

Please use the below command line and adjust the number depending on what your resolution is:

gst-launch videotestsrc ! video/x-raw-yuv,width=1280,height=720 ! mfw_v4lsink device=/dev/video16

Let me know what you see.

Thanks,

Ryan

Re: Distorted Video i.MX6 gStreamer

ryanerb — Mon, 23 Jun 2014 18:34:42 GMT

Here is the TO from the bootloader:

CPU: Freescale i.MX6DL rev1.1 at 792 MHz

Here is some other information from the bootloader:

U-Boot SPL 2014.04-00125-g4d08626 (May 16 2014 - 13:31:51)

NAND : 256 MiB

U-Boot 2014.04-00125-g4d08626 (May 16 2014 - 13:31:51)

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Tue, 24 Jun 2014 01:21:05 GMT

oh! I tested in imx6Q (not DL)

let me try again :smileywink:

Re: Distorted Video i.MX6 gStreamer

ryanerb — Fri, 27 Jun 2014 00:24:58 GMT

Hello Daiane,

Looking for an update and trying to resolve by end of this week.

Please feel free to ask any more questions so we can get this resolved.

Please let me know the results of the videotestsrc test.

Thank you,
Ryan

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Fri, 27 Jun 2014 13:28:48 GMT

this is my board/u-boot

U-Boot 2014.01 (Jun 05 2014 - 05:20:06)

CPU: Freescale i.MX6DL rev1.1 at 792 MHz

kernel:

Linux imx6dlsabresd 3.10.17-1.0.0_ga+g232293e

MM:

3.0.11

and this is the image I used to test:

http://ci.ossystems.com.br/public/fsl-community-bsp/daisy/19/framebuffer/imx6dlsabresd

I tested again with the same movies I had test before. And I was not able to reproduce the issue.

What is the board you are using? I only have access today to one imx6dlsabresd, but I can test imx6dlsabreauto next week.

Can you, please, try to reproduce using a Freescale Reference Board?

Re: Distorted Video i.MX6 gStreamer

ryanerb — Mon, 30 Jun 2014 19:32:48 GMT

Hello,

I only have a Sabre-Lite and Nitrogen 6x so I cannot test on a Freescale Reference board.

Can you tell post your results of the videotestsrc command?

Please use the below command line and adjust the number depending on what your resolution is:

gst-launch videotestsrc ! video/x-raw-yuv,width=1280,height=720 ! mfw_v4lsink device=/dev/video16

Thank you,

Ryan

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Tue, 01 Jul 2014 19:42:14 GMT

The exact command line you shared works fine over here.

update:

and fbset shows the resolution 1280x720-50

D: 74.250

H: 37.500

V: 50.000

Re: Distorted Video i.MX6 gStreamer

ryanerb — Tue, 01 Jul 2014 19:44:55 GMT

Hi Daiane,

Could you provide a few more details, such as what resolution you were running at and if you were using HDMI or LVDS?

Thank you,

Ryan

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Tue, 01 Jul 2014 19:46:16 GMT

it is only HDMI

please see the fbset info I updated in last reply (sorry)

Re: Distorted Video i.MX6 gStreamer

ryanerb — Tue, 01 Jul 2014 21:52:08 GMT

Thanks for the fbset information.

Can you fully clarify the kernel version, the MM version, and the OS userspace.

Thank you,

Ryan

Re: Re: Distorted Video i.MX6 gStreamer

timharvey — Tue, 01 Jul 2014 23:56:33 GMT

Daiane,

Thanks for your help here.

We are using a Gateworks Ventana GW5400 board, which is closely based off the SabreSD reference design. We are now running yocto v1.6 with MM 3.0.11 with the fsl 3.10.17-1.0.0_ga kernel (with some patches on top to fully support our board - source is here: Commits · Gateworks/linux-imx6 · GitHub)

Here are some updated specifics - I would appreciate it if you could repeat this on your SabreSD with HDMI out and see if you get the same results as us.

root@ventana:~# uname -a

Linux ventana 3.10.17-1.0.0_ga+yocto+g44f5a1b #1 SMP Mon Jun 23 13:53:13 PDT 2014 armv7l GNU/Linux

root@ventana:~# cat /proc/cmdline

# no video= params to override the deafult mxcfb configuration from devicetree which is HDMI, CVBS, LVDS for our board

console=ttymxc1,115200 root=ubi0:rootfs ubi.mtd=2 rootfstype=ubifs debug

root@ventana:~# dmesg | grep mxc_sdc_fb

[ 0.650594] mxc_sdc_fb fb.31: registered mxc display driver hdmi IPU1_DISP1

[ 0.685380] mxc_sdc_fb fb.32: registered mxc display driver adv739x IPU2_DISP0

[ 0.695182] mxc_sdc_fb fb.33: registered mxc display driver ldb IPU1_DISP0

root@ventana:~# dmesg | grep "i.MX6"

[ 0.000000] Machine: Freescale i.MX6 Quad/DualLite (Device Tree), model: Gateworks Ventana i.MX6 Dual/Quad GW54XX

[ 0.000000] CPU identified as i.MX6Q, silicon rev 1.2

root@ventana:~# opkg list_installed | grep gst-fsl-plugin

gst-fsl-plugin - 3.0.11-r0

gst-fsl-plugin-gplay - 3.0.11-r0

root@ventana:~# cat /sys/class/graphics/fb0/modes

S:1920x1080p-60

S:1920x1080p-50

S:1280x720p-60

S:1280x720p-50

S:720x576p-50

S:720x480p-60

V:640x480p-60

D:720x480p-59

D:1280x720p-60

V:640x480p-60

root@ventana:~# cat /sys/class/graphics/fb0/mode

S:1920x1080p-60

root@ventana:~# fbset

mode "1920x1080-60"

# D: 148.500 MHz, H: 67.500 kHz, V: 60.000 Hz

geometry 1920 1080 1920 1080 24

timings 6734 148 88 36 4 44 5

hsync high

vsync high

rgba 8/16,8/8,8/0,0/0

endmode

# default display output is 1080p

# attempt 480p input source to 1080p output (this shows fine)

gst-launch videotestsrc ! video/x-raw-yuv,width=720,height=480 ! mfw_v4lsink device=/dev/video16 sync=false

MFW_GST_V4LSINK_PLUGIN 3.0.11 build on Jun 23 2014 14:43:24.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1920x1080

[V4L Update Display]: left=0, top=0, width=1920, height=1080

set v4l display crop sucessfully

New clock: GstSystemClock

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 15521986668 ns.

Setting pipeline to PAUSED ...

Running time 0:00:15.523626668 render fps 54.240

Setting pipeline to READY ...

Setting pipeline to NULL ...

Total rendered:842

Freeing pipeline ...

[--->FINALIZE v4l_sink

root@ventana:~#

# attempt a 1080p input to a 1080p output (this shows display issues)

root@ventana:~# gst-launch videotestsrc ! video/x-raw-yuv,width=1920,height=1080 ! mfw_v4lsink device=/dev/video16 sync=false

MFW_GST_V4LSINK_PLUGIN 3.0.11 build on Jun 23 2014 14:43:24.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...[ 1627.986231] mxc_v4l2_output v4l2_out.38: Bypass IC.

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1920x1080

[V4L Update Display]: left=0, top=0, width=1920, height=1080

set v4l display crop sucessfully

New clock: GstSystemClock

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 20274201669 ns.

Setting pipeline to PAUSED ...

Running time 0:00:20.274989669 render fps 23.132

Setting pipeline to READY ...

Setting pipeline to NULL ...

Total rendered:469

Freeing pipeline ...

[--->FINALIZE v4l_sink

root@ventana:~#

# change the default 1080p output to 480p

root@ventana:~# echo "S:720x480p-60" > /sys/class/graphics/fb0/mode

root@ventana:~# cat /sys/class/graphics/fb0/mode

S:720x480p-60

root@ventana:~# fbset

mode "720x480-60"

# D: 27.000 MHz, H: 31.469 kHz, V: 59.940 Hz

geometry 720 480 720 480 12

timings 37037 60 16 30 9 62 6

nonstd 842094158

rgba 8/16,8/8,8/0,0/0

endmode

# now we are at 480p output

# 480p source to a 480p output shows display issues

root@ventana:~# gst-launch videotestsrc ! video/x-raw-yuv,width=720,height=480 ! mfw_v4lsink device=/dev/video16 sync=false

MFW_GST_V4LSINK_PLUGIN 3.0.11 build on Jun 23 2014 14:43:24.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:720x480

[V4L Update Display]: left=0, top=0, width=720, height=480

set v4l display crop sucessfully

New clock: GstSystemClock

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 5508465000 ns.

Setting pipeline to PAUSED ...

Running time 0:00:05.509253001 render fps 59.899

Setting pipeline to READY ...

Setting pipeline to NULL ...

Total rendered:330

Freeing pipeline ...

[--->FINALIZE v4l_sink

# change back to 1080p

# 720p input to 1080p output shows fine

root@ventana:~# gst-launch videotestsrc ! video/x-raw-yuv,width=720,height=480 ! mfw_v4lsink device=/dev/video16 sync=false

MFW_GST_V4LSINK_PLUGIN 3.0.11 build on Jun 23 2014 14:43:24.

Setting pipeline to PAUSED ...

Pipeline is PREROLLING ...

>>V4L_SINK: Actually buffer status:

hardware buffer : 12

software buffer : 0

Pipeline is PREROLLED ...

Setting pipeline to PLAYING ...

full screen size:1920x1080

[V4L Update Display]: left=0, top=0, width=1920, height=1080

set v4l display crop sucessfully

New clock: GstSystemClock

^CCaught interrupt -- handling interrupt.

Interrupt: Stopping pipeline ...

Execution ended after 4256313001 ns.

Setting pipeline to PAUSED ...

Running time 0:00:04.257095334 render fps 54.027

Setting pipeline to READY ...

Setting pipeline to NULL ...

Total rendered:230

Freeing pipeline ...

[--->FINALIZE v4l_sink

The above seems to indicate to me that whenever scaling is necessary the output is fine, but whenever the input resolution matches the output we have problems.

With the following patch, this issue appears to be resolved, but I'm not clear if its a valid fix or if it will cause other issues:

diff --git a/drivers/media/platform/mxc/output/mxc_vout.c b/drivers/media/platfo
index 9cb4568..89326d9 100644
--- a/drivers/media/platform/mxc/output/mxc_vout.c
+++ b/drivers/media/platform/mxc/output/mxc_vout.c
@@ -1219,6 +1219,7 @@ static int mxc_vout_try_task(struct mxc_vout_output *vout)
        }
        /* assume task.output already set by S_CROP */
        vout->linear_bypass_pp = is_pp_bypass(vout);
+vout->linear_bypass_pp = 0;
        if (vout->linear_bypass_pp) {
                v4l2_info(vout->vfd->v4l2_dev, "Bypass IC.\n");
                output->format = input->format;

Are you saying that you cannot recreate the issue above using a SabreSD with 3.10.17_1.0.0-ga kernel, yocto1.6 userspace, and default kernel cmdline such that HDMI is fb0?

Thanks,

Tim

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Thu, 03 Jul 2014 19:31:44 GMT

Hi timharvey

Are you saying that you cannot recreate the issue above using a SabreSD with 3.10.17_1.0.0-ga kernel, yocto1.6 userspace, and default kernel cmdline such that HDMI is fb0?

Yes, that´s what I´m saying. My command line is video=mxcfb0:dev=hdmi,1920x1080M@60,if=RGB24

I don´t have a "non-freescale" board to test it. So I´m guessing it´s related to the board name/id. I´m digging the source code but I was not able to find any clue on root cause for this problem. It would be easier if I could see the error over here, but It looks like we have already covered all the pieces that differs from our environment.

Do you have any other think I could test?

Your patch changes the kernel, and it removes completely the possibility of using bypass of pp (post processor from IPU). As I remember, this paramenter is passed by gstreamer source code (mfw_vl4sink). Have you tried to change gstreamer plugin instead?

Re: Distorted Video i.MX6 gStreamer

daiane_angolini — Thu, 03 Jul 2014 19:32:36 GMT

Sorry, do you mean I follow the same commands and share my log?

	video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=
	(fraction)2997/125