i.MX Processors中的主题 Re: Re: Re: browser video acceleration

browser video acceleration

pouet78 — Mon, 02 Nov 2020 13:04:34 GMT

Hello,

I don't understand why seeing a video from a browser (firefox with gstreamer enabled) laggs whereas it works better (some glitches) with a video player (totem)

I use a wandboard duo with ubuntu 12.04

Here are the outputs

With Firefox

pouet78@wandboard-01:~$ firefox file:///home/pouet78/test_video.html

Aiur: 3.0.7

Core: MPEG4PARSER_06.06.01 build on Mar 1 2013 14:21:54

mime: video/quicktime; audio/x-m4a; application/x-3gp

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.1

Content Info:

Seekable : Yes

Size(byte): 99466300

Movie Info:

Seekable : Yes

Live      : No

Duration : 0:01:52.831664000

ReadMode : File

Track    : 2

Track 00 [video_000000] Enabled

Duration: 0:01:52.820000000

Language: und

Mime:

      video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=

      (fraction)24000/1001, codec_data=(buffer)0000000167640033ac34e2805005ba10001974f

      004c4b408f18318a80000000168eebce5531cc305d2628d13080214868783a1c0d04e12142c0ac0d

      a02fe10042ad35e9e850b748c778a1410088b172105449ca3050e204448b20a4d8a0818270908098

      48541dc4290a43164215a201900cae8340f81e86f03300b6017002ac05981d61a07802a8400a9020

      87404700bc010506e036404b811805902e07203e0087ff85b

[INFO] Product Info: i.MX6Q/D/S

vpudec versions

plugin: 3.0.7

wrapper: 1.0.35(VPUWRAPPER_ARM_LINUX Build on Jul 2 2013 08:38:58)

vpulib: 5.4.12

firmware: 2.1.9.36350

Track 01 [audio_000000] Enabled

Duration: 0:01:52.831664000

Language: und

Mime:

      audio/x-ac3, channels=(int)6, rate=(int)48000, bitrate=(int)0, framed=(boolean)t

      rue

[INFO] bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0

[WARN] VPU iram is less than needed, some parts don't use iram

[--->FINALIZE aiurdemux

With totem

pouet78@wandboard-01:~$ totem --fullscreen --play /home/pouet78/Videos/h264_720p_hp_5.1_6mbps_ac3_planet.mp4

MFW_GST_V4LSINK_PLUGIN 3.0.7 build on Jul 2 2013 09:22:06.

(totem:5619): GLib-GObject-CRITICAL **: Read/writable property 'object' on class 'ZeitgeistDpPlugin' has type 'TotemObject' which is not exactly equal to the type 'GObject' of the property on the interface 'PeasActivatable'

Aiur: 3.0.7

Core: MPEG4PARSER_06.06.01 build on Mar 1 2013 14:21:54

mime: video/quicktime; audio/x-m4a; application/x-3gp

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.1

Content Info:

URI:

      file:///home/pouet78/Videos/h264_720p_hp_5.1_6mbps_ac3_planet.mp4

Idx File:

      /home/pouet78/.aiur/.home.pouet78.Videos.h264_720p_hp_5.1_6mbps_ac3_planet.mp4.a

      idx

Seekable : Yes

Size(byte): 99466300

Movie Info:

Seekable : Yes

Live      : No

Duration : 0:01:52.831664000

ReadMode : File

Track    : 2

Track 00 [video_000000] Enabled

Duration: 0:01:52.820000000

Language: und

Mime:

      video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=

      (fraction)24000/1001, codec_data=(buffer)0000000167640033ac34e2805005ba10001974f

      004c4b408f18318a80000000168eebce5531cc305d2628d13080214868783a1c0d04e12142c0ac0d

      a02fe10042ad35e9e850b748c778a1410088b172105449ca3050e204448b20a4d8a0818270908098

      48541dc4290a43164215a201900cae8340f81e86f03300b6017002ac05981d61a07802a8400a9020

      87404700bc010506e036404b811805902e07203e0087ff85b

** (totem:5619): WARNING **: Problem inhibiting the screensaver: GDBus.Error:org.freedesktop.DBus.Error.NameHasNoOwner: Name "org.gnome.SessionManager" does not exist

[INFO] Product Info: i.MX6Q/D/S

vpudec versions

plugin: 3.0.7

wrapper: 1.0.35(VPUWRAPPER_ARM_LINUX Build on Jul 2 2013 08:38:58)

vpulib: 5.4.12

firmware: 2.1.9.36350

Track 01 [audio_000000] Enabled

Duration: 0:01:52.831664000

Language: und

Mime:

      audio/x-ac3, channels=(int)6, rate=(int)48000, bitrate=(int)0, framed=(boolean)t

      rue

[INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0

[WARN] VPU iram is less than needed, some parts don't use iram

>>V4L_SINK: Actually buffer status:

hardware buffer : 17

software buffer : 0

full screen size:1280x720

[V4L Update Display]: left=0, top=0, width=1280, height=720

Running time 0:01:52.834747000 render fps 23.955

The html code is simple:

<!DOCTYPE html>
<html>
  <body>
    <video autoplay>
      <source src="Videos/h264_720p_hp_5.1_6mbps_ac3_planet.mp4" type="video/mp4">
      <source src="Videos/h264_720p_hp_5.1_6mbps_ac3_planet.webmhd.webm" type="video/webm">
      Your browser does not support the video tag.
    </video>
  </body>
</html>

Thanks for your help

PS : if you want to try, the video is a generic sample you should be able to get in Internet

Re: browser video acceleration

LeonardoSandova — Mon, 11 Nov 2013 16:47:41 GMT

Could you please run the same pipelines, just execute this command before launching them

export GST_DEBUG=GST_ELEMENT_FACTORY:3

This is the way to enable the factory's log, which indicates which elements are actually being used.

Leo

Re: Re: browser video acceleration

pouet78 — Mon, 11 Nov 2013 19:55:45 GMT

Firefox :

pouet78@wandboard-01:~$ firefox file:///home/pouet78/test_video.html

0:00:00.207944000 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "playbin2"

0:00:00.217417333 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "capsfilter"

0:00:00.225343333 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "appsink"

0:00:00.226820667 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "bin"

0:00:00.228010333 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "capsfilter"

0:00:00.228640666 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "appsink"

0:00:00.229299666 15394 0x2b06dc00 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "bin"

0:00:00.235940333 15394 0x3ab59d40 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "uridecodebin"

0:00:00.237928000 15394 0x3ab59d40 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "appsrc" named "source"

0:00:00.239265666 15394 0x3ab59d40 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "decodebin2"

0:00:00.240031666 15394 0x3ab59d40 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "typefind" named "typefind"

0:00:00.300904000 15394 0x3ab59d40 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "aiurdemux"

(firefox:15394): GStreamer-CRITICAL **: gst_debug_log_valist: assertion `category != NULL' failed

Aiur: 3.0.7

Core: MPEG4PARSER_06.06.01 build on Mar 1 2013 14:21:54

mime: video/quicktime; audio/x-m4a; application/x-3gp

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.1

Content Info:

Seekable : Yes

Size(byte): 99466300

Movie Info:

Seekable : Yes

Live      : No

Duration : 0:01:52.831664000

ReadMode : File

Track     : 2

Track 00 [video_000000] Enabled

Duration: 0:01:52.820000000

Language: und

Mime:

       video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=

       (fraction)24000/1001, codec_data=(buffer)0000000167640033ac34e2805005ba10001974f

       004c4b408f18318a80000000168eebce5531cc305d2628d13080214868783a1c0d04e12142c0ac0d

       a02fe10042ad35e9e850b748c778a1410088b172105449ca3050e204448b20a4d8a0818270908098

       48541dc4290a43164215a201900cae8340f81e86f03300b6017002ac05981d61a07802a8400a9020

       87404700bc010506e036404b811805902e07203e0087ff85b

0:00:00.376878333 15394 0x3ac11790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "multiqueue"

0:00:00.401262000 15394 0x3ac11790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "vpudec"

[INFO] Product Info: i.MX6Q/D/S

vpudec versions :smileyhappy:

plugin: 3.0.7

wrapper: 1.0.35(VPUWRAPPER_ARM_LINUX Build on Jul 2 2013 08:38:58)

vpulib: 5.4.12

firmware: 2.1.9.36350

Track 01 [audio_000000] Enabled

Duration: 0:01:52.831664000

Language: und

Mime:

       audio/x-ac3, channels=(int)6, rate=(int)48000, bitrate=(int)0, framed=(boolean)t

       rue

0:00:00.455026000 15394 0x3ac11790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "ac3parse"

0:00:00.460413667 15394 0x3ac11790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "capsfilter"

0:00:00.508503666 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "a52dec"

0:00:00.514894000 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "input-selector"

0:00:00.518106666 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "input-selector"

0:00:00.520612667 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "tee" named "audiotee"

0:00:00.525549667 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "vbin"

0:00:00.526436667 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "queue" named "vqueue"

0:00:00.531688667 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "identity" named "identity"

0:00:00.556858000 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "ffmpegcolorspace" named "conv"

0:00:00.619761333 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "videoscale" named "scale"

0:00:00.684664333 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "abin"

0:00:00.685549666 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "queue" named "aqueue"

0:00:00.687621999 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "identity" named "identity"

0:00:00.708292333 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "volume" named "volume"

0:00:00.751943666 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "audioconvert" named "conv"

0:00:00.764553666 15394 0x3c4cf790 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "audioresample" named "resample"

[INFO] bitstreamMode 1, chromaInterleave 0, mapType 0, tiled2LinearEnable 0

[WARN] VPU iram is less than needed, some parts don't use iram

totem :

pouet78@wandboard-01:~$ totem --fullscreen --play /home/pouet78/Videos/h264_720p_hp_5.1_6mbps_ac3_planet.mp4

0:00:00.876571335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "playbin2" named "play"

0:00:00.885952335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "gconfaudiosink" named "audio-sink"

0:00:00.891016002 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "testsink"

0:00:00.913995335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "gconfvideosink" named "video-sink"

0:00:00.914896002 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "testsink"

0:00:00.941067669 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "autovideosink"

0:00:00.941978669 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "tempsink"

0:00:00.942579002 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "bin"

0:00:00.948344668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "mfw_v4lsink" named "autovideosink0-actual-sink-mfw_v4l"

MFW_GST_V4LSINK_PLUGIN 3.0.7 build on Jul 2 2013 09:22:06.

0:00:00.953770668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "autoaudiosink"

0:00:00.954704002 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "tempsink"

0:00:00.955379668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "bin"

0:00:00.993770335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "pulsesink" named "autoaudiosink0-actual-sink-pulse"

0:00:01.005646668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "tempsink"

0:00:01.006219335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "testsink"

0:00:01.007059335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "capsfilter" named "audiofilter"

0:00:01.007955001 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "audiosinkbin"

0:00:01.084946001 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "goom" named "vis_element"

0:00:01.118260334 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "capsfilter" named "vis_capsfilter"

0:00:01.119030001 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "vis_bin"

0:00:01.120469335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "goom" named "vis_element"

0:00:01.153359335 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "capsfilter" named "vis_capsfilter"

0:00:01.154155668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "vis_bin"

(totem:15375): GLib-GObject-CRITICAL **: Read/writable property 'object' on class 'ZeitgeistDpPlugin' has type 'TotemObject' which is not exactly equal to the type 'GObject' of the property on the interface 'PeasActivatable'

0:00:01.709201669 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "uridecodebin"

0:00:01.711556669 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "filesrc" named "source"

0:00:01.713330669 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "decodebin2"

0:00:01.714703668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "typefind" named "typefind"

0:00:01.755478002 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "autoaudiosink"

0:00:01.756193002 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "fakesink" named "tempsink"

0:00:01.756797668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "bin"

0:00:01.758498668 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "pulsesink" named "autoaudiosink1-actual-sink-pulse"

0:00:01.780171669 15375 0x2c1fa860 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "aiurdemux"

(totem:15375): GStreamer-CRITICAL **: gst_debug_log_valist: assertion `category != NULL' failed

Aiur: 3.0.7

Core: MPEG4PARSER_06.06.01 build on Mar 1 2013 14:21:54

mime: video/quicktime; audio/x-m4a; application/x-3gp

file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm11_elinux.so.3.1

Content Info:

URI:

       file:///home/pouet78/Videos/h264_720p_hp_5.1_6mbps_ac3_planet.mp4

Idx File:

       /home/pouet78/.aiur/.home.pouet78.Videos.h264_720p_hp_5.1_6mbps_ac3_planet.mp4.a

       idx

Seekable : Yes

Size(byte): 99466300

Movie Info:

Seekable : Yes

Live      : No

Duration : 0:01:52.831664000

** (totem:15375): WARNING **: Problem inhibiting the screensaver: GDBus.Error:org.freedesktop.DBus.Error.NameHasNoOwner: Name "org.gnome.SessionManager" does not exist

ReadMode : File

Track     : 2

Track 00 [video_000000] Enabled

Duration: 0:01:52.820000000

Language: und

Mime:

       video/x-h264, parsed=(boolean)true, width=(int)1280, height=(int)720, framerate=

       (fraction)24000/1001, codec_data=(buffer)0000000167640033ac34e2805005ba10001974f

       004c4b408f18318a80000000168eebce5531cc305d2628d13080214868783a1c0d04e12142c0ac0d

       a02fe10042ad35e9e850b748c778a1410088b172105449ca3050e204448b20a4d8a0818270908098

       48541dc4290a43164215a201900cae8340f81e86f03300b6017002ac05981d61a07802a8400a9020

       87404700bc010506e036404b811805902e07203e0087ff85b

0:00:01.861684002 15375 0x330cf060 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "multiqueue"

0:00:01.877565002 15375 0x330cf060 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "vpudec"

[INFO] Product Info: i.MX6Q/D/S

vpudec versions :smileyhappy:

plugin: 3.0.7

wrapper: 1.0.35(VPUWRAPPER_ARM_LINUX Build on Jul 2 2013 08:38:58)

vpulib: 5.4.12

firmware: 2.1.9.36350

Track 01 [audio_000000] Enabled

Duration: 0:01:52.831664000

Language: und

Mime:

       audio/x-ac3, channels=(int)6, rate=(int)48000, bitrate=(int)0, framed=(boolean)t

       rue

0:00:01.911316335 15375 0x330cf060 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "ac3parse"

0:00:01.914182335 15375 0x330cf060 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "capsfilter"

0:00:01.935416335 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "a52dec"

0:00:01.940229002 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "input-selector"

0:00:01.942292002 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:376:gst_element_factory_create: creating element "input-selector"

0:00:01.943338669 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "tee" named "audiotee"

0:00:01.945838668 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "vbin"

0:00:01.946482668 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "queue" named "vqueue"

0:00:01.949670669 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "bin" named "abin"

0:00:01.950511669 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "queue" named "aqueue"

0:00:01.952394002 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "identity" named "identity"

0:00:01.969856002 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "volume" named "volume"

0:00:01.996861335 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "audioconvert" named "conv"

0:00:02.006618002 15375 0x32a1d750 INFO     GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "audioresample" named "resample"

[INFO] bitstreamMode 1, chromaInterleave 1, mapType 0, tiled2LinearEnable 0

[WARN] VPU iram is less than needed, some parts don't use iram

>>V4L_SINK: Actually buffer status:

hardware buffer : 17

software buffer : 0

full screen size:1280x720

[V4L Update Display]: left=0, top=0, width=1280, height=720

Re: browser video acceleration

kaskasi — Mon, 11 Nov 2013 21:04:09 GMT

Have you compared what is actually running using top ?

Re: Re: browser video acceleration

LeonardoSandova — Mon, 11 Nov 2013 22:03:42 GMT

On Firefox, this is the problem

0:00:00.556858000 15394 0x3c4cf790 INFO GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "ffmpegcolorspace" named "conv"

0:00:00.619761333 15394 0x3c4cf790 INFO GST_ELEMENT_FACTORY gstelementfactory.c:374:gst_element_factory_create: creating element "videoscale" named "scale"

These two elements do the processing using the CPU and RAM, so it decreases the playback speed considerably. What I do not understand is that if the two are using playbin2 (an element container), why totem is not including these.... The only way to figure out these is to dig into the source code, I believe.

Re: browser video acceleration

pouet78 — Mon, 11 Nov 2013 23:51:11 GMT

Nothing special as I run the 2 commands from a ssh cli one just after the other and don't see any other new process running but the command.

I see that firefox is using 12% of RAM and totem onlu 2.9%

Re: Re: Re: browser video acceleration

pouet78 — Mon, 11 Nov 2013 23:54:11 GMT

Tried to remove the 2 specified plugins but still the same issue. The debug changed only on the two lines :

0:00:03.870994335 3373 0x3d5e3dc0 INFO GST_ELEMENT_FACTORY gstelementfactory.c:467:gst_element_factory_make: no such element factory "ffmpegcolorspace"!

0:00:03.871790335 3373 0x3d5e3dc0 INFO GST_ELEMENT_FACTORY gstelementfactory.c:467:gst_element_factory_make: no such element factory "videoscale"!

The modules are not run and the lag is still there :smileysad:

Re: Re: Re: browser video acceleration

LeonardoSandova — Tue, 12 Nov 2013 00:11:35 GMT

Can you launch firefox through the touchscreen? do you have the element mfw_ipucsc? if not, try to install it.

Leo

Re: Re: Re: Re: browser video acceleration

pouet78 — Tue, 12 Nov 2013 09:00:17 GMT

Don't have a touchscreen, only a TV and keyboard/mouse. That's why I do my tests through ssh.

mfw_ipucsc is there

pouet78@wandboard-01:~$ gst-inspect|grep ipucsc

ipucsc.imx: mfw_ipucsc: IPU-based video converter

Re: Re: Re: Re: browser video acceleration

LeonardoSandova — Tue, 12 Nov 2013 16:41:27 GMT

What I wanted to know is if somehow when you open the browser with the mouse (touchscreen is not possible), so see the same problem. It can be the case that when you log in with ssh, it is a different user as the one you are on the GUI. Anyway, I think there is no easy solution unless you see how firefox integrates with the MM framework.

Leo