topic Re: VPU hardware decoding not working in kirkstone release in i.MX Graphics

VPU hardware decoding not working in kirkstone release

Junjielu — Tue, 06 Dec 2022 01:09:33 GMT

Hi There,

In my understanding, we can use the following commands to determine whether `gpu` hardware decoder works or not:

user@imx8mqevk:~$ cat /proc/interrupts | grep hantrodec
 77:          0          0          0          0  GPCv2 i.MX8MQ   7 Level     hantrodec
 78:          0          0          0          0  GPCv2 i.MX8MQ   8 Level     hantrodec

Use watch command to observe IRQ77 while playing MP4 videos:

user@imx8mqevk:~$ watch -n1 cat /proc/irq/77/spurious

1) hardnott release (desktop):

2) kirkstone release (desktop):

In my testing, the same MP4 file and the built-in "Video" player ( totem) have been used. Why "VPU" hard decoder does not work any more in "kirkstone" release?

thanks a lot for the help!

Best,

Jason

Re: VPU hardware decoding not working in kirkstone release

joanxie — Thu, 08 Dec 2022 02:25:30 GMT

you can use gstreamer to test again, use "gplay-1.0 xxx.mp4" to playback the mp4 video

Re: VPU hardware decoding not working in kirkstone release

Junjielu — Tue, 13 Dec 2022 18:15:15 GMT

Hi Joan,

I tried to use "gplay-1.0 xxx.mp4", but failed.

============================================

user@imx8mqevk:~/Videos$ gplay-1.0 up.mp4

FSL_GPLAY2_01.00_LINUX build on May 20 2022 06:51:21

Disable subtitle rendering

====== AIUR: 4.7.0 build on May 20 2022 06:51:21. ======
Core: MPEG4PARSER_06.20.06 build on May 7 2022 07:52:31
file: /usr/lib/imx-mm/parser/lib_mp4_parser_arm_elinux.so.3.2
------------------------
Track 00 [audio_0] Enabled
Duration: 0:00:52.848616000
Language: und
Mime:
audio/mpeg, mpegversion=(int)4, channels=(int)2, rate=(int)44100, bitrat e=(int)125648, stream-format=(string)raw, codec_data=(buffer)1210
------------------------

====== BEEP: 4.7.0 build on May 20 2022 06:51:21. ======
Core: AAC decoder Wrapper build on Jul 28 2020 10:45:34
file: /usr/lib/imx-mm/audio-codec/wrap/lib_aacd_wrap_arm_elinux.so.3
CODEC: BLN_MAD-MMCODECS_AACD_ARM_03.09.00_ARMV8 build on Sep 20 2017 15:02:50.
------------------------
Track 01 [video_0] Enabled
Duration: 0:00:52.844458000
Language: und
Mime:
video/x-h264, parsed=(boolean)true, alignment=(string)au, stream-format= (string)avc, width=(int)640, height=(int)240, framerate=(fraction)24000/1001, co dec_data=(buffer)01640015ffe1002567640015acd1c0a07ec0548303032000007d200017701c9 0001e848003d09c98701f162d1e01000668e9bb2cc00bfdf8f800
------------------------
====== VPUDEC: 4.7.0 build on May 20 2022 06:51:21. ======
wrapper: 3.0.0 (VPUWRAPPER_ARM64_LINUX Build on Jun 2 2022 08:51:59)
vpulib: 1.1.1
firmware: 1.1.1.65535

===!!! Current pulsesink device is alsa_output.platform-sound-wm8524.stereo-fall back !!!===

=========== fsl_player_play() ==================

FSL_GPLAY2_01.00_LINUX build on May 20 2022 06:51:21
[h]display the operation Help
[p]Play
[s]Stop
[e]Seek
[a]Pause when playing, play when paused
[v]Volume
[m]Switch to mute or not
[>]Play next file
[<]Play previous file
[r]Switch to repeated mode or not
[u]Select the video track
[d]Select the audio track
[b]Select the subtitle track
[n]Select adaptive playback track
[f]Set full screen
[z]resize the width and height
[t]Rotate
[c]Setting play rate
[i]Display the metadata
[x]eXit
State changed: buffering
ERROR Error from element /GstPlayBin:playbin/GstURIDecodeBin:uridecodebin0/GstDe codeBin:decodebin0/GstAiurDemux:aiurdemux0: GStreamer encountered a general stre am error.
GStreamer encountered a general stream error.
../git/plugins/aiurdemux/aiurdemux.c(1139): aiurdemux_pull_task (): /GstPlayBin: playbin/GstURIDecodeBin:uridecodebin0/GstDecodeBin:decodebin0/GstAiurDemux:aiurd emux0:
streaming stopped, reason error, state 3 for up.mp4
getNextItem No next item!
No more media file, exit gplay!
FSL_PLAYER_UI_MSG_EXIT
Exit display thread
fsl_player_deinit

Re: VPU hardware decoding not working in kirkstone release

joanxie — Sun, 18 Dec 2022 11:38:11 GMT

did you have any issue playback other mp4 files? all of mp4 has this issue or only up.mp4?

Re: VPU hardware decoding not working in kirkstone release

Junjielu — Mon, 19 Dec 2022 07:19:15 GMT

Hi Joan,

I tried several MP4 files and the results were consistent with each other.

Thank you very much!

Best,

Jason

Re: VPU hardware decoding not working in kirkstone release

joanxie — Fri, 30 Dec 2022 07:16:22 GMT

did you use nxp board or your own customized board? I couldn't find any issue on nxp board before when playback the mp4 files, you can download the test files from:

"http://bbb3d.renderfarming.net/download.html"

test the Standard 2D video like 720p, you also can use the command

"gst-launch-1.0 playbin uri=file:///mnt/sdcard/test.mp4"

"$ gstreamer-launch-1.0 filesrc location=<video_file> ! \
video/quicktime ! aiurdemux ! h264parse ! vpudec ! \
queue max-size-time=0 ! autovideosink sync=false"