8MPLUSLPD4-PEVK + Baser daA4200-30mci + Yocto 5.4.70-2.3.2 + Basler 1.3.1 dart-bcon-mipi driver

[marcus-castlepeakinc]

Hello,

Very new to this space, however, I'm trying to find out why I'm not able to see the expected fps via plyonviewer that this camera is rated for.  I'm only seeing ~ 7fps.  I understand, from reading other posts, that exposure can be adjusted the help the fps rate, which I have done to achieve the ~7fps I'm at right now.  Wondering if anyone else has run into this issue and has suggestions on what I can do on this platform combo to increase the fps @ 13 MP.

Thanks!

[smianozib]

I am trying to understand what you saying but I would like to ask you what should be the bandwidth do you have any document defining the limit so that we know what should be a limit for this bandwidth? Alight motion pro APK

[POlaerax]

1 quite useful information, not very relevant this is the best game in 2022 that you should try: gacha cute download

[marcus-castlepeakinc]

I'm at 3840x2160, ~8 MP.  Attached is the log file.  Thanks!

[joanxie]

what resolution do you use? could you send the logfile to me

[marcus-castlepeakinc]

I'm at 3840x2160, ~8 MP. Attached is the log file. Thanks!

[joanxie]

I tested the latest bsp 5.10.52 successfully, I think 5.4.70 should be ok too, I used imx8mp-evk-basler-ov5640.dtb, then insert the camera to the mipi csi port, the test command I used:

"gst-launch-1.0 -v v4l2src ! "video/x-raw,width=3840,height=2160" ! waylandsink"

see my result:

root@imx8mpevk:~# gst-launch-1.0 -v v4l2src ! "video/x-raw,width=3840,height=2160" ! waylandsink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)30/1, colorimetry=(string)2:6:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)30/1, colorimetry=(string)2:6:5:1
/GstPipeline:pipeline0/GstWaylandSink:waylandsink0.GstPad:sink: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)30/1, colorimetry=(string)2:6:5:1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)30/1, colo[ 91.271506] unsupported dwe command 259
rimetry=(string)2:6:5:1
[ 91.271513] unsupported dwe command 260
[ 91.371595] enter isp_mi_stop
[ 91.380610] Not supported 3dnr
[ 91.911276] unsupported function isp_disable_bls
[ 91.911287] unsupported function isp_s_bls
[ 91.915991] unsupported function isp_enable_bls
[ 91.920136] unsupported function isp_enable_bls
[ 91.924712] enter isp_s_comp
[ 91.932180] enter isp_s_comp
[ 91.935205] enter isp_s_comp
[ 91.950880] enter isp_s_comp
[ 91.953892] enter wdr3_hw_init
[ 91.957021] wdr3 res: 3840 2160
[ 91.960861] enter isp_mi_start
[ 97.118141] ###### 30.49 fps ######
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:08.425076875
Setting pipeline to NULL ...
[ 99.652238] enter isp_mi_stop
Total showed frames (227), playing for (0:00:08.425097500), fps (26.943).

[marcus-castlepeakinc]

With the 5.10.52 bsp loaded, and a daA3840-30mc camera, after boot

root@imx8mpevk:~# v4l2-ctl --all -d /dev/video2

Driver Info:
Driver name : viv_v4l2_device
Card type : VIV
Bus info : platform:viv0
Driver version : 5.10.52
Capabilities : 0x84200001
Video Capture
Streaming
Extended Pix Format
Device Capabilities
Device Caps : 0x04200001
Video Capture
Streaming
Extended Pix Format
Media Driver Info:
Driver name : vvcam-video
Model : viv_media
Serial :
Bus info :
Media version : 5.10.52
Hardware revision: 0x00000000 (0)
Driver version : 5.10.52
Interface Info:
ID : 0x03000003
Type : V4L Video
Entity Info:
ID : 0x00000001 (1)
Name : viv_v4l20
Function : V4L2 I/O
Pad 0x01000002 : 0: Sink, Must Connect
Link 0x02000010: from remote pad 0x1000006 of entity 'vvcam-dwe.0': Data, Enabled
Priority: 2
Video input : 0 (camera: ok)
Format Video Capture:
Width/Height : 1920/1080
Pixel Format : 'YUYV' (YUYV 4:2:2)
Field : None
Bytes per Line : 3840
Size Image : 4147200
Colorspace : Rec. 709
Transfer Function : Default (maps to Rec. 709)
YCbCr/HSV Encoding: Default (maps to Rec. 709)
Quantization : Default (maps to Limited Range)
Flags :
Crop Capability Video Capture:
Bounds : Left 0, Top 0, Width 1920, Height 1080
Default : Left 0, Top 0, Width 1920, Height 1080
Pixel Aspect: 1/1
Selection Video Capture: crop, Left 0, Top 0, Width 1920, Height 1080, Flags:
Selection Video Capture: crop_default, Left 0, Top 0, Width 1920, Height 1080, Flags:
Selection Video Capture: crop_bounds, Left 0, Top 0, Width 1920, Height 1080, Flags:
Selection Video Capture: compose, Left 0, Top 0, Width 1920, Height 1080, Flags:
Selection Video Capture: compose_default, Left 0, Top 0, Width 3840, Height 2160, Flags:
Selection Video Capture: compose_bounds, Left 0, Top 0, Width 3840, Height 2160, Flags:
Streaming Parameters Video Capture:
Capabilities : timeperframe
Frames per second: 60.000 (60/1)
Read buffers : 0

User Controls

viv_ext_ctrl 0x0098f901 (str) : min=0 max=65535 step=1 value='' flags=has-payload
sensor_resw 0x0098f903 (int) : min=0 max=3840 step=1 default=1920 value=0 flags=read-only, volatile
sensor_resh 0x0098f904 (int) : min=0 max=2160 step=1 default=1080 value=0 flags=read-only, volatile

NOTE:  Frames per second: 60.0

This should be a 30 fps camera.

root@imx8mpevk:~# gst-launch-1.0 -v v4l2src device=/dev/video2 ! "video/x-raw,width=3840,height=2160" ! autovideosink
Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Pipeline is PREROLLED ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)60/1, pixel-aspect-ratio=(fraction)1/1, interlace-m1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)60/1, pixel-aspect-ratio=(fraction)1/1, inter1
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)60/1, pixel1
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstWaylandSink:autovideosink0-actual-sink-wayland.GstPad:sink: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerat1
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)60/1, pixel-aspect-ratio=(fractio1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, width=(int)3840, height=(int)2160, format=(string)YUY2, framerate=(fraction)60/1, pixel-aspect-r[ 322.517254] enter ispp
atio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)2:6:11:1
[ 323.218124] enter isp_s_comp
[ 323.221043] enter isp_s_comp
[ 323.223950] enter isp_s_comp
[ 323.239951] enter wdr3_hw_init
[ 323.243011] wdr3 res: 1920 1080
[ 323.246960] enter isp_mi_start
[ 381.198347] ###### video2(0) 54.43 fps ######

Is this an inconsistentcy in 5.10.52 bsp

[marcus-castlepeakinc]

I was wondering if you ran this test with a real 4k monitor attached.  With a real 4k monitor attached to by board, I'm getting ~15 fps processed.  Can you try?

[joanxie]

did you see my result I tested before?

root@imx8mpevk:~# gst-launch-1.0 -v v4l2src ! "video/x-raw,width=3840,height=2160" ! waylandsink

[ 97.118141] ###### 30.49 fps ######
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:08.425076875
Setting pipeline to NULL ...
[ 99.652238] enter isp_mi_stop
Total showed frames (227), playing for (0:00:08.425097500), fps (26.943).

[marcus-castlepeakinc]

Yes I did.  However, I'm seeing different performance results whether I have a 4k monitor attached or something smaller.  Can you use a 4k monitor and let me know what the performance is?

[joanxie]

what do you  mean 4k monitor or smaller? do you mean connect 4k display(HDMI) with imx8mp?

[marcus-castlepeakinc]

Yes, please plugin a 4k monitor to the 8MPLUSLPD4-PEVK board and let me know what the fps is for

gst-launch-1.0 -v v4l2src ! "video/x-raw,width=3840,height=2160" ! waylandsink

[joanxie]

yes, if use 4k display, the frame rate should be lower fps, because of bandwidth limitation

[marcus-castlepeakinc]

is there any documentation describing this bandwidth limitation?  what exactly has this bandwidth limitation?

[joanxie]

I don't find such document, this issue is related to the IC design, as I known, for the original design, the design team didn't asked for supporting 4k monitor, so vpu has the same issue on 4k monitor, but they don't have confirmed answer if current imx8mp can support this or not, I will continue following this, if I get any update from them, I will reply to you

[marcus-castlepeakinc]

Hi.

Using mx8mp-evk-basler-ov5640.dtb, camera in MIPI CSI1, the gst-launch command gives me:

Setting pipeline to PAUSED ...
ERROR: Pipeline doesn't want to pause.
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Cannot identify device '/dev/video0'.

Pylonviewer only shows the emulation camera.

I did see this on the serial console at boot:

[ 6.497788] imx8_media_dev: module is from the staging directory, the quality is unknown, you have been warned.
[ 6.519217] mx8-img-md: Registered mxc_isi.1.capture as /dev/video0
[ 6.526204] unregister ISI channel: mxc_isi.1
[ OK ] Started ISP i.MX 8Mplus daemon.
[ 6.543565] ABRM: Manufacturer: Basler, Model: daA4200-30mci, Device: 108011-02, Serial: basler:40054723
[ 6.555164] mx8-img-md: Registered sensor subdevice: basler-camera-vvcam 1-0036 (1)

When you said you used 5.10.52, was that off the hardknott project (instead of zeus)?  Will the 1.3.1 basler driver work with that kernel version?

[joanxie]

refer to your logfile you don't use the correct video device, pls give me the result after you use "v4l2-ctl --list-device"

for bsp version, I download the demo images from：

“https://www.nxp.com/design/software/embedded-software/i-mx-software/embedded-linux-for-i-mx-applicat...

refer to the release note, current bsp supports 4-lane Basler CSI MIPI cameras AR0821 with 4K@30 with ISP on i.MX8M Plus.

[marcus-castlepeakinc]

I switched to the Basler daA3840-30mc, which is a AR0821 camera.  It works in Zeus with the Basler drivers built into the BSP.  With Hardknott prebuilt BSPs, the camera does not work.  Are the Basler drivers required with Hardknott?

[joanxie]

do you mean L5.4.70-2.3.0? I just tested successfully, let me remind, set fdtfile, not fdt_file, I think maybe you have set the wrong fdt file, and after boot up, use /dev/video2 as capture device, like "gst-launch-1.0 -v v4l2src device=/dev/video2 ! "video/x-raw,width=3840,height=2160" ! waylandsink"

[marcus-castlepeakinc · Accepted solution]

Setting fdtfile, not fdt_file fixed this.  Thanks!