topic Re: [IMX8MP][ISP] isp_media_server crashes at camdev::SensorOps::queryCaps() in i.MX Processors

[IMX8MP][ISP] isp_media_server crashes at camdev::SensorOps::queryCaps()

khang_letruong — Fri, 23 Jul 2021 15:08:19 GMT

Dear Experts,

I'm using the isp-imx-4.2.2.11.0 for the porting of our custom camera (Sony IMX296) and build it in Partial/Release mode. Following are the steps for running the test program :

1. Run daemon in first console :

root@IMX8MPEVK:/opt/imx8-isp/bin# export ISP_LOG_LEVEL=8 root@IMX8MPEVK:/opt/imx8-isp/bin# ./run.sh -c imx296 -lm RUN_SCRIPT=/opt/imx8-isp/bin/run.sh RUN_SCRIPT_PATH=/opt/imx8-isp/bin Trying configuration "imx296"... Removing vvcam-isp... Removing vvcam-dwe... Removing vvcam-video... Removing imx8-media-dev... Removing ov2775... Removing os08a20... Removing imx296... Removing basler-camera-driver-vvcam... Loading module imx296 ... imx296 Loaded /lib/modules/5.4.70/kernel/drivers/staging/media/imx/imx296.ko Loading module imx8-media-dev ... imx8_media_dev Loaded /lib/modules/5.4.70/kernel/drivers/staging/media/imx/imx8-media-dev.ko Loading module vvcam-video ... vvcam_video Loaded /lib/modules/5.4.70/kernel/drivers/staging/media/imx/vvcam-video.ko Loading module vvcam-dwe ... vvcam_dwe Loaded /lib/modules/5.4.70/kernel/drivers/staging/media/imx/vvcam-dwe.ko Loading module vvcam-isp ... vvcam_isp Loaded /lib/modules/5.4.70/kernel/drivers/staging/media/imx/vvcam-isp.ko Starting isp_media_server with configuration file CAMERA0 INFO : [ISP_MEDIA_SERVER] ****************************************************************** INFO : [ISP_MEDIA_SERVER] VIV ISP Media Control Framework V4.2.2p11 (Jul 23 2021, 05:50:38) INFO : [ISP_MEDIA_SERVER] ******************************************************************

dmesg before :

[ 104.559510] imx296: loading out-of-tree module taints kernel. [ 104.560776] imx296 1-001a: 1-001a supply vdda not found, using dummy regulator [ 104.560856] imx296 1-001a: 1-001a supply vddd not found, using dummy regulator [ 104.560893] imx296 1-001a: 1-001a supply vddo not found, using dummy regulator [ 104.592081] imx296 1-001a: imx296_set_ctrl : ctrl = {.id = 0x009f0903, .val = 0x00000000} [ 104.592088] imx296 1-001a: I2C writing value 00 at address 0x3238 [ 104.592711] imx296 1-001a: I2C writing value 01 at address 0x3008 [ 104.593309] imx296 1-001a: I2C writing value 3c at address 0x3254 [ 104.594161] imx296 1-001a: I2C writing value 00 at address 0x3255 [ 104.594774] imx296 1-001a: I2C writing value 00 at address 0x3008 [ 104.595388] imx296 1-001a: I2C writing value 01 at address 0x3022 [ 104.596008] imx296 1-001a: no limit for max-data_rate [ 104.596014] imx296 1-001a: Camera is found [ 104.637765] imx8_media_dev: module is from the staging directory, the quality is unknown, you have been warned. [ 104.638782] mx8-img-md: Registered sensor subdevice: imx296 1-001a (1) [ 104.638793] mx8-img-md: created link [imx296 1-001a] => [mxc-mipi-csi2.0] [ 104.638800] mxc-md 32c00000.bus:camera: mxc_md_create_links [ 104.644498] imx296 1-001a: imx296_set_fmt : fmt = {.which = 0x00000000} [ 104.644509] imx296 1-001a: imx296_set_fmt : mode = {.width = 1440, .height = 1080, .pixel_rate = 74250000} [ 104.644529] enter imx296_ioc_qcap [ 104.693421] enter viv_video_init_module [ 104.751994] enter viv_dwe_init_module [ 104.752429] enter dwe_hw_probe [ 104.752901] vvcam dewarp driver probed [ 104.843932] enter viv_isp_init_module [ 104.844359] enter isp_hw_probe [ 104.844689] vvcam isp driver registered [ 104.858084] enter isp_mi_stop

Run the ./video_test program in another console :

root@IMX8MPEVK:~# export ISP_LOG_LEVEL=8 root@IMX8MPEVK:/opt/imx8-isp/bin# ./video_test -w 1440 -h 1080 -f RAW10 -t 2 -m0 -d0 INFO : [VIDEOTEST] Open Device: /dev/video0 (fd=3) INFO : [VIDEOTEST] Driver: viv_v4l2_device INFO : [VIDEOTEST] found viv video dev /dev/video0 INFO : [VIDEOTEST] openDevice Control User Controls INFO : [VIDEOTEST] openDevice Control viv_ext_ctrl INFO : [VIDEOTEST] openDevice, find viv ctrl id 0x98f901 INFO : [VIDEOTEST] open camdev ret : 3 INFO : [VIDEOTEST] Open Device: /dev/video0 (fd=3) INFO : [VIDEOTEST] Driver: viv_v4l2_device INFO : [VIDEOTEST] Card: VIV INFO : [VIDEOTEST] Version: 5.4.70 INFO : [VIDEOTEST] All Caps: 84200001 INFO : [VIDEOTEST] Dev Caps: 04200001 ERROR : [VIDEOTEST] Video Test:Get Caps Supports Failed[-1]

Message in 1st console :

INFO : [MediaPipeline] NativeSensor Creat loading []... ./run.sh: line 376: 601 Segmentation fault (core dumped) ./isp_media_server $RUN_OPTION

dmesg after :

[ 140.133526] imx296 1-001a: imx296_set_fmt : fmt = {.which = 0x00000000} [ 140.133535] imx296 1-001a: imx296_set_fmt : mode = {.width = 1440, .height = 1080, .pixel_rate = 74250000} [ 140.133545] enter imx296_ioc_qcap [ 140.174000] imx296 1-001a: imx296_set_fmt : fmt = {.which = 0x00000000} [ 140.174012] imx296 1-001a: imx296_set_fmt : mode = {.width = 1440, .height = 1080, .pixel_rate = 74250000} [ 140.174020] enter imx296_ioc_qcap [ 140.174058] imx296 1-001a: imx296_set_fmt : fmt = {.which = 0x00000000} [ 140.174065] imx296 1-001a: imx296_set_fmt : mode = {.width = 1440, .height = 1080, .pixel_rate = 74250000} [ 140.174074] enter imx296_ioc_qcap [ 140.202126] enter isp_mi_stop

The handler of VIDIOC_QUERYCAP ioctl call is copied for existing examples (ov2775, os08a20) :

int imx296_ioc_qcap(struct imx296 *sensor, void *args) { struct v4l2_capability *cap = (struct v4l2_capability *)args; pr_debug("enter %s\n", __func__); strcpy((char *)cap->driver, "imx296"); sprintf((char *)cap->bus_info, "csi%d",sensor->csi); if(sensor->i2c_client->adapter) {//bus_info[8]-i2c bus dev number cap->bus_info[VVCAM_CAP_BUS_INFO_I2C_ADAPTER_NR_POS] = (__u8)sensor->i2c_client->adapter->nr; } else { cap->bus_info[VVCAM_CAP_BUS_INFO_I2C_ADAPTER_NR_POS] = 0xFF; } return 0; }

To update, I add debug message into vvcam/v4l2/video/video.c

static int viv_post_event(struct v4l2_event *event, void *fh, bool sync) { struct viv_video_file *handle = priv_to_handle(fh); struct v4l2_fh *video_fh = (struct v4l2_fh *)fh; if(!video_fh || !event) { pr_err("%s: invalid inputs (NULL pointer detected)", __func__); return -EINVAL; } if(!video_event_subscribed(video_fh->vdev, event, RETRY_TIMES_MAX)) { pr_err("%s: unsubscribed event id =%d type=0x%08x", __func__, event->id, event->type); return -EAGAIN; } if (sync) reinit_completion(&handle->wait); mutex_lock(&handle->event_mutex); v4l2_event_queue(handle->vdev->video, event); mutex_unlock(&handle->event_mutex); if (sync) { if (wait_for_completion_timeout(&handle->wait, msecs_to_jiffies( VIV_VIDEO_EVENT_TIMOUT_MS)) == 0) { pr_err("%s: completion timeout", __func__); return -ETIMEDOUT; } } return 0; }

and dmesg gave :

[ 805.538307] enter isp_mi_stop [ 810.462078] viv_post_event: completion timeout

Could someone tell me what's wrong with the capture capacities or why did the timeout happen, please ?

Thanks in advance and best regards,
Khang

Re: [IMX8MP][ISP] Video Test: Get Caps Supports Failed[-1]

khang_letruong — Fri, 23 Jul 2021 13:25:15 GMT

I'd like to provide more information about the coredump of isp_media_server in attachment. It seems that the coredump happened within a prebuilt library : /backup/build/users/nxa18621/vsi-isp/verisilicon_sw_isp/units/cam_device/source/camera/cam_sensor.cp

(gdb) bt #0 camdev::SensorOps::queryCaps (pHal=0xffffb00010a0, pModeArray=pModeArray@entry=0xffffb6c85760, pCurMode=pCurMode@entry=0xffffb6c85730, pDefMode=pDefMode@entry=0xffffb6c85734) at /backup/build/users/nxa18621/vsi-isp/verisilicon_sw_isp/units/cam_device/source/camera/cam_sensor.cpp:538

I notice that there's similar file under units/cam_device/source/camera/cam_sensor.cpp, but I could not get it built since the Full build gave error :

$ ./build-all-isp.sh release full BUILD_TYPE: release BUILD: full Full build ---------------------> Release build ---------------------> -- Toolchain file defaulted to '/opt/Yocto/fsl-imx-wayland/5.4-zeus/sysroots/x86_64-pokysdk-linux/usr/share/cmake/OEToolchainConfig.cmake' -- The C compiler identification is GNU 9.2.0 -- The CXX compiler identification is GNU 9.2.0 -- Check for working C compiler: /opt/Yocto/fsl-imx-wayland/5.4-zeus/sysroots/x86_64-pokysdk-linux/usr/bin/aarch64-poky-linux/aarch64-poky-linux-gcc -- Check for working C compiler: /opt/Yocto/fsl-imx-wayland/5.4-zeus/sysroots/x86_64-pokysdk-linux/usr/bin/aarch64-poky-linux/aarch64-poky-linux-gcc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /opt/Yocto/fsl-imx-wayland/5.4-zeus/sysroots/x86_64-pokysdk-linux/usr/bin/aarch64-poky-linux/aarch64-poky-linux-g++ -- Check for working CXX compiler: /opt/Yocto/fsl-imx-wayland/5.4-zeus/sysroots/x86_64-pokysdk-linux/usr/bin/aarch64-poky-linux/aarch64-poky-linux-g++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done ==========SET platform to ARM64========== CMAKE_PREFIX_PATH: QWT6_PATH: ========== APPMODE set to V4L2 ========== ## Full source compile, ISP_VERSION input: ISP8000NANO_V1802 ##NANO_V1802 CFG ## ISP_VERSION configure setting: ISP8000NANO_V1802 #### Product Configuration Version: ISP8000NANO_V1802 -- ============================================================================= -- Project description: ISP app shell for test app and UIs -- project bin:/devel/Dynimlabs/SW/isp-imx-imx296/appshell/build -- project obj dir:/devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/obj -- project src:/devel/Dynimlabs/SW/isp-imx-imx296/appshell -- Cmake root dor:/devel/Dynimlabs/SW/isp-imx-imx296/appshell LIB_ROOT is at: /devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/generated INSTALL_ROOT is at: /devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/dist system: UNIX -- JsonCpp Version: 1.9.0 -- Looking for C++ include clocale -- Looking for C++ include clocale - found -- Looking for localeconv -- Looking for localeconv - found -- Looking for C++ include sys/types.h -- Looking for C++ include sys/types.h - found -- Looking for C++ include stdint.h -- Looking for C++ include stdint.h - found -- Looking for C++ include stddef.h -- Looking for C++ include stddef.h - found -- Check size of lconv -- Check size of lconv - done -- Performing Test HAVE_DECIMAL_POINT -- Performing Test HAVE_DECIMAL_POINT - Success Using full source compile -- ============================================================================= -- Project description: ISP driver project -- project bin:/devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/obj/units -- project obj dir:/devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/obj/units/obj -- project src:/devel/Dynimlabs/SW/isp-imx-imx296/units -- Cmake root dir:/devel/Dynimlabs/SW/isp-imx-imx296/appshell/../units LIB_ROOT is at: /devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/generated INSTALL_ROOT is at: /devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/dist system: UNIX -- Panasonic face recognition disabled CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:8 (add_subdirectory): add_subdirectory given source "aec" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:9 (add_subdirectory): add_subdirectory given source "awb" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:10 (add_subdirectory): add_subdirectory given source "af" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:11 (add_subdirectory): add_subdirectory given source "adpf" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:12 (add_subdirectory): add_subdirectory given source "adpcc" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:13 (add_subdirectory): add_subdirectory given source "a2dnr" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:14 (add_subdirectory): add_subdirectory given source "a3dnr" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:15 (add_subdirectory): add_subdirectory given source "awdr3" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:16 (add_subdirectory): add_subdirectory given source "ahdr" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:17 (add_subdirectory): add_subdirectory given source "aee" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:18 (add_subdirectory): add_subdirectory given source "aflt" which is not an existing directory. CMake Error at /devel/Dynimlabs/SW/isp-imx-imx296/units/aaa/CMakeLists.txt:19 (add_subdirectory): add_subdirectory given source "avs" which is not an existing directory. /devel/Dynimlabs/SW/isp-imx-imx296/mediacontrol MCTOP DIR: ##:/devel/Dynimlabs/SW/isp-imx-imx296/appshell/../mediacontrol /devel/Dynimlabs/SW/isp-imx-imx296/appshell -- Configuring incomplete, errors occurred! See also "/devel/Dynimlabs/SW/isp-imx-imx296/appshell/build/CMakeFiles/CMakeOutput.log". make: *** No targets specified and no makefile found. Stop. /devel/Dynimlabs/SW/isp-imx-imx296 removed 'build_output_release_full.tgz' removed 'build_output_release_full/blob/run-vsi.sh' removed 'build_output_release_full/blob/start_isp.sh' removed 'build_output_release_full/blob/dewarp_config/daA3840_30mc_4K.json' removed 'build_output_release_full/blob/dewarp_config/sensor_dwe_1080P_config.json' removed 'build_output_release_full/blob/dewarp_config/sensor_dwe_720P_config.json' removed 'build_output_release_full/blob/dewarp_config/daA3840_30mc_1080P.json' removed 'build_output_release_full/blob/dewarp_config/sensor_dwe_4K_config.json' removed directory 'build_output_release_full/blob/dewarp_config' removed 'build_output_release_full/blob/run.sh' removed 'build_output_release_full/blob/case/config/2007_sensor_dwe_os08a20.json' removed 'build_output_release_full/blob/case/config/2009_isp0_vse.json' removed 'build_output_release_full/blob/case/config/2015_dual_isp_dewarp_hw.json' removed 'build_output_release_full/blob/case/config/2007_vse_4_streams.json' removed 'build_output_release_full/blob/case/config/daA3840_30mc_4K.json' removed 'build_output_release_full/blob/case/config/2006_sensor_dwe.json' removed 'build_output_release_full/blob/case/config/1002_sensor_dwe_native.json' removed 'build_output_release_full/blob/case/config/2008_isp0_3_streams.json' removed 'build_output_release_full/blob/case/config/2011_dual_isp_dewarp.json' removed 'build_output_release_full/blob/case/config/1003_sensor_dw200_native.json' removed 'build_output_release_full/blob/case/config/2006_sensor_dwe_hdr.json' removed 'build_output_release_full/blob/case/config/daA3840_30mc_1080P.json' removed 'build_output_release_full/blob/case/config/2006_sensor_dwe2.json' removed 'build_output_release_full/blob/case/config/2008_sensor_dwe_ov2775_720p.json' removed 'build_output_release_full/blob/case/config/2003_mc_fake_source.json' removed 'build_output_release_full/blob/case/config/2005_mc_sensor.json' removed 'build_output_release_full/blob/case/config/2014_isp0_vse_hw.json' removed 'build_output_release_full/blob/case/config/2013_isp0_3_streams_hw.json' removed 'build_output_release_full/blob/case/config/2005_mc_sensor2.json' removed 'build_output_release_full/blob/case/config/2012_isp0_5_streams_hw.json' removed 'build_output_release_full/blob/case/config/2016_isp0_5_streams_dec.json' removed 'build_output_release_full/blob/case/config/1001_sensor_dwe_v4l2.json' removed 'build_output_release_full/blob/case/config/1004_sensor_dw200_v4l2.json' removed directory 'build_output_release_full/blob/case/config' removed directory 'build_output_release_full/blob/case' removed directory 'build_output_release_full/blob' removed directory 'build_output_release_full/boot' removed 'build_output_release_full/opt/imx8-isp/bin/run-vsi.sh' removed 'build_output_release_full/opt/imx8-isp/bin/start_isp.sh' removed 'build_output_release_full/opt/imx8-isp/bin/dewarp_config/daA3840_30mc_4K.json' removed 'build_output_release_full/opt/imx8-isp/bin/dewarp_config/sensor_dwe_1080P_config.json' removed 'build_output_release_full/opt/imx8-isp/bin/dewarp_config/sensor_dwe_720P_config.json' removed 'build_output_release_full/opt/imx8-isp/bin/dewarp_config/daA3840_30mc_1080P.json' removed 'build_output_release_full/opt/imx8-isp/bin/dewarp_config/sensor_dwe_4K_config.json' removed directory 'build_output_release_full/opt/imx8-isp/bin/dewarp_config' removed 'build_output_release_full/opt/imx8-isp/bin/run.sh' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2007_sensor_dwe_os08a20.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2009_isp0_vse.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2015_dual_isp_dewarp_hw.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2007_vse_4_streams.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/daA3840_30mc_4K.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2006_sensor_dwe.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/1002_sensor_dwe_native.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2008_isp0_3_streams.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2011_dual_isp_dewarp.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/1003_sensor_dw200_native.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2006_sensor_dwe_hdr.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/daA3840_30mc_1080P.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2006_sensor_dwe2.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2008_sensor_dwe_ov2775_720p.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2003_mc_fake_source.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2005_mc_sensor.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2014_isp0_vse_hw.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2013_isp0_3_streams_hw.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2005_mc_sensor2.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2012_isp0_5_streams_hw.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/2016_isp0_5_streams_dec.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/1001_sensor_dwe_v4l2.json' removed 'build_output_release_full/opt/imx8-isp/bin/case/config/1004_sensor_dw200_v4l2.json' removed directory 'build_output_release_full/opt/imx8-isp/bin/case/config' removed directory 'build_output_release_full/opt/imx8-isp/bin/case' removed directory 'build_output_release_full/opt/imx8-isp/bin' removed directory 'build_output_release_full/opt/imx8-isp' removed directory 'build_output_release_full/opt' removed directory 'build_output_release_full/usr/lib' removed directory 'build_output_release_full/usr' removed directory 'build_output_release_full' cp: cannot stat 'appshell/build/generated/release/lib/*.so*': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/IMX296*': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/imx296*': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/OV2775*': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/ov2775*': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/isp_media_server': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/*_test': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/vvext': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/Sensor0_Entry.cfg': No such file or directory cp: cannot stat 'appshell/build/generated/release/bin/Sensor1_Entry.cfg': No such file or directory cp: cannot stat 'build_output_release_full/usr/lib/*': No such file or directory

Thanks in advance for your helps.

BR,

Re: [IMX8MP][ISP] isp_media_server crashes at camdev::SensorOps::queryCaps()

khang_letruong — Sat, 31 Jul 2021 11:25:31 GMT

Hi again,

Sorry for another wrong alert. I found the cause: I maintain the extracted isp-imx in our own repository for customized driver development. However, the diff tool I use did not see the difference of .so files during the migration from isp-imx-4.2.2.6.0 to isp-imx-4.2.2.11.0 . Thus, they stayed the same as isp-imx-4.2.2.6.0 and I faced the same issue as described in IMX8M-Plus Camera Integration and using ISP.

Br,
Khang.