lowlight opensource ai-isp test on imx95

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

lowlight opensource ai-isp test on imx95

weiping_liu
NXP Employee
NXP Employee
0 0 50

 

  There are many open-source low-light AI-ISP models. The table below is a comparison table provided by Copilot. 

 

Algorithm

GitHub

Type

i.MX95 NPU Suitability

 

MSR (Retinex)

jsrsinchana/.../MSR-algorithm

Non-AI (ISP)

Medium

 

Zero-DCE++

arnabroy734/low_light_enhancement

Lightweight CNN + Curve

Very High

 

RetinexNet

weichen582/RetinexNet

CNN (Retinex)

Medium

 

EnlightenGAN

VITA-Group/EnlightenGAN

GAN (CNN)

Very High (lite)

 

FLOL

cidautai/FLOL

Lightweight CNN

High

 

SNR-aware

JIA-Lab-research/SNR-Aware

Transformer + CNN

Low

 

KinD

zhangyhuaee/KinD

Retinex + CNN

Medium

 

RetinexNet-lite

Derived

Light CNN

Medium

 

EnlightenGAN-lite

Derived

Small CNN

Very High

 

Fast LLIE CNN

Various

Small CNN

High

 

 

Tested above open-source models with UVC to perform performance evaluation on the exip-os08a20 module with linear mode. Found that SCI(GitHub - vis-opt-group/SCI: [CVPR 2022] This is the official code for the paper "Toward Fast, Flexib...) computation is relatively small, low-light performance is good in subjective evaluations, and it can basically run on the IMX95. The testing method involves copying the tflite file and test script to the /root/ directory of the IMX95 and running the following command: `python3 test_sci_cvpr_illu_imx95_int8.py --model sci_tpami_illu_imx95_int8.tflite`. The comparison interface shown below is displayed.

weiping_liu_0-1784087656398.png

 

 

%3CLINGO-SUB%20id%3D%22lingo-sub-2395167%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3Elowlight%20opensource%20ai-isp%20test%20on%20imx95%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2395167%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CBR%20%2F%3E%0A%3CP%3E%3CSPAN%3E%26nbsp%3B%20There%20are%20many%20open-source%20low-light%20AI-ISP%20models.%20The%20table%20below%20is%20a%20comparison%20table%20provided%20by%20Copilot.%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CBR%20%2F%3E%0A%3CTABLE%3E%0A%3CTBODY%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EAlgorithm%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EGitHub%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EType%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3Ei.MX95%20NPU%20Suitability%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EMSR%20(Retinex)%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3Ejsrsinchana%2F...%2FMSR-algorithm%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ENon-AI%20(ISP)%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EMedium%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EZero-DCE%2B%2B%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3Earnabroy734%2Flow_light_enhancement%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ELightweight%20CNN%20%2B%20Curve%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EVery%20High%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ERetinexNet%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3Eweichen582%2FRetinexNet%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ECNN%20(Retinex)%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EMedium%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EEnlightenGAN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EVITA-Group%2FEnlightenGAN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EGAN%20(CNN)%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EVery%20High%20(lite)%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EFLOL%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3Ecidautai%2FFLOL%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ELightweight%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EHigh%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ESNR-aware%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EJIA-Lab-research%2FSNR-Aware%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ETransformer%20%2B%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ELow%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EKinD%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3Ezhangyhuaee%2FKinD%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ERetinex%20%2B%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EMedium%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ERetinexNet-lite%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EDerived%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ELight%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EMedium%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EEnlightenGAN-lite%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EDerived%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ESmall%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EVery%20High%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3CTR%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EFast%20LLIE%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EVarious%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3ESmall%20CNN%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CP%3EHigh%3C%2FP%3E%0A%3C%2FTD%3E%0A%3CTD%20width%3D%22115%22%3E%0A%3CBR%20%2F%3E%0A%3C%2FTD%3E%0A%3C%2FTR%3E%0A%3C%2FTBODY%3E%0A%3C%2FTABLE%3E%0A%3CBR%20%2F%3E%0A%3CP%3E%3CSPAN%20class%3D%22jCAhz%20ChMk0b%22%3E%3CSPAN%20class%3D%22ryNqvb%22%3ETested%20above%20open-source%20models%20with%20UVC%20to%20perform%20performance%20evaluation%20on%20the%20exip-os08a20%20module%20with%20linear%20mode.%3C%2FSPAN%3E%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%20class%3D%22jCAhz%20ChMk0b%22%3E%3CSPAN%20class%3D%22ryNqvb%22%3EFound%20that%20SCI%EF%BC%88%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fvis-opt-group%2FSCI%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EGitHub%20-%20vis-opt-group%2FSCI%3A%20%5BCVPR%202022%5D%20This%20is%20the%20official%20code%20for%20the%20paper%20%22Toward%20Fast%2C%20Flexib...%3C%2FA%3E%EF%BC%89%20computation%20is%20relatively%20small%2C%20low-light%20performance%20is%20good%20in%20subjective%20evaluations%2C%20and%20it%20can%20basically%20run%20on%20the%20IMX95.%20The%20testing%20method%20involves%20copying%20the%20tflite%20file%20and%20test%20script%20to%20the%20%2Froot%2F%20directory%20of%20the%20IMX95%20and%20running%20the%20following%20command%3A%20%60python3%20test_sci_cvpr_illu_imx95_int8.py%20--model%20sci_tpami_illu_imx95_int8.tflite%60.%20The%20comparison%20interface%20shown%20below%20is%20displayed.%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22weiping_liu_0-1784087656398.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22weiping_liu_0-1784087656398.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.nxp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F392320iB18F72B7B3647AD9%2Fimage-size%2Fmedium%3Fv%3Dv2%26amp%3Bpx%3D400%22%20role%3D%22button%22%20title%3D%22weiping_liu_0-1784087656398.png%22%20alt%3D%22weiping_liu_0-1784087656398.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CBR%20%2F%3E%0A%3CBR%20%2F%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2395167%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3Ei.MX%26nbsp%3BProcessors%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ESensor%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E