i.MX 8MP using both ISI + ISP for single CSI

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

i.MX 8MP using both ISI + ISP for single CSI

1,716 Views
malik_cisse
Senior Contributor I

Hi,

Application Note: AN13430 "i.MX 8MP Dual ISI channels for single CSI" explains how to use two ISI channels connected on single CSI port.

I would like to do something similar but instead of using two ISI channels, I would like to use ISI and ISP like this:isp_plus_isi.pngFollowing AN13430 I achieved some success but the imx8mp crashes when stopping one of the pipelines (ISI or ISP). It seems the stop is propagated to physical CSI which causes the crash.

Did someone succeed doing this?

Any hints are welcome. Thx

0 Kudos
7 Replies

1,689 Views
malik_cisse
Senior Contributor I

Interesting. Thanks for the feedback.

However I am not using ISI_0 at all (I am using ISP_0 and ISI_1 ), so the line buffer can entirely be used by ISI_1.

What I heard though is that one cannot use 4K on both ISP channels. Not sure this is true, but I can imagine it is.

0 Kudos

1,690 Views
malik_cisse
Senior Contributor I

Interesting. Thanks for the feedback.

However I am not using ISI_0 at all (I am using ISP_0 and ISI_1 ), so the line buffer can entirely be used by ISI_1.

What I heard though is that one cannot use 4K on both ISP channels. Not sure this is true, but I can imagine it is.

0 Kudos

1,686 Views
kiseok_ko
Contributor III

We can find below table in RM.

kiseok_ko_0-1654230622773.png

but, I also test and receive 4K x 2ch each 15fps

(I have captured using gstreamer. so, I don't know exact pipeline.)

By the way, I really wonder you how to capture 4K on ISI_1;

If It is possible, I want to capture both 4K & 720p stream on ISI simultaneously.

 

0 Kudos

1,442 Views
malik_cisse
Senior Contributor I

Hi kiseok_ko,

When you did this test:

>>I also test and receive 4K x 2ch each 15fps

Did you also have the chance to test only one 4K x 1ch while using same 2ch configuration as above?

What FPS performance could you measure on 1ch? Do you achieve 4K 30fps or 15fps?
I would like to know if the resources get allocated dynamically or if one has to remove second channel from device tree in order to have full 30fps performance.

Thank you

0 Kudos

1,680 Views
malik_cisse
Senior Contributor I

Hi kiseok_ko,

>>but, I also test and receive 4K x 2ch each 15fps

This is very very interesting. You are saying you managed to run 2 ISPs in parallel at 15fps each like this:

malik_cisse_0-1654246721794.png

Can you confirm please?

According to RM below I thought this would not be possible.

 

As for your question:

>>By the way, I really wonder you how to capture 4K on ISI_1;

Yes

>>If It is possible, I want to capture both 4K & 720p stream on ISI simultaneously.

Can you please elaborate. Which case do you want do do, case1 or case2?

malik_cisse_1-1654247203946.png

 

malik_cisse_2-1654247223242.png

 

Case1: is possible. explained in NXP AN13430.pdf - i.MX 8MP Dual ISI channels for single CSI

Case2: Should be regular case. I don't see any problems here

0 Kudos

1,658 Views
kiseok_ko
Contributor III

@malik_cisse 

Can you confirm please?

According to RM below I thought this would not be possible.

sensor input is bayer rgb ,and ISP output is YUV422I, on the fly to DISPLAY(wayland sink with some options).

Too month ago, I did test dual 4K ISP on console using gstreamer.

 I opened 2 consoles by ssh and I executed gst-launch for each.

 I modified dual basler in "run.sh" and "start_isp.sh".

and I modified i2c channel ( actually. this memory is not exact  )

finally, I just confirm 15fps message. I didn't check frame count.

  ( It is possible that frame rate is lower than 15fps. )

==== and, my turn^^ ====
kiseok_ko_0-1654648354503.png

In above diagram, 

If we use 4K on ISI_0, chain_buf borrow ISI_1's line buffer.

 kiseok_ko_1-1654648485504.png  

kiseok_ko_2-1654648557214.png

So,  ISI_1 could not use Line Buffer.

Also, I tested several method, but Streams Image changed to all greens.

Could you explain more how to open case2's streams, please? 

 

================== finally ===================

where is nxp staff?

Please, Confirm or Answer This Issues.

0 Kudos

1,694 Views
kiseok_ko
Contributor III

ISI_1 (ordered by ISI_0, ISI_1)  can not treat 4K.

kiseok_ko_0-1654133933490.png

 

0 Kudos