topic Re: Does iMX8M CSI support metadata/embedded data? in i.MX Processors

Does iMX8M CSI support metadata/embedded data?

t_spil — Tue, 21 Jan 2020 01:49:00 GMT

Hello,

We are working with a sensor that outputs a RAW12 (0x2C) image plus Embedded Data (MetaData) (0x12) as shown in the image. We are getting completely correct images from the RAW12 data and now we are trying to get the meta data out in the same data buffer without success. In the reference manual there are a few mentions of the Embedded Data type, but nothing concrete on how to get it out alongside a different data type. Also the meta data is of a different size than that of the normal image. For our application this meta data is important.

Does iMX8M CSI support metadata/embedded data? And can it output it in the same data buffer as the rest of the normal image, or is there a different way to get it out?

Thanks,

Twan

Re: Does iMX8M CSI support metadata/embedded data?

jamesbone — Tue, 21 Jan 2020 17:03:35 GMT

Dear Twan,

CSI will not receive mixed signal (RAW + metadata) and be able to discriminate and handle the RAW data. In order to receive this kind of data, you'll have to set CSI to receive generic data and store it on memory., like you already try it.

Have a great day,
TIC

-------------------------------------------------------------------------------
Note:
- If this post answers your question, please click the "Mark Correct" button. Thank you!

- We are following threads for 7 weeks after the last post, later replies are ignored
Please open a new thread and refer to the closed one, if you have a related question at a later point in time.
-------------------------------------------------------------------------------

Re: Does iMX8M CSI support metadata/embedded data?

matt_frandsen — Tue, 04 Feb 2020 21:57:37 GMT

I would also like to be able to get both image data and the embedded/meta data. Can you provide some reference on how to "set CSI to receive generic data and store it on memory"?

Re: Does iMX8M CSI support metadata/embedded data?

james_kim — Sat, 08 Feb 2020 15:04:23 GMT

Any more clues?

This is another dead end?
James

Re: Does iMX8M CSI support metadata/embedded data?

t_spil — Tue, 18 Feb 2020 00:10:50 GMT

We haven't been able to figure out how to get the meta data out. Instead we developed a workaround. We now trigger the sensor to ascertain the correct frame count, which we needed from the meta data.

Re: Does iMX8M CSI support metadata/embedded data?

koki_sato — Wed, 19 Feb 2020 05:17:18 GMT

> Instead we developed a workaround.

How did you get the metadata?

Re: Does iMX8M CSI support metadata/embedded data?

james_kim — Wed, 19 Feb 2020 21:35:01 GMT

I can extract one line of metadata.

#define BIT_MIPI_DATA_FORMAT_META (0x12 << 25)

...

if (pix->height == 1) {
cr18 |= BIT_MIPI_DATA_FORMAT_META;
csi_dev->csi_two_8bit_sensor_mode = false;

}
csi_write(csi_dev, cr18, CSI_CSICR18);

valid_res[] = {

...

[4] = {1920, 1080},

[5] = {1920, 1}, // metadata

}

Re: Does iMX8M CSI support metadata/embedded data?

matt_frandsen — Thu, 20 Feb 2020 18:12:20 GMT

Are you able to get one line of metadata and the image? Or just the metadata?

Re: Does iMX8M CSI support metadata/embedded data?

james_kim — Thu, 20 Feb 2020 20:41:09 GMT

Just the metadata. IMX8 only takes one datatype unless fast switching of datatype after captured a metadata.

Re: Does iMX8M CSI support metadata/embedded data?

t_spil — Sun, 23 Feb 2020 22:42:24 GMT

The workaround involves not using the metadata

Re: Does iMX8M CSI support metadata/embedded data?

james_kim — Mon, 02 Mar 2020 19:42:08 GMT

Now I'm checking it and it turns out that it captures the first line of image data. It's not capturing the metadata line.

NXP need to answer it. Does NXP verify IMX8 CSI capturing DT (0x12)?

James

Re: Does iMX8M CSI support metadata/embedded data?

koki_sato — Wed, 15 Apr 2020 07:44:10 GMT

> Now I'm checking it and it turns out that it captures the first line of image data. It's not capturing the metadata line.

me too.