i.MX ProcessorsのトピックRe: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

stevetsai — Thu, 15 Aug 2013 03:57:06 GMT

iMX6 Android camera HAL from freescale does support UVC USB camera, but it just supports few V4L2 formats. We want to use USB camera which supports 720P video stream with MJPEG format. Does anyone patch UvcDevice.cpp to support MJPEG video stream?

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

liyu1 — Mon, 14 Oct 2013 02:03:33 GMT

I also have such a demand ！！！！！thanks !

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

saurabh206 — Tue, 25 Feb 2014 14:09:42 GMT

Is there any update for this issue?

I am also phasing same issue.

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

QiaopingZhang — Thu, 17 Apr 2014 07:37:51 GMT

me too...

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

mghasan — Tue, 27 May 2014 06:17:27 GMT

Hi,

It could be possible to add OMX wrapper in Camera HAL and decode MJPEG data and send it to camera app.

@Freescale,

Is this feasible and correct to do decoding of MJPEG data in Camera HAL for USB camera to support higher resolution like 720p and 1080p at 15 or more fps?

This is important feature to have and to use better external camera.

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

FangHui — Wed, 29 Oct 2014 03:25:12 GMT

The patch is based on kk4.4.2_1.0.0-ga_rc3.

The MJPG feature is mostly realized in UvcMJPGDevice.cpp.

In default, MJPG feature is no enabled.

To use MJPG feature, need

setprop uvc_mjpg 1

ps | grep mediaserver

kill xxx

If you want to make the MJPG feature as default behavior, you can modify come codes.

Currently, support preview, picture, record.Snapshot on recording not supported.

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

norisugi — Mon, 17 Nov 2014 02:56:36 GMT

Hi Fang-san,

Is it possible to use the pre-installed camera application for capturing the MJPEG data ?

Best Regards,

Nori

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

norisugi — Tue, 18 Nov 2014 11:57:48 GMT

Hi Fang-san,

Is the following code In UvcMJPGDevice.cpp necessary ?

adjustSensorFormats(sensorFormats, index);

if (mDefaultFormat == 0) {

FLOGE("Error: invalid mDefaultFormat:%d", mDefaultFormat);

return BAD_VALUE;

}

When I disable that code, I can get the MJPEG data with the camera app.

Could you show me the correct code if I'm mistake ?

Best Regards,

Nori

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

FangHui — Mon, 01 Dec 2014 09:24:08 GMT

Hi, Sugi-san

Seems the usb camera on your side has no format listed in adjustSensorFormats().

Since you just use MJPG format, so it's ok to disable the codes.

BRs,

Fang Hui

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

lisztkao — Wed, 10 Dec 2014 03:45:09 GMT

I got a strange error after patch the code

[unnamed-3439-0] updateTexImage: clearing GL error: 0x501

Did I lost something?

Thank you

------------------------------------------------------------------------------------

If I change mPreviewPixelFormat from HAL_PIXEL_FORMAT_YCbCr_422_SP to HAL_PIXEL_FORMAT_YCbCr_420_SP,

preview screen will be shown.

However, the color tune is weird.

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

yilinglin — Mon, 26 Jan 2015 11:01:11 GMT

Hi FangHui,

Is there any follow up updates?

I got the same issue as lisztkao, that we both got the error after code patching.

And after changing mPreviewPixelFormat from HAL_PIXEL_FORMAT_YCbCr_422_SP to HAL_PIXEL_FORMAT_YCbCr_420_SP,

I got the preview in Android Camera app but with terrible color.

However, snapshot and recording will generate normal file, unlike preview frame.

Though it's not working on every camera.

MJPEG support is really import in our project, and we are using android 4.2.2 imx6 (sabresd-6dq).

Hope to hear from you with any updates very soon!

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

FangHui — Wed, 28 Jan 2015 08:49:37 GMT

Hi, Lin

For MJPG preview, first decode to YUV422, also tell the GPU to proc as YUV422.

If the version you use is jb4.2.2_1.0.0, you can try to update gpu version refer to GPU upgrade to latest p13 for JB4.2.2_1.1.0 release

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

yilinglin — Wed, 28 Jan 2015 09:24:16 GMT

Hi Fang,

I will try this patch, thanks!.

One more question, since VPU decoder needs 16 pixels align,

when I config the desired resolution to 1920 x 1080 in camera app,

I have to change the number to 1920 x 1088 to avoid ERROR occuring.

Is it still functional if I use 1920x1088? Or I could only use other workable resolutions(like 1280x720)?

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

FangHui — Fri, 30 Jan 2015 06:18:31 GMT

Hi, Lin

To take 1088 picture, seems you should change a little code in native camera apk.

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

yilinglin — Fri, 30 Jan 2015 07:35:29 GMT

Hi Fang,

Yes, I do. But instead I wrote a simple app to access camera through Android Camera API.

Now the camera app can work successfully under several resolutions, such as 640x480, 800x608, 1280x720, and 1600x896(all@30fps).

(Thanks for your tip on preview issue !!)

However, when it comes to 1920x1088@30 fps, the camera will fail.

I kept seeing error message as below:

E/FslCameraHAL( 2291): VPU can't output one frame after feed stream, cap and feed again, capLoop 1

E/FslCameraHAL( 2291): VPU can't output one frame after feed stream, cap and feed again, capLoop 2

......

E/FslCameraHAL( 2291): VPU can't output one frame after feed stream, cap and feed again, capLoop 100

E/FslCameraHAL( 2291): device thread exit with frame = null, 5 buffers still in v4l

E/FslCameraHAL( 2291): handleError handle error:2

E/Camera2 ( 2291): Error condition 2 reported by HAL, arguments 0, 0

Seems it failed to acquire frame at 1920x1088, do you have any thoughts or advise about this issue?

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

FangHui — Wed, 01 Jul 2015 08:51:24 GMT

Hi, Lin

Due to uvc driver, cfilledbuffer.length maybe just w*h, not actually the valid mjpg size.

If the resolution is large (such as 1080p), the bit stream may overflow for VPU decoder,

Thus, you can modify codes in UvcMJPGDevice.cpp as below:

JPGLen = cfilledbuffer.length;

JPGLen = cfilledbuffer.length/2;

Also, you may modify condes in frameworks/av/services/camera/libcameraservice/api1/client2/Parameters.h

static const unsigned int MAX_PREVIEW_HEIGHT = 1080;

static const unsigned int MAX_PREVIEW_HEIGHT = 1088;

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

佳杰吴 — Tue, 19 Jan 2016 06:15:38 GMT

Hi, i put the uvcMJPG.patch,but it cann't preview ,it shows that

Platform:

android4.4.2

imx6d

do you have any thoughts or advise about this issue

Re: MJPEG format in UvcDevice.cpp(i.MX6 Android camera HAL)

ach_dmatek — Mon, 10 Jun 2019 07:48:15 GMT

I feel no use .