topic Re: I.MX8M plus AI Robot platform Ubuntu OS in i.MX Processors

I.MX8M plus AI Robot platform Ubuntu OS

Arrow_AE_KingLiu — Wed, 26 May 2021 04:27:38 GMT

There are some questions from our customer need your commet :

Does I.MX8M plus support all operator included by tensor flow lite ? I saw some words in the i.MX_Machine_Learning_User's_Guide.pdf . The TensorFlow Lite library uses the Android NN API implementation from the GPU/NPU driver for running inference using the GPU/NPU hardware accelerator. The implemented NN API version is 1.2, which has limitations in supported tensor data types and operations, compared to the feature set of TensorFlow Lite. Therefore,
some models may work without acceleration enabled, but may fail when using the NN API. So the answer is NOT ?
Right now the I.MX8M plus support Ubuntu rootfs , does it include ROS and some ML sample ? Our customer is using Jetson Nano , it is base on Ubuntu rootfs , support ROS default . Right now they are evaluating replacing the Jetson nano with I.MX8M plus , they would like to use ubuntu .
I noted the I.MX8M plus is 2.3 TOPS base on int8 , compare to the Jetson Nano 472 GFLOPS, how to understand the advantage between them ?
Could you help to share some information about the camera using in the AI Robot EVK ?

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Wed, 26 May 2021 08:02:38 GMT

1, i.MX8M Plus can support all operator included by tensor flow lite, but not all by NPU. Because if NN API don't support certain operator, TFlite will rollback to CPU. So some models may work without NPU acceleration enabled, and only performance will be impacted.

2, L5.10 can support to build Ubuntu 20.04 image with eIQ and its example, but don't include ROS. Customer need to install ROS by himself. NXP can't release any Ubuntu image due to license issue.

3, Jetson Nano has 128 cores GPU with 472GFLOPS, and its performance is 0.92TOPS which is less than half of i.MX8MP.

4, AI Robot board supports AP1302+AR1335. AR1335+8MP internal ISP is still on-going.

Re: I.MX8M plus AI Robot platform Ubuntu OS

Arrow_AE_KingLiu — Wed, 26 May 2021 08:31:56 GMT

@xiaodong_zhang

Thanks for your reply

Jetson Nano has 128 cores GPU with 472GFLOPS, and its performance is 0.92TOPS which is less than half of i.MX8MP.

How to get the 0.92TOPS base on 128 GPU Jetson nano ? Do you have the computation formula ?

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Wed, 26 May 2021 08:58:08 GMT

According to the below picture

472GFLOPS(FP16) = 472*2GOPS(INT8)=472*2%1024TOPS ≈ 0.92TOPS

Re: I.MX8M plus AI Robot platform Ubuntu OS

Arrow_AE_KingLiu — Wed, 26 May 2021 09:45:23 GMT

@xiaodong_zhang

AI Robot board supports AP1302+AR1335. AR1335+8MP internal ISP is still on-going.

One more question , how can I get the HW and SW of the camera module board ?

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Thu, 03 Jun 2021 02:23:14 GMT

Hi @Arrow_AE_KingLiu

You can touch marketing Fang Yi for HW module. SW will be released to you when it's ready.

Add more information:

@Arrow_AE_KingLiu AR1335 module vendor is AVNET, Contact window is Peterson, Griffin <Griffin.Peterson@AVNET.COM> , onsemi window is Sean Zhang <Sean.Zhang@onsemi.com>

Re: I.MX8M plus AI Robot platform Ubuntu OS

Arrow_AE_KingLiu — Thu, 27 May 2021 07:24:41 GMT

@xiaodong_zhang

Hi Xiaodong

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Thu, 27 May 2021 08:19:20 GMT

Hi @Arrow_AE_KingLiu

1, Currently i.MX8MP only support to build Ubuntu 20.04 officially. If customer want to build 18.04 or 16.04, please refer to Ubuntu-i.MX8MP.pdf.

2, In OpenCV, only DNN module bases on deep learning. But i.MX8MP NPU don't support DNN. For other machine vision algorithm, OpenCV can be configured to use OpenCL to accelerate. Or choose external vision processor.

3, You can convert TF model of Yolo-v4 to TFlite, and use i.MX8MP NPU as TFlite's backend.

4, China SE team had ported orbbec 3D camera for smart lock, you can get it from marketing Fang Yi.

Re: I.MX8M plus AI Robot platform Ubuntu OS

Arrow_AE_KingLiu — Thu, 27 May 2021 09:34:46 GMT

@xiaodong_zhang

In OpenCV, only DNN module bases on deep learning. But i.MX8MP NPU don't support DNN. For other machine vision algorithm, OpenCV can be configured to use OpenCL to accelerate. Or choose external vision processor

So it mearn that we can not accelerate the OpenCV compution using GPU or NPU , it just run on the Cotex-A core (CPU)

Re: I.MX8M plus AI Robot platform Ubuntu OS

Arrow_AE_KingLiu — Thu, 03 Jun 2021 08:10:37 GMT

@xiaodong_zhang

As right now the ubuntu20.04 rootfs is base on I.MX8M plus EVK , we are going to install the ubuntu 20.04 on the AI robot EVK , please help to share the user guide . Thanks

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Fri, 04 Jun 2021 02:14:30 GMT

@Arrow_AE_KingLiu

Please desktop manifest as the following:

repo init -u https://source.codeaurora.org/external/imx/imx-manifest -b imx-linux-gatesgarth -m imx-5.10.9-1.0.0_desktop.xml

And then, apply patch 0001-Add-to-support-i.MX8M-Plus-AI-Robot-board-and-some-t.patch for layer meta-nxp-desktop and untar meta-imx8mp-ai-robot-L5.10.9-gatesgarth.tar.gz under <Yocto folder>/source.

$ DISTRO=imx-desktop-xwayland MACHINE=imx8mpairobotdesktop source imx-setup-desktop.sh -b build-ai-robot-desktop

After the above command, you should add BBLAYERS += "${BSPDIR}/sources/meta-imx8mp-ai-robot " in <Yocto folder>/build-ai-robot-desktop/bblayers.conf
$bitbake imx-image-desktop

Note:

<Yocto folder>/source/meta-nxp-desktop/conf/distro/imx-desktop-xwayland.conf has some configure options like IMAGE_ROOTFS_SIZE, you can change it for larger size of rootfs. Default user account and password are all user. You can change it by the below guide.

# Set user account and password
#APTGET_ADD_USER = "user:password:shell"
# format 'name:password:shell'.
# 'name' is the user name.
# 'password' is an encrypted password (e.g. generated with
# `echo "P4sSw0rD" \| openssl passwd -stdin`).
# If empty or missing, they'll get an empty password.
# 'shell' is the default shell (if empty, default is /bin/sh).

Re: I.MX8M plus AI Robot platform Ubuntu OS

khang_letruong — Tue, 22 Jun 2021 00:43:48 GMT

Dear @xiaodong_zhang ,

I'm interested in testing this AI Robot Platform but I'm struggling the following error while doing the rootfs :

Initialising tasks: 100% |############################################################| Time: 0:00:03 Sstate summary: Wanted 287 Found 285 Missed 2 Current 2317 (99% match, 99% complete) NOTE: Executing Tasks ERROR: imx-image-desktop-20.04.2-r0 do_rootfs: [log_check] imx-image-desktop: found 1 error message in the logfile: [log_check] Failed to connect to bus: Host is down ERROR: Logfile of failure stored in: /backup/NXP/Yocto/imx-yocto-bsp-5_10_9-1_0_0-desktop/build-ai-robot-desktop/tmp/work/imx8mp_ai_robot-fsl-linux/imx-image-desktop/20.04.2-r0/temp/log.do_rootfs.30696 ERROR: Task (/backup/NXP/Yocto/imx-yocto-bsp-5_10_9-1_0_0-desktop/sources/meta-nxp-desktop/recipes-fsl/images/imx-image-desktop.bb:do_rootfs) failed with exit code '1'

My host is Ubuntu-18.04. I wonder if you could help to solve this issue please ?

Thanks very in advance and best regards,
Khang

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Wed, 30 Jun 2021 02:30:25 GMT

@khang_letruong

Please send me your error log (file log.do_rootfs.30696).

Re: I.MX8M plus AI Robot platform Ubuntu OS

khang_letruong — Wed, 30 Jun 2021 05:56:16 GMT

Hi @xiaodong_zhang ,

Please find the requested file in attachment. Additional information :I still faced this error within Ubuntu-20.04 as host.

Br,
Khang

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Wed, 30 Jun 2021 06:48:02 GMT

@khang_letruong

what configuration of your build server ?

BTW, here is my log:

Creating config file /etc/idmapd.conf with new version
Adding system user `statd' (UID 116) ...
Adding new user `statd' (UID 116) with group `nogroup' ...
Not creating home directory `/var/lib/nfs'.
Created symlink /etc/systemd/system/multi-user.target.wants/nfs-client.target -> /lib/systemd/system/nfs-client.target.
Created symlink /etc/systemd/system/remote-fs.target.wants/nfs-client.target -> /lib/systemd/system/nfs-client.target.
Setting up libgcc-9-dev:arm64 (9.3.0-17ubuntu1~20.04) ...
Setting up libltdl-dev:arm64 (2.4.6-14) ...
Setting up pkg-config (0.29.1-0ubuntu4) ...
Setting up libc6-dev:arm64 (2.31-0ubuntu9.2) ...
Setting up python3-future (0.18.2-2) ...
update-alternatives: using /usr/bin/python3-futurize to provide /usr/bin/futurize (futurize) in auto mode
update-alternatives: using /usr/bin/python3-pasteurize to provide /usr/bin/pasteurize (pasteurize) in auto mode
Setting up gcc-9 (9.3.0-17ubuntu1~20.04) ...
Setting up openssh-sftp-server (1:8.2p1-4ubuntu0.2) ...
Setting up openssh-server (1:8.2p1-4ubuntu0.2) ...

Re: I.MX8M plus AI Robot platform Ubuntu OS

khang_letruong — Wed, 30 Jun 2021 07:06:15 GMT

I have Ubuntu-18.04 desktop with the packages required by Yocto in the iMX Yocto Project User's Guide :

sudo apt-get install gawk wget git-core diffstat unzip texinfo gcc-multilib \ build-essential chrpath socat cpio python python3 python3-pip python3-pexpect \ xz-utils debianutils iputils-ping python3-git python3-jinja2 libegl1-mesa libsdl1.2-dev \ pylint3 xterm

BR,
Khang

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Wed, 30 Jun 2021 07:10:07 GMT

@khang_letruong

How many DDR Memory?

Re: I.MX8M plus AI Robot platform Ubuntu OS

khang_letruong — Wed, 30 Jun 2021 07:13:43 GMT

@xiaodong_zhang,

My machine has 32GB of RAM :

$ free total used free shared buff/cache available Mem: 32812796 7672156 1930688 134612 23209952 24551288 Swap: 2097148 804352 1292796

Do you have a dockerfile for the generating the building environment btw, please ?

Br,
K

Re: I.MX8M plus AI Robot platform Ubuntu OS

xiaodong_zhang — Wed, 30 Jun 2021 08:10:34 GMT

@khang_letruong

The issue is caused by package nfs-common (version upgrade after releasing i.MX Yocto ubuntu). You can fix the issue by removing nfs-common in imx-image-desktop.bb.

diff --git a/recipes-fsl/images/imx-image-desktop.bb b/recipes-fsl/images/imx-image-desktop.bb
index ba2f216..1485897 100644
--- a/recipes-fsl/images/imx-image-desktop.bb
+++ b/recipes-fsl/images/imx-image-desktop.bb
@@ -79,7 +79,6 @@ APTGET_EXTRA_PACKAGES += "\
ethtool wget ftp iputils-ping lrzsz \
net-tools \
ntpdate \
- nfs-common \
openssh-server \
python3-future libtool autoconf pkg-config \
bluez connman

Re: I.MX8M plus AI Robot platform Ubuntu OS

khang_letruong — Wed, 30 Jun 2021 08:26:38 GMT

Hi @xiaodong_zhang ,

Glad that you found the cause of the issue, I will update the recipe, re-bitbake the image and let you know.

Br,
Khang