We had the need to rebuild our source trees as some changes were not getting picked up.
In the shift to github from codeaurora it seems branches no longer exist in either
Linux source code migration (CAF -> Github) - NXP Community
or using
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b dunfell
During the repo sync we get this error.
gfine@phx1-inf-dev001:~/ls1043a_051723b$ repo init -u https://github.com/nxp-qoriq/yocto-sdk -b dunfell
Downloading Repo source from https://gerrit.googlesource.com/git-repo
remote: Counting objects: 151, done
remote: Finding sources: 100% (9/9)
remote: Total 9 (delta 4), reused 7 (delta 4)
Unpacking objects: 100% (9/9), done.
Your identity is: Glen Fine <glen.fine@canyonaero.com>
If you want to change this, please re-run 'repo init' with --config-name
repo has been initialized in /home/gfine/ls1043a_051723b
gfine@phx1-inf-dev001:~/ls1043a_051723b$ repo sync
remote: Enumerating objects: 147, done.
remote: Counting objects: 100% (147/147), done.
remote: Compressing objects: 100% (86/86), done.
remote: Total 134 (delta 71), reused 107 (delta 44), pack-reused 0
Receiving objects: 100% (134/134), 119.23 KiB | 38.00 KiB/s, done.
Resolving deltas: 100% (71/71), completed with 7 local objects.
Fetching: 50% (6/12) 6:44 | Last synced: openembedded/meta-openembeddedb' % Total % Received % Xferd Average Speed Time Time Time Current\n Dload Upload Total Spent Left Speed\n\r 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (6) Could not resolve host: source.codeaurora.org\n'
Fetching: 50% (6/12) 6:48 | Last synced: openembedded/meta-openembedded
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq:
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq: sleeping 4.0 seconds before retrying
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq:
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
error: Cannot fetch qoriq/qoriq-components/meta-qoriq from https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq
Fetching: 75% (9/12) 6:54 | Last synced: meta-selinux
It seems dunfell is not longer available so we tried
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b hardknott
and
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b langfell
with the same result.
I have combed the community to see if an update was posted.
Are we working with the wrong repo? If so, what is the correct repo? We tried
repo init -u https://github.com/nxp-imx/imx-manifest -b dunfell
and it fails as well.
which soc you want build with yocto?
for Layerscape chips there 2 ways to use sdk :1 LLDP or 2 RTE(real time edge)
you need do as document guide exactly, yocto is very picky about the host environment.
Hope this helps.
Hello @gfine1,
Let me contact to the internal team in order to resolve this issue, I let you know as soon I have a response
Regards,
Sebastian
Apparently, someone is updating the repo.. This morning I did...
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b dunfell
and it worked. But the repo sync fails becasue ther are still references to codeaurora in the scripts
and the
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b langfell
failed as unable to find the branch
Hello @gfine1 ,
I would like to inform you that I'm working on your question, I will let you know as soon as I have an update.
Thank you so much for your patience
Regards,
Sebastian
Quick update.
For this initial build command
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b dunfell
it appears the dunfell branch is close to being usable, but it appears that the dunfell branch is under construction as when we do a repo sync we get the following.
remote: Enumerating objects: 147, done.
remote: Counting objects: 100% (147/147), done.
remote: Compressing objects: 100% (86/86), done.
remote: Total 134 (delta 71), reused 107 (delta 44), pack-reused 0
Receiving objects: 100% (134/134), 119.23 KiB | 1.25 MiB/s, done.
Resolving deltas: 100% (71/71), completed with 7 local objects.
Fetching: 50% (6/12) 0:22 | Last synced: openembedded/meta-openembedded
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq:
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq: sleeping 4.0 seconds before retrying
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq:
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
error: Cannot fetch qoriq/qoriq-components/meta-qoriq from https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq
Fetching: 100% (12/12), done in 43.842s
Fetching: 0% (0/1) 0:04 | None
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq:
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq: sleeping 4.0 seconds before retrying
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
qoriq/qoriq-components/meta-qoriq:
fatal: unable to access 'https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq/': Could not resolve host: source.codeaurora.org
error: Cannot fetch qoriq/qoriq-components/meta-qoriq from https://source.codeaurora.org/external/qoriq/qoriq-components/meta-qoriq
Fetching: 100% (1/1), done in 4.031s
fatal: failed to unpack tree object HEAD
error.GitError: Cannot checkout qoriq/qoriq-components/meta-qoriq: Cannot initialize work tree for qoriq/qoriq-components/meta-qoriq
error: Cannot checkout qoriq/qoriq-components/meta-qoriq
Checking out: 100% (12/12), done in 0.610s
error: Unable to fully sync the tree.
error: Downloading network changes failed.
error: Checking out local projects failed.
Failing repos:
sources/meta-qoriq
Try re-running with "-j1 --fail-fast" to exit at the first error.
Do you know when they will finish? Note the pointer to codeaurora still exist.
It also appears the langdale branch needs to be updated as well.
Hello @gfine1,
This is the response from the internal team:
----------------------------------
the following steps can resolve the problem:
vi ./.repo/manifests/default.xml
change
<project remote="nxp" revision="760e52a9a4c05729689595d4a884ebf97cba81ad" name="qoriq/qoriq-components/meta-qoriq" path="sources/meta-qoriq">
to
<project remote="github" revision="760e52a9a4c05729689595d4a884ebf97cba81ad" name="nxp-qoriq/meta-qoriq" path="sources/meta-qoriq">
run the command below to check which URL needed to be modified accord to your need.
$ grep -rn 'source.codeaurora.org/external' sources/
--------------------------------------
Best Regards,
Sebastian
Apparently this isn't the only solution.
We went through the tedious effort of modifying 139 recipes that had codeaurora in them (See attached text file) to gitgub but bitbake is still failing
We did grep -rn 'source.codeaurora.org/external' sources/
and upon investigation these recipes that failed also have some branches (under SRC_URI) in https://github.com/nxp-qoriq/yocto-sdk that are nonexistent.
Can NXP provide a proper /sources directory? Preferably in a tarball.
Hello @gfine1,
I have already forwarded your questions to the internal team, when I have any update I will let you know.
bitbake is still failing.
Hello @gfine1,
Please follow the steps below, it works on the internal team side:
----------------
repo init -u https://github.com/nxp-qoriq/yocto-sdk -b dunfell
cd .repo/manifests
+++ b/default.xml
@@ -15,7 +15,7 @@
- <project remote="nxp" revision="760e52a9a4c05729689595d4a884ebf97cba81ad" name="qoriq/qoriq-components/meta-qoriq" path="sources/meta-qoriq">
+ <project remote="github" revision="760e52a9a4c05729689595d4a884ebf97cba81ad" name="nxp-qoriq/meta-qoriq" path="sources/meta-qoriq">
grep -r -l 'source.codeaurora.org/external/qoriq/qoriq-components' sources | xargs sed -i 's|source.codeaurora.org/external/qoriq/qoriq-components|github.com/nxp-qoriq|g'
grep -r -l 'github.com/nxp/' sources | xargs sed -i 's|github.com/nxp/|github.com/nxp-qoriq/|g'
source ./setup-env -m ls1028ardb -b build_ls1028ardb
bitbake fsl-image-networking
------------
Regards,
Sebastian
Worked great to a point. Evidentially it's not fully baked yet.
ERRORS....
Some are fetch error of either the repo not found or failed to respond in time.. ggriggs works with me.
ERROR: eth-config-git-r2 do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1008/bus"; export PATH="/home/griggs/ls1043a/build_ls1043ardb/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/griggs/ls1043a/sources/poky/scripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/usr/bin/aarch64-fsl-linux:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot/usr/bin/crossscripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/usr/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/usr/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/bin:/home/griggs/ls1043a/sources/poky/bitbake/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/hosttools"; export HOME="/home/griggs"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://github.com/nxp-qoriq/eth-config /home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.eth-config --progress failed with exit code 128, output:
Cloning into bare repository '/home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.eth-config'...
fatal: unable to connect to github.com:
github.com[0: 140.82.112.3]: errno=Connection timed out
ERROR: eth-config-git-r2 do_fetch: Fetcher failure for URL: 'git://github.com/nxp-qoriq/eth-config;nobranch=1'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/temp/log.do_fetch.32557
ERROR: Task (/home/griggs/ls1043a/sources/meta-freescale/recipes-dpaa/eth-config/eth-config_git.bb:do_fetch) failed with exit code
ERROR: ptpd-qoriq-1.0-r0 do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1008/bus"; export PATH="/home/griggs/ls1043a/build_ls1043ardb/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/griggs/ls1043a/sources/poky/scripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/recipe-sysroot-native/usr/bin/aarch64-fsl-linux:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/recipe-sysroot/usr/bin/crossscripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/recipe-sysroot-native/usr/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/recipe-sysroot-native/usr/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/recipe-sysroot-native/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/recipe-sysroot-native/bin:/home/griggs/ls1043a/sources/poky/bitbake/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/hosttools"; export HOME="/home/griggs"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://github.com/nxp-qoriq/ptpd /home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.ptpd --progress failed with exit code 128, output:
Cloning into bare repository '/home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.ptpd'...
fatal: unable to connect to github.com:
github.com[0: 140.82.112.3]: errno=Connection timed out
ERROR: ptpd-qoriq-1.0-r0 do_fetch: Fetcher failure for URL: 'git://github.com/nxp-qoriq/ptpd;nobranch=1'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/ptpd-qoriq/1.0-r0/temp/log.do_fetch.4193
ERROR: Task (/home/griggs/ls1043a/sources/meta-freescale/recipes-daemons/ptpd/ptpd-qoriq.bb:do_fetch) failed with exit code '1'
ERROR: restool-git-r0 do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1008/bus"; export PATH="/home/griggs/ls1043a/build_ls1043ardb/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/griggs/ls1043a/sources/poky/scripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/restool/git-r0/recipe-sysroot-native/usr/bin/aarch64-fsl-linux:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/restool/git-r0/recipe-sysroot/usr/bin/crossscripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/restool/git-r0/recipe-sysroot-native/usr/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/restool/git-r0/recipe-sysroot-native/usr/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/restool/git-r0/recipe-sysroot-native/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/restool/git-r0/recipe-sysroot-native/bin:/home/griggs/ls1043a/sources/poky/bitbake/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/hosttools"; export HOME="/home/griggs"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://github.com/nxp-qoriq/restool /home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.restool --progress failed with exit code 128, output:
Cloning into bare repository '/home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.restool'...
fatal: unable to connect to github.com:
github.com[0: 140.82.112.3]: errno=Connection timed out
ERROR: dpdk-19.11-r0 do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1008/bus"; export PATH="/home/griggs/ls1043a/build_ls1043ardb/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/griggs/ls1043a/sources/poky/scripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/recipe-sysroot-native/usr/bin/aarch64-fsl-linux:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/recipe-sysroot/usr/bin/crossscripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/recipe-sysroot-native/usr/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/recipe-sysroot-native/usr/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/recipe-sysroot-native/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/recipe-sysroot-native/bin:/home/griggs/ls1043a/sources/poky/bitbake/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/hosttools"; export HOME="/home/griggs"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://github.com/nxp-qoriq/dpdk /home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.dpdk --progress failed with exit code 128, output:
Cloning into bare repository '/home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.dpdk'...
fatal: unable to connect to github.com:
github.com[0: 140.82.112.3]: errno=Connection timed out
ERROR: dpdk-19.11-r0 do_fetch: Fetcher failure for URL: 'git://github.com/nxp-qoriq/dpdk;nobranch=1'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/griggs/ls1043a/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/dpdk/19.11-r0/temp/log.do_fetch.8816
ERROR: Task (/home/griggs/ls1043a/sources/meta-qoriq/recipes-extended/dpdk/dpdk_19.11.bb:do_fetch) failed with exit code '1'
NOTE: Sending SIGTERM to remaining 5 tasks
Summary: 4 tasks failed:
/home/griggs/ls1043a/sources/meta-freescale/recipes-dpaa/eth-config/eth-config_git.bb:do_fetch
/home/griggs/ls1043a/sources/meta-freescale/recipes-daemons/ptpd/ptpd-qoriq.bb:do_fetch
/home/griggs/ls1043a/sources/meta-freescale/recipes-dpaa2/restool/restool_git.bb:do_fetch
/home/griggs/ls1043a/sources/meta-qoriq/recipes-extended/dpdk/dpdk_19.11.bb:do_fetch
Summary: There were 33 WARNING messages shown.
Summary: There were 8 ERROR messages shown, returning a non-zero exit code.
griggs@phx1-inf-dev001:~/ls1043a/build_ls1043ardb$ ^C
griggs@phx1-inf-dev001:~/ls1043a/build_ls1043ardb$ ERROR: eth-config-git-r2 do_fetch: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; unset _PYTHON_SYSCONFIGDATA_NAME; export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1008/bus"; export PATH="/home/griggs/ls1043a/build_ls1043ardb/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/griggs/ls1043a/sources/poky/scripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/usr/bin/aarch64-fsl-linux:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot/usr/bin/crossscripts:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/usr/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/usr/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/sbin:/home/griggs/ls1043a/build_ls1043ardb/tmp/work/aarch64-fsl-linux/eth-config/git-r2/recipe-sysroot-native/bin:/home/griggs/ls1043a/sources/poky/bitbake/bin:/home/griggs/ls1043a/build_ls1043ardb/tmp/hosttools"; export HOME="/home/griggs"; LANG=C git -c core.fsyncobjectfiles=0 clone --bare --mirror git://github.com/nxp-qoriq/eth-config /home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.eth-config --progress failed with exit code 128, output:
ERROR:: command not found
fatal: Too many arguments.
Let me know what the internal team says about the errors.
Hello @gfine1,
This is the response from the internal team:
------------------------------------------
According to your previous log, the cause was the instability of network access to github.com sometimes.
Cloning into bare repository '/home/griggs/ls1043a/downloads/git2/github.com.nxp-qoriq.eth-config'...
fatal: unable to connect to github.com:
github.com[0: 140.82.112.3]: errno=Connection timed out
ERROR: eth-config-git-r2 do_fetch: Fetcher failure for URL: 'git://github.com/nxp-qoriq/eth-config;nobranch=1'. Unable to fetch URL from any source.
with the steps I shared, it worked well 100% in my network environment without any build error.
you can manually run command "git clone https:///github.com/nxp-qoriq/eth-config" to test your network, once it works, just rebuild it again.
--------------------------------------
Regards,
Sebastian