How to mirror git://git.freescale.com/ppc/sdk/

[pro-supportengi]

How can customers mirror git://git.freescale.com/ppc/sdk?

Following the procedure below, how can customers mirror http://git.freescale.com/ppc/sdk yocto SDK 2.0 for the LS1043ARDB creating a successfull SDK 2.0 yocto build environment?

Install the `repo` utility:

$: mkdir ~/bin

$: curl https://storage.googleapis.com/git-repo-downloads/repo > ~/bin/repo

$: chmod a+x ~/bin/repo

$: PATH=${PATH}:~/bin

git clone git://git.freescale.com/yocto/fsl-yocto-repo.git -b fsl-sdk-v2.0-public

git checkout -b fsl-sdk-v2.0-public

repo init -u http://sw-stash.freescale.net/scm/sdk/sdk-devel.git  -b sdk-v2.0.x

repo sync --no-clone-bundle

Cannot use the following git repo for customers http://sw-stash.freescale.net/scm/sdk/sdk-devel.git. Need to use the public site git://git.freescale.com/ppc/sdk and not the internal sw-stach.freescale.net git repository to mirror the yocto SDK 2.0. Is this possible and how?

Customers do not have access to this git repo: http://sw-stash.freescale.net/scm/sdk/sdk-devel.git.

Need to mirror the yocto SDK 2.0 from git://git.freescale.com/ppc/sdk, where is the sdk-devel.git or yocto repo in http://git.freescale.com/ppc/sdk?

[yipingwang]

Hello pro-supportengineer,

Please refer to the following procedure which I got from the NXP SDK production team for the external customer.

$: mkdir ~/bin
$: curl https://dl-ssl.google.com/dl/googlesource/git-repo/repo > ~/bin/repo
$: chmod a+x ~/bin/repo

$: PATH=${PATH}:~/bin
$: mkdir fsl-qoriq-sdk
$: cd fsl-qoriq-sdk
$: repo init -u git://git.freescale.com/yocto/fsl-yocto-repo.git -b refs/tags/fsl-sdk-v2.0-public
$: repo sync

Thanks,

Yiping

[pro-supportengi]

Hi Yiping,

attempted to do a minimal configuration using the instructions above.  Here are the results.  I'll also try core and full, but appears there is not sufficient components to avoid the build from breaking even with a minimal configuration.  Any recommendations from the product team?

NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION        = "1.28.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "Ubuntu-15.10"
TARGET_SYS        = "aarch64-fsl-linux"
MACHINE           = "ls1043ardb"
DISTRO            = "fsl-qoriq"
DISTRO_VERSION    = "2.0"
TUNE_FEATURES     = "aarch64"
TARGET_FPU        = ""
meta             
meta-yocto       
meta-yocto-bsp    = "HEAD:53f0290658256f57c6e5d24459763eb96db2c1c1"
meta-oe          
meta-multimedia  
meta-gnome       
meta-networking  
meta-perl        
meta-python      
meta-ruby        
meta-filesystems 
meta-webserver   
meta-xfce         = "HEAD:dc5634968b270dde250690609f0015f881db81f2"
meta-freescale    = "HEAD:2461b02ac6e7d549647ced03b084f14f845906d1"
meta-virtualization = "HEAD:042425c1d98bdd7e44a62789bd03b375045266f5"
meta-java         = "HEAD:8b776ac68f9af4596be3824152bcf0bc6b67fa1d"
meta-openstack   
meta-openstack-aio-deploy
meta-openstack-compute-deploy
meta-openstack-compute-test-config
meta-openstack-controller-deploy
meta-openstack-controller-test-config
meta-openstack-qemu
meta-openstack-swift-deploy
meta-cloud-services = "HEAD:d8bc0d92d0f741e2ea1e6d3d9bc6b7a091d03cfb"
meta-security     = "HEAD:f9367e71f923fc7d2fb600208e2b97535ea41777"
meta-linaro-toolchain = "HEAD:10b71bed9cfe76baa22c72806ff814cf85c2f73b"

NOTE: Preparing RunQueue
NOTE: Checking sstate mirror object availability (for 487 objects)
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
WARNING: Failed to fetch URL git://git.freescale.com/ppc/sdk/linux.git;branch=sdk-v2.0.x, attempting MIRRORS if available
ERROR: Fetcher failure: Unable to find revision bd51baffc04ecc73f933aee1c3a37c8b44b889a7 in branch sdk-v2.0.x even from upstream
ERROR: Function failed: Fetcher failure for URL: 'git://git.freescale.com/ppc/sdk/linux.git;branch=sdk-v2.0.x'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/tlsmith/src/fsl-qoriq-sdk/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/linux-qoriq/4.1-r0/temp/log.do_fetch.38331
ERROR: Task 45 (/home/tlsmith/src/fsl-qoriq-sdk/sources/meta-freescale/recipes-kernel/linux/linux-qoriq_4.1.bb, do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 712 tasks of which 0 didn't need to be rerun and 1 failed.
Waiting for 0 running tasks to finish:

Summary: 1 task failed:
  /home/tlsmith/src/fsl-qoriq-sdk/sources/meta-freescale/recipes-kernel/linux/linux-qoriq_4.1.bb, do_fetch
Summary: There were 2 WARNING messages shown.
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
tlsmith@ubuntu:~/src/fsl-qoriq-sdk/build_ls1043ardb$

[pro-supportengi]

Here is the output from a full and core build.  The .gz files in the mirror are missing causing these failures. See attached files here and the screenshot .png above. The index of mirror sources are missing .gz files needed for the download.  These need to be populated for the minimal, core, and full build to succeed, or the .bb files need to be modified to pull from a different mirror location (http://git.freescale.com/git/cgit.cgi/ppc/sdk). Can you have the necessary compressed sources be added to the /mirror/sources/ index?

Index of /mirror/sources//external-link.jspa?url=http%3A%2F%2Fgit.freescale.com%2Fgit%2Fcgit.cgi%2Fppc%2Fsdk%2Flinux.git

E7440:~/src/fsl-qoriq-sdk/fsl-qoriq-sdk/build_ls1043ardb$ bitbake fsl-image-full
Loading cache: 100% |###########################################| ETA:  00:00:00
Loaded 3366 entries from dependency cache.
WARNING: No recipes available for:
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-devtools/qemu/qemu_2.2.0.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-devtools/python/python-nose_1.2.1.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-core/busybox/busybox_1.23.1.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-containers/lxc/lxc_1.0.7.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-support/fuse/fuse_2.9.3.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-support/postgresql/postgresql_9.2.4.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-support/ntp/ntp_4.2.8.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-support/iproute2/iproute2_3.17.0.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-support/dnsmasq/dnsmasq_2.72.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-graphics/xorg-app/xterm_303.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-graphics/xorg-lib/libxaw_1.0.10.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-extended/libpam/libpam_1.1.6.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-extended/lighttpd/lighttpd_1.4.35.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-httpd/apache2/apache2_2.4.10.bbappend
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-cloud-services/meta-openstack/recipes-connectivity/openssh/openssh_6.7p1.bbappend
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION        = "1.28.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "Ubuntu-14.04"
TARGET_SYS        = "aarch64-fsl-linux"
MACHINE           = "ls1043ardb"
DISTRO            = "fsl-qoriq"
DISTRO_VERSION    = "2.0"
TUNE_FEATURES     = "aarch64"
TARGET_FPU        = ""
meta              
meta-yocto        
meta-yocto-bsp    = "HEAD:53f0290658256f57c6e5d24459763eb96db2c1c1"
meta-oe           
meta-multimedia   
meta-gnome        
meta-networking   
meta-perl         
meta-python       
meta-ruby         
meta-filesystems  
meta-webserver    
meta-xfce         = "HEAD:dc5634968b270dde250690609f0015f881db81f2"
meta-freescale    = "HEAD:2461b02ac6e7d549647ced03b084f14f845906d1"
meta-virtualization = "HEAD:042425c1d98bdd7e44a62789bd03b375045266f5"
meta-java         = "HEAD:8b776ac68f9af4596be3824152bcf0bc6b67fa1d"
meta-openstack    
meta-openstack-aio-deploy
meta-openstack-compute-deploy
meta-openstack-compute-test-config
meta-openstack-controller-deploy
meta-openstack-controller-test-config
meta-openstack-qemu
meta-openstack-swift-deploy
meta-cloud-services = "HEAD:d8bc0d92d0f741e2ea1e6d3d9bc6b7a091d03cfb"
meta-security     = "HEAD:f9367e71f923fc7d2fb600208e2b97535ea41777"
meta-linaro-toolchain = "HEAD:10b71bed9cfe76baa22c72806ff814cf85c2f73b"

NOTE: Preparing RunQueue
NOTE: Checking sstate mirror object availability (for 2487 objects)
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
WARNING: Failed to fetch URL git://git.freescale.com/ppc/sdk/linux.git;branch=sdk-v2.0.x, attempting MIRRORS if available
ERROR: Fetcher failure: Unable to find revision bd51baffc04ecc73f933aee1c3a37c8b44b889a7 in branch sdk-v2.0.x even from upstream
ERROR: Function failed: Fetcher failure for URL: 'git://git.freescale.com/ppc/sdk/linux.git;branch=sdk-v2.0.x'. Unable to fetch URL from any source.
ERROR: Logfile of failure stored in: /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/build_ls1043ardb/tmp/work/ls1043ardb-fsl-linux/linux-qoriq/4.1-r0/temp/log.do_fetch.10509
ERROR: Task 45 (/home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-freescale/recipes-kernel/linux/linux-qoriq_4.1.bb, do_fetch) failed with exit code '1'
NOTE: Tasks Summary: Attempted 1392 tasks of which 882 didn't need to be rerun and 1 failed.
Waiting for 0 running tasks to finish:

Summary: 1 task failed:
  /home/tlsmith/src/fsl-qoriq-sdk/fsl-qoriq-sdk/sources/meta-freescale/recipes-kernel/linux/linux-qoriq_4.1.bb, do_fetch
Summary: There were 2 WARNING messages shown.
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
E7440:~/src/fsl-qoriq-sdk/fsl-qoriq-sdk/build_ls1043ardb$