Hi, yong: Thanks for your explanations. About your suggestions, i have some confuses. if the xx_missing.txt file and xx_fails.txt file at $HOME/stx-tools/centos-mirror-tools/output don’t have any contents, Can I think that all packages have been downloaded? Or how can I ensure that my mirror is completeness? Additional, when run “generate-cgcs-centos-repo.sh /import/mirrors/CentOS/stx-r1/CentOS/pike/” , it created missing.txt file which include some missing package. But I have manually downloaded these missing packages. Thanks Dehao From: Hu, Yong Sent: Monday, August 27, 2018 9:06 AM To: Shang, Dehao <dehao.shang@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] building starlingx image issue. Libvirt and its related packages should be built out of “~/cgcs-root/stx/git/libvirt/”. If the build of this libvirt src tree was successful, you should see such a file: ./std/rpmbuild/RPMS/libvirt-devel-3.5.0-1.tis.2.x86_64.rpm, which would be used as the dependency for other packages build later. Looking through your log, it seemed “libvirt” build failed. And most likely that’s caused by other packages (required by libvirt building) missing in your mirror. My advice is you go back to check what packages were missing (meaning failed to download) by studying log files in your **mirror download container**, Specially watch out those files named “xx_missing.txt”. From: "Shang, Dehao" dehao.shang@intel.com<mailto:dehao.shang@intel.com> Date: Sunday, 26 August 2018 at 11:09 PM To: "starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io>" <starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io>> Subject: [Starlingx-discuss] building starlingx image issue. Hi, On 24/7/18, i cleaned up all pkgs and environments, clone the newest stx-tools and re-build image from the first step. When running “bash download_mirror.sh”, in order to ensure mirror completeness, i check all missing.lst and fails.lst content at $HOME/stx-tools/centos-mirror-tools/output folder. When running “generate-cgcs-centos-repo.sh /import/mirrors/CentOS/stx-r1/CentOS/pike/”, i also check miss.txt file, and manually download all missing packages. But now, “build-pkgs --serial” still show that some packages building fails. Build-std.log file show 259 pkgs building success, and still have some packages fails as following: Failed to build packages: vm-topology-1.0-1.tis.src.rpm sm-1.0.0-23.tis.src.rpm libvirt-python-3.5.0-1.tis.1.src.rpm libvirt-3.5.0-1.tis.2.src.rpm integrity-kmod-4.12-0.tis.5.src.rpm I check every std/results/user-starling-tis-r5-pike-std/xxxxx/root.log file. I think that one error is obvious, namely Error: No Package found for libvirt-devel >= 0.9.11 at std/results/user-starlingx-tis-r5-pike-std/libvirt-python-3.5.0-1.tis.1/root.log I try to manually download libvirt-devel-4.3.0-1.el7.x86_64.rpm, copy it into $HOME/starlingx/mirror/CentOS/stx-r1/CentOS/pike/Binary/x86_64/, create a link to /localdisk/designer/dehao/starlingx/cgcs-root/cgcs-centos-repo/Binary/, then update link using generate-cgcs-centos-repo.sh inside container. But, still fails. Whether still lack of some package? If yes, I should download which version, and which folder these missing package be placed to ? The following is some log information at /std/results/user-starlingx-tis-pike-std/ folder: ========================================== For vm-topology-1.0-1.tis DEBUG util.py:577: Executing command: ['/usr/bin/yum-builddep', '--installroot', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/', '--releasever', '7', '/localdisk/loadbuild/dehao/starlingx/std/mock/root//builddir/build/SRPMS/vm-topology-1.0-1.tis.src.rpm'] with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'LC_MESSAGES': 'C.UTF-8', 'WRS_GIT_BRANCH': 'HEAD', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'BUILD_BY': 'dehao'} and shell False DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C DEBUG util.py:491: http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild...: [Errno 14] HTTP Error 404 - Not Found DEBUG util.py:491: Trying other mirror. DEBUG util.py:491: To address this issue please refer to the below knowledge base article DEBUG util.py:491: https://access.redhat.com/articles/1320623 DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/ DEBUG util.py:491: Getting requirements for vm-topology-1.0-1.tis.src DEBUG util.py:491: --> Already installed : python-2.7.5-58.el7.tis.3.x86_64 DEBUG util.py:491: --> python-keyring-5.7.1-1.tis.2.noarch DEBUG util.py:491: --> python2-setuptools-38.5.1-1.el7.tis.0.noarch DEBUG util.py:491: Error: No Package found for libvirt DEBUG util.py:632: Child return code was: 1 DEBUG util.py:226: kill orphans DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False DEBUG util.py:632: Child return code was: 0 For sm-1.0.0-23.tis [dehao@64407abf411b std]$ vm-topology-1.0-1.tis.src.rpm^C [dehao@64407abf411b std]$ vim results/dehao-starlingx-tis-r5-pike-std/vm-topology-1.0-1.tis/root.log [dehao@64407abf411b std]$ results/dehao-starlingx-tis-r5-pike-std/vm-topology-1.0-1.tis/root.log^C [dehao@64407abf411b std]$ sm-1.0.0-23.tis.src.rpm^C [dehao@64407abf411b std]$ vim results/dehao-starlingx-tis-r5-pike-std/sm-1.0.0-23.tis/root.log DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C DEBUG util.py:491: http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild...: [Errno 14] HTTP Error 404 - Not Found DEBUG util.py:491: Trying other mirror. DEBUG util.py:491: To address this issue please refer to the below knowledge base article DEBUG util.py:491: https://access.redhat.com/articles/1320623 DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/ DEBUG util.py:491: Getting requirements for sm-1.0.0-23.tis.src DEBUG util.py:491: --> Already installed : fm-common-dev-1.0-8.tis.x86_64 DEBUG util.py:491: --> Already installed : gcc-4.8.5-28.el7.x86_64 DEBUG util.py:491: --> Already installed : glib2-devel-2.50.3-3.el7.x86_64 DEBUG util.py:491: --> Already installed : glibc-2.17-222.el7.x86_64 DEBUG util.py:491: --> Already installed : json-c-0.11-4.el7_0.x86_64 DEBUG util.py:491: --> Already installed : json-c-devel-0.11-4.el7_0.x86_64 DEBUG util.py:491: --> Already installed : libuuid-devel-2.23.2-43.el7.tis.3.x86_64 DEBUG util.py:491: --> Already installed : 1:openssl-devel-1.0.2k-12.el7.x86_64 DEBUG util.py:491: --> Already installed : sm-common-dev-1.0.0-19.tis.x86_64 DEBUG util.py:491: --> Already installed : sm-db-dev-1.0.0-25.tis.x86_64 DEBUG util.py:491: --> Already installed : sqlite-devel-3.7.17-8.el7.x86_64 DEBUG util.py:491: --> Already installed : systemd-219-42.el7_4.1.tis.10.x86_64 DEBUG util.py:491: --> Already installed : systemd-devel-219-42.el7_4.1.tis.10.x86_64 DEBUG util.py:491: No uninstalled build requires DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size} %{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/sm-1.0.0-23.tis/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True For libvirt-python-3.5.0-1.tis.1 DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C DEBUG util.py:491: http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild...: [Errno 14] HTTP Error 404 - Not Found DEBUG util.py:491: Trying other mirror. DEBUG util.py:491: To address this issue please refer to the below knowledge base article DEBUG util.py:491: https://access.redhat.com/articles/1320623 DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/ DEBUG util.py:491: Getting requirements for libvirt-python-3.5.0-1.tis.1.src DEBUG util.py:491: --> python-devel-2.7.5-58.el7.tis.3.x86_64 DEBUG util.py:491: --> python-lxml-3.2.1-4.el7.x86_64 DEBUG util.py:491: --> python-nose-1.3.7-7.el7.noarch DEBUG util.py:491: Error: No Package found for libvirt-devel >= 0.9.11 DEBUG util.py:632: Child return code was: 1 DEBUG util.py:226: kill orphans DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None For libvirt-3.5.0-1.tis.2 DEBUG util.py:491: --> Already installed : sanlock-devel-3.5.0-1.el7.tis.3.x86_64 DEBUG util.py:491: --> Already installed : scrub-2.5.2-7.el7.x86_64 DEBUG util.py:491: --> Already installed : systemd-devel-219-42.el7_4.1.tis.10.x86_64 DEBUG util.py:491: --> Already installed : systemd-219-42.el7_4.1.tis.10.x86_64 DEBUG util.py:491: --> Already installed : systemtap-sdt-devel-3.1-3.el7.x86_64 DEBUG util.py:491: --> Already installed : util-linux-2.23.2-43.el7.tis.3.x86_64 DEBUG util.py:491: --> Already installed : xhtml1-dtds-1.0-20020801.11.el7.noarch DEBUG util.py:491: --> Already installed : yajl-devel-2.0.4-4.el7.x86_64 DEBUG util.py:491: No uninstalled build requires DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size} %{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/libvirt-3.5.0-1.tis.2/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None DEBUG util.py:226: kill orphans DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '-l', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/dev/pts'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '-l', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/dev/shm'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None For integrity-kmod-4.12-0.tis.5.src.rpm DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C DEBUG util.py:491: http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild...: [Errno 14] HTTP Error 404 - Not Found DEBUG util.py:491: Trying other mirror. DEBUG util.py:491: To address this issue please refer to the below knowledge base article DEBUG util.py:491: https://access.redhat.com/articles/1320623 DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/ DEBUG util.py:491: Getting requirements for integrity-kmod-4.12-0.tis.5.src DEBUG util.py:491: --> Already installed : kernel-devel-3.10.0-862.6.3.el7.36.tis.x86_64 DEBUG util.py:491: --> Already installed : 1:openssl-1.0.2k-12.el7.x86_64 DEBUG util.py:491: --> Already installed : 4:perl-5.16.3-292.el7.x86_64 DEBUG util.py:491: --> Already installed : redhat-rpm-config-9.1.0-80.el7.centos.noarch DEBUG util.py:491: --> Already installed : tpm-kmod-symbols-4.12-0.tis.5.x86_64 DEBUG util.py:491: No uninstalled build requires DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None DEBUG util.py:577: Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size} %{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/integrity-kmod-4.12-0.tis.5/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True DEBUG util.py:632: Child return code was: 0 DEBUG util.py:651: child environment: None Thanks Dehao