Hi, yong:
Thanks for your explanations.
About your suggestions, i have some confuses.
if the xx_missing.txt file and xx_fails.txt file at
$HOME/stx-tools/centos-mirror-tools/output don’t have any contents, Can I think that all packages have been downloaded? Or how can I ensure that my mirror is
completeness?
Additional, when run “generate-cgcs-centos-repo.sh /import/mirrors/CentOS/stx-r1/CentOS/pike/” , it created missing.txt
file which include some missing package. But I have manually downloaded these missing packages.
Thanks
Dehao
Libvirt and its related packages should be built out of “~/cgcs-root/stx/git/libvirt/”.
If the build of this libvirt src tree was successful, you should see such a file:
./std/rpmbuild/RPMS/libvirt-devel-3.5.0-1.tis.2.x86_64.rpm, which would be used as the dependency for other packages build later.
Looking through your log, it seemed “libvirt” build failed. And most likely that’s caused by other packages (required by libvirt building) missing in your mirror.
My advice is you go back to check what packages were missing (meaning failed to download) by studying log files in your **mirror download container**,
Specially watch out those files named “xx_missing.txt”.
From:
"Shang, Dehao"
dehao.shang@intel.com
Date: Sunday, 26 August 2018 at 11:09 PM
To: "starlingx-discuss@lists.starlingx.io" <starlingx-discuss@lists.starlingx.io>
Subject: [Starlingx-discuss] building starlingx image issue.
Hi,
On 24/7/18, i cleaned up all pkgs and environments, clone the newest stx-tools and re-build image from the first step.
When running “bash download_mirror.sh”, in order to ensure mirror completeness, i check all missing.lst and fails.lst content at $HOME/stx-tools/centos-mirror-tools/output folder.
When running “generate-cgcs-centos-repo.sh /import/mirrors/CentOS/stx-r1/CentOS/pike/”, i also check miss.txt file, and manually download all missing packages.
But now, “build-pkgs --serial” still show that some packages building fails.
Build-std.log file show 259 pkgs building success, and still have some packages fails as following:
Failed to build packages: vm-topology-1.0-1.tis.src.rpm sm-1.0.0-23.tis.src.rpm libvirt-python-3.5.0-1.tis.1.src.rpm libvirt-3.5.0-1.tis.2.src.rpm
integrity-kmod-4.12-0.tis.5.src.rpm
I check every std/results/user-starling-tis-r5-pike-std/xxxxx/root.log file.
I think that one error is obvious, namely Error: No Package found for libvirt-devel >= 0.9.11 at std/results/user-starlingx-tis-r5-pike-std/libvirt-python-3.5.0-1.tis.1/root.log
I try to manually download libvirt-devel-4.3.0-1.el7.x86_64.rpm, copy it into $HOME/starlingx/mirror/CentOS/stx-r1/CentOS/pike/Binary/x86_64/, create a link
to /localdisk/designer/dehao/starlingx/cgcs-root/cgcs-centos-repo/Binary/, then update link using generate-cgcs-centos-repo.sh inside container. But, still fails.
Whether still lack of some package? If yes, I should download which version, and which folder these missing package be placed to ?
The following is some log information at /std/results/user-starlingx-tis-pike-std/ folder:
==========================================
For vm-topology-1.0-1.tis
DEBUG util.py:577: Executing command: ['/usr/bin/yum-builddep', '--installroot', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/', '--releasever',
'7', '/localdisk/loadbuild/dehao/starlingx/std/mock/root//builddir/build/SRPMS/vm-topology-1.0-1.tis.src.rpm'] with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'LC_MESSAGES': 'C.UTF-8', 'WRS_GIT_BRANCH':
'HEAD', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007"',
'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'PS1': '<mock-chroot>
\\s-\\v\\$ ', 'BUILD_BY': 'dehao'} and shell False
DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:
http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml:
[Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491: Trying other mirror.
DEBUG util.py:491: To address this issue please refer to the below knowledge base article
DEBUG util.py:491:
https://access.redhat.com/articles/1320623
DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on
https://bugs.centos.org/
DEBUG util.py:491: Getting requirements for vm-topology-1.0-1.tis.src
DEBUG util.py:491: --> Already installed : python-2.7.5-58.el7.tis.3.x86_64
DEBUG util.py:491: --> python-keyring-5.7.1-1.tis.2.noarch
DEBUG util.py:491: --> python2-setuptools-38.5.1-1.el7.tis.0.noarch
DEBUG util.py:491: Error: No Package found for libvirt
DEBUG util.py:632: Child return code was: 1
DEBUG util.py:226: kill orphans
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env
{'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632: Child return code was: 0
For sm-1.0.0-23.tis
[dehao@64407abf411b std]$ vm-topology-1.0-1.tis.src.rpm^C
[dehao@64407abf411b std]$ vim results/dehao-starlingx-tis-r5-pike-std/vm-topology-1.0-1.tis/root.log
[dehao@64407abf411b std]$ results/dehao-starlingx-tis-r5-pike-std/vm-topology-1.0-1.tis/root.log^C
[dehao@64407abf411b std]$ sm-1.0.0-23.tis.src.rpm^C
[dehao@64407abf411b std]$ vim results/dehao-starlingx-tis-r5-pike-std/sm-1.0.0-23.tis/root.log
DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:
http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml:
[Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491: Trying other mirror.
DEBUG util.py:491: To address this issue please refer to the below knowledge base article
DEBUG util.py:491:
https://access.redhat.com/articles/1320623
DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on
https://bugs.centos.org/
DEBUG util.py:491: Getting requirements for sm-1.0.0-23.tis.src
DEBUG util.py:491: --> Already installed : fm-common-dev-1.0-8.tis.x86_64
DEBUG util.py:491: --> Already installed : gcc-4.8.5-28.el7.x86_64
DEBUG util.py:491: --> Already installed : glib2-devel-2.50.3-3.el7.x86_64
DEBUG util.py:491: --> Already installed : glibc-2.17-222.el7.x86_64
DEBUG util.py:491: --> Already installed : json-c-0.11-4.el7_0.x86_64
DEBUG util.py:491: --> Already installed : json-c-devel-0.11-4.el7_0.x86_64
DEBUG util.py:491: --> Already installed : libuuid-devel-2.23.2-43.el7.tis.3.x86_64
DEBUG util.py:491: --> Already installed : 1:openssl-devel-1.0.2k-12.el7.x86_64
DEBUG util.py:491: --> Already installed : sm-common-dev-1.0.0-19.tis.x86_64
DEBUG util.py:491: --> Already installed : sm-db-dev-1.0.0-25.tis.x86_64
DEBUG util.py:491: --> Already installed : sqlite-devel-3.7.17-8.el7.x86_64
DEBUG util.py:491: --> Already installed : systemd-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491: --> Already installed : systemd-devel-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491: No uninstalled build requires
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size}
%{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/sm-1.0.0-23.tis/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY':
'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007"',
'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot>
\\s-\\v\\$ ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True
For libvirt-python-3.5.0-1.tis.1
DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:
http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml:
[Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491: Trying other mirror.
DEBUG util.py:491: To address this issue please refer to the below knowledge base article
DEBUG util.py:491:
https://access.redhat.com/articles/1320623
DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on
https://bugs.centos.org/
DEBUG util.py:491: Getting requirements for libvirt-python-3.5.0-1.tis.1.src
DEBUG util.py:491: --> python-devel-2.7.5-58.el7.tis.3.x86_64
DEBUG util.py:491: --> python-lxml-3.2.1-4.el7.x86_64
DEBUG util.py:491: --> python-nose-1.3.7-7.el7.noarch
DEBUG util.py:491: Error: No Package found for libvirt-devel >= 0.9.11
DEBUG util.py:632: Child return code was: 1
DEBUG util.py:226: kill orphans
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env
{'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
For libvirt-3.5.0-1.tis.2
DEBUG util.py:491: --> Already installed : sanlock-devel-3.5.0-1.el7.tis.3.x86_64
DEBUG util.py:491: --> Already installed : scrub-2.5.2-7.el7.x86_64
DEBUG util.py:491: --> Already installed : systemd-devel-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491: --> Already installed : systemd-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491: --> Already installed : systemtap-sdt-devel-3.1-3.el7.x86_64
DEBUG util.py:491: --> Already installed : util-linux-2.23.2-43.el7.tis.3.x86_64
DEBUG util.py:491: --> Already installed : xhtml1-dtds-1.0-20020801.11.el7.noarch
DEBUG util.py:491: --> Already installed : yajl-devel-2.0.4-4.el7.x86_64
DEBUG util.py:491: No uninstalled build requires
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size}
%{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/libvirt-3.5.0-1.tis.2/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash',
'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007"',
'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot>
\\s-\\v\\$ ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
DEBUG util.py:226: kill orphans
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env
{'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '-l', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/dev/pts'] with env
{'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: ['/bin/umount', '-n', '-l', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/dev/shm'] with env
{'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
For integrity-kmod-4.12-0.tis.5.src.rpm
DEBUG util.py:489: BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:
http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml:
[Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491: Trying other mirror.
DEBUG util.py:491: To address this issue please refer to the below knowledge base article
DEBUG util.py:491:
https://access.redhat.com/articles/1320623
DEBUG util.py:491: If above article doesn't help to resolve this issue please create a bug on
https://bugs.centos.org/
DEBUG util.py:491: Getting requirements for integrity-kmod-4.12-0.tis.5.src
DEBUG util.py:491: --> Already installed : kernel-devel-3.10.0-862.6.3.el7.36.tis.x86_64
DEBUG util.py:491: --> Already installed : 1:openssl-1.0.2k-12.el7.x86_64
DEBUG util.py:491: --> Already installed : 4:perl-5.16.3-292.el7.x86_64
DEBUG util.py:491: --> Already installed : redhat-rpm-config-9.1.0-80.el7.centos.noarch
DEBUG util.py:491: --> Already installed : tpm-kmod-symbols-4.12-0.tis.5.x86_64
DEBUG util.py:491: No uninstalled build requires
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
DEBUG util.py:577: Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size}
%{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/integrity-kmod-4.12-0.tis.5/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash',
'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007"',
'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot>
\\s-\\v\\$ ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True
DEBUG util.py:632: Child return code was: 0
DEBUG util.py:651: child environment: None
Thanks
Dehao