[Starlingx-discuss] building starlingx image issue.

Shang, Dehao dehao.shang at intel.com
Mon Aug 27 01:43:26 UTC 2018 

Hi, yong:

         Thanks for your explanations.

         About your suggestions, i have some confuses.

         if the xx_missing.txt file and xx_fails.txt file at $HOME/stx-tools/centos-mirror-tools/output don’t have any contents, Can I think that all packages have been downloaded? Or how can I ensure that my mirror is completeness?

         Additional, when run “generate-cgcs-centos-repo.sh /import/mirrors/CentOS/stx-r1/CentOS/pike/” ,  it created missing.txt file which include some missing package. But I have manually downloaded these missing packages.


Thanks
Dehao

From: Hu, Yong
Sent: Monday, August 27, 2018 9:06 AM
To: Shang, Dehao <dehao.shang at intel.com>; starlingx-discuss at lists.starlingx.io
Subject: Re: [Starlingx-discuss] building starlingx image issue.

Libvirt and its related packages should be built out of “~/cgcs-root/stx/git/libvirt/”.
If the build of this libvirt src tree was successful, you should see such a file:
./std/rpmbuild/RPMS/libvirt-devel-3.5.0-1.tis.2.x86_64.rpm, which would be used as the dependency for other packages build later.

Looking through your log, it seemed “libvirt” build failed.  And most likely that’s caused by other packages (required by libvirt building) missing in your mirror.
My advice is you go back to check what packages were missing (meaning failed to download) by studying log files in your **mirror download container**,
Specially watch out those files named “xx_missing.txt”.


From: "Shang, Dehao" dehao.shang at intel.com<mailto:dehao.shang at intel.com>
Date: Sunday, 26 August 2018 at 11:09 PM
To: "starlingx-discuss at lists.starlingx.io<mailto:starlingx-discuss at lists.starlingx.io>" <starlingx-discuss at lists.starlingx.io<mailto:starlingx-discuss at lists.starlingx.io>>
Subject: [Starlingx-discuss] building starlingx image issue.


Hi,
         On 24/7/18, i cleaned up all pkgs and environments, clone the newest stx-tools and re-build image from the first step.

         When running “bash download_mirror.sh”, in order to ensure mirror completeness, i check all missing.lst and fails.lst content at $HOME/stx-tools/centos-mirror-tools/output folder.

         When running “generate-cgcs-centos-repo.sh /import/mirrors/CentOS/stx-r1/CentOS/pike/”, i also check miss.txt file, and manually download all missing packages.

         But now, “build-pkgs --serial” still show that some packages building fails.

         Build-std.log file show 259 pkgs building success, and still have some packages fails as following:
Failed to build packages:  vm-topology-1.0-1.tis.src.rpm  sm-1.0.0-23.tis.src.rpm  libvirt-python-3.5.0-1.tis.1.src.rpm  libvirt-3.5.0-1.tis.2.src.rpm  integrity-kmod-4.12-0.tis.5.src.rpm

I check every std/results/user-starling-tis-r5-pike-std/xxxxx/root.log file.

         I think that one error is obvious, namely Error: No Package found for libvirt-devel >= 0.9.11 at std/results/user-starlingx-tis-r5-pike-std/libvirt-python-3.5.0-1.tis.1/root.log

         I try to manually download libvirt-devel-4.3.0-1.el7.x86_64.rpm, copy it into $HOME/starlingx/mirror/CentOS/stx-r1/CentOS/pike/Binary/x86_64/, create a link to /localdisk/designer/dehao/starlingx/cgcs-root/cgcs-centos-repo/Binary/, then update link using generate-cgcs-centos-repo.sh inside container. But, still fails.

         Whether still lack of some package? If yes, I should download which version, and which folder these missing package be placed to ?

The following is some log information at /std/results/user-starlingx-tis-pike-std/ folder:

==========================================
For vm-topology-1.0-1.tis

DEBUG util.py:577:  Executing command: ['/usr/bin/yum-builddep', '--installroot', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/', '--releasever', '7', '/localdisk/loadbuild/dehao/starlingx/std/mock/root//builddir/build/SRPMS/vm-topology-1.0-1.tis.src.rpm'] with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'LC_MESSAGES': 'C.UTF-8', 'WRS_GIT_BRANCH': 'HEAD', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'BUILD_BY': 'dehao'} and shell False
DEBUG util.py:489:  BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:  http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491:  Trying other mirror.
DEBUG util.py:491:  To address this issue please refer to the below knowledge base article
DEBUG util.py:491:  https://access.redhat.com/articles/1320623
DEBUG util.py:491:  If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/
DEBUG util.py:491:  Getting requirements for vm-topology-1.0-1.tis.src
DEBUG util.py:491:   --> Already installed : python-2.7.5-58.el7.tis.3.x86_64
DEBUG util.py:491:   --> python-keyring-5.7.1-1.tis.2.noarch
DEBUG util.py:491:   --> python2-setuptools-38.5.1-1.el7.tis.0.noarch
DEBUG util.py:491:  Error: No Package found for libvirt
DEBUG util.py:632:  Child return code was: 1
DEBUG util.py:226:  kill orphans
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632:  Child return code was: 0


For sm-1.0.0-23.tis

[dehao at 64407abf411b std]$ vm-topology-1.0-1.tis.src.rpm^C
[dehao at 64407abf411b std]$ vim results/dehao-starlingx-tis-r5-pike-std/vm-topology-1.0-1.tis/root.log
[dehao at 64407abf411b std]$  results/dehao-starlingx-tis-r5-pike-std/vm-topology-1.0-1.tis/root.log^C
[dehao at 64407abf411b std]$ sm-1.0.0-23.tis.src.rpm^C
[dehao at 64407abf411b std]$ vim results/dehao-starlingx-tis-r5-pike-std/sm-1.0.0-23.tis/root.log
DEBUG util.py:489:  BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:  http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491:  Trying other mirror.
DEBUG util.py:491:  To address this issue please refer to the below knowledge base article
DEBUG util.py:491:  https://access.redhat.com/articles/1320623
DEBUG util.py:491:  If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/
DEBUG util.py:491:  Getting requirements for sm-1.0.0-23.tis.src
DEBUG util.py:491:   --> Already installed : fm-common-dev-1.0-8.tis.x86_64
DEBUG util.py:491:   --> Already installed : gcc-4.8.5-28.el7.x86_64
DEBUG util.py:491:   --> Already installed : glib2-devel-2.50.3-3.el7.x86_64
DEBUG util.py:491:   --> Already installed : glibc-2.17-222.el7.x86_64
DEBUG util.py:491:   --> Already installed : json-c-0.11-4.el7_0.x86_64
DEBUG util.py:491:   --> Already installed : json-c-devel-0.11-4.el7_0.x86_64
DEBUG util.py:491:   --> Already installed : libuuid-devel-2.23.2-43.el7.tis.3.x86_64
DEBUG util.py:491:   --> Already installed : 1:openssl-devel-1.0.2k-12.el7.x86_64
DEBUG util.py:491:   --> Already installed : sm-common-dev-1.0.0-19.tis.x86_64
DEBUG util.py:491:   --> Already installed : sm-db-dev-1.0.0-25.tis.x86_64
DEBUG util.py:491:   --> Already installed : sqlite-devel-3.7.17-8.el7.x86_64
DEBUG util.py:491:   --> Already installed : systemd-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491:   --> Already installed : systemd-devel-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491:  No uninstalled build requires
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size} %{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/sm-1.0.0-23.tis/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True


For libvirt-python-3.5.0-1.tis.1

DEBUG util.py:489:  BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:  http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491:  Trying other mirror.
DEBUG util.py:491:  To address this issue please refer to the below knowledge base article
DEBUG util.py:491:  https://access.redhat.com/articles/1320623
DEBUG util.py:491:  If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/
DEBUG util.py:491:  Getting requirements for libvirt-python-3.5.0-1.tis.1.src
DEBUG util.py:491:   --> python-devel-2.7.5-58.el7.tis.3.x86_64
DEBUG util.py:491:   --> python-lxml-3.2.1-4.el7.x86_64
DEBUG util.py:491:   --> python-nose-1.3.7-7.el7.noarch
DEBUG util.py:491:  Error: No Package found for libvirt-devel >= 0.9.11
DEBUG util.py:632:  Child return code was: 1
DEBUG util.py:226:  kill orphans
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None


For libvirt-3.5.0-1.tis.2

DEBUG util.py:491:   --> Already installed : sanlock-devel-3.5.0-1.el7.tis.3.x86_64
DEBUG util.py:491:   --> Already installed : scrub-2.5.2-7.el7.x86_64
DEBUG util.py:491:   --> Already installed : systemd-devel-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491:   --> Already installed : systemd-219-42.el7_4.1.tis.10.x86_64
DEBUG util.py:491:   --> Already installed : systemtap-sdt-devel-3.1-3.el7.x86_64
DEBUG util.py:491:   --> Already installed : util-linux-2.23.2-43.el7.tis.3.x86_64
DEBUG util.py:491:   --> Already installed : xhtml1-dtds-1.0-20020801.11.el7.noarch
DEBUG util.py:491:   --> Already installed : yajl-devel-2.0.4-4.el7.x86_64
DEBUG util.py:491:  No uninstalled build requires
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size} %{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/libvirt-3.5.0-1.tis.2/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None
DEBUG util.py:226:  kill orphans
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: ['/bin/umount', '-n', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/var/cache/yum/'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: ['/bin/umount', '-n', '-l', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/dev/pts'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: ['/bin/umount', '-n', '-l', '/localdisk/loadbuild/dehao/starlingx/std/mock/root/dev/shm'] with env {'LANG': 'en_US.UTF-8', 'TERM': 'vt100', 'SHELL': '/bin/sh', 'HOSTNAME': 'mock', 'HOME': '/builddir', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin'} and shell False
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None



For integrity-kmod-4.12-0.tis.5.src.rpm

DEBUG util.py:489:  BUILDSTDERR: Failed to set locale, defaulting to C
DEBUG util.py:491:  http://127.0.0.1:8088/localdisk/loadbuild/dehao/starlingx/installer/rpmbuild/RPMS/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
DEBUG util.py:491:  Trying other mirror.
DEBUG util.py:491:  To address this issue please refer to the below knowledge base article
DEBUG util.py:491:  https://access.redhat.com/articles/1320623
DEBUG util.py:491:  If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/
DEBUG util.py:491:  Getting requirements for integrity-kmod-4.12-0.tis.5.src
DEBUG util.py:491:   --> Already installed : kernel-devel-3.10.0-862.6.3.el7.36.tis.x86_64
DEBUG util.py:491:   --> Already installed : 1:openssl-1.0.2k-12.el7.x86_64
DEBUG util.py:491:   --> Already installed : 4:perl-5.16.3-292.el7.x86_64
DEBUG util.py:491:   --> Already installed : redhat-rpm-config-9.1.0-80.el7.centos.noarch
DEBUG util.py:491:   --> Already installed : tpm-kmod-symbols-4.12-0.tis.5.x86_64
DEBUG util.py:491:  No uninstalled build requires
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None
DEBUG util.py:577:  Executing command: rpm -qa --root '/localdisk/loadbuild/dehao/starlingx/std/mock/root' --qf '%{nevra} %{buildtime} %{size} %{pkgid} installed\n' > /localdisk/loadbuild/dehao/starlingx/std/results/dehao-starlingx-tis-r5-pike-std/integrity-kmod-4.12-0.tis.5/installed_pkgs.log with env {'LANG': 'en_US.UTF-8', 'BUILD_DATE': '2018-08-26 04:52:14 +0000', 'TERM': 'vt100', 'SHELL': '/bin/bash', 'BUILD_BY': 'dehao', 'HOSTNAME': 'mock', 'REPO': '/localdisk/designer/dehao/starlingx/cgcs-root', 'CGCS_GIT_BRANCH': 'HEAD', 'PROMPT_COMMAND': 'printf "\\033]0;<mock-chroot>\\007<file:///\\033]0;%3cmock-chroot%3e\007>"', 'PATH': '/usr/bin:/bin:/usr/sbin:/sbin', 'HOME': '/builddir', 'PS1': '<mock-chroot> \\s-\\v\\$<file:///\\s-\v\$> ', 'WRS_GIT_BRANCH': 'HEAD'} and shell True
DEBUG util.py:632:  Child return code was: 0
DEBUG util.py:651:  child environment: None





Thanks
Dehao


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20180827/d83d5ad6/attachment-0001.html>

More information about the Starlingx-discuss mailing list