Re: [Starlingx-discuss] download_mirrors.sh issues
I don't know if this is the proper solution, but I was able to google around and find the centos repo where some of those missing rpms are located. http://vault.centos.org/centos/7.3.1611/cr/x86_64/ If I add this entry to StarlingX.repo [Starlingx-C7.3.1611-cr] name=Starlingx-CentOS-7.3.1611 - cr baseurl=http://vault.centos.org/centos/7.3.1611/cr/x86_64 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 enabled=1 and re-copy that to /etc/yum.repos.d/ then the download stage no longer complains about some of the missing entries like python-2.7.5-58 etc.. I will re-run the complete download routine and see if this fixes all the remaining (non src) issues. Al From: Bailey, Henry Albert (Al) Sent: Wednesday, July 25, 2018 11:26 AM To: 'starlingx-discuss@lists.starlingx.io' Subject: download_mirrors.sh issues I am following the instructions here: https://wiki.openstack.org/wiki/StarlingX/Developer_Guide#Software_Requireme... I have been un-successful in running the first setup actions for doing an official build, which is getting my mirror setup. I have all the latest commits in master for stx-tools. The first issue encountered was the macros. This has already been reported here https://storyboard.openstack.org/#!/story/2003072 I only had 4 entries listed as missing, until after I updated these to the following newer versions epel-rpm-macros-7-19.noarch.rpm python2-rpm-macros-3-20.el7.noarch.rpm python-rpm-macros-3-20.el7.noarch.rpm python-srpm-macros-3-20.el7.noarch.rpm I don't know if that is the appropriate solution, since all this allowed me to do was fail to download some other things. Running download_mirror.sh again showed 140+ rpms as missing As an aside, sometimes the "missing" log files are blank, even though not all components were downloaded. I assume this is due to something aborting. Lighttpd for example is never being found. By redirecting the script to log everything to a file, it shows this particular error message which may be a potential culprit "Loaded plugins: fastestmirror, ovl http://epel.blizoo.mk/epel/7Server/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden Trying other mirror. To address this issue please refer to the below knowledge base article https://access.redhat.com/solutions/69319 If above article doesn't help to resolve this issue please create a bug on https://bugs.centos.org/ One of the configured repositories failed (Starlingx-epel.blizoo.mk_epel_7Server_x86_64 - epel.blizoo.mk_epel_7Server_x86_64), and yum doesn't have enough cached data to continue. At this point the only safe thing yum can do is fail." Does anyone know anything about this blizoo repo? Is it causing anyone else to not be able to download all the rpms, or is it unrelated to the build setup issues? Al
I don't know if this is the proper solution, but I was able to google around and find the centos repo where some of those missing rpms are located.
Thanks Al! I will leave this to our rpm experts...
http://vault.centos.org/centos/7.3.1611/cr/x86_64/
If I add this entry to StarlingX.repo
[Starlingx-C7.3.1611-cr] name=Starlingx-CentOS-7.3.1611 - cr baseurl=http://vault.centos.org/centos/7.3.1611/cr/x86_64 gpgcheck=1 gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 enabled=1
and re-copy that to /etc/yum.repos.d/
then the download stage no longer complains about some of the missing entries like python-2.7.5-58 etc..
I will re-run the complete download routine and see if this fixes all the remaining (non src) issues.
Is it possible you submit a patch if it works for you? Adopting the over communication approach, I am logging all the steps and output in this url [0]. Not using etherpad to have a faster edit / easy formatting. [0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
I will re-run the complete download routine and see if this fixes all the remaining (non src) issues.
Is it possible you submit a patch if it works for you?
Adopting the over communication approach, I am logging all the steps and output in this url [0]. Not using etherpad to have a faster edit / easy formatting.
[0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
Afternoon update on StarlingX Compilation Master Branch started today morning. stx-tools branch master $ git log --pretty=oneline -2 f31f99ab91435c32c24a86efd2e697177074f4b7 Merge "policycoreutils-newrole was missing" c3000c2936f56ad0257142d5c5bad3afc08c46cc Merge "upgrade linux-firmware RPM version" Taking StarlingX Developer Guide [0] as an input and a temporal Github page [1] as an output. [1] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
Afternoon update on StarlingX Compilation Master Branch started today morning.
Next update: stx-tools branch master $ git log --pretty=oneline -2 f31f99ab91435c32c24a86efd2e697177074f4b7 Merge "policycoreutils-newrole was missing" c3000c2936f56ad0257142d5c5bad3afc08c46cc Merge "upgrade linux-firmware RPM version" Changes: - During build-pkgs: "No Package found for selinux-policy-devel" - Bug / Task created [2] - Review created [3] Taking StarlingX Developer Guide [0] as an input and a temporal Github page [1] as an output. [0] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [1] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md [2] https://storyboard.openstack.org/#!/story/2003102 [3] https://review.openstack.org/#/c/585915/
Hi Abraham, The patch is available here. https://review.openstack.org/#/c/586230/ This seems to fix almost all the missing rpms. There are less than 20 missing now, some of which may be related to the blizoo repo . I am recreating a fresh mirror now, and I will try to track down the remaining missing rpms. Al -----Original Message----- From: Arce Moreno, Abraham [mailto:abraham.arce.moreno@intel.com] Sent: Wednesday, July 25, 2018 5:00 PM To: Arce Moreno, Abraham; Bailey, Henry Albert (Al); starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues
I will re-run the complete download routine and see if this fixes all the remaining (non src) issues.
Is it possible you submit a patch if it works for you?
Adopting the over communication approach, I am logging all the steps and output in this url [0]. Not using etherpad to have a faster edit / easy formatting.
[0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
Afternoon update on StarlingX Compilation Master Branch started today morning. stx-tools branch master $ git log --pretty=oneline -2 f31f99ab91435c32c24a86efd2e697177074f4b7 Merge "policycoreutils-newrole was missing" c3000c2936f56ad0257142d5c5bad3afc08c46cc Merge "upgrade linux-firmware RPM version" Taking StarlingX Developer Guide [0] as an input and a temporal Github page [1] as an output. [1] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
After wiping the output folder and running the download_mirror.sh command with the updated repo, there were still 24 rpms missing. Some of those (like docker-ce) did not make any sense, so I looked into it. 1) StarlingX_3rd.repo is only copied to /etc/yum.repos.d/ when the docker image is created. It is removed by the download_mirror.sh script. If you run that script a second time to try to update your mirror, all the 3rd party repos are missing and it will not be able to find them. Re-copying StarlingX_3rd.repo to /etc/yum.repos.d/ at the beginning of download_mirror.sh resolves this. I think the StarlingX.repo should also get re-copied, in case that file is altered by a commit, and you wish to re-run the script to re-update the mirror. 2) 3 of the missing entries are macros. My update for https://review.openstack.org/#/c/585861/ did not fix them. yum seems to be able to find version 21, so I will update to that version. Al -----Original Message----- From: Bailey, Henry Albert (Al) Sent: Thursday, July 26, 2018 10:24 AM To: starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues Hi Abraham, The patch is available here. https://review.openstack.org/#/c/586230/ This seems to fix almost all the missing rpms. There are less than 20 missing now, some of which may be related to the blizoo repo . I am recreating a fresh mirror now, and I will try to track down the remaining missing rpms. Al -----Original Message----- From: Arce Moreno, Abraham [mailto:abraham.arce.moreno@intel.com] Sent: Wednesday, July 25, 2018 5:00 PM To: Arce Moreno, Abraham; Bailey, Henry Albert (Al); starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues
I will re-run the complete download routine and see if this fixes all the remaining (non src) issues.
Is it possible you submit a patch if it works for you?
Adopting the over communication approach, I am logging all the steps and output in this url [0]. Not using etherpad to have a faster edit / easy formatting.
[0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
Afternoon update on StarlingX Compilation Master Branch started today morning. stx-tools branch master $ git log --pretty=oneline -2 f31f99ab91435c32c24a86efd2e697177074f4b7 Merge "policycoreutils-newrole was missing" c3000c2936f56ad0257142d5c5bad3afc08c46cc Merge "upgrade linux-firmware RPM version" Taking StarlingX Developer Guide [0] as an input and a temporal Github page [1] as an output. [1] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md
setting enabled=0 on the epel.blizoo.mk repos will prevent the deletion of StarlingX_3rd.repo On 18-07-26 02:27 PM, Bailey, Henry Albert (Al) wrote:
After wiping the output folder and running the download_mirror.sh command with the updated repo, there were still 24 rpms missing. Some of those (like docker-ce) did not make any sense, so I looked into it.
1) StarlingX_3rd.repo is only copied to /etc/yum.repos.d/ when the docker image is created. It is removed by the download_mirror.sh script. If you run that script a second time to try to update your mirror, all the 3rd party repos are missing and it will not be able to find them. Re-copying StarlingX_3rd.repo to /etc/yum.repos.d/ at the beginning of download_mirror.sh resolves this. I think the StarlingX.repo should also get re-copied, in case that file is altered by a commit, and you wish to re-run the script to re-update the mirror.
2) 3 of the missing entries are macros. My update for https://review.openstack.org/#/c/585861/ did not fix them. yum seems to be able to find version 21, so I will update to that version.
Al
-----Original Message----- From: Bailey, Henry Albert (Al) Sent: Thursday, July 26, 2018 10:24 AM To: starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues
Hi Abraham, The patch is available here. https://review.openstack.org/#/c/586230/ This seems to fix almost all the missing rpms. There are less than 20 missing now, some of which may be related to the blizoo repo .
I am recreating a fresh mirror now, and I will try to track down the remaining missing rpms.
Al
-----Original Message----- From: Arce Moreno, Abraham [mailto:abraham.arce.moreno@intel.com] Sent: Wednesday, July 25, 2018 5:00 PM To: Arce Moreno, Abraham; Bailey, Henry Albert (Al); starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues
I will re-run the complete download routine and see if this fixes all the remaining (non src) issues. Is it possible you submit a patch if it works for you?
Adopting the over communication approach, I am logging all the steps and output in this url [0]. Not using etherpad to have a faster edit / easy formatting.
[0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md Afternoon update on StarlingX Compilation Master Branch started today morning.
stx-tools branch master
$ git log --pretty=oneline -2 f31f99ab91435c32c24a86efd2e697177074f4b7 Merge "policycoreutils-newrole was missing" c3000c2936f56ad0257142d5c5bad3afc08c46cc Merge "upgrade linux-firmware RPM version"
Taking StarlingX Developer Guide [0] as an input and a temporal Github page [1] as an output.
[1] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Ignore that. StarlingX_3rd.repo is explicitly deleted in download_mirror.sh. never got that far do to a syntax error i introduced. On 18-07-26 02:42 PM, Scott Little wrote:
setting enabled=0 on the epel.blizoo.mk repos will prevent the deletion of StarlingX_3rd.repo
On 18-07-26 02:27 PM, Bailey, Henry Albert (Al) wrote:
After wiping the output folder and running the download_mirror.sh command with the updated repo, there were still 24 rpms missing. Some of those (like docker-ce) did not make any sense, so I looked into it.
1) StarlingX_3rd.repo is only copied to /etc/yum.repos.d/ when the docker image is created. It is removed by the download_mirror.sh script. If you run that script a second time to try to update your mirror, all the 3rd party repos are missing and it will not be able to find them. Re-copying StarlingX_3rd.repo to /etc/yum.repos.d/ at the beginning of download_mirror.sh resolves this. I think the StarlingX.repo should also get re-copied, in case that file is altered by a commit, and you wish to re-run the script to re-update the mirror.
2) 3 of the missing entries are macros. My update for https://review.openstack.org/#/c/585861/ did not fix them. yum seems to be able to find version 21, so I will update to that version.
Al
-----Original Message----- From: Bailey, Henry Albert (Al) Sent: Thursday, July 26, 2018 10:24 AM To: starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues
Hi Abraham, The patch is available here. https://review.openstack.org/#/c/586230/ This seems to fix almost all the missing rpms. There are less than 20 missing now, some of which may be related to the blizoo repo .
I am recreating a fresh mirror now, and I will try to track down the remaining missing rpms.
Al
-----Original Message----- From: Arce Moreno, Abraham [mailto:abraham.arce.moreno@intel.com] Sent: Wednesday, July 25, 2018 5:00 PM To: Arce Moreno, Abraham; Bailey, Henry Albert (Al); starlingx-discuss@lists.starlingx.io Subject: RE: download_mirrors.sh issues
I will re-run the complete download routine and see if this fixes all the remaining (non src) issues. Is it possible you submit a patch if it works for you?
Adopting the over communication approach, I am logging all the steps and output in this url [0]. Not using etherpad to have a faster edit / easy formatting.
[0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md Afternoon update on StarlingX Compilation Master Branch started today morning.
stx-tools branch master
$ git log --pretty=oneline -2 f31f99ab91435c32c24a86efd2e697177074f4b7 Merge "policycoreutils-newrole was missing" c3000c2936f56ad0257142d5c5bad3afc08c46cc Merge "upgrade linux-firmware RPM version"
Taking StarlingX Developer Guide [0] as an input and a temporal Github page [1] as an output.
[1] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [0] https://github.com/xe1gyq/starlingx/blob/master/DeveloperGuide.md _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
participants (3)
-
Arce Moreno, Abraham
-
Bailey, Henry Albert (Al)
-
Scott Little