[Starlingx-discuss] [build] mirror-check.sh to verify updates in upstream.
Hi, According to our today's build meeting I just want to share this script[0]. What it does is to go through the rpms defined in the .lst files and then, using repoquery, verify is there's a new version of a package available in upstream (centos) servers. As it might be of the interest of the community to automate this script (in cengn or other server) I would like to share as well this Gitlab CI job[1] as an example on how I have setup this script. Here's also how the output looks like[2]. Currently, the script reports the packages detailed below. The updating is being tracked by this bug[3] I hope this can be interesting to someone. -Erich - [0] https://opendev.org/starlingx/tools/src/branch/master/centos-mirror-tools/mi... - [1] https://gitlab.com/erichcm/stx-mirror-check - [2] https://gitlab.com/erichcm/stx-mirror-check/-/jobs/236723311 - [3] https://bugs.launchpad.net/starlingx/+bug/1817351 Package lighttpd-1.4.52-1.el7.src not found, available lighttpd-1.4.54-1.el7.src Package perl-generators-1.08-6.el7.noarch not found, available perl-generators-1.08-7.el7.noarch Package pyflakes-1.3.0-2.el7.noarch not found, available pyflakes-0.9.2-1.el7.noarch Package python2-certifi-2018.10.15-1.el7.noarch not found, available python2-certifi-2018.10.15-5.el7.noarch Package python2-ddt-1.1.3-1.el7.noarch not found, available python2-ddt-1.2.0-2.el7.noarch Package python2-iso8601-0.1.11-7.el7.noarch not found, available python2-iso8601-0.1.11-8.el7.noarch Package python2-jsonschema-2.5.1-3.el7.noarch not found, available python2-jsonschema-2.6.0-2.el7.noarch Package python2-mccabe-0.6.1-6.el7.noarch not found, available python2-mccabe-0.6.1-7.el7.noarch Package python2-mimeparse-1.6.0-4.el7.noarch not found, available python2-mimeparse-1.6.0-5.el7.noarch Package python2-olefile-0.46-1.el7.noarch not found, available python2-olefile-0.46-2.el7.noarch Package python2-pika-0.10.0-9.el7.noarch not found, available python2-pika-0.10.0-10.el7.noarch Package python2-PyMySQL-0.9.2-1.el7.noarch not found, available python2-PyMySQL-0.9.2-2.el7.noarch Package python2-pyngus-2.2.4-1.el7.noarch not found, available python2-pyngus-2.3.0-1.el7.noarch Package python2-rpm-macros-3-22.el7.noarch not found, available python2-rpm-macros-3-24.el7.noarch Package python2-sphinx_rtd_theme-0.2.4-2.el7.0.noarch not found, available python2-sphinx_rtd_theme-0.2.4-3.el7.noarch Package python2-whoosh-2.7.4-3.el7.noarch not found, available python2-whoosh-2.7.4-5.el7.noarch Package python-contextlib2-0.5.1-2.el7.noarch not found, available python-contextlib2-0.5.1-3.el7.noarch Package python-rpm-macros-3-22.el7.noarch not found, available python-rpm-macros-3-24.el7.noarch Package python-srpm-macros-3-22.el7.noarch not found, available python-srpm-macros-3-24.el7.noarch Package libcmocka-1.1.3-1.el7.x86_64 not found, available libcmocka-1.1.5-1.el7.x86_64 Package libcmocka-devel-1.1.3-1.el7.x86_64 not found, available libcmocka-devel-1.1.5-1.el7.x86_64 Package libzstd-1.3.8-1.el7.x86_64 not found, available libzstd-1.4.0-1.el7.x86_64 Package openjpeg2-2.3.0-6.el7.x86_64 not found, available openjpeg2-2.3.1-1.el7.x86_64 Package python2-qpid-proton-0.24.0-2.el7.x86_64 not found, available python2-qpid-proton-0.28.0-1.el7.x86_64 Package python2-simplejson-3.10.0-1.el7.x86_64 not found, available python2-simplejson-3.10.0-7.el7.x86_64 Package qpid-proton-c-0.24.0-2.el7.x86_64 not found, available qpid-proton-c-0.28.0-1.el7.x86_64 Package python2-pysocks-1.6.8-5.el7.noarch not found, available python2-pysocks-1.6.8-6.el7.noarch Package python2-scapy-2.4.0-2.el7.noarch not found, available python2-scapy-2.4.0-3.el7.noarch Package collectd-5.8.0-4.el7.x86_64 not found, available collectd-5.8.1-4.el7.x86_64 Package containernetworking-cni-0.5.1-1.el7.x86_64 not found, available Package cppcheck-1.84-1.el7.x86_64 not found, available cppcheck-1.87-1.el7.x86_64 Package ntfs-3g-2017.3.23-6.el7.x86_64 not found, available ntfs-3g-2017.3.23-11.el7.x86_64 Package ntfs-3g-devel-2017.3.23-6.el7.x86_64 not found, available ntfs-3g-devel-2017.3.23-11.el7.x86_64 Package ntfsprogs-2017.3.23-6.el7.x86_64 not found, available ntfsprogs-2017.3.23-11.el7.x86_64 Package python2-msgpack-0.5.6-4.el7.x86_64 not found, available python2-msgpack-0.6.1-2.el7.x86_64
I've added a job to CENGN to run the mirror-check.sh script. The report is published here... http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/reports/mirr... ...unless folks can propose a better place. I haven't tried to trigger anything beyond that, e.g. perhaps an email to starlingx-discuss, but we can discuss at the next meeting. Scott On 2019-06-20 4:42 p.m., Cordoba Malibran, Erich wrote:
Hi,
According to our today's build meeting I just want to share this script[0]. What it does is to go through the rpms defined in the .lst files and then, using repoquery, verify is there's a new version of a package available in upstream (centos) servers.
As it might be of the interest of the community to automate this script (in cengn or other server) I would like to share as well this Gitlab CI job[1] as an example on how I have setup this script. Here's also how the output looks like[2].
Currently, the script reports the packages detailed below. The updating is being tracked by this bug[3]
I hope this can be interesting to someone.
-Erich
- [0] https://opendev.org/starlingx/tools/src/branch/master/centos-mirror-tools/mi... - [1] https://gitlab.com/erichcm/stx-mirror-check - [2] https://gitlab.com/erichcm/stx-mirror-check/-/jobs/236723311 - [3] https://bugs.launchpad.net/starlingx/+bug/1817351
Package lighttpd-1.4.52-1.el7.src not found, available lighttpd-1.4.54-1.el7.src Package perl-generators-1.08-6.el7.noarch not found, available perl-generators-1.08-7.el7.noarch Package pyflakes-1.3.0-2.el7.noarch not found, available pyflakes-0.9.2-1.el7.noarch Package python2-certifi-2018.10.15-1.el7.noarch not found, available python2-certifi-2018.10.15-5.el7.noarch Package python2-ddt-1.1.3-1.el7.noarch not found, available python2-ddt-1.2.0-2.el7.noarch Package python2-iso8601-0.1.11-7.el7.noarch not found, available python2-iso8601-0.1.11-8.el7.noarch Package python2-jsonschema-2.5.1-3.el7.noarch not found, available python2-jsonschema-2.6.0-2.el7.noarch Package python2-mccabe-0.6.1-6.el7.noarch not found, available python2-mccabe-0.6.1-7.el7.noarch Package python2-mimeparse-1.6.0-4.el7.noarch not found, available python2-mimeparse-1.6.0-5.el7.noarch Package python2-olefile-0.46-1.el7.noarch not found, available python2-olefile-0.46-2.el7.noarch Package python2-pika-0.10.0-9.el7.noarch not found, available python2-pika-0.10.0-10.el7.noarch Package python2-PyMySQL-0.9.2-1.el7.noarch not found, available python2-PyMySQL-0.9.2-2.el7.noarch Package python2-pyngus-2.2.4-1.el7.noarch not found, available python2-pyngus-2.3.0-1.el7.noarch Package python2-rpm-macros-3-22.el7.noarch not found, available python2-rpm-macros-3-24.el7.noarch Package python2-sphinx_rtd_theme-0.2.4-2.el7.0.noarch not found, available python2-sphinx_rtd_theme-0.2.4-3.el7.noarch Package python2-whoosh-2.7.4-3.el7.noarch not found, available python2-whoosh-2.7.4-5.el7.noarch Package python-contextlib2-0.5.1-2.el7.noarch not found, available python-contextlib2-0.5.1-3.el7.noarch Package python-rpm-macros-3-22.el7.noarch not found, available python-rpm-macros-3-24.el7.noarch Package python-srpm-macros-3-22.el7.noarch not found, available python-srpm-macros-3-24.el7.noarch Package libcmocka-1.1.3-1.el7.x86_64 not found, available libcmocka-1.1.5-1.el7.x86_64 Package libcmocka-devel-1.1.3-1.el7.x86_64 not found, available libcmocka-devel-1.1.5-1.el7.x86_64 Package libzstd-1.3.8-1.el7.x86_64 not found, available libzstd-1.4.0-1.el7.x86_64 Package openjpeg2-2.3.0-6.el7.x86_64 not found, available openjpeg2-2.3.1-1.el7.x86_64 Package python2-qpid-proton-0.24.0-2.el7.x86_64 not found, available python2-qpid-proton-0.28.0-1.el7.x86_64 Package python2-simplejson-3.10.0-1.el7.x86_64 not found, available python2-simplejson-3.10.0-7.el7.x86_64 Package qpid-proton-c-0.24.0-2.el7.x86_64 not found, available qpid-proton-c-0.28.0-1.el7.x86_64 Package python2-pysocks-1.6.8-5.el7.noarch not found, available python2-pysocks-1.6.8-6.el7.noarch Package python2-scapy-2.4.0-2.el7.noarch not found, available python2-scapy-2.4.0-3.el7.noarch Package collectd-5.8.0-4.el7.x86_64 not found, available collectd-5.8.1-4.el7.x86_64 Package containernetworking-cni-0.5.1-1.el7.x86_64 not found, available Package cppcheck-1.84-1.el7.x86_64 not found, available cppcheck-1.87-1.el7.x86_64 Package ntfs-3g-2017.3.23-6.el7.x86_64 not found, available ntfs-3g-2017.3.23-11.el7.x86_64 Package ntfs-3g-devel-2017.3.23-6.el7.x86_64 not found, available ntfs-3g-devel-2017.3.23-11.el7.x86_64 Package ntfsprogs-2017.3.23-6.el7.x86_64 not found, available ntfsprogs-2017.3.23-11.el7.x86_64 Package python2-msgpack-0.5.6-4.el7.x86_64 not found, available python2-msgpack-0.6.1-2.el7.x86_64 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
participants (2)
-
Cordoba Malibran, Erich
-
Scott Little