[Starlingx-discuss] CENGN build of r/stx.8.0
Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9. Scott
Hi Scott, Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build? Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build: 2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh [2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ### And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline. Thales ________________________________ From: Scott Little <scott.little@windriver.com> Sent: Wednesday, February 8, 2023 6:04 PM To: starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> Subject: [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9. Scott _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO. The problem has been corrected and another build is underway. ETA is 9pm Eastern. Scott On 2023-02-09 06:33, Cervi, Thales Elero wrote:
Hi Scott,
Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build?
Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... <http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/> Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build:
2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh
[2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ###
And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline.
Thales
------------------------------------------------------------------------ *From:* Scott Little <scott.little@windriver.com> *Sent:* Wednesday, February 8, 2023 6:04 PM *To:* starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9.
Scott
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
We have a good build of r/stx.8.0 Scott On 2023-02-09 13:11, Scott Little wrote:
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO.
The problem has been corrected and another build is underway. ETA is 9pm Eastern.
Scott
On 2023-02-09 06:33, Cervi, Thales Elero wrote:
Hi Scott,
Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build?
Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03hWIN2xhQ$> Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build:
2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh <https://urldefense.com/v3/__http://build-helm-charts.sh__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03gzx9l2mA$>
[2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ###
And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline.
Thales
------------------------------------------------------------------------ *From:* Scott Little <scott.little@windriver.com> *Sent:* Wednesday, February 8, 2023 6:04 PM *To:* starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9.
Scott
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
Sorry folks, the last r/stx/8/0 build was invalid. One more build configuration fix and we'll try again. ETA: 10 pm Eastern expected output URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/2... Scott On 2023-02-10 10:05, Scott Little wrote:
We have a good build of r/stx.8.0
Scott
On 2023-02-09 13:11, Scott Little wrote:
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO.
The problem has been corrected and another build is underway. ETA is 9pm Eastern.
Scott
On 2023-02-09 06:33, Cervi, Thales Elero wrote:
Hi Scott,
Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build?
Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03hWIN2xhQ$> Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build:
2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh <https://urldefense.com/v3/__http://build-helm-charts.sh__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03gzx9l2mA$>
[2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ###
And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline.
Thales
------------------------------------------------------------------------ *From:* Scott Little <scott.little@windriver.com> *Sent:* Wednesday, February 8, 2023 6:04 PM *To:* starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9.
Scott
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
**14:19:54* 2023-02-10 19:19:54,585 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,589 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for Simple dependency. *14:19:54* 2023-02-10 19:19:54,593 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,601 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lsb/lsb_11.1.0.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python3.9/python3.9_3.9.2-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/linux/linux_5.10.162-1.stx.31.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/net-tools/net-tools_1.60+git20181103.0eebece-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/systemd/systemd_247.3-7.stx.8.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/setuptools/setuptools_52.0.0-4.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/dh-python/dh-python_4.20201102+nmu1.stx.2.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/openldap/openldap_2.4.57+dfsg-3+deb11u1.stx.9.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lvm2/lvm2_2.03.11-2.stx.2.dsc'} 14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstacksdk/python-openstacksdk_0.50.0-6.stx.1.dsc'} *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstackclient/python-openstackclient_5.4.0-4.stx.3.dsc'} *14:19:54* 2023-02-10 19:19:54,606 - [1mdsc_depend[0m - [1;31mERROR[0m: There are unexpected circular dependency. *14:19:54* Traceback (most recent call last): *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 2034, in <module> *14:19:54* build_controller.build_all(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1513, in build_all *14:19:54* self.build_layers(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1637, in build_layers *14:19:54* self.build_layer(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1613, in build_layer *14:19:54* self.build_layer_and_build_types(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1598, in build_layer_and_build_types *14:19:54* self.build_layer_and_build_type(layer=layer, build_type=build_type, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1564, in build_layer_and_build_type *14:19:54* self.build_packages(layer_pkg_dirs, pkg_dirs, layer, word, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1824, in build_packages *14:19:54* self.run_build_loop(layer_pkgdir_dscs, target_pkgdir_dscs, layer, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1299, in run_build_loop *14:19:54* deps_resolver = dsc_depend.Dsc_build_order(dsc_list_file, dscs_list, ds_logger) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 935, in __init__ *14:19:54* super().__init__(logger, self.meta_info, circular_conf_file) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 520, in __init__ *14:19:54* self.__grouping(meta_info) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 823, in __grouping *14:19:54* raise Exception('UNEXPECTED CIRCULAR DEPENDENCY.') *14:19:54* Exception: UNEXPECTED CIRCULAR DEPENDENCY. *14:19:54* command terminated with exit code 1 *14:19:54* *14:19:54* *14:19:54* ### *14:19:54* ### Failed to build packages after 3 iterations *14:19:54* ### *14:19:54* On 2023-02-10 13:25, Scott Little wrote:
Sorry folks, the last r/stx/8/0 build was invalid. One more build configuration fix and we'll try again.
ETA: 10 pm Eastern
expected output URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/2...
Scott
On 2023-02-10 10:05, Scott Little wrote:
We have a good build of r/stx.8.0
Scott
On 2023-02-09 13:11, Scott Little wrote:
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO.
The problem has been corrected and another build is underway. ETA is 9pm Eastern.
Scott
On 2023-02-09 06:33, Cervi, Thales Elero wrote:
Hi Scott,
Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build?
Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03hWIN2xhQ$> Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build:
2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh <https://urldefense.com/v3/__http://build-helm-charts.sh__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03gzx9l2mA$>
[2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ###
And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline.
Thales
------------------------------------------------------------------------ *From:* Scott Little <scott.little@windriver.com> *Sent:* Wednesday, February 8, 2023 6:04 PM *To:* starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9.
Scott
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
Found a manifest issue. Master branch content leaked into the build of the r/stx.8.0 branch. I have fixed the r/stx.8.0 manifest, and restarted the r/stx.8.0 build. ETA: 6am Eastern. expected output URL: <http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/20230211T011643Z>http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/20230211T011643Z The master branch build will be delayed till 6 am. The master branch might or might not have a circular dependency issue as I noted previously. If it does, the probable trigger was https://review.opendev.org/c/starlingx/integ/+/871349 Scott On 2023-02-10 17:52, Scott Little wrote:
**14:19:54* 2023-02-10 19:19:54,585 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,589 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for Simple dependency. *14:19:54* 2023-02-10 19:19:54,593 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,601 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lsb/lsb_11.1.0.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python3.9/python3.9_3.9.2-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/linux/linux_5.10.162-1.stx.31.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/net-tools/net-tools_1.60+git20181103.0eebece-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/systemd/systemd_247.3-7.stx.8.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/setuptools/setuptools_52.0.0-4.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/dh-python/dh-python_4.20201102+nmu1.stx.2.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/openldap/openldap_2.4.57+dfsg-3+deb11u1.stx.9.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lvm2/lvm2_2.03.11-2.stx.2.dsc'} 14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstacksdk/python-openstacksdk_0.50.0-6.stx.1.dsc'} *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstackclient/python-openstackclient_5.4.0-4.stx.3.dsc'} *14:19:54* 2023-02-10 19:19:54,606 - [1mdsc_depend[0m - [1;31mERROR[0m: There are unexpected circular dependency. *14:19:54* Traceback (most recent call last): *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 2034, in <module> *14:19:54* build_controller.build_all(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1513, in build_all *14:19:54* self.build_layers(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1637, in build_layers *14:19:54* self.build_layer(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1613, in build_layer *14:19:54* self.build_layer_and_build_types(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1598, in build_layer_and_build_types *14:19:54* self.build_layer_and_build_type(layer=layer, build_type=build_type, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1564, in build_layer_and_build_type *14:19:54* self.build_packages(layer_pkg_dirs, pkg_dirs, layer, word, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1824, in build_packages *14:19:54* self.run_build_loop(layer_pkgdir_dscs, target_pkgdir_dscs, layer, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1299, in run_build_loop *14:19:54* deps_resolver = dsc_depend.Dsc_build_order(dsc_list_file, dscs_list, ds_logger) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 935, in __init__ *14:19:54* super().__init__(logger, self.meta_info, circular_conf_file) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 520, in __init__ *14:19:54* self.__grouping(meta_info) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 823, in __grouping *14:19:54* raise Exception('UNEXPECTED CIRCULAR DEPENDENCY.') *14:19:54* Exception: UNEXPECTED CIRCULAR DEPENDENCY. *14:19:54* command terminated with exit code 1 *14:19:54* *14:19:54* *14:19:54* ### *14:19:54* ### Failed to build packages after 3 iterations *14:19:54* ### *14:19:54*
On 2023-02-10 13:25, Scott Little wrote:
Sorry folks, the last r/stx/8/0 build was invalid. One more build configuration fix and we'll try again.
ETA: 10 pm Eastern
expected output URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/2...
Scott
On 2023-02-10 10:05, Scott Little wrote:
We have a good build of r/stx.8.0
Scott
On 2023-02-09 13:11, Scott Little wrote:
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO.
The problem has been corrected and another build is underway. ETA is 9pm Eastern.
Scott
On 2023-02-09 06:33, Cervi, Thales Elero wrote:
Hi Scott,
Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build?
Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03hWIN2xhQ$> Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build:
2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh <https://urldefense.com/v3/__http://build-helm-charts.sh__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03gzx9l2mA$>
[2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ###
And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline.
Thales
------------------------------------------------------------------------ *From:* Scott Little <scott.little@windriver.com> *Sent:* Wednesday, February 8, 2023 6:04 PM *To:* starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9.
Scott
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
Trying again after full wipe of prior damaged build environment. ETA: 10am Eastern. expected output URL: <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/20230211T011643Z__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSdVzTAIOg$>http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/ <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSfe-0jCRQ$>20230211T045208Z On 2023-02-10 20:23, Scott Little wrote:
Found a manifest issue. Master branch content leaked into the build of the r/stx.8.0 branch.
I have fixed the r/stx.8.0 manifest, and restarted the r/stx.8.0 build.
ETA: 6am Eastern.
expected output URL: <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/20230211T011643Z__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSdVzTAIOg$>http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/ <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSfe-0jCRQ$>20230211T011643Z The master branch build will be delayed till 6 am. The master branch might or might not have a circular dependency issue as I noted previously. If it does, the probable trigger was https://review.opendev.org/c/starlingx/integ/+/871349
Scott
On 2023-02-10 17:52, Scott Little wrote:
**14:19:54* 2023-02-10 19:19:54,585 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,589 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for Simple dependency. *14:19:54* 2023-02-10 19:19:54,593 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,601 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lsb/lsb_11.1.0.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python3.9/python3.9_3.9.2-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/linux/linux_5.10.162-1.stx.31.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/net-tools/net-tools_1.60+git20181103.0eebece-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/systemd/systemd_247.3-7.stx.8.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/setuptools/setuptools_52.0.0-4.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/dh-python/dh-python_4.20201102+nmu1.stx.2.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/openldap/openldap_2.4.57+dfsg-3+deb11u1.stx.9.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lvm2/lvm2_2.03.11-2.stx.2.dsc'} 14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstacksdk/python-openstacksdk_0.50.0-6.stx.1.dsc'} *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstackclient/python-openstackclient_5.4.0-4.stx.3.dsc'} *14:19:54* 2023-02-10 19:19:54,606 - [1mdsc_depend[0m - [1;31mERROR[0m: There are unexpected circular dependency. *14:19:54* Traceback (most recent call last): *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 2034, in <module> *14:19:54* build_controller.build_all(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1513, in build_all *14:19:54* self.build_layers(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1637, in build_layers *14:19:54* self.build_layer(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1613, in build_layer *14:19:54* self.build_layer_and_build_types(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1598, in build_layer_and_build_types *14:19:54* self.build_layer_and_build_type(layer=layer, build_type=build_type, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1564, in build_layer_and_build_type *14:19:54* self.build_packages(layer_pkg_dirs, pkg_dirs, layer, word, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1824, in build_packages *14:19:54* self.run_build_loop(layer_pkgdir_dscs, target_pkgdir_dscs, layer, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1299, in run_build_loop *14:19:54* deps_resolver = dsc_depend.Dsc_build_order(dsc_list_file, dscs_list, ds_logger) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 935, in __init__ *14:19:54* super().__init__(logger, self.meta_info, circular_conf_file) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 520, in __init__ *14:19:54* self.__grouping(meta_info) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 823, in __grouping *14:19:54* raise Exception('UNEXPECTED CIRCULAR DEPENDENCY.') *14:19:54* Exception: UNEXPECTED CIRCULAR DEPENDENCY. *14:19:54* command terminated with exit code 1 *14:19:54* *14:19:54* *14:19:54* ### *14:19:54* ### Failed to build packages after 3 iterations *14:19:54* ### *14:19:54*
On 2023-02-10 13:25, Scott Little wrote:
Sorry folks, the last r/stx/8/0 build was invalid. One more build configuration fix and we'll try again.
ETA: 10 pm Eastern
expected output URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/2...
Scott
On 2023-02-10 10:05, Scott Little wrote:
We have a good build of r/stx.8.0
Scott
On 2023-02-09 13:11, Scott Little wrote:
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO.
The problem has been corrected and another build is underway. ETA is 9pm Eastern.
Scott
On 2023-02-09 06:33, Cervi, Thales Elero wrote:
Hi Scott,
Is any of these issues by any chance related to the reason why the stx-openstack helm-chart is not being generated as part of the master/debian/monolithic build?
Last build with a stx-openstack helm-chart generated was: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03hWIN2xhQ$> Since then, I see weird mentions to STX_8.0 pipeline on the build-helm-charts.log.txt for master/debian/monolithic build:
2023-02-08T05:49:21.269Z] + /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh <https://urldefense.com/v3/__http://build-helm-charts.sh__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03gzx9l2mA$>
[2023-02-08T05:49:21.269Z] reading /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf [2023-02-08T05:49:21.269Z] cd /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools [2023-02-08T05:49:21.269Z] sourcing ./import-stx [2023-02-08T05:49:21.820Z] # found primary helm charts: [stx-openstack:stx-openstack-helm-fluxcd] pattern=[stx-openstack-helm-fluxcd] [2023-02-08T05:49:22.071Z] # found extra helm charts: [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] [2023-02-08T05:49:22.071Z] ### [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor [2023-02-08T05:49:22.071Z] ###
And it seems that the stx-openstack helm-chart build is being skipped for some reason. If this is one of the issues you mentioned to be already fixed, please let me know. Otherwise, we can raise a Launchpad to track this build issue accordingly since the lack of a helm-chart as a latest_build output currently broke the stx-openstack Sanity Tests pipeline.
Thales
------------------------------------------------------------------------ *From:* Scott Little <scott.little@windriver.com> *Sent:* Wednesday, February 8, 2023 6:04 PM *To:* starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 Several issues have been corrected in the build tools. We have started a second build attempt on branch r/stx.8.0. If all goes well, we should have a build by 06:00 Z on Feb 9.
Scott
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
We have a good build at last. https://mirror.starlingx.cengn.ca/mirror/starlingx/rc/stx.8.0/debian/monolit... Scott On 2023-02-11 00:11, Scott Little wrote:
Trying again after full wipe of prior damaged build environment.
ETA: 10am Eastern.
expected output URL: <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/20230211T011643Z__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSdVzTAIOg$>http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/ <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSfe-0jCRQ$>20230211T045208Z On 2023-02-10 20:23, Scott Little wrote:
Found a manifest issue. Master branch content leaked into the build of the r/stx.8.0 branch.
I have fixed the r/stx.8.0 manifest, and restarted the r/stx.8.0 build.
ETA: 6am Eastern.
expected output URL: <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/20230211T011643Z__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSdVzTAIOg$>http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/ <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/__;!!AjveYdw8EvQ!f_aO5P9dLm-Qx8TBHjEEDojYRpiP8ovkIWYQJASGY70VQGcbL5-dac8MalRvGgfDekeW02QEMcBGv-19gJQLDSfe-0jCRQ$>20230211T011643Z The master branch build will be delayed till 6 am. The master branch might or might not have a circular dependency issue as I noted previously. If it does, the probable trigger was https://review.opendev.org/c/starlingx/integ/+/871349
Scott
On 2023-02-10 17:52, Scott Little wrote:
**14:19:54* 2023-02-10 19:19:54,585 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,589 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for Simple dependency. *14:19:54* 2023-02-10 19:19:54,593 - [1mdsc_depend[0m - [1;34mDEBUG[0m: Scan pkgs meta info for circular dependency. *14:19:54* 2023-02-10 19:19:54,601 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lsb/lsb_11.1.0.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python3.9/python3.9_3.9.2-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/linux/linux_5.10.162-1.stx.31.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/net-tools/net-tools_1.60+git20181103.0eebece-1.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/systemd/systemd_247.3-7.stx.8.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/setuptools/setuptools_52.0.0-4.stx.1.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/dh-python/dh-python_4.20201102+nmu1.stx.2.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/openldap/openldap_2.4.57+dfsg-3+deb11u1.stx.9.dsc', '/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/lvm2/lvm2_2.03.11-2.stx.2.dsc'} 14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,603 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstacksdk/python-openstacksdk_0.50.0-6.stx.1.dsc'} *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;34mDEBUG[0m: CIRCULAR DEPENDENCY DETECTED. *14:19:54* 2023-02-10 19:19:54,604 - [1mdsc_depend[0m - [1;31mERROR[0m: Circular dependency: {'/localdisk/loadbuild/jenkins/rc-stx-8-0-debian/std/python-openstackclient/python-openstackclient_5.4.0-4.stx.3.dsc'} *14:19:54* 2023-02-10 19:19:54,606 - [1mdsc_depend[0m - [1;31mERROR[0m: There are unexpected circular dependency. *14:19:54* Traceback (most recent call last): *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 2034, in <module> *14:19:54* build_controller.build_all(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1513, in build_all *14:19:54* self.build_layers(layers=layers, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1637, in build_layers *14:19:54* self.build_layer(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1613, in build_layer *14:19:54* self.build_layer_and_build_types(layer=layer, build_types=build_types, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1598, in build_layer_and_build_types *14:19:54* self.build_layer_and_build_type(layer=layer, build_type=build_type, packages=packages) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1564, in build_layer_and_build_type *14:19:54* self.build_packages(layer_pkg_dirs, pkg_dirs, layer, word, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1824, in build_packages *14:19:54* self.run_build_loop(layer_pkgdir_dscs, target_pkgdir_dscs, layer, build_type=build_type) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/build-pkgs", line 1299, in run_build_loop *14:19:54* deps_resolver = dsc_depend.Dsc_build_order(dsc_list_file, dscs_list, ds_logger) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 935, in __init__ *14:19:54* super().__init__(logger, self.meta_info, circular_conf_file) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 520, in __init__ *14:19:54* self.__grouping(meta_info) *14:19:54* File "/localdisk/designer/jenkins/rc-stx-8-0-debian/cgcs-root/build-tools/stx/dsc_depend.py", line 823, in __grouping *14:19:54* raise Exception('UNEXPECTED CIRCULAR DEPENDENCY.') *14:19:54* Exception: UNEXPECTED CIRCULAR DEPENDENCY. *14:19:54* command terminated with exit code 1 *14:19:54* *14:19:54* *14:19:54* ### *14:19:54* ### Failed to build packages after 3 iterations *14:19:54* ### *14:19:54*
On 2023-02-10 13:25, Scott Little wrote:
Sorry folks, the last r/stx/8/0 build was invalid. One more build configuration fix and we'll try again.
ETA: 10 pm Eastern
expected output URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/8.0/debian/monolithic/2...
Scott
On 2023-02-10 10:05, Scott Little wrote:
We have a good build of r/stx.8.0
Scott
On 2023-02-09 13:11, Scott Little wrote:
Last nights build of r/stx.8.0 failed again, a variation of the prior issue. As you note, the failure impacts images and helm charts, not the ISO.
The problem has been corrected and another build is underway. ETA is 9pm Eastern.
Scott
On 2023-02-09 06:33, Cervi, Thales Elero wrote: > Hi Scott, > > Is any of these issues by any chance related to the reason why > the stx-openstack helm-chart is not being generated as part of > the master/debian/monolithic build? > > Last build with a stx-openstack helm-chart generated was: > http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/2... > <https://urldefense.com/v3/__http://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230207T070000Z/__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03hWIN2xhQ$> > Since then, I see weird mentions to STX_8.0 pipeline on the > build-helm-charts.log.txt for master/debian/monolithic build: > > 2023-02-08T05:49:21.269Z] + > /var/lib/jenkins/workspace/STX_8.0_build_pipelines/parts/build-helm-charts/scripts/build-helm-charts.sh > <https://urldefense.com/v3/__http://build-helm-charts.sh__;!!AjveYdw8EvQ!bjn2396Vr2K9YsBVSovG1Iag0qO8wRqoAkcWtELvarmDRH3BfFLholWrySCnKxMcVA2oiZJROsm6PTwF9tpY03gzx9l2mA$> > > [2023-02-08T05:49:21.269Z] reading > /localdisk/designer/jenkins/rc-stx-8-0-debian/build.conf > [2023-02-08T05:49:21.269Z] cd > /home/localdisk/designer/jenkins/rc-stx-8-0-debian/repo/stx-tools > [2023-02-08T05:49:21.269Z] sourcing ./import-stx > [2023-02-08T05:49:21.820Z] # found primary helm charts: > [stx-openstack:stx-openstack-helm-fluxcd] > pattern=[stx-openstack-helm-fluxcd] > [2023-02-08T05:49:22.071Z] # found extra helm charts: > [stx-monitor:stx-monitor-helm] pattern=[stx-*-helm] > [2023-02-08T05:49:22.071Z] > [2023-02-08T05:49:22.071Z] > [2023-02-08T05:49:22.071Z] ### > [2023-02-08T05:49:22.071Z] ### building extra helm chart stx-monitor > [2023-02-08T05:49:22.071Z] ### > > And it seems that the stx-openstack helm-chart build is being > skipped for some reason. > If this is one of the issues you mentioned to be already fixed, > please let me know. > Otherwise, we can raise a Launchpad to track this build issue > accordingly since the lack of a helm-chart as a latest_build > output currently broke the stx-openstack Sanity Tests pipeline. > > Thales > > > ------------------------------------------------------------------------ > *From:* Scott Little <scott.little@windriver.com> > *Sent:* Wednesday, February 8, 2023 6:04 PM > *To:* starlingx-discuss@lists.starlingx.io > <starlingx-discuss@lists.starlingx.io> > *Subject:* [Starlingx-discuss] CENGN build of r/stx.8.0 > Several issues have been corrected in the build tools. We have > started > a second build attempt on branch r/stx.8.0. If all goes well, we > should > have a build by 06:00 Z on Feb 9. > > Scott > > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io
participants (2)
-
Cervi, Thales Elero
-
Scott Little