Hi Scott, I found the issue here. From log http://mirror.starlingx.cengn.ca/mirror/starlingx/ussuri/centos/monolithic/2... The script put a wrong upper-constraint file to below tarball. Running: wget https://opendev.org/openstack/requirements/raw/commit/2da5c5045118b0e36fb144... This was introduced by patch https://review.opendev.org/#/c/708766/ # Locking down constraints as a temporary fix for build issues, until images move to python3 - LP: 1863957 #with_retries ${MAX_ATTEMPTS} wget https://raw.githubusercontent.com/openstack/requirements/${OPENSTACK_BRANCH}/upper-constraints.txt with_retries ${MAX_ATTEMPTS} wget https://opendev.org/openstack/requirements/raw/commit/2da5c5045118b0e36fb144... Now we need change it back, since we move openstack to ussuri which support python3 only now. I also got double confirm from Chant that he changed here manually in his build environment, but not submitted it to below patch. I have updated patch https://review.opendev.org/#/c/712880/ @Scott Little Please help cherry pick the latest update and retrigger the build again. Thanks! Zhipeng -----Original Message----- From: Liu, ZhipengS <zhipengs.liu@intel.com> Sent: 2020年6月17日 13:15 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Scott Little <scott.little@windriver.com>; starlingx-discuss@lists.starlingx.io Subject: RE: [Starlingx-discuss] [build-report] STX_build_master_ussuri - Build # 9 - Still Failing! Sorry for typo, below "merge" should be "cherry-pick" -----Original Message----- From: Liu, ZhipengS <zhipengs.liu@intel.com> Sent: 2020年6月17日 10:13 To: Scott Little <scott.little@windriver.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] [build-report] STX_build_master_ussuri - Build # 9 - Still Failing! Hi Scott, Root cause found. It is strange, need you to further check your build script. For your base image build, I can see that [1] should be cherry-picked from below log. ------------------------------------------------ Step 5/5 : RUN set -ex ; sed -i '/\[main\]/ atimeout=120' /etc/yum.conf ; mv /stx.repo /etc/yum.repos.d/ ; yum upgrade --disablerepo=* ${REPO_OPTS} -y ; yum install --disablerepo=* ${REPO_OPTS} -y qemu-img openssh-clients python3 python3-pip python3-wheel rh-python36-mod_wsgi ; rm -rf /var/log/* /tmp/* /var/tmp/* ------------------------------------------------ But from openstack service image build log It seems not cherry-pick patch [1] So, it still uses train upper-constraints to build openstack image, see one log [2] https://raw.githubusercontent.com/openstack/requirements/stable/train/upper-... [1] https://review.opendev.org/#/c/712880/ [2]http://mirror.starlingx.cengn.ca/mirror/starlingx/ussuri/centos/monolithic/2... Thanks! Zhipeng -----Original Message----- From: Liu, ZhipengS Sent: 2020年6月17日 8:08 To: 'build.starlingx@gmail.com' <build.starlingx@gmail.com>; starlingx-discuss@lists.starlingx.io Subject: RE: [Starlingx-discuss] [build-report] STX_build_master_ussuri - Build # 9 - Still Failing! Hi scott, I have checked logs, base image, wheel build pass. For 13 openstack images, 5/13 failed, we will check further in our local setup today( We didn't see below errors during our local build) 1) nova, glance, heat [91mERROR: Could not find a version that satisfies the requirement networkx===2.3 (from -c /tmp/wheels/upper-constraints.txt (line 101)) (from versions: 1.9rc1, 1.9, 1.9.1, 1.10rc2, 1.11rc2, 1.11, 2.2, 2.4rc2, 2.4) [0m[91mERROR: No matching distribution found for networkx===2.3 (from -c /tmp/wheels/upper-constraints.txt (line 101)) 2) gnocchi [91mERROR: Could not find a version that satisfies the requirement uWSGI===2.0.17.1 (from -c /tmp/wheels/upper-constraints.txt (line 705)) (from versions: none) [0m[91mERROR: No matching distribution found for uWSGI===2.0.17.1 (from -c /tmp/wheels/upper-constraints.txt (line 705)) [0mThe command '/bin/sh -c /opt/loci/scripts/install.sh' returned a non-zero code: 1 3) cinder [91mERROR: Could not find a version that satisfies the requirement google-api-python-client===1.7.11 (from -c /tmp/wheels/upper-constraints.txt (line 303)) (from versions: 1.4.2, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.6.4, 1.6.5, 1.6.6, 1.6.7, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.7.8, 1.7.9, 1.7.10, 1.7.12, 1.8.0, 1.8.1, 1.8.2, 1.8.3, 1.8.4, 1.9.0, 1.9.1, 1.9.2, 1.9.3) ERROR: No matching distribution found for google-api-python-client===1.7.11 (from -c /tmp/wheels/upper-constraints.txt (line 303)) [0mThe command '/bin/sh -c /opt/loci/scripts/install.sh' returned a non-zero code: 1 Thanks! Zhipeng -----Original Message----- From: build.starlingx@gmail.com <build.starlingx@gmail.com> Sent: 2020年6月17日 6:50 To: starlingx-discuss@lists.starlingx.io Subject: [Starlingx-discuss] [build-report] STX_build_master_ussuri - Build # 9 - Still Failing! Project: STX_build_master_ussuri Build #: 9 Status: Still Failing Timestamp: 20200616T130458Z Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/ussuri/centos/monolithic/2... -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: true FORCE_BUILD: true _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss