Hello Frank and Austin Applying stx-openstack was stuck because armada applied openstack-glance failed. After tracking relative logs, I found some error message in ceph-manager.log. I guess that glance-api can't found object storage backend so openstack-glance deployed failed. /var/log/ceph-manager.log 4854:2021-11-01 12:54:22.945 97854 ERROR ceph_manager.monitor [-] Getting the quota for cinder-volumes pool failed:unrecognized pool 'cinder-volumes'): CephMgrDumpError: Failed to get ceph manager info. Command 'ceph mgr dump --connect-timeout 5' returned non-zero exit status 1 4857:2021-11-01 12:54:22.973 97854 ERROR ceph_manager.monitor [-] Getting the quota for images pool failed:unrecognized pool 'images'): CephMgrDumpError: Failed to get ceph manager info. Command 'ceph mgr dump --connect-timeout 5' returned non-zero exit status 1 4860:2021-11-01 12:54:23.002 97854 ERROR ceph_manager.monitor [-] Getting the quota for ephemeral pool failed:unrecognized pool 'ephemeral'): CephMgrDumpError: Failed to get ceph manager info. Command 'ceph mgr dump --connect-timeout 5' returned non-zero exit status 1 4865:2021-11-01 12:54:23.053 97854 ERROR ceph_manager.monitor [-] Rados gateway object data pool does not exist.: CephMgrDumpError: Failed to get ceph manager info. Command 'ceph mgr dump --connect-timeout 5' returned non-zero exit status 1 From: Sun, Austin <austin.sun@intel.com> Sent: Wednesday, November 3, 2021 8:56 AM To: Miller, Frank <Frank.Miller@windriver.com>; Yu, Chengde <chengde.yu@intel.com> Cc: Dimofte, Alexandru <alexandru.dimofte@intel.com>; starlingx-discuss@lists.starlingx.io Subject: RE: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20211101T235004Z Hi Frank: Our team member Chant will check this issue. Thanks. BR Austin Sun. From: Miller, Frank <Frank.Miller@windriver.com<mailto:Frank.Miller@windriver.com>> Sent: Tuesday, November 2, 2021 11:05 PM To: Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>> Cc: Dimofte, Alexandru <alexandru.dimofte@intel.com<mailto:alexandru.dimofte@intel.com>>; starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20211101T235004Z Austin: Can someone on the Openstack-distro project investigate and determine why the openstack apply is failing? Could this somehow be related to the ceph upversion that merged on Oct 28? The sanities since then have been Red. Frank From: Dimofte, Alexandru <alexandru.dimofte@intel.com<mailto:alexandru.dimofte@intel.com>> Sent: Tuesday, November 02, 2021 3:50 AM To: starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20211101T235004Z [Please note: This e-mail is from an EXTERNAL e-mail address] Sanity Test from 2021-November-01 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20211101T235004Z/outputs/iso/<https://urldefense.com/v3/__http:/mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20211101T235004Z/outputs/iso/__;!!AjveYdw8EvQ!P8CLSIx0t3dxnK4hPKrM-FMmAjuB4vrZBLZEk8Vyu_oVjJqkZbI6gA2H8xmw-RSStF6f$>) Status: RED Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20211101T235004Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz<https://urldefense.com/v3/__http:/mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20211101T235004Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz__;!!AjveYdw8EvQ!P8CLSIx0t3dxnK4hPKrM-FMmAjuB4vrZBLZEk8Vyu_oVjJqkZbI6gA2H8xmw-YPWulIr$> All configurations are affected. The LP: https://bugs.launchpad.net/starlingx/+bug/1949360<https://urldefense.com/v3/__https:/bugs.launchpad.net/starlingx/*bug/1949360__;Kw!!AjveYdw8EvQ!P8CLSIx0t3dxnK4hPKrM-FMmAjuB4vrZBLZEk8Vyu_oVjJqkZbI6gA2H8xmw-TNlX19D$> Kind regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte@intel.com<mailto:alexandru.dimofte@intel.com> Intel Romania