If each controller is running a different load, then this would be a lab setup issue. @Dimofte, Alexandru<mailto:alexandru.dimofte@intel.com> can you please investigate this? We will wait for the resolution of this issue before declaring the 5.0 release as ready. Thanks, Ghada From: Sun, Austin <austin.sun@intel.com> Sent: Wednesday, May 19, 2021 10:14 PM To: Dimofte, Alexandru <alexandru.dimofte@intel.com>; starlingx-discuss@lists.starlingx.io; Miller, Frank <Frank.Miller@windriver.com>; Little, Scott <Scott.Little@windriver.com>; Panech, Davlet <Davlet.Panech@windriver.com> Subject: Re: [Starlingx-discuss] Sanity RC 5.0 Test LAYERED build ISO 20210519T010439Z [Please note: This e-mail is from an EXTERNAL e-mail address] Hi All: Some Investigation found on LP #1928949: 1) Not sure why controller-1 build info is master info. controller-0 is r/stx.5.0 , "20210519T042950Z" . Is it possible ? @Miller, Frank<mailto:Frank.Miller@windriver.com> , @Little, Scott<mailto:Scott.Little@windriver.com> @Panech, Davlet<mailto:Davlet.Panech@windriver.com>: could this happen possibly ? or setup issue ? 2) This issue is because rabbitmq pod running on controller-1 fail. + exec rabbitmq-server Failed to create thread: Resource temporarily unavailable (11) Once changes, --pod-max-pids 750 to --pod-max-pids 2000 in /etc/sysconfig/kubelet on controller-1 . reapply openstack the rabbitmq pod running on controller-1 successfully . This change is related w/ [1] merged on 0518 maybe need increase some value for pid limited , the question is what value should be appropriate. [1] https://review.opendev.org/c/starlingx/stx-puppet/+/791267/3/<https://urldefense.com/v3/__https:/review.opendev.org/c/starlingx/stx-puppet/*/791267/3/__;Kw!!AjveYdw8EvQ!O0bB7OtiCCPZIDipG-T_lalpmSeoNwF_PwryeAYLmGdp0heiK3ZEgweneLoTLtcRIzyc$> Thanks. BR Austin Sun. From: Dimofte, Alexandru <alexandru.dimofte@intel.com<mailto:alexandru.dimofte@intel.com>> Sent: Wednesday, May 19, 2021 10:52 PM To: starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: [Starlingx-discuss] Sanity RC 5.0 Test LAYERED build ISO 20210519T010439Z Sanity Test from 2021-May-19 (http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/5.0/centos/flock/20210519T010439Z/outputs/iso/<https://urldefense.com/v3/__http:/mirror.starlingx.cengn.ca/mirror/starlingx/rc/5.0/centos/flock/20210519T010439Z/outputs/iso/__;!!AjveYdw8EvQ!O0bB7OtiCCPZIDipG-T_lalpmSeoNwF_PwryeAYLmGdp0heiK3ZEgweneLoTLri9xlkK$>) Status: RED This might be related to: https://bugs.launchpad.net/starlingx/+bug/1928949<https://urldefense.com/v3/__https:/bugs.launchpad.net/starlingx/*bug/1928949__;Kw!!AjveYdw8EvQ!O0bB7OtiCCPZIDipG-T_lalpmSeoNwF_PwryeAYLmGdp0heiK3ZEgweneLoTLoaBS07J$> - stx-openstack apply-failed because of osh-openstack-rabbitmq install issue Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/rc/5.0/centos/flock/20210519T010439Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz<https://urldefense.com/v3/__http:/mirror.starlingx.cengn.ca/mirror/starlingx/rc/5.0/centos/flock/20210519T010439Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz__;!!AjveYdw8EvQ!O0bB7OtiCCPZIDipG-T_lalpmSeoNwF_PwryeAYLmGdp0heiK3ZEgweneLoTLryQ0UxK$> Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte@intel.com<mailto:alexandru.dimofte@intel.com> Intel Romania