[Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
Hi all, After did below 2 modifications, the issue mentioned in https://storyboard.openstack.org/#!/story/2003036 should be fixed tentatively since we have not enabled docker/kubernetes related features ==================================================================== Remove below 3 lines in stx-config/puppet-manifests/src/manifests/controller.pp #include ::platform::docker #include ::platform::kubernetes::master #include ::platform::collectd Remove below 2 lines in stx-config/puppet-manifests/src/manifests/compute.pp #include ::platform::collectd #include ::platform::kubernetes::worker ==================================================================== To avoid this deployment issue, may I submit a patch for above change? Welcome to add your comment if you have any concern or good suggestion. Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月18日 11:23 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Hu, Yong <yong.hu@intel.com>; 'Scott Little' <scott.little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] build-pkgs: package built failed , mock package missing
Mingyuan asked me checked comps.xml yesterday, it didn't exist. I also could not create it through executing generate-cgcs-centos-repo.sh.
Thanks Zhipeng, Mingyuan,
Understood about the problem. Yong and Erich were talking a few days ago internally about the way to handle comps.xml and they suggested a minimal xml so time to bring this conversation out.
How about this first version [0]? If it is possible for you to test and see if we can start taking this as our base file.
Review submitted: "Add minimal comps.xml file into cgcs-centos generator" https://review.openstack.org/#/c/583445
Zhipeng: Please hold off on your proposed modifications. We do not see config_controller failures in our builds and testing and the code below is required for current storyboards that are in progress. We are investigating and will get back to you soon. Frank -----Original Message----- From: Liu, ZhipengS [mailto:zhipengs.liu@intel.com] Sent: Monday, July 23, 2018 4:39 AM To: Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi all, After did below 2 modifications, the issue mentioned in https://storyboard.openstack.org/#!/story/2003036 should be fixed tentatively since we have not enabled docker/kubernetes related features ==================================================================== Remove below 3 lines in stx-config/puppet-manifests/src/manifests/controller.pp #include ::platform::docker #include ::platform::kubernetes::master #include ::platform::collectd Remove below 2 lines in stx-config/puppet-manifests/src/manifests/compute.pp #include ::platform::collectd #include ::platform::kubernetes::worker ==================================================================== To avoid this deployment issue, may I submit a patch for above change? Welcome to add your comment if you have any concern or good suggestion. Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月18日 11:23 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Hu, Yong <yong.hu@intel.com>; 'Scott Little' <scott.little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] build-pkgs: package built failed , mock package missing
Mingyuan asked me checked comps.xml yesterday, it didn't exist. I also could not create it through executing generate-cgcs-centos-repo.sh.
Thanks Zhipeng, Mingyuan,
Understood about the problem. Yong and Erich were talking a few days ago internally about the way to handle comps.xml and they suggested a minimal xml so time to bring this conversation out.
How about this first version [0]? If it is possible for you to test and see if we can start taking this as our base file.
Review submitted: "Add minimal comps.xml file into cgcs-centos generator" https://review.openstack.org/#/c/583445 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Frank, This is due to Zhipeng was following wiki guide here: https://wiki.openstack.org/wiki/StarlingX/Developer_Guide#Build_StarlingX_IS... And please notice that the generated ISO missed the below packages: #selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node But Abraham commented out due to the missing dependencies of those RPMs. If WR can provide the dependencies that we shall add into our mirror (yours are superset of ours), then I am thinking it can help to solve the issue correctly. Thanks. - cindy -----Original Message----- From: Miller, Frank [mailto:Frank.Miller@windriver.com] Sent: Monday, July 23, 2018 9:42 PM To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Zhipeng: Please hold off on your proposed modifications. We do not see config_controller failures in our builds and testing and the code below is required for current storyboards that are in progress. We are investigating and will get back to you soon. Frank -----Original Message----- From: Liu, ZhipengS [mailto:zhipengs.liu@intel.com] Sent: Monday, July 23, 2018 4:39 AM To: Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi all, After did below 2 modifications, the issue mentioned in https://storyboard.openstack.org/#!/story/2003036 should be fixed tentatively since we have not enabled docker/kubernetes related features ==================================================================== Remove below 3 lines in stx-config/puppet-manifests/src/manifests/controller.pp #include ::platform::docker #include ::platform::kubernetes::master #include ::platform::collectd Remove below 2 lines in stx-config/puppet-manifests/src/manifests/compute.pp #include ::platform::collectd #include ::platform::kubernetes::worker ==================================================================== To avoid this deployment issue, may I submit a patch for above change? Welcome to add your comment if you have any concern or good suggestion. Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月18日 11:23 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Hu, Yong <yong.hu@intel.com>; 'Scott Little' <scott.little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] build-pkgs: package built failed , mock package missing
Mingyuan asked me checked comps.xml yesterday, it didn't exist. I also could not create it through executing generate-cgcs-centos-repo.sh.
Thanks Zhipeng, Mingyuan,
Understood about the problem. Yong and Erich were talking a few days ago internally about the way to handle comps.xml and they suggested a minimal xml so time to bring this conversation out.
How about this first version [0]? If it is possible for you to test and see if we can start taking this as our base file.
Review submitted: "Add minimal comps.xml file into cgcs-centos generator" https://review.openstack.org/#/c/583445 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Cindy: I think the first issue is the storyboard is using an old ISO from July 3rd (stx-07-03-2018.iso) and the commits to add the influxdb and kubernetes packages were merged after July 3rd: Influxdb: https://review.openstack.org/#/c/580021/ (Jul 4) Docker: https://review.openstack.org/#/c/581076/ (Jul 12) Kubernetes: https://review.openstack.org/#/c/581108/ (July 9) So my suggestion is you try a more recent pull & build and see if the issue is solved. Frank -----Original Message----- From: Xie, Cindy [mailto:cindy.xie@intel.com] Sent: Monday, July 23, 2018 9:50 AM To: Miller, Frank; Liu, ZhipengS; Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Frank, This is due to Zhipeng was following wiki guide here: https://wiki.openstack.org/wiki/StarlingX/Developer_Guide#Build_StarlingX_IS... And please notice that the generated ISO missed the below packages: #selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node But Abraham commented out due to the missing dependencies of those RPMs. If WR can provide the dependencies that we shall add into our mirror (yours are superset of ours), then I am thinking it can help to solve the issue correctly. Thanks. - cindy -----Original Message----- From: Miller, Frank [mailto:Frank.Miller@windriver.com] Sent: Monday, July 23, 2018 9:42 PM To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Zhipeng: Please hold off on your proposed modifications. We do not see config_controller failures in our builds and testing and the code below is required for current storyboards that are in progress. We are investigating and will get back to you soon. Frank -----Original Message----- From: Liu, ZhipengS [mailto:zhipengs.liu@intel.com] Sent: Monday, July 23, 2018 4:39 AM To: Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi all, After did below 2 modifications, the issue mentioned in https://storyboard.openstack.org/#!/story/2003036 should be fixed tentatively since we have not enabled docker/kubernetes related features ==================================================================== Remove below 3 lines in stx-config/puppet-manifests/src/manifests/controller.pp #include ::platform::docker #include ::platform::kubernetes::master #include ::platform::collectd Remove below 2 lines in stx-config/puppet-manifests/src/manifests/compute.pp #include ::platform::collectd #include ::platform::kubernetes::worker ==================================================================== To avoid this deployment issue, may I submit a patch for above change? Welcome to add your comment if you have any concern or good suggestion. Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月18日 11:23 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Hu, Yong <yong.hu@intel.com>; 'Scott Little' <scott.little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] build-pkgs: package built failed , mock package missing
Mingyuan asked me checked comps.xml yesterday, it didn't exist. I also could not create it through executing generate-cgcs-centos-repo.sh.
Thanks Zhipeng, Mingyuan,
Understood about the problem. Yong and Erich were talking a few days ago internally about the way to handle comps.xml and they suggested a minimal xml so time to bring this conversation out.
How about this first version [0]? If it is possible for you to test and see if we can start taking this as our base file.
Review submitted: "Add minimal comps.xml file into cgcs-centos generator" https://review.openstack.org/#/c/583445 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi Frank, My iso file was built with the code synced in 7/19. I have double checked that the code has already included all these 3 patches.(influxdb and docker RPM are already there) As I know, Abraham also used latest code after 7/17. Right? @Abraham. When built iso, it had some dependency issues, then commented out below lines in build_iso/image.inc #selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node Thanks! Zhipeng -----Original Message----- From: Miller, Frank [mailto:Frank.Miller@windriver.com] Sent: 2018年7月23日 22:01 To: Xie, Cindy <cindy.xie@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Cindy: I think the first issue is the storyboard is using an old ISO from July 3rd (stx-07-03-2018.iso) and the commits to add the influxdb and kubernetes packages were merged after July 3rd: Influxdb: https://review.openstack.org/#/c/580021/ (Jul 4) Docker: https://review.openstack.org/#/c/581076/ (Jul 12) Kubernetes: https://review.openstack.org/#/c/581108/ (July 9) So my suggestion is you try a more recent pull & build and see if the issue is solved. Frank -----Original Message----- From: Xie, Cindy [mailto:cindy.xie@intel.com] Sent: Monday, July 23, 2018 9:50 AM To: Miller, Frank; Liu, ZhipengS; Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Frank, This is due to Zhipeng was following wiki guide here: https://wiki.openstack.org/wiki/StarlingX/Developer_Guide#Build_StarlingX_IS... And please notice that the generated ISO missed the below packages: #selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node But Abraham commented out due to the missing dependencies of those RPMs. If WR can provide the dependencies that we shall add into our mirror (yours are superset of ours), then I am thinking it can help to solve the issue correctly. Thanks. - cindy -----Original Message----- From: Miller, Frank [mailto:Frank.Miller@windriver.com] Sent: Monday, July 23, 2018 9:42 PM To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Zhipeng: Please hold off on your proposed modifications. We do not see config_controller failures in our builds and testing and the code below is required for current storyboards that are in progress. We are investigating and will get back to you soon. Frank -----Original Message----- From: Liu, ZhipengS [mailto:zhipengs.liu@intel.com] Sent: Monday, July 23, 2018 4:39 AM To: Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi all, After did below 2 modifications, the issue mentioned in https://storyboard.openstack.org/#!/story/2003036 should be fixed tentatively since we have not enabled docker/kubernetes related features ==================================================================== Remove below 3 lines in stx-config/puppet-manifests/src/manifests/controller.pp #include ::platform::docker #include ::platform::kubernetes::master #include ::platform::collectd Remove below 2 lines in stx-config/puppet-manifests/src/manifests/compute.pp #include ::platform::collectd #include ::platform::kubernetes::worker ==================================================================== To avoid this deployment issue, may I submit a patch for above change? Welcome to add your comment if you have any concern or good suggestion. Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月18日 11:23 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Hu, Yong <yong.hu@intel.com>; 'Scott Little' <scott.little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] build-pkgs: package built failed , mock package missing
Mingyuan asked me checked comps.xml yesterday, it didn't exist. I also could not create it through executing generate-cgcs-centos-repo.sh.
Thanks Zhipeng, Mingyuan,
Understood about the problem. Yong and Erich were talking a few days ago internally about the way to handle comps.xml and they suggested a minimal xml so time to bring this conversation out.
How about this first version [0]? If it is possible for you to test and see if we can start taking this as our base file.
Review submitted: "Add minimal comps.xml file into cgcs-centos generator" https://review.openstack.org/#/c/583445 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
My iso file was built with the code synced in 7/19. I have double checked that the code has already included all these 3 patches.(influxdb and docker RPM are already there)
As I know, Abraham also used latest code after 7/17. Right? @Abraham.
Correct!
When built iso, it had some dependency issues, then commented out below lines in build_iso/image.inc
#selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node
Let us try today and will get back to this mailing list.
When built iso, it had some dependency issues, then commented out below lines in build_iso/image.inc
#selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node
Let us try today and will get back to this mailing list.
Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide
Hi Abraham, Thanks for your quick feedback! I will also try it according to your updated GUIDE and update to you later today. Since dependency issue has been fixed, no need for my patch. zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 8:31 To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
When built iso, it had some dependency issues, then commented out below lines in build_iso/image.inc
#selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node
Let us try today and will get back to this mailing list.
Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide
Hi, I think there are two issues here, 1.- kubernetes-kubeadm requires a containernetworking-cni and that causes a failure in build-iso, this is reported here[0] 2.- With the dependencies resolved and with docker and kubernetes packages within the ISO, the config_controller command fails in step 6 trying to install docker-ce. We have seen this behavior in three different builds, also we have see it as sporadic, same ISO in some system finishes successful and in other fails. Next time we see the problem we'll make a further debug. [0] https://storyboard.openstack.org/#!/story/2003011 On 7/23/18, 9:12 PM, "Liu, ZhipengS" <zhipengs.liu@intel.com> wrote: Hi Abraham, Thanks for your quick feedback! I will also try it according to your updated GUIDE and update to you later today. Since dependency issue has been fixed, no need for my patch. zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 8:31 To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller > > When built iso, it had some dependency issues, then commented out > > below lines in build_iso/image.inc > > > > #selinux-policy > > ... > > #dockers-ce > > #kubernetes > > #kubernetes-client > > #kubernetes-kubeadm > > #kubernetes-master > > #kubernetes-node > > Let us try today and will get back to this mailing list. Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi Erich and Abraham, According to the latest GUIDE, changes in imag.inc are reverted. I synced the latest code and finished build. When build iso, there is a dependency issue I saw below. 16:25:59 These RPMS had problems (likely version conflicts) 16:25:59 containernetworking-cni 16:25:59 selinux-policy-base 16:25:59 selinux-policy-targeted 16:25:59 Could not install dependencies After I downloaded below 3 rpms, build-iso pass. policycoreutils-2.5-22.el7.x86_64.rpm policycoreutils-newrole-2.5-22.el7.x86_64.rpm policycoreutils-python-2.5-22.el7.x86_64.rpm Do you have the same dependency issue? Need to update it to GUIDE if so. Zhipeng -----Original Message----- From: Cordoba Malibran, Erich Sent: 2018年7月24日 11:38 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi, I think there are two issues here, 1.- kubernetes-kubeadm requires a containernetworking-cni and that causes a failure in build-iso, this is reported here[0] 2.- With the dependencies resolved and with docker and kubernetes packages within the ISO, the config_controller command fails in step 6 trying to install docker-ce. We have seen this behavior in three different builds, also we have see it as sporadic, same ISO in some system finishes successful and in other fails. Next time we see the problem we'll make a further debug. [0] https://storyboard.openstack.org/#!/story/2003011 On 7/23/18, 9:12 PM, "Liu, ZhipengS" <zhipengs.liu@intel.com> wrote: Hi Abraham, Thanks for your quick feedback! I will also try it according to your updated GUIDE and update to you later today. Since dependency issue has been fixed, no need for my patch. zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 8:31 To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller > > When built iso, it had some dependency issues, then commented out > > below lines in build_iso/image.inc > > > > #selinux-policy > > ... > > #dockers-ce > > #kubernetes > > #kubernetes-client > > #kubernetes-kubeadm > > #kubernetes-master > > #kubernetes-node > > Let us try today and will get back to this mailing list. Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Zhipeng, Please check if you have this patch included in your code base: https://review.openstack.org/#/c/585043/ this one newly merged in the morning. GDC has built the ISO with the patch and Ada is doing the validation. Thx. - cindy -----Original Message----- From: Liu, ZhipengS Sent: Tuesday, July 24, 2018 5:08 PM To: Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Erich and Abraham, According to the latest GUIDE, changes in imag.inc are reverted. I synced the latest code and finished build. When build iso, there is a dependency issue I saw below. 16:25:59 These RPMS had problems (likely version conflicts) 16:25:59 containernetworking-cni 16:25:59 selinux-policy-base 16:25:59 selinux-policy-targeted 16:25:59 Could not install dependencies After I downloaded below 3 rpms, build-iso pass. policycoreutils-2.5-22.el7.x86_64.rpm policycoreutils-newrole-2.5-22.el7.x86_64.rpm policycoreutils-python-2.5-22.el7.x86_64.rpm Do you have the same dependency issue? Need to update it to GUIDE if so. Zhipeng -----Original Message----- From: Cordoba Malibran, Erich Sent: 2018年7月24日 11:38 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi, I think there are two issues here, 1.- kubernetes-kubeadm requires a containernetworking-cni and that causes a failure in build-iso, this is reported here[0] 2.- With the dependencies resolved and with docker and kubernetes packages within the ISO, the config_controller command fails in step 6 trying to install docker-ce. We have seen this behavior in three different builds, also we have see it as sporadic, same ISO in some system finishes successful and in other fails. Next time we see the problem we'll make a further debug. [0] https://storyboard.openstack.org/#!/story/2003011 On 7/23/18, 9:12 PM, "Liu, ZhipengS" <zhipengs.liu@intel.com> wrote: Hi Abraham, Thanks for your quick feedback! I will also try it according to your updated GUIDE and update to you later today. Since dependency issue has been fixed, no need for my patch. zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 8:31 To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller > > When built iso, it had some dependency issues, then commented out > > below lines in build_iso/image.inc > > > > #selinux-policy > > ... > > #dockers-ce > > #kubernetes > > #kubernetes-client > > #kubernetes-kubeadm > > #kubernetes-master > > #kubernetes-node > > Let us try today and will get back to this mailing list. Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi Cindy, This is the key one, already in my code base. BRs zhipeng -----Original Message----- From: Xie, Cindy Sent: 2018年7月24日 19:20 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Zhipeng, Please check if you have this patch included in your code base: https://review.openstack.org/#/c/585043/ this one newly merged in the morning. GDC has built the ISO with the patch and Ada is doing the validation. Thx. - cindy -----Original Message----- From: Liu, ZhipengS Sent: Tuesday, July 24, 2018 5:08 PM To: Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Erich and Abraham, According to the latest GUIDE, changes in imag.inc are reverted. I synced the latest code and finished build. When build iso, there is a dependency issue I saw below. 16:25:59 These RPMS had problems (likely version conflicts) 16:25:59 containernetworking-cni 16:25:59 selinux-policy-base 16:25:59 selinux-policy-targeted 16:25:59 Could not install dependencies After I downloaded below 3 rpms, build-iso pass. policycoreutils-2.5-22.el7.x86_64.rpm policycoreutils-newrole-2.5-22.el7.x86_64.rpm policycoreutils-python-2.5-22.el7.x86_64.rpm Do you have the same dependency issue? Need to update it to GUIDE if so. Zhipeng -----Original Message----- From: Cordoba Malibran, Erich Sent: 2018年7月24日 11:38 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi, I think there are two issues here, 1.- kubernetes-kubeadm requires a containernetworking-cni and that causes a failure in build-iso, this is reported here[0] 2.- With the dependencies resolved and with docker and kubernetes packages within the ISO, the config_controller command fails in step 6 trying to install docker-ce. We have seen this behavior in three different builds, also we have see it as sporadic, same ISO in some system finishes successful and in other fails. Next time we see the problem we'll make a further debug. [0] https://storyboard.openstack.org/#!/story/2003011 On 7/23/18, 9:12 PM, "Liu, ZhipengS" <zhipengs.liu@intel.com> wrote: Hi Abraham, Thanks for your quick feedback! I will also try it according to your updated GUIDE and update to you later today. Since dependency issue has been fixed, no need for my patch. zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 8:31 To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller > > When built iso, it had some dependency issues, then commented out > > below lines in build_iso/image.inc > > > > #selinux-policy > > ... > > #dockers-ce > > #kubernetes > > #kubernetes-client > > #kubernetes-kubeadm > > #kubernetes-master > > #kubernetes-node > > Let us try today and will get back to this mailing list. Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Cindy, Sorry, I copied the wrong build error info in my first email today, which mislead you. It should be below one ========================================= 17:34:28 Debug: Packages still unresolved: 17:34:28 17:34:29 Warning: Infinite loop detected in dependency resolution. See /localdisk/loadbuild/zhipengl/starlingx/export/deps.txt for details -- exiting 17:34:29 These RPMS had problems (likely version conflicts) 17:34:29 policycoreutils 17:34:29 policycoreutils-newrole 17:34:29 policycoreutils-python 17:34:29 Could not install dependencies ============================================== From error detail log, it indicates selinux-policy depend on policycoreutils with version >= 2.5-18. In current mirror, we only have two related RPM below. policycoreutils-2.5-17.1.el7.x86_64. policycoreutils-devel-2.5-17.1.el7.x86_64.rpm policycoreutils-python-2.5-17.1.el7.x86_64.rpm So, I downloaded below 3 RPM, and build-iso pass (with latest code today) policycoreutils-2.5-22.el7.x86_64.rpm policycoreutils-newrole-2.5-22.el7.x86_64.rpm policycoreutils-python-2.5-22.el7.x86_64.rpm I also deployed with the ISO I built without comment out kubernetes/docker/connectd. Then it failed at step6/8 during Config_controller. With the error info in puppet.log as below. ========================================================= Error: Systemd start for connectd failed! Stage/Platform::Collectd/Service[collectd]/ensure:change from stopped to running failed: Systemd start for collectd failed. ========================================================= @Erich and Abraham, any comment on my build and test result? Thanks! Zhipeng -----Original Message----- From: Liu, ZhipengS [mailto:zhipengs.liu@intel.com] Sent: 2018年7月24日 21:10 To: Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Cindy, This is the key one, already in my code base. BRs zhipeng -----Original Message----- From: Xie, Cindy Sent: 2018年7月24日 19:20 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Zhipeng, Please check if you have this patch included in your code base: https://review.openstack.org/#/c/585043/ this one newly merged in the morning. GDC has built the ISO with the patch and Ada is doing the validation. Thx. - cindy -----Original Message----- From: Liu, ZhipengS Sent: Tuesday, July 24, 2018 5:08 PM To: Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Erich and Abraham, According to the latest GUIDE, changes in imag.inc are reverted. I synced the latest code and finished build. When build iso, there is a dependency issue I saw below. 16:25:59 These RPMS had problems (likely version conflicts) 16:25:59 containernetworking-cni 16:25:59 selinux-policy-base 16:25:59 selinux-policy-targeted 16:25:59 Could not install dependencies After I downloaded below 3 rpms, build-iso pass. policycoreutils-2.5-22.el7.x86_64.rpm policycoreutils-newrole-2.5-22.el7.x86_64.rpm policycoreutils-python-2.5-22.el7.x86_64.rpm Do you have the same dependency issue? Need to update it to GUIDE if so. Zhipeng -----Original Message----- From: Cordoba Malibran, Erich Sent: 2018年7月24日 11:38 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi, I think there are two issues here, 1.- kubernetes-kubeadm requires a containernetworking-cni and that causes a failure in build-iso, this is reported here[0] 2.- With the dependencies resolved and with docker and kubernetes packages within the ISO, the config_controller command fails in step 6 trying to install docker-ce. We have seen this behavior in three different builds, also we have see it as sporadic, same ISO in some system finishes successful and in other fails. Next time we see the problem we'll make a further debug. [0] https://storyboard.openstack.org/#!/story/2003011 On 7/23/18, 9:12 PM, "Liu, ZhipengS" <zhipengs.liu@intel.com> wrote: Hi Abraham, Thanks for your quick feedback! I will also try it according to your updated GUIDE and update to you later today. Since dependency issue has been fixed, no need for my patch. zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 8:31 To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Xie, Cindy <cindy.xie@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller > > When built iso, it had some dependency issues, then commented out > > below lines in build_iso/image.inc > > > > #selinux-policy > > ... > > #dockers-ce > > #kubernetes > > #kubernetes-client > > #kubernetes-kubeadm > > #kubernetes-master > > #kubernetes-node > > Let us try today and will get back to this mailing list. Zhipeng, @Hayde has been able to build today from M/2018.07 [0] removing the need to comment above dependencies. Can you please help us confirm the steps are correct starting from scratch? Master compilation is in process using Hayde's fix. Developer Guide has been updated including notes for branches Master and M/2018.07 https://wiki.openstack.org/wiki/StarlingX/Developer_Guide M/2018.07 generated ISO is being deployed today under Controller Storage and Simplex configurations following Installation Guide [1] and Validation Guide [2]: [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000321.html [1] https://wiki.openstack.org/wiki/StarlingX/Installation_Guide [2] https://wiki.openstack.org/wiki/StarlingX/Validation_Guide _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi Abraham, Scott, Hayde Thanks for your confirm! I have reviewed the patch, let's make it merged today. The remaining issue is that I saw the same error as before when I deployed it on multinode. Error: Systemd start for connectd failed! @Scott, could you help check it as well? Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 21:53 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
This is the key one, already in my code base
Yes Zhipeng, you are correct! Those packages are missing to have the full build. Do you have the patch available? If not we can work on it with CC to you.
Do we already have a patch regarding: https://storyboard.openstack.org/#!/story/2003070 ? Then please add the patch link there. @ Zhipeng, you can create another task under the same story for the connectd failure you're seeing. Thx. - cindy -----Original Message----- From: Liu, ZhipengS Sent: Wednesday, July 25, 2018 9:23 AM To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Abraham, Scott, Hayde Thanks for your confirm! I have reviewed the patch, let's make it merged today. The remaining issue is that I saw the same error as before when I deployed it on multinode. Error: Systemd start for connectd failed! @Scott, could you help check it as well? Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 21:53 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
This is the key one, already in my code base
Yes Zhipeng, you are correct! Those packages are missing to have the full build. Do you have the patch available? If not we can work on it with CC to you.
There is Gerrit integration with story board. This was discussed previously on the mailing list, but I am re-sending as a reminder. http://superuser.openstack.org/articles/openstack-gerrit-storyboard-integrat... If the commit message includes the Story and Task IDs, the task will automatically be set to Merged and gerrit will include links to the review in story board. See this story for an example: https://storyboard.openstack.org/#!/story/2003085 I suggest we all use this moving forward for better traceability. Thanks, Ghada -----Original Message----- From: Xie, Cindy [mailto:cindy.xie@intel.com] Sent: Wednesday, July 25, 2018 10:51 AM To: Liu, ZhipengS; Arce Moreno, Abraham; Cordoba Malibran, Erich; Miller, Frank; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Do we already have a patch regarding: https://storyboard.openstack.org/#!/story/2003070 ? Then please add the patch link there. @ Zhipeng, you can create another task under the same story for the connectd failure you're seeing. Thx. - cindy -----Original Message----- From: Liu, ZhipengS Sent: Wednesday, July 25, 2018 9:23 AM To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Abraham, Scott, Hayde Thanks for your confirm! I have reviewed the patch, let's make it merged today. The remaining issue is that I saw the same error as before when I deployed it on multinode. Error: Systemd start for connectd failed! @Scott, could you help check it as well? Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 21:53 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
This is the key one, already in my code base
Yes Zhipeng, you are correct! Those packages are missing to have the full build. Do you have the patch available? If not we can work on it with CC to you. _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Ghada, Yes, this is great feature - we used to have this inside Intel with Gerrit and Jira but nice to see we now have it with Gerrit and StoryBoard integrated. We shall use it! Thanks. - cindy -----Original Message----- From: Khalil, Ghada [mailto:Ghada.Khalil@windriver.com] Sent: Wednesday, July 25, 2018 11:05 PM To: Xie, Cindy <cindy.xie@intel.com>; Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller There is Gerrit integration with story board. This was discussed previously on the mailing list, but I am re-sending as a reminder. http://superuser.openstack.org/articles/openstack-gerrit-storyboard-integrat... If the commit message includes the Story and Task IDs, the task will automatically be set to Merged and gerrit will include links to the review in story board. See this story for an example: https://storyboard.openstack.org/#!/story/2003085 I suggest we all use this moving forward for better traceability. Thanks, Ghada -----Original Message----- From: Xie, Cindy [mailto:cindy.xie@intel.com] Sent: Wednesday, July 25, 2018 10:51 AM To: Liu, ZhipengS; Arce Moreno, Abraham; Cordoba Malibran, Erich; Miller, Frank; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Do we already have a patch regarding: https://storyboard.openstack.org/#!/story/2003070 ? Then please add the patch link there. @ Zhipeng, you can create another task under the same story for the connectd failure you're seeing. Thx. - cindy -----Original Message----- From: Liu, ZhipengS Sent: Wednesday, July 25, 2018 9:23 AM To: Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller Hi Abraham, Scott, Hayde Thanks for your confirm! I have reviewed the patch, let's make it merged today. The remaining issue is that I saw the same error as before when I deployed it on multinode. Error: Systemd start for connectd failed! @Scott, could you help check it as well? Thanks! Zhipeng -----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月24日 21:53 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Xie, Cindy <cindy.xie@intel.com>; Cordoba Malibran, Erich <erich.cordoba.malibran@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
This is the key one, already in my code base
Yes Zhipeng, you are correct! Those packages are missing to have the full build. Do you have the patch available? If not we can work on it with CC to you. _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Thanks Zhipeng for noticing.
Yes, these are required. Scott
After I downloaded below 3 rpms, build-iso pass. policycoreutils-2.5-22.el7.x86_64.rpm policycoreutils-newrole-2.5-22.el7.x86_64.rpm policycoreutils-python-2.5-22.el7.x86_64.rpm
I have submitted a new patch [0] that already requires these rpms. [0] https://review.openstack.org/#/c/585465/
The story seems to implicate collectd and influxdb. In addition to the changes Frank has identified, you also need ... https://review.openstack.org/579307 I've attempted a manual audit of the .lst files. All requirements for the new packages seem to be present. Can you confirm the new packages have been installed in your build? 1) in your build environmnet, look in $MY_WORKSPACE/export/dist/isolinux/Packages $ ls *collectd* *influx* collectd-5.7.1-2.el7.x86_64.rpm influxdb-0.9.5.1-1.x86_64.rpm puppet-collectd-5.1.0-2.4a3843cgit.el7.noarch.rpm collectd-extensions-1.0-0.tis.1.x86_64.rpm influxdb-extensions-1.0-0.tis.1.x86_64.rpm python2-influxdb-4.0.0-1.el7.1.noarch.rpm 2) the runtime view on your controllor... $ rpm -qa | grep influxdb python2-influxdb-4.0.0-1.el7.1.noarch influxdb-0.9.5.1-1.x86_64 $ rpm -qa | grep collectd collectd-5.7.1-2.el7.x86_64 collectd-extensions-1.0-0.tis.1.x86_64 puppet-collectd-5.1.0-2.4a3843cgit.el7.noarch On 18-07-23 10:01 AM, Miller, Frank wrote:
Cindy:
I think the first issue is the storyboard is using an old ISO from July 3rd (stx-07-03-2018.iso) and the commits to add the influxdb and kubernetes packages were merged after July 3rd:
Influxdb: https://review.openstack.org/#/c/580021/ (Jul 4) Docker: https://review.openstack.org/#/c/581076/ (Jul 12) Kubernetes: https://review.openstack.org/#/c/581108/ (July 9)
So my suggestion is you try a more recent pull & build and see if the issue is solved.
Frank
-----Original Message----- From: Xie, Cindy [mailto:cindy.xie@intel.com] Sent: Monday, July 23, 2018 9:50 AM To: Miller, Frank; Liu, ZhipengS; Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: RE: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
Frank, This is due to Zhipeng was following wiki guide here: https://wiki.openstack.org/wiki/StarlingX/Developer_Guide#Build_StarlingX_IS...
And please notice that the generated ISO missed the below packages:
#selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node
But Abraham commented out due to the missing dependencies of those RPMs. If WR can provide the dependencies that we shall add into our mirror (yours are superset of ours), then I am thinking it can help to solve the issue correctly.
Thanks. - cindy
-----Original Message----- From: Miller, Frank [mailto:Frank.Miller@windriver.com] Sent: Monday, July 23, 2018 9:42 PM To: Liu, ZhipengS <zhipengs.liu@intel.com>; Arce Moreno, Abraham <abraham.arce.moreno@intel.com>; Hu, Yong <yong.hu@intel.com>; Little, Scott <Scott.Little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: Re: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
Zhipeng:
Please hold off on your proposed modifications. We do not see config_controller failures in our builds and testing and the code below is required for current storyboards that are in progress. We are investigating and will get back to you soon.
Frank
-----Original Message----- From: Liu, ZhipengS [mailto:zhipengs.liu@intel.com] Sent: Monday, July 23, 2018 4:39 AM To: Arce Moreno, Abraham; Hu, Yong; Little, Scott; Qi, Mingyuan; 'starlingx-discuss@lists.starlingx.io' Subject: [Starlingx-discuss] About deployment issue: 06/08: Failed to execute controller manifest. Sporadic fail when config_controller
Hi all,
After did below 2 modifications, the issue mentioned in https://storyboard.openstack.org/#!/story/2003036 should be fixed tentatively since we have not enabled docker/kubernetes related features
==================================================================== Remove below 3 lines in stx-config/puppet-manifests/src/manifests/controller.pp #include ::platform::docker #include ::platform::kubernetes::master #include ::platform::collectd Remove below 2 lines in stx-config/puppet-manifests/src/manifests/compute.pp #include ::platform::collectd #include ::platform::kubernetes::worker ====================================================================
To avoid this deployment issue, may I submit a patch for above change? Welcome to add your comment if you have any concern or good suggestion.
Thanks! Zhipeng
-----Original Message----- From: Arce Moreno, Abraham Sent: 2018年7月18日 11:23 To: Liu, ZhipengS <zhipengs.liu@intel.com>; Hu, Yong <yong.hu@intel.com>; 'Scott Little' <scott.little@windriver.com>; Qi, Mingyuan <mingyuan.qi@intel.com>; 'starlingx-discuss@lists.starlingx.io' <starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] build-pkgs: package built failed , mock package missing
Mingyuan asked me checked comps.xml yesterday, it didn't exist. I also could not create it through executing generate-cgcs-centos-repo.sh. Thanks Zhipeng, Mingyuan,
Understood about the problem. Yong and Erich were talking a few days ago internally about the way to handle comps.xml and they suggested a minimal xml so time to bring this conversation out.
How about this first version [0]? If it is possible for you to test and see if we can start taking this as our base file.
[0] https://pastebin.com/KMB8QLNX Review submitted:
"Add minimal comps.xml file into cgcs-centos generator" https://review.openstack.org/#/c/583445 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
I think the first issue is the storyboard is using an old ISO from July 3rd (stx-07- 03-2018.iso) and the commits to add the influxdb and kubernetes packages were merged after July 3rd:
Influxdb: https://review.openstack.org/#/c/580021/ (Jul 4) Docker: https://review.openstack.org/#/c/581076/ (Jul 12) Kubernetes: https://review.openstack.org/#/c/581108/ (July 9)
So my suggestion is you try a more recent pull & build and see if the issue is solved.
I will build from master today and report back. Also, if there is some reason we shall not base our Getting Started Developer Guide [0] in Milestone 2018.07.0 [1] please let us know. [0] https://wiki.openstack.org/wiki/StarlingX/Developer_Guide [1] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000285.html
Frank, This is due to Zhipeng was following wiki guide here: https://wiki.openstack.org/wiki/StarlingX/Developer_Guide#Build_StarlingX_ ISO
Correct, great to see we are following this guide which shall be the official steps to follow.
And please notice that the generated ISO missed the below packages:
#selinux-policy ... #dockers-ce #kubernetes #kubernetes-client #kubernetes-kubeadm #kubernetes-master #kubernetes-node
But Abraham commented out due to the missing dependencies of those RPMs. If WR can provide the dependencies that we shall add into our mirror (yours are superset of ours), then I am thinking it can help to solve the issue correctly.
However due to changes happening everyday it gets outdated so today I will work In having one pointing to our Milestone 2018.07.0 [0] [0] http://lists.starlingx.io/pipermail/starlingx-discuss/2018-July/000285.html
participants (8)
-
Arce Moreno, Abraham
-
Cordoba Malibran, Erich
-
Khalil, Ghada
-
Liu, ZhipengS
-
Martinez Landa, Hayde
-
Miller, Frank
-
Scott Little
-
Xie, Cindy