October 2019 - Starlingx-discuss

[Starlingx-discuss] Status of Ceph containerization // RE: Weekly StarlingX non-OpenStack distro meeting
by Chen, Tingjie 22 Oct '19

22 Oct '19

Hi All, For the status of Ceph containerization, https://storyboard.openstack.org/#!/story/2005527 I list sub-tasks currently we are working on for STX 3.0 as following: 36441 & 36442: [MS2] [Subtask] Create helm-chart for Rook operator with CSI support [MS2] [Subtask] Create helm-chart for Ceph cluster patch: https://review.opendev.org/#/c/681457<https://review.opendev.org/> in review, and received several comments, we plan to break into 2 patches with rook-ceph and ceph-cluster helm charts, since rook-ceph port from rook community and with customized patch, this need to rework with tarball with build.spec. 36443 & 36444 & 36576: [MS2] [Subtask] Bring up Rook & Ceph cluster with helm-charts in system service after ansible script [MS2] [Subtask] Override function for STX deployment configurations. [MS2] [Subtask] Investigate the ceph mon/osd policy with system configuration Actually there is patch: https://review.opendev.org/#/c/687340<https://review.opendev.org/> but we also others parameters (as following table) to overrides, so will finished soon. Name Description Plan in phase ceph-mon count ceph monitor count have 2 policies: 1. for AIO, 1 monitor. Simplex have 1, and duplex is for drbd so show ceph-mon-list for 2 uuid. 2. for multi-node, 3 monitors. STX 3.0 ceph-mon affinity ceph monitor affinity: 1. for AIO, 1 monitor. Duplex is for drbd so show ceph-mon-list for 2 uuid, but deloyed in controller-0 2. for multi-node, There are 3 monitors, 2 in controllers and 1 in compute-0 by default. In 2+2+2, cannot config monitor STX 3.0 ceph-mgr modules modules configuration (pg_autoscaler etc) STX 3.0 ceph-osd location Since disk conflict with native Ceph deployment, current implementation is located in /var/lib/rook/storage-dir, will switch to each baremetal disk in STX 4.0 STX 4.0 36445: [MS2] [Subtask] Rook plugin implementation with several features support Create a new rookclient.py to interact with sysinv, implement the main framework, the patch is in dev and ready to review soon. In STX 3.0, the features mentioned in previous sub-tasks of Containerized Ceph will NOT break functionality & resource with native Ceph cluster & sysinv. Martin(Haochuan) and me are making efforts on the subtasks. Also I have filed test cases with current phase: https://ethercalc.openstack.org/81005mu7o1pg Welcome to give comments~ Thanks, Tingjie -----Original Message----- From: Xie, Cindy <cindy.xie(a)intel.com> Sent: Wednesday, October 16, 2019 9:54 PM To: Wold, Saul <saul.wold(a)intel.com>; 'starlingx-discuss(a)lists.starlingx.io' <starlingx-discuss(a)lists.starlingx.io>; 'Rowsell, Brent' <Brent.Rowsell(a)windriver.com> Subject: Re: [Starlingx-discuss] Weekly StarlingX non-OpenStack distro meeting Agenda & notes for 10/16 meeting: . Ceph containerization update (Tingjie) https://review.opendev.org/#/c/681457/ this is for Helm chart definition, can be review now. https://review.opendev.org/#/c/687340/ for Helm overrides framework, need to extend later. verified in AIO and multi-node provision. configuration needs to be override according to STX parameters. Martin working on this for parameters to align w/ the native deployment. for stx.3.0: only to merge the implantation for Helm chart and override framework. and rook-plugin which support sysinv, this can co-exist w/ current native ceph deployment. test case development is in progress, Tingjie will sync with Fernando. for sysinv, still need to working on patches, not ready for upload/review. AR: Tingjie to send email to the mailing list for the current status & planning for include partial implementation without impacting the native Ceph functionality. . Debranding update (Saul) Starting from the tools repo, the tools in the build area to debrand the mirroring process. Part of this is for ease of use for build steps. Very early stage. Not fit in stx.3.0 scope. https://storyboard.openstack.org/#!/story/2006387, call volunteer from the community. . CentOS 8 upgrade planning (Cindy) CentOS 8.0 2 stories created: https://storyboard.openstack.org/#!/story/2006728, the kernel inside CentOS 8 is 4.18, there is no RT kernel. https://storyboard.openstack.org/#!/story/2006729 Shuai is working on new kernel onto build system. Need to understand each patches. there was an earlier analysis for kernel patches available. AR: Saul please share this analysis to Shuai. against 4.19 kernel some long time ago. See https://docs.google.com/spreadsheets/d/1nKnkweuxcqvVOoRcpnTYMVUUv1RoAugOWXM… Tab Kernel Patches Details https://github.com/xe1gyq/linux/commits/v4.19 https://github.com/xe1gyq/linux/commits/v4.18 AR: Shuai to provide an Excel sheet to compare RPM/sRPM in StarlingX and in CentOS 8.0 . Opens - none _____________________________________________ From: Xie, Cindy Sent: Tuesday, October 15, 2019 9:39 PM To: Wold, Saul <saul.wold(a)intel.com<mailto:saul.wold@intel.com>>; 'starlingx-discuss(a)lists.starlingx.io' <starlingx-discuss(a)lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io>>; 'Rowsell, Brent' <Brent.Rowsell(a)windriver.com<mailto:Brent.Rowsell@windriver.com>> Subject: RE: Weekly StarlingX non-OpenStack distro meeting Agenda: - Ceph containerization update (Tingjie) - Debranding update (Saul) - CentOS 8 upgrade planning (Cindy) - Opens Cindy Xie IAGS http://starlingx.io/ -----Original Appointment----- From: Xie, Cindy Sent: Thursday, April 25, 2019 5:42 PM To: Xie, Cindy; 'zhaos'; Wold, Saul; 'starlingx-discuss(a)lists.starlingx.io'; 'Rowsell, Brent' Cc: Armstrong, Robert H; 'Komiyama, Takeo'; 'Eslimi, Dariush'; 'Seiler, Glenn'; 'Peng Tan'; 'Chen, Jacky'; Gomez, Juan P; 'Waines, Greg'; 'Zhi Zhi2 Chang'; 'Badea, Daniel'; Jones, Bruce E; Chen, Tingjie; 'Carlos Cebrian'; Cobbley, David A; Hu, Wei W Subject: Weekly StarlingX non-OpenStack distro meeting When: Wednesday, October 16, 2019 9:00 PM-10:00 PM (UTC+08:00) Beijing, Chongqing, Hong Kong, Urumqi. Where: https://zoom.us/j/342730236 . Cadence and time slot: o Wednesday 9AM Winter EDT (10PM China time, US PDT Winter time 6AM) . Call Details: o Zoom link: https://zoom.us/j/342730236 o Dialing in from phone: o Dial(for higher quality, dial a number based on your current location): US: +1 669 900 6833 or +1 646 876 9923 o Meeting ID: 342 730 236 o International numbers available: https://zoom.us/u/ed95sU7aQ . Meeting Agenda and Minutes: o https://etherpad.openstack.org/p/stx-distro-other _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss(a)lists.starlingx.io<mailto:Starlingx-discuss@lists.starlingx.io> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss

1 0

[Starlingx-discuss] [ Test ] meeting agenda for 10/22
by Cabrales, Ada 22 Oct '19

22 Oct '19

Agenda for 10/22 1. Sanity status Unified sanity On track for 10/28? 2. stx.3.0 testing updates Feature testing Tracker - https://docs.google.com/spreadsheets/d/1n9P7as4iqO55DytIRuIGdyc7x0n2WM_q-cM… Distributed cloud - Yang Backup and restore - Yang Fault Containerization - Fer Upversion to train - JC GPU for K8 - Richo QAT for K8 - Richo Redfish - Cristopher Infra & Cluster monitoring - Yang Regression testing: Tracker - https://docs.google.com/spreadsheets/d/1X085xI96M6PIeum87w6IEF11G-TG-W1OeGu… 3. Opens

1 0

[Starlingx-discuss] CENGN Build failures caused by new mock version 1.4.20
by Penney, Don 21 Oct '19

21 Oct '19

Hi folks, A new version of mock, 1.4.20, was recently released, and is getting picked up by the build container setup: https://opendev.org/starlingx/tools/src/branch/master/Dockerfile#L71 Unfortunately, our build tools are using a deprecated tool mockchain, which has now been dropped in this new mock-1.4.20, replaced with 'mock --chain'. This is causing the CENGN builds to fail. As a workaround, I'm trying to force the CENGN build to use mock-1.4.19. If this is successful, we could update the Dockerfile with this short-term workaround to unblock developers using a build container. The long-term solution, of course, would be to update the build tools to use 'mock --chain'. Cheers, Don. Don Penney, Developer, Wind River

1 2

[Starlingx-discuss] Distro.openstack Oct 22 meeting Agenda
by Jones, Bruce E 21 Oct '19

21 Oct '19

* Update on upgrade to Train * Need a volunteer for a small change to the governance repo * Defect review https://bugs.launchpad.net/starlingx/+bugs?field.tag=stx.distro.openstack

1 0

[Starlingx-discuss] [build-report] STX_build_master_master - Build # 290 - Still Failing!
by build.starlingx＠gmail.com 21 Oct '19

21 Oct '19

Project: STX_build_master_master Build #: 290 Status: Still Failing Timestamp: 20191021T142954Z Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191021T14… -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: true

1 0

[Starlingx-discuss] [build-report] STX_BUILD_container_setup - Build # 502 - Still Failing!
by build.starlingx＠gmail.com 21 Oct '19

21 Oct '19

Project: STX_BUILD_container_setup Build #: 502 Status: Still Failing Timestamp: 20191021T143006Z Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191021T14… -------------------------------------------------------------------------------- Parameters PROJECT: master MY_WORKSPACE: /localdisk/loadbuild/jenkins/master/20191021T142954Z DOCKER_BUILD_ID: jenkins-master-20191021T142954Z-builder PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191021T14… DOCKER_BUILD_TAG: master-20191021T142954Z-builder-image PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/20191021T142954Z/logs MY_REPO_ROOT: /localdisk/designer/jenkins/master

1 0

[Starlingx-discuss] [build-report] STX_build_master_master - Build # 289 - Still Failing!
by build.starlingx＠gmail.com 21 Oct '19

21 Oct '19

Project: STX_build_master_master Build #: 289 Status: Still Failing Timestamp: 20191021T140817Z Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191021T14… -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: true

1 0

[Starlingx-discuss] [build-report] STX_BUILD_container_setup - Build # 501 - Failure!
by build.starlingx＠gmail.com 21 Oct '19

21 Oct '19

Project: STX_BUILD_container_setup Build #: 501 Status: Failure Timestamp: 20191021T140855Z Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191021T14… -------------------------------------------------------------------------------- Parameters PROJECT: master MY_WORKSPACE: /localdisk/loadbuild/jenkins/master/20191021T140817Z DOCKER_BUILD_ID: jenkins-master-20191021T140817Z-builder PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191021T14… DOCKER_BUILD_TAG: master-20191021T140817Z-builder-image PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/20191021T140817Z/logs MY_REPO_ROOT: /localdisk/designer/jenkins/master

1 0

[Starlingx-discuss] STX loads between Friday and this morning will likely fail ansible bootstrap
by Bailey, Henry Albert (Al) 21 Oct '19

21 Oct '19

A submission was merged on Friday which broke ansible bootstrap in some environments. Any loads with code synchronized since Friday will likely fail with an error during ansible in the "Saving config in sysinv database" phase. The failures are related to retry on failure, so if an environment does not encounter the failure, it will not retry, and may actually work. It has been reverted, here is the revert (which looks like it is merging now) https://review.opendev.org/#/c/689600/ Al

1 0

[Starlingx-discuss] [build-report] STX_build_lst_audit - Build # 158 - Still Failing!
by build.starlingx＠gmail.com 21 Oct '19

21 Oct '19

Project: STX_build_lst_audit Build #: 158 Status: Still Failing Timestamp: 20191020T232742Z Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191020T23… -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master/20191020T230000Z DOCKER_BUILD_ID: jenkins-master-20191020T230000Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20191020T23… PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/20191020T230000Z/logs MASTER_JOB_NAME: STX_build_master_master MY_REPO_ROOT: /localdisk/designer/jenkins/master PUBLISH_DISTRO_BASE: /export/mirror/starlingx/master/centos

1 0