From austin.sun at intel.com Mon Mar 1 07:33:05 2021 From: austin.sun at intel.com (Sun, Austin) Date: Mon, 1 Mar 2021 07:33:05 +0000 Subject: [Starlingx-discuss] Agenda StarlingX Distro-OpenStack: Bi-weekly Project Meeting -- 03/02 Message-ID: Hi All: As planned , we will have openstack distro meeting from tomorrow (03/02). The topic will be : - Bugs review https://bugs.launchpad.net/starlingx/+bugs?field.tag=stx.distro.openstack -stx 6.0 feature discuss If any new feature needed, please add to topic https://etherpad.opendev.org/p/stx-distro-openstack-meetings Thanks. BR Austin Sun. -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Mon Mar 1 12:47:18 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Mon, 1 Mar 2021 12:47:18 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210227T023307Z Message-ID: Sanity Test from 2021-February-27 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210227T023307Z/outputs/iso/ ) Status: RED Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210227T023307Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Defect opened: https://bugs.launchpad.net/starlingx/+bug/1917308 . All tests which needs openstack fails after that sequence. Regards, STX Validation Team [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Ghada.Khalil at windriver.com Mon Mar 1 14:27:00 2021 From: Ghada.Khalil at windriver.com (Khalil, Ghada) Date: Mon, 1 Mar 2021 14:27:00 +0000 Subject: [Starlingx-discuss] Minutes: StarlingX Release Meeting - Feb 24/2020 Message-ID: Agenda/Minutes are posted at: https://etherpad.openstack.org/p/stx-releases stx.5.0 - Milestone-3 Progress - Milestone-3 / Feature Test: 3/1/2021 - Good progress on features wrt to code merges and feature testing. - Agreed to declare the milestone next week - Exceptions are noted in the feature status spreadsheet - Feature Status - https://docs.google.com/spreadsheets/d/1JbOQELqXG_GDoP1jo6YoRDytpTkJEs89TVimzvrqc_A/edit#gid=1107209846 - Feature Test - https://docs.google.com/spreadsheets/d/1jro4ItdSobB0-fseK_4cOZJHhUyuh_eCBBsDOp_A5Pc/edit#gid=968103774 - Regression Test - Started this week, but going slowly as feature testing is finishing off From build.starlingx at gmail.com Mon Mar 1 15:51:54 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Mon, 1 Mar 2021 10:51:54 -0500 (EST) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer_layered - Build # 1298 - Failure! Message-ID: <2050696029.19.1614613915581.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer_layered Build #: 1298 Status: Failure Timestamp: 20210301T154434Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210301T152754Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-flock/20210301T152754Z DOCKER_BUILD_ID: jenkins-master-flock-20210301T152754Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master-flock/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210301T152754Z/logs BUILD_IMG: true FULL_BUILD: false PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/flock/20210301T152754Z/logs MASTER_JOB_NAME: STX_build_layer_flock_master_master LAYER: flock MY_REPO_ROOT: /localdisk/designer/jenkins/master-flock BUILD_ISO: true From build.starlingx at gmail.com Mon Mar 1 15:51:57 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Mon, 1 Mar 2021 10:51:57 -0500 (EST) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 410 - Failure! Message-ID: <122829671.22.1614613917888.JavaMail.javamailuser@localhost> Project: STX_build_layer_flock_master_master Build #: 410 Status: Failure Timestamp: 20210301T152754Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210301T152754Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From scott.little at windriver.com Mon Mar 1 16:23:43 2021 From: scott.little at windriver.com (Scott Little) Date: Mon, 1 Mar 2021 11:23:43 -0500 Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 410 - Failure! In-Reply-To: <122829671.22.1614613917888.JavaMail.javamailuser@localhost> References: <122829671.22.1614613917888.JavaMail.javamailuser@localhost> Message-ID: <48bad648-7f2c-4baa-0dda-32155d8ec556@windriver.com> Raised a launchpad to cover this build failure ... https://bugs.launchpad.net/starlingx/+bug/1917330 I have also posted a reversion of the offending commit for review https://review.opendev.org/c/starlingx/SDO-rv-service/+/778026 Scott On 2021-03-01 10:51 a.m., build.starlingx at gmail.com wrote: > [Please note: This e-mail is from an EXTERNAL e-mail address] > > Project: STX_build_layer_flock_master_master > Build #: 410 > Status: Failure > Timestamp: 20210301T152754Z > Branch: master > > Check logs at: > http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210301T152754Z/logs > -------------------------------------------------------------------------------- > Parameters > > FULL_BUILD: false > FORCE_BUILD: false > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From kennelson11 at gmail.com Mon Mar 1 17:45:21 2021 From: kennelson11 at gmail.com (Kendall Nelson) Date: Mon, 1 Mar 2021 09:45:21 -0800 Subject: [Starlingx-discuss] [all] April 2021 PTG Dates & Registration Message-ID: Hello Everyone! I'm sure you all have been anxiously awaiting the announcement of the dates for the next virtual PTG[1]! The PTG will take place April 19-23, 2021! PTG registration is now open[2]. Like last time, it is free, but we will again be using it to communicate details about the event (schedules, passwords, etc), so please take two minutes to register! Early next week we will send out info to mailing lists about signing up teams. Also, the same as last time, we will have an ethercalc signup and a survey to gather some other data about your team. Can't wait to see you all there! -the Kendalls (diablo_rojo & wendallkaters) [1] https://www.openstack.org/ptg/ [2] https://april2021-ptg.eventbrite.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From Saul.Wold at windriver.com Mon Mar 1 18:11:13 2021 From: Saul.Wold at windriver.com (Saul Wold) Date: Mon, 1 Mar 2021 10:11:13 -0800 Subject: [Starlingx-discuss] Merging Multi-OS & Distro Meeting In-Reply-To: <8f7e3f50-15a9-3b18-95ea-cebcfd536cd9@windriver.com> References: <8f7e3f50-15a9-3b18-95ea-cebcfd536cd9@windriver.com> Message-ID: <53bad2b6-8a25-e6ba-04ee-324072ec4c86@windriver.com> I have not heard any negative on this idea and confirmed with Ildiko on the meeting slot. New meeting planned for Wednesday 1430 UTC / 0630 PT / 2230 China this week and it will move to 1330 UTC / 0630 PT / 2130 China on the 17th when the NA "springs forward". Sau! On 2/23/21 1:43 PM, Saul Wold wrote: > > Folks, > > I would like to try and reduce our meeting load by one and ideally at a > more reasonable time.  I would like to propose using the Wed @ 1430 UTC > (0630 PT / 2230 China) when Canada/US "spring forward" on March 14th the > China time will move to 2130. So there will be 1 late meeting and then > shift. > > Please respond if are part of either of these teams and this time does > not work.  Another option would be the current Multi-OS time slot on > Tuesday at 1530 UTC, but that would mean a 2330 China time shifting > after the 14th to 2230. > > Ildiko, can you confirm that the Wed @ 1430 is available every other > week opposite the Release Team meeting (so staring March 4th). > > Thanks -- Sau! From build.starlingx at gmail.com Tue Mar 2 01:15:32 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Mon, 1 Mar 2021 20:15:32 -0500 (EST) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer_layered - Build # 1301 - Failure! Message-ID: <1519388295.26.1614647736207.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer_layered Build #: 1301 Status: Failure Timestamp: 20210302T010728Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210302T000319Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-flock/20210302T000319Z DOCKER_BUILD_ID: jenkins-master-flock-20210302T000319Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master-flock/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210302T000319Z/logs BUILD_IMG: true FULL_BUILD: false PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/flock/20210302T000319Z/logs MASTER_JOB_NAME: STX_build_layer_flock_master_master LAYER: flock MY_REPO_ROOT: /localdisk/designer/jenkins/master-flock BUILD_ISO: true From build.starlingx at gmail.com Tue Mar 2 01:15:37 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Mon, 1 Mar 2021 20:15:37 -0500 (EST) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 411 - Still Failing! In-Reply-To: <1043295993.20.1614613916237.JavaMail.javamailuser@localhost> References: <1043295993.20.1614613916237.JavaMail.javamailuser@localhost> Message-ID: <820687557.29.1614647738391.JavaMail.javamailuser@localhost> Project: STX_build_layer_flock_master_master Build #: 411 Status: Still Failing Timestamp: 20210302T000319Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210302T000319Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From Venkata.Veldanda at radisys.com Tue Mar 2 05:55:19 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Tue, 2 Mar 2021 05:55:19 +0000 Subject: [Starlingx-discuss] starlingx: unable to delete images from local registry In-Reply-To: References: Message-ID: + Hi Folks - any thoughts about the below issue? From: Venkata Ramana Veldanda Sent: Tuesday, February 23, 2021 9:23 PM To: starlingx-discuss at lists.starlingx.io Subject: starlingx: unable to delete images from local registry Hi, We are using STX4.0 We have been trying to delete the images from the registry and it doesn't appear to be deleting. The "registry-image-delete" returns success but couldn't figure what is going wrong. Are there corresponding logs where the delete progress can be checked? Also, is there a workaround to delete them? controller-0:/home/sysadmin# source /etc/platform/openrc [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list --nowrap +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# system registry-image-delete vdu/du-testmac:v1 Image vdu/du-testmac:v1 deleted, please run garbage collect to free disk space. [root at controller-0 sysadmin(keystone_admin)]# system registry-image-delete vdu/du-l1:v1 Image vdu/du-l1:v1 deleted, please run garbage collect to free disk space. [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list --nowrap +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system registry-image-delete vdu/dul1:v1 Image vdu/dul1:v1 deleted, please run garbage collect to free disk space. [root at controller-0 sysadmin(keystone_admin)]# system registry-garbage-collect Running docker registry garbage collect [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list --nowrap +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system registry-image-tags vdu/dul1 [root at controller-0 sysadmin(keystone_admin)]# system registry-image-tags vdu/du-testmac [root at controller-0 sysadmin(keystone_admin)]# system registry-image-tags vdu/du-l1 [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# -------------- next part -------------- An HTML attachment was scrubbed... URL: From Greg.Waines at windriver.com Tue Mar 2 13:11:05 2021 From: Greg.Waines at windriver.com (Waines, Greg) Date: Tue, 2 Mar 2021 13:11:05 +0000 Subject: [Starlingx-discuss] starlingx: unable to delete images from local registry In-Reply-To: References: Message-ID: <71E63BAE-EC01-4E8A-8349-3A9E8F948641@windriver.com> ( cc’d jerry sun ... he may know ) Although the image did not get removed from the list, you notice that the image no longer has any tags (versions). This has come up before ... I think this is just odd behaviour of the docker registry that it maintains the knowledge of the image even if it no longer has any tags/versions. Jerry ? Greg. From: Venkata Ramana Veldanda Date: Tuesday, March 2, 2021 at 12:58 AM To: "starlingx-discuss at lists.starlingx.io" Cc: Srinivas Sadagopan Subject: Re: [Starlingx-discuss] starlingx: unable to delete images from local registry [Please note: This e-mail is from an EXTERNAL e-mail address] + Hi Folks – any thoughts about the below issue? From: Venkata Ramana Veldanda Sent: Tuesday, February 23, 2021 9:23 PM To: starlingx-discuss at lists.starlingx.io Subject: starlingx: unable to delete images from local registry Hi, We are using STX4.0 We have been trying to delete the images from the registry and it doesn’t appear to be deleting. The “registry-image-delete” returns success but couldn’t figure what is going wrong. Are there corresponding logs where the delete progress can be checked? Also, is there a workaround to delete them? controller-0:/home/sysadmin# source /etc/platform/openrc [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list --nowrap +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# system registry-image-delete vdu/du-testmac:v1 Image vdu/du-testmac:v1 deleted, please run garbage collect to free disk space. [root at controller-0 sysadmin(keystone_admin)]# system registry-image-delete vdu/du-l1:v1 Image vdu/du-l1:v1 deleted, please run garbage collect to free disk space. [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list --nowrap +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system registry-image-delete vdu/dul1:v1 Image vdu/dul1:v1 deleted, please run garbage collect to free disk space. [root at controller-0 sysadmin(keystone_admin)]# system registry-garbage-collect Running docker registry garbage collect [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list --nowrap +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system registry-image-tags vdu/dul1 [root at controller-0 sysadmin(keystone_admin)]# system registry-image-tags vdu/du-testmac [root at controller-0 sysadmin(keystone_admin)]# system registry-image-tags vdu/du-l1 [root at controller-0 sysadmin(keystone_admin)]# system registry-image-list +----------------------------------------------------------------+ | Image Name | +----------------------------------------------------------------+ | docker.io/nfvpe/multus | | docker.io/starlingx/k8s-cni-sriov | | docker.io/starlingx/k8s-plugins-sriov-network-device | | docker.io/starlingx/n3000-opae | | gcr.io/kubernetes-helm/tiller | | k8s.gcr.io/coredns | | k8s.gcr.io/defaultbackend | | k8s.gcr.io/etcd | | k8s.gcr.io/kube-apiserver | | k8s.gcr.io/kube-controller-manager | | k8s.gcr.io/kube-proxy | | k8s.gcr.io/kube-scheduler | | k8s.gcr.io/pause | | quay.io/airshipit/armada | | quay.io/calico/cni | | quay.io/calico/kube-controllers | | quay.io/calico/node | | quay.io/calico/pod2daemon-flexvol | | quay.io/jetstack/cert-manager-acmesolver | | quay.io/jetstack/cert-manager-cainjector | | quay.io/jetstack/cert-manager-controller | | quay.io/jetstack/cert-manager-webhook | | quay.io/k8scsi/snapshot-controller | | quay.io/kubernetes-ingress-controller/nginx-ingress-controller | | quay.io/stackanetes/kubernetes-entrypoint | | vdu/du-l1 | | vdu/du-testmac | | vdu/dul1 | +----------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# -------------- next part -------------- An HTML attachment was scrubbed... URL: From scott.little at windriver.com Tue Mar 2 16:01:34 2021 From: scott.little at windriver.com (Scott Little) Date: Tue, 2 Mar 2021 11:01:34 -0500 Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 411 - Still Failing! In-Reply-To: <820687557.29.1614647738391.JavaMail.javamailuser@localhost> References: <1043295993.20.1614613916237.JavaMail.javamailuser@localhost> <820687557.29.1614647738391.JavaMail.javamailuser@localhost> Message-ID: <4ae81bce-8146-87c0-b02d-2a77e080a208@windriver.com> Same failure as the #410 build.  The revert didn't merge in time for this build. The revert has now merged, and I've launched a manual build to confirm we have it fixed. Scott On 2021-03-01 8:15 p.m., build.starlingx at gmail.com wrote: > [Please note: This e-mail is from an EXTERNAL e-mail address] > > Project: STX_build_layer_flock_master_master > Build #: 411 > Status: Still Failing > Timestamp: 20210302T000319Z > Branch: master > > Check logs at: > http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210302T000319Z/logs > -------------------------------------------------------------------------------- > Parameters > > FULL_BUILD: false > FORCE_BUILD: false > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From Bill.Zvonar at windriver.com Tue Mar 2 17:13:57 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Tue, 2 Mar 2021 17:13:57 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 3, 2021) Message-ID: Hi all, reminder of the weekly TSC/Community calls coming up tomorrow. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210303T1500 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From openinfradn at gmail.com Wed Mar 3 01:17:10 2021 From: openinfradn at gmail.com (open infra) Date: Wed, 3 Mar 2021 06:47:10 +0530 Subject: [Starlingx-discuss] STX supported/recommended hardware In-Reply-To: References: Message-ID: On Tue, Feb 23, 2021 at 10:08 PM Jones, Bruce E wrote: > > Is there such minimum spec for NICs to achieve better performance (low > latency/less packet loss)? > > > > No, not really. We have this [1] but that is more about network setup > than NIC requirements. For small clusters 1g NICs should be fine but 10g > might be needed for larger clusters or network intensive workloads. > > > > StarlingX supports DPDK and Time Sensitive Networking, both of which > significantly reduce packet latency. > Thank you, Bruce! > > Brucej > > > > [1] > https://docs.starlingx.io/planning/kubernetes/network-requirements.html > > > > *From:* open infra > *Sent:* Tuesday, February 23, 2021 1:24 AM > *To:* Jones, Bruce E > *Cc:* starlingx-discuss at lists.starlingx.io > *Subject:* Re: [Starlingx-discuss] STX supported/recommended hardware > > > > Hi Bruce, > > > > On Tue, Feb 23, 2021 at 12:54 AM Jones, Bruce E > wrote: > > Hi Danishka. The StarlingX project documents hardware requirements in the > installation guides. For instance this doc [1] describes the min hardware > requirements for the Standard with Dedicated Storage configuration. > > > > Most testing of StarlingX occurs outside of community resources. My > company has a test lab consisting of a range of systems that we use for > testing. In general the software supports the amd64 architecture and I > would recommend Xeon-D series processors or the equivalent as a minimum for > controller and worker nodes. > > > > Is there such minimum spec for NICs to achieve better performance (low > latency/less packet loss)? > > > > It’s really your budget and your workload requirements that determine how > much capacity you need. You can see this link [2] for more info on > planning a deployment. > > > > brucej > > > > [1] > https://docs.starlingx.io/deploy_install_guides/r4_release/bare_metal/dedicated_storage_hardware.html > > [2] https://docs.starlingx.io/planning/index.html > > > > *From:* open infra > *Sent:* Monday, February 22, 2021 9:43 AM > *To:* starlingx-discuss at lists.starlingx.io > *Subject:* [Starlingx-discuss] STX supported/recommended hardware > > > > Hi, > > > > Is there a recommended hardware list or a list of tested (by community) > hardware? > > > > Regards, > > Danishka > > > > > > Regards, > > Danishka > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Wed Mar 3 12:14:16 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Wed, 3 Mar 2021 12:14:16 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210302T141852Z Message-ID: Sanity Test from 2021-March-02 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210302T141852Z/outputs/iso/ ) Status: RED Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210302T141852Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Defects opened: https://bugs.launchpad.net/starlingx/+bug/1917615 - Stx-openstack apply-fail during provisioning https://bugs.launchpad.net/starlingx/+bug/1917308 - Stx-openstack apply-fail after swact standby controller, lock, unlock standby controller All tests which needs openstack fails after that sequence. Regards, STX Validation Team [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Saul.Wold at windriver.com Wed Mar 3 14:05:36 2021 From: Saul.Wold at windriver.com (Wold, Saul) Date: Wed, 3 Mar 2021 14:05:36 +0000 Subject: [Starlingx-discuss] Weekly StarlingX non-OpenStack distro meeting Message-ID: Hi All: Update new series Next Meeting will be planned on Dec 23 (last of the year). * Cadence and time slot: * Bi-Weekly Wednesday 9AM EDT (2200 China time, US PDT time 6AM) * Call Details: * Zoom link: https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 * Dialing in from phone: * Dial(for higher quality, dial a number based on your current location): US: +1 669 900 6833 or +1 646 876 9923 * Meeting ID: 342 730 236 * Passcode: 419405 * International numbers available: https://zoom.us/u/ed95sU7aQ * Meeting Agenda and Minutes: * https://etherpad.openstack.org/p/stx-distro-other Sau! -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 6936 bytes Desc: not available URL: From Saul.Wold at windriver.com Wed Mar 3 14:05:37 2021 From: Saul.Wold at windriver.com (Wold, Saul) Date: Wed, 3 Mar 2021 14:05:37 +0000 Subject: [Starlingx-discuss] Weekly StarlingX OS Distro & Multi-OS meeting Message-ID: Hi All: Changed Meeting time to 1430 UTC & Merged MultiOS Meeting * Cadence and time slot: * Bi-Weekly Wednesday 0930 EDT (1430 UTC, 2230 China time, 0630 PT time) * Call Details: * Zoom link: https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 * Dialing in from phone: * Dial(for higher quality, dial a number based on your current location): US: +1 669 900 6833 or +1 646 876 9923 * Meeting ID: 342 730 236 * Passcode: 419405 * International numbers available: https://zoom.us/u/ed95sU7aQ * Meeting Agenda and Minutes: * https://etherpad.openstack.org/p/stx-distro-other Sau! -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 7448 bytes Desc: not available URL: From bruce.e.jones at intel.com Wed Mar 3 15:43:45 2021 From: bruce.e.jones at intel.com (Jones, Bruce E) Date: Wed, 3 Mar 2021 15:43:45 +0000 Subject: [Starlingx-discuss] TSC and community call notes for 3 Mar 2021 Message-ID: TSC call * No topics. Community Call Mar 3 * Standing Topics * Build/Sanity * Builds are working again after two build-breaking issues were reverted. * Sanity tests are in progress. Yesterday's report was Red due to a new defect - stx-openstack failed at the provisioning step. * https://bugs.launchpad.net/starlingx/+bug/1917615 * https://bugs.launchpad.net/starlingx/+bug/1917308 * Suspected commit identified: https://review.opendev.org/c/starlingx/config/+/773451 * Ghada pinged Frank Miller for his team to follow up * Gerrit Reviews in Need of Attention * Nothing this week * Topics for this Week * Starting the planning for STX 6.0 - looking for ideas, suggestions, etc... for new features * PTG is the week of April 19th (week after OpenStack Victoria release) - we should come into those sessions with a candidate feature list * Support for GPUs in OpenStack - might already there for PCI passthrough. Nova and Cyborg are working on improvements. Cyborg is not currently part of StarlingX. * ARs from Previous Meetings * None * Open Requests for Help * [HSC] * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-February/010929.html * Is there any plan to support Centos 8 in upcoming Releases? No, we do not plan to support CentOS 8 * Also since Centos 8 EOL is 2021, is there any plan to support any alternate OS? Work is in progress to build a plan for support of an alternative OS. The work is coordinated through the OS/Multi-OS meeting (every other Wed at 6:30AM PST). * [sanath kumar] * https://drive.google.com/file/d/1phZPTh3IlpoqRLJQJTJA2puJxTtHWai_/view?usp=sharing * On the context to above link, why is controller- 0 allocated with only 20GB out of 2.2TB? Is there any way by which we can increase the memory allocated to controller-0? * We reviewed some screen shots on line. Sanath please post the screenshots you shared with the community on the mailing list and community - please help! * Build Matters (if required) -------------- next part -------------- An HTML attachment was scrubbed... URL: From Venkata.Veldanda at radisys.com Wed Mar 3 16:05:43 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Wed, 3 Mar 2021 16:05:43 +0000 Subject: [Starlingx-discuss] How to load SCTP module persistently Message-ID: Hi, We are integrating our 5G Flexran solution on Starlingx and We are using Stx 4.0.1 ISO in AIO-SX mode. We found that SCTP kernel module not available in stx 4.0.1 ISO, what is the way to persistently install SCTP module ? [root at controller-0 sysadmin(keystone_admin)]# cat /etc/build.info ### ### StarlingX ### Release 20.06 ### OS="centos" SW_VERSION="20.06" BUILD_TARGET="Host Installer" BUILD_TYPE="Formal" BUILD_ID="r/stx.4.0" JOB="STX_4.0_build_layer_flock" BUILD_BY="starlingx.build at cengn.ca" BUILD_NUMBER="22" BUILD_HOST="starlingx_mirror" BUILD_DATE="2020-08-05 12:25:52 +0000" FLOCK_OS="centos" FLOCK_JOB="STX_4.0_build_layer_flock" FLOCK_BUILD_BY="starlingx.build at cengn.ca" FLOCK_BUILD_NUMBER="22" FLOCK_BUILD_HOST="starlingx_mirror" FLOCK_BUILD_DATE="2020-08-05 12:25:52 +0000" 1. As per discussion and resolution in "https://bugs.launchpad.net/starlingx/+bug/1894171", it seems that SCTP kernel module is not part of stx 4.0.1 ISO. [root at controller-0 sysadmin(keystone_admin)]# modprobe sctp modprobe: FATAL: Module sctp not found. We then manually downloaded this rpm: "http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/distro/outputs/RPMS/rt/kernel-rt-modules-extra-4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64.rpm. And after installing this (rpm -i kernel-rt-modules-extra-4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64.rpm), the "modprobe sctp" was successful However, on reboot the SCTP installation is not persistent, we have to again do rpm install. After manually installing "kernel-rt-modules-extra-4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64.rpm", what is the mechanism to persist SCTP kernel module across reboots.. Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From Venkata.Veldanda at radisys.com Wed Mar 3 16:20:19 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Wed, 3 Mar 2021 16:20:19 +0000 Subject: [Starlingx-discuss] stx 4.0.1 kubernetes sriov resources suddenly disappears Message-ID: Hi, We are using STX 4.0.1 to install our Flexran based 5G solution in AIO-SX mode . We had created VFs on the N3000 device and some of the NIC interfaces. These resources were reflected in the Kuberenets allocatable resources. During the course of using the system, the allocatable resources for N3000 and one of the NIC interface crad started coming up as 0. The following is a part of kubectl describe nodes output. The affected resources are intel.com/intel_fpga_fec, intel.com/pci_sriov_net_datanet_c, and intel.com/pci_sriov_net_datanet_u We already tried lock/unlock, delete and re-create the resources, but none of these help to recover the resources [root at controller-0 sysadmin(keystone_admin)]# cat /etc/build.info ### ### StarlingX ### Release 20.06 ### OS="centos" SW_VERSION="20.06" BUILD_TARGET="Host Installer" BUILD_TYPE="Formal" BUILD_ID="r/stx.4.0" JOB="STX_4.0_build_layer_flock" BUILD_BY="starlingx.build at cengn.ca" BUILD_NUMBER="22" BUILD_HOST="starlingx_mirror" BUILD_DATE="2020-08-05 12:25:52 +0000" FLOCK_OS="centos" FLOCK_JOB="STX_4.0_build_layer_flock" FLOCK_BUILD_BY="starlingx.build at cengn.ca" FLOCK_BUILD_NUMBER="22" FLOCK_BUILD_HOST="starlingx_mirror" FLOCK_BUILD_DATE="2020-08-05 12:25:52 +0000" Capacity: cpu: 96 ephemeral-storage: 10190100Ki hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 memory: 97436728Ki pods: 110 Allocatable: cpu: 92 ephemeral-storage: 9391196145 hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 It seems like everything is "OK" upto sriov device plugin because the sriov device plugin pod logs do show that the correct number of resources are getting updated towards kubernetes Here are some of the CLI outputs: [root at controller-0 sysadmin(keystone_admin)]# system host-device-show controller-0 pci_0000_1d_00_0 +-----------------------+---------------------------------------------------------------------------------------------------------+ | Property | Value | +-----------------------+---------------------------------------------------------------------------------------------------------+ | name | pci_0000_1d_00_0 | | address | 0000:1d:00.0 | | class id | 120000 | | vendor id | 8086 | | device id | 0d8f | | class name | Processing accelerators | | vendor name | Intel Corporation | | device name | Device 0d8f | | numa_node | 0 | | enabled | True | | sriov_totalvfs | 8 | | sriov_numvfs | 8 | | sriov_vfs_pci_address | 0000:1d:00.1,0000:1d:00.2,0000:1d:00.3,0000:1d:00.4,0000:1d:00.5,0000:1d:00.6,0000:1d:00.7,0000:1d:01.0 | | sriov_vf_pdevice_id | 0d90 | | extra_info | | | created_at | 2021-03-03T13:46:26.363470+00:00 | | updated_at | 2021-03-03T13:47:12.684827+00:00 | | root_key | None | | revoked_key_ids | None | | boot_page | None | | bitstream_id | None | | bmc_build_version | None | | bmc_fw_version | None | | driver | igb_uio | | sriov_vf_driver | igb_uio | +-----------------------+---------------------------------------------------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system host-if-show controller-0 sriovfh1 +-----------------+--------------------------------------+ | Property | Value | +-----------------+--------------------------------------+ | ifname | sriovfh1 | | iftype | ethernet | | ports | [u'enp177s0f3'] | | imac | 40:a6:b7:34:e4:a3 | | imtu | 9216 | | ifclass | pci-sriov | | ptp_role | none | | aemode | None | | schedpolicy | None | | txhashpolicy | None | | uuid | 6f30a690-2414-424f-b5fc-d324d63cc502 | | ihost_uuid | 8075e0db-4cc5-4d74-8601-849adce97b7e | | vlan_id | None | | uses | [] | | used_by | [] | | created_at | | | updated_at | | | sriov_numvfs | 16 | | sriov_vf_driver | vfio | | accelerated | [True] | +-----------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-list controller-0 +--------------+--------------------------------------+----------+------------------+ | hostname | uuid | ifname | datanetwork_name | +--------------+--------------------------------------+----------+------------------+ | controller-0 | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | sriovfh1 | datanet-c | | controller-0 | 6aff29d7-cfaf-48b4-9802-b17b8a025efc | sriovdn1 | datanetdn1 | | controller-0 | 76a2da50-11a6-408e-90b3-3a316cef6557 | sriovmh1 | datanetmh1 | | controller-0 | e155e1d0-8dec-47e6-ac60-076832698a95 | sriovfh1 | datanet-u | | controller-0 | e569db46-a31b-4b8f-b7ca-175b1168798f | sriovbh1 | datanetbh1 | +--------------+--------------------------------------+----------+------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-show datanet-c controller-0 datanet-ccontroller-0 datanet-c datanet-clist controller-0 +--------------+--------------------------------------+----------+------------------+ | hostname | uuid | ifname | datanetwork_name | +--------------+--------------------------------------+----------+------------------+ | controller-0 | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | sriovfh1 | datanet-c | | controller-0 | 6aff29d7-cfaf-48b4-9802-b17b8a025efc | sriovdn1 | datanetdn1 | | controller-0 | 76a2da50-11a6-408e-90b3-3a316cef6557 | sriovmh1 | datanetmh1 | | controller-0 | e155e1d0-8dec-47e6-ac60-076832698a95 | sriovfh1 | datanet-u | | controller-0 | e569db46-a31b-4b8f-b7ca-175b1168798f | sriovbh1 | datanetbh1 | +--------------+--------------------------------------+----------+------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-list controller-0show 63a44e7b-18f4-4f9b-8504-a950cb8abb86 +------------------+--------------------------------------+ | Property | Value | +------------------+--------------------------------------+ | hostname | controller-0 | | uuid | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | | ifname | sriovfh1 | | datanetwork_name | datanet-c | +------------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-show 63a44e7b-18f4-4f9b-8504-a950cb8abb86e155e1d0-8dec-47e6-ac60-076832698a95 +------------------+--------------------------------------+ | Property | Value | +------------------+--------------------------------------+ | hostname | controller-0 | | uuid | e155e1d0-8dec-47e6-ac60-076832698a95 | | ifname | sriovfh1 | | datanetwork_name | datanet-u | +------------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# sriov device plugin logs: ===================================================================================== controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep intel_fpga_fec "resourceName": "intel_fpga_fec", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275709 138581 manager.go:193] validating resource name "intel.com/intel_fpga_fec" I0303 13:47:07.450400 138581 manager.go:116] Creating new ResourcePool: intel_fpga_fec I0303 13:47:07.450446 138581 manager.go:145] New resource server is created for intel_fpga_fec ResourcePool I0303 13:47:07.453772 138581 server.go:191] starting intel_fpga_fec device plugin endpoint at: intel.com_intel_fpga_fec.sock I0303 13:47:07.454032 138581 server.go:217] intel_fpga_fec device plugin endpoint started serving I0303 13:47:07.640208 138581 server.go:106] Plugin: intel.com_intel_fpga_fec.sock gets registered successfully at Kubelet I0303 13:47:07.640225 138581 server.go:131] ListAndWatch(intel_fpga_fec) invoked I0303 13:47:07.640342 138581 server.go:139] ListAndWatch(intel_fpga_fec): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:1d:01.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},},} controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep intel_fpga_fecpci_sriov_net_datanet_c "resourceName": "pci_sriov_net_datanet_c", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275645 138581 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanet_c" I0303 13:47:07.449979 138581 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanet_c I0303 13:47:07.450122 138581 manager.go:145] New resource server is created for pci_sriov_net_datanet_c ResourcePool I0303 13:47:07.450478 138581 server.go:191] starting pci_sriov_net_datanet_c device plugin endpoint at: intel.com_pci_sriov_net_datanet_c.sock I0303 13:47:07.451088 138581 server.go:217] pci_sriov_net_datanet_c device plugin endpoint started serving I0303 13:47:07.639929 138581 server.go:131] ListAndWatch(pci_sriov_net_datanet_c) invoked I0303 13:47:07.640068 138581 server.go:106] Plugin: intel.com_pci_sriov_net_datanet_c.sock gets registered successfully at Kubelet I0303 13:47:07.639996 138581 server.go:139] ListAndWatch(pci_sriov_net_datanet_c): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0f.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep pci_sriov_net_datanet_cu "resourceName": "pci_sriov_net_datanet_u", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275700 138581 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanet_u" I0303 13:47:07.450306 138581 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanet_u I0303 13:47:07.450388 138581 manager.go:145] New resource server is created for pci_sriov_net_datanet_u ResourcePool I0303 13:47:07.453443 138581 server.go:191] starting pci_sriov_net_datanet_u device plugin endpoint at: intel.com_pci_sriov_net_datanet_u.sock I0303 13:47:07.453750 138581 server.go:217] pci_sriov_net_datanet_u device plugin endpoint started serving I0303 13:47:07.639929 138581 server.go:131] ListAndWatch(pci_sriov_net_datanet_u) invoked I0303 13:47:07.639945 138581 server.go:139] ListAndWatch(pci_sriov_net_datanet_u): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0e.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} I0303 13:47:07.640791 138581 server.go:106] Plugin: intel.com_pci_sriov_net_datanet_u.sock gets registered successfully at Kubelet controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Wed Mar 3 21:51:11 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Wed, 3 Mar 2021 21:51:11 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210303T033720Z Message-ID: Sanity Test from 2021-March-03 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210303T033720Z/outputs/iso/ ) Status: RED Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210303T033720Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz This image is affected by: https://bugs.launchpad.net/starlingx/+bug/1917308 - Stx-openstack apply-fail after swact standby controller, lock, unlock standby controller All tests which needs openstack fails after that sequence. Regards, STX Validation Team [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From maryx.camp at intel.com Wed Mar 3 22:18:20 2021 From: maryx.camp at intel.com (Camp, MaryX) Date: Wed, 3 Mar 2021 22:18:20 +0000 Subject: [Starlingx-discuss] [docs] [meeting] Docs team notes 03-Mar-21 Message-ID: Hello all, Here are this week's docs team meeting minutes (short form). Details in [2]. Join us if you have interest in StarlingX docs! We meet on Wednesdays 12:30 PST.   [1]   Call logistics: https://wiki.openstack.org/wiki/Starlingx/Meetings   [2]   Tracking Etherpad: https://etherpad.openstack.org/p/stx-documentation thanks, Mary Camp ========== 03-Mar-21 All -- reviews merged since last meeting: 0 All -- bug status -- 17 total - team agrees to defer all low priority LP until the upstreaming effort is completed. Status/questions/opens Reminder to Greg that a couple reviews need final approval: SNMPv3 doc changes: https://review.opendev.org/c/starlingx/docs/+/773544 Security guide update: https://review.opendev.org/c/starlingx/docs/+/771288 Regarding the question from last week, PTP won't be upstreamed yet per Greg, it is not part of release 5.0. Closing the gap between August WRCP snapshot and the current upstream content. This will eliminate the double work that WR team is dealing with now. Rafael has submitted first review towards this: https://review.opendev.org/c/starlingx/docs/+/778528 Ron and Juanita will review first, then add other reviewers when it's ready for approval. Another person will be helping out also. After this, we will sort out the duplicated info (2nd priority). API documentation questions Engineer is making updates, this is a completely new repository (not starlingx/config like SNMP changes). https://review.opendev.org/c/starlingx/ptp-notification-armada-app/+/777850 Content is more than just APIs but also description and figures. First step is to set up the ptp repository to mimic starlingx/config with api-ref/source folder, py.conf, index.rst, etc. Ron seeing some issues with "mirror" of the STX upstream to be used as the baseline for WRCP docs. Scott joined meeting and made helpful suggestions for this issue. Version drop-down update - first review is submitted, mostly under the hood changes. https://review.opendev.org/c/starlingx/docs/+/778556 Mary will add reviewers. From haridhar.kalvala at intel.com Thu Mar 4 05:09:58 2021 From: haridhar.kalvala at intel.com (Kalvala, Haridhar) Date: Thu, 4 Mar 2021 05:09:58 +0000 Subject: [Starlingx-discuss] issue with customize horizon openstack dashboard Message-ID: Hi, With customize horizon openstack dashboard, I am facing login issue with following error. Do not find any other error log wither in horizon or keystone pods. The login id and password are correct. Any suggestion/support here will be useful. Regards, Haridhar Kalvala Error Log: 10.10.10.2 - - [04/Mar/2021:12:52:50 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:52:50 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:52:50 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8937 10.10.10.2 - - [04/Mar/2021:12:52:50 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8937 "http://172.16.192.115:80/" "kube-probe/1.18" 2021-03-04 12:52:52.232755 Login failed for user "admin" using domain "Default", remote address 10.10.10.2. 10.10.10.2 - - [04/Mar/2021:12:52:52 +0000] "POST /auth/login/ HTTP/1.1" 200 9047 10.10.10.2 - - [04/Mar/2021:12:52:52 +0000] "POST /auth/login/ HTTP/1.1" 200 9047 "http://10.10.10.2:31000/auth/login/?next=/" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:85.0) Gecko/20100101 Firefox/85.0" 2021-03-04 12:52:54.301786 /var/lib/openstack/lib/python3.6/site-packages/eventlet/patcher.py:1: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2021-03-04 12:52:54.301801 import imp 2021-03-04 12:52:54.603056 /var/lib/openstack/lib64/python3.6/site-packages/scss/namespace.py:172: DeprecationWarning: inspect.getargspec() is deprecated since Python 3.0, use inspect.signature() or inspect.getfullargspec() 2021-03-04 12:52:54.603069 argspec = inspect.getargspec(function) 10.10.10.2 - - [04/Mar/2021:12:52:52 +0000] "GET /i18n/js/horizon+openstack_dashboard/ HTTP/1.1" 200 3223 10.10.10.2 - - [04/Mar/2021:12:52:52 +0000] "GET /i18n/js/horizon+openstack_dashboard/ HTTP/1.1" 200 3223 "http://10.10.10.2:31000/auth/login/" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:85.0) Gecko/20100101 Firefox/85.0" 10.10.10.2 - - [04/Mar/2021:12:52:55 +0000] "GET /header/ HTTP/1.1" 200 112 10.10.10.2 - - [04/Mar/2021:12:52:55 +0000] "GET /header/ HTTP/1.1" 200 112 "http://10.10.10.2:31000/auth/login/" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:85.0) Gecko/20100101 Firefox/85.0" 10.10.10.2 - - [04/Mar/2021:12:53:00 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:00 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:00 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8946 10.10.10.2 - - [04/Mar/2021:12:53:00 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8946 "http://172.16.192.115:80/" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:10 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:10 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:10 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8940 10.10.10.2 - - [04/Mar/2021:12:53:10 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8940 "http://172.16.192.115:80/" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:20 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:20 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:20 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8946 10.10.10.2 - - [04/Mar/2021:12:53:20 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8946 "http://172.16.192.115:80/" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:30 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:30 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:30 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8937 10.10.10.2 - - [04/Mar/2021:12:53:30 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8937 "http://172.16.192.115:80/" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:40 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:40 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:40 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8938 10.10.10.2 - - [04/Mar/2021:12:53:40 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8938 "http://172.16.192.115:80/" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:49 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:49 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:49 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8940 10.10.10.2 - - [04/Mar/2021:12:53:49 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8940 "http://172.16.192.115:80/" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:50 +0000] "GET / HTTP/1.1" 302 - 10.10.10.2 - - [04/Mar/2021:12:53:50 +0000] "GET / HTTP/1.1" 302 - "-" "kube-probe/1.18" 10.10.10.2 - - [04/Mar/2021:12:53:50 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8942 10.10.10.2 - - [04/Mar/2021:12:53:50 +0000] "GET /auth/login/?next=/ HTTP/1.1" 200 8942 "http://172.16.192.115:80/" "kube-probe/1.18" -------------- next part -------------- An HTML attachment was scrubbed... URL: From Venkata.Veldanda at radisys.com Thu Mar 4 13:50:34 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Thu, 4 Mar 2021 13:50:34 +0000 Subject: [Starlingx-discuss] CPU Isolation discrepancy Message-ID: Hi I am running StarlingX 4.0 in Low Latency Mode in AIO-SX. We have isolated CPUs for application as below using the supported way. However, we can see that kubelet treads are scheduled on application isolated vcpus - Ex: 49, 50, 75. Could someone explain the behavior here?. Full log is attached. controller-0:/home/sysadmin# cat /proc/cmdline BOOT_IMAGE=/vmlinuz-4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64 root=UUID=837a0268-a574-45ea-b560-a6e5afc483dd ro security_profile=standard module_blacklist=integrity,ima audit=0 tboot=false crashkernel=auto biosdevname=0 console=tty0 iommu=pt usbcore.autosuspend=-1 selinux=0 enforcing=0 nmi_watchdog=0 softlockup_panic=0 intel_iommu=on user_namespace.enable=1 skew_tick=1 hugepagesz=1G hugepages=47 hugepagesz=2M hugepages=0 default_hugepagesz=1G irqaffinity=0,24,48,72 rcu_nocbs=1-23,25-47,49-71,73-95 nohz_full=1-23,25-47,49-71,73-95 isolcpus=1-22,25-46,49-70,73-94 kthread_cpus=0,24,48,72 nopti nospectre_v2 nospectre_v1 [root at controller-0 sysadmin(keystone_admin)]# pidstat -t -p 134731 Linux 4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64 (controller-0) 03/03/2021 _x86_64_(96 CPU) 01:26:28 AM 0 - 145642 0.00 0.00 0.00 0.00 50 |__kubelet 01:26:28 AM 0 - 145643 0.01 0.01 0.00 0.02 72 |__kubelet 01:26:28 AM 0 - 146196 0.05 0.03 0.00 0.08 24 |__kubelet 01:26:28 AM 0 - 147027 0.00 0.00 0.00 0.00 75 |__kubelet 01:26:28 AM 0 - 147028 0.00 0.00 0.00 0.00 49 |__kubelet system host-cpu-list controller-0 | 456f11f6-231f-4c6a-b9d9-fa35a6f6bff6 | 49 | 0 | 1 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated | | | | | | | @ 3.00GHz | | | | | | | | | | | d491dd29-8603-4bf1-8620-9fbdde5d5d38 | 50 | 0 | 2 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated | | 94bb8566-e726-418a-ae1f-3264807bfbcd | 75 | 1 | 3 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated | Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: cpu_info_log.txt URL: From Venkata.Veldanda at radisys.com Thu Mar 4 18:06:19 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Thu, 4 Mar 2021 18:06:19 +0000 Subject: [Starlingx-discuss] CPU Isolation discrepancy In-Reply-To: References: Message-ID: The reason I bring out this concern is even dockerd seem to be running on isolated cores. For some reason the scheduler seem to be completely ignoring isolcpus. Is that correct? The impact here is that we have certain 100% poll threads that needs to be scheduled on couple of CPUs and we do not have a clue on where to allocate because of this behaviour. Any comments are appreciated. [cid:image001.jpg at 01D7114F.2BCF1840] From: Venkata Ramana Veldanda Sent: Thursday, March 4, 2021 7:21 PM To: starlingx-discuss at lists.starlingx.io Cc: Srinivas Sadagopan Subject: CPU Isolation discrepancy Hi I am running StarlingX 4.0 in Low Latency Mode in AIO-SX. We have isolated CPUs for application as below using the supported way. However, we can see that kubelet treads are scheduled on application isolated vcpus - Ex: 49, 50, 75. Could someone explain the behavior here?. Full log is attached. controller-0:/home/sysadmin# cat /proc/cmdline BOOT_IMAGE=/vmlinuz-4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64 root=UUID=837a0268-a574-45ea-b560-a6e5afc483dd ro security_profile=standard module_blacklist=integrity,ima audit=0 tboot=false crashkernel=auto biosdevname=0 console=tty0 iommu=pt usbcore.autosuspend=-1 selinux=0 enforcing=0 nmi_watchdog=0 softlockup_panic=0 intel_iommu=on user_namespace.enable=1 skew_tick=1 hugepagesz=1G hugepages=47 hugepagesz=2M hugepages=0 default_hugepagesz=1G irqaffinity=0,24,48,72 rcu_nocbs=1-23,25-47,49-71,73-95 nohz_full=1-23,25-47,49-71,73-95 isolcpus=1-22,25-46,49-70,73-94 kthread_cpus=0,24,48,72 nopti nospectre_v2 nospectre_v1 [root at controller-0 sysadmin(keystone_admin)]# pidstat -t -p 134731 Linux 4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64 (controller-0) 03/03/2021 _x86_64_(96 CPU) 01:26:28 AM 0 - 145642 0.00 0.00 0.00 0.00 50 |__kubelet 01:26:28 AM 0 - 145643 0.01 0.01 0.00 0.02 72 |__kubelet 01:26:28 AM 0 - 146196 0.05 0.03 0.00 0.08 24 |__kubelet 01:26:28 AM 0 - 147027 0.00 0.00 0.00 0.00 75 |__kubelet 01:26:28 AM 0 - 147028 0.00 0.00 0.00 0.00 49 |__kubelet system host-cpu-list controller-0 | 456f11f6-231f-4c6a-b9d9-fa35a6f6bff6 | 49 | 0 | 1 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated | | | | | | | @ 3.00GHz | | | | | | | | | | | d491dd29-8603-4bf1-8620-9fbdde5d5d38 | 50 | 0 | 2 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated | | 94bb8566-e726-418a-ae1f-3264807bfbcd | 75 | 1 | 3 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated | Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 24047 bytes Desc: image001.jpg URL: From sinlam at hotmail.com Fri Mar 5 03:31:37 2021 From: sinlam at hotmail.com (Sin Lam Tan) Date: Fri, 5 Mar 2021 03:31:37 +0000 Subject: [Starlingx-discuss] Starlingx Kubernetes support Juju Charms? Message-ID: Dear all, I would like to integrate Open Source Mano (OSM) with Starlingx Kubernetes. When I use OSM command to add Kubernetes cluster in OSM host, osm k8scluster-add --creds ./kubeconfig --version '1.18.1' --vim openstack-starlingx --description "My K8s cluster" --k8s-nets '{"net1": "external_network"}' k8s-cluster It contains an error below: Failing init juju-bundle: b'ERROR ensuring k8s credential \"0a433ed8\" with RBAC setup: ensuring cluster role \"juju-credential-0a433ed8\" in namespace \"kube-system\": Get https://192.168.206.1:6443/apis/rbac.authorization.k8s.io/v1/clusterroles/juju-credential-0a433ed8: dial tcp 192.168.206.1:6443: i/o timeout\\n';Failing init helm-chart: Unable to connect to the server: dial tcp 192.168.206.1:6443: i/o timeout" My Starlingx with Kubernetes has IP 10.10.10.3, and my OSM host has IP 10.10.10.70. May I know if Starlingx Kubernetes contains Juju Charms support? Thanks for any information! Regards, Sin Lam -------------- next part -------------- An HTML attachment was scrubbed... URL: From Venkata.Veldanda at radisys.com Fri Mar 5 09:29:36 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Fri, 5 Mar 2021 09:29:36 +0000 Subject: [Starlingx-discuss] stx 4.0.1 kubernetes sriov resources suddenly disappears In-Reply-To: References: Message-ID: Adding more info to this question as this is becoming a bit show stopper for us. Any help is appreciated. Until SRIOV everything seems to be configured properly and they reflecting under /etc/pcidp/config.json When we compared the faulty resource intel_fpga_fec with another stable SRIOV resource 'pci_sriov_net_datanetmh1' the log doesn't show any issues nor it is different. However from kubelet perspective there seems to be something wrong and resources are not showing up in "kubectl describe nodes". Attached the log comparison. How do we dump the kubelet logs? The command 'journalctl -u kubelet' works on my CentOS Kubernetes but not on StarlingX [root at local ~]# journalctl -u kubelet -- No entries -- Also raised a launch pad bug with logs https://bugs.launchpad.net/starlingx/+bug/1917857 From: Venkata Ramana Veldanda Sent: Wednesday, March 3, 2021 9:50 PM To: starlingx-discuss at lists.starlingx.io Cc: Srinivas Sadagopan Subject: stx 4.0.1 kubernetes sriov resources suddenly disappears Hi, We are using STX 4.0.1 to install our Flexran based 5G solution in AIO-SX mode . We had created VFs on the N3000 device and some of the NIC interfaces. These resources were reflected in the Kuberenets allocatable resources. During the course of using the system, the allocatable resources for N3000 and one of the NIC interface crad started coming up as 0. The following is a part of kubectl describe nodes output. The affected resources are intel.com/intel_fpga_fec, intel.com/pci_sriov_net_datanet_c, and intel.com/pci_sriov_net_datanet_u We already tried lock/unlock, delete and re-create the resources, but none of these help to recover the resources [root at controller-0 sysadmin(keystone_admin)]# cat /etc/build.info ### ### StarlingX ### Release 20.06 ### OS="centos" SW_VERSION="20.06" BUILD_TARGET="Host Installer" BUILD_TYPE="Formal" BUILD_ID="r/stx.4.0" JOB="STX_4.0_build_layer_flock" BUILD_BY="starlingx.build at cengn.ca" BUILD_NUMBER="22" BUILD_HOST="starlingx_mirror" BUILD_DATE="2020-08-05 12:25:52 +0000" FLOCK_OS="centos" FLOCK_JOB="STX_4.0_build_layer_flock" FLOCK_BUILD_BY="starlingx.build at cengn.ca" FLOCK_BUILD_NUMBER="22" FLOCK_BUILD_HOST="starlingx_mirror" FLOCK_BUILD_DATE="2020-08-05 12:25:52 +0000" Capacity: cpu: 96 ephemeral-storage: 10190100Ki hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 memory: 97436728Ki pods: 110 Allocatable: cpu: 92 ephemeral-storage: 9391196145 hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 It seems like everything is "OK" upto sriov device plugin because the sriov device plugin pod logs do show that the correct number of resources are getting updated towards kubernetes Here are some of the CLI outputs: [root at controller-0 sysadmin(keystone_admin)]# system host-device-show controller-0 pci_0000_1d_00_0 +-----------------------+---------------------------------------------------------------------------------------------------------+ | Property | Value | +-----------------------+---------------------------------------------------------------------------------------------------------+ | name | pci_0000_1d_00_0 | | address | 0000:1d:00.0 | | class id | 120000 | | vendor id | 8086 | | device id | 0d8f | | class name | Processing accelerators | | vendor name | Intel Corporation | | device name | Device 0d8f | | numa_node | 0 | | enabled | True | | sriov_totalvfs | 8 | | sriov_numvfs | 8 | | sriov_vfs_pci_address | 0000:1d:00.1,0000:1d:00.2,0000:1d:00.3,0000:1d:00.4,0000:1d:00.5,0000:1d:00.6,0000:1d:00.7,0000:1d:01.0 | | sriov_vf_pdevice_id | 0d90 | | extra_info | | | created_at | 2021-03-03T13:46:26.363470+00:00 | | updated_at | 2021-03-03T13:47:12.684827+00:00 | | root_key | None | | revoked_key_ids | None | | boot_page | None | | bitstream_id | None | | bmc_build_version | None | | bmc_fw_version | None | | driver | igb_uio | | sriov_vf_driver | igb_uio | +-----------------------+---------------------------------------------------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system host-if-show controller-0 sriovfh1 +-----------------+--------------------------------------+ | Property | Value | +-----------------+--------------------------------------+ | ifname | sriovfh1 | | iftype | ethernet | | ports | [u'enp177s0f3'] | | imac | 40:a6:b7:34:e4:a3 | | imtu | 9216 | | ifclass | pci-sriov | | ptp_role | none | | aemode | None | | schedpolicy | None | | txhashpolicy | None | | uuid | 6f30a690-2414-424f-b5fc-d324d63cc502 | | ihost_uuid | 8075e0db-4cc5-4d74-8601-849adce97b7e | | vlan_id | None | | uses | [] | | used_by | [] | | created_at | | | updated_at | | | sriov_numvfs | 16 | | sriov_vf_driver | vfio | | accelerated | [True] | +-----------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-list controller-0 +--------------+--------------------------------------+----------+------------------+ | hostname | uuid | ifname | datanetwork_name | +--------------+--------------------------------------+----------+------------------+ | controller-0 | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | sriovfh1 | datanet-c | | controller-0 | 6aff29d7-cfaf-48b4-9802-b17b8a025efc | sriovdn1 | datanetdn1 | | controller-0 | 76a2da50-11a6-408e-90b3-3a316cef6557 | sriovmh1 | datanetmh1 | | controller-0 | e155e1d0-8dec-47e6-ac60-076832698a95 | sriovfh1 | datanet-u | | controller-0 | e569db46-a31b-4b8f-b7ca-175b1168798f | sriovbh1 | datanetbh1 | +--------------+--------------------------------------+----------+------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-show datanet-c controller-0 datanet-ccontroller-0 datanet-c datanet-clist controller-0 +--------------+--------------------------------------+----------+------------------+ | hostname | uuid | ifname | datanetwork_name | +--------------+--------------------------------------+----------+------------------+ | controller-0 | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | sriovfh1 | datanet-c | | controller-0 | 6aff29d7-cfaf-48b4-9802-b17b8a025efc | sriovdn1 | datanetdn1 | | controller-0 | 76a2da50-11a6-408e-90b3-3a316cef6557 | sriovmh1 | datanetmh1 | | controller-0 | e155e1d0-8dec-47e6-ac60-076832698a95 | sriovfh1 | datanet-u | | controller-0 | e569db46-a31b-4b8f-b7ca-175b1168798f | sriovbh1 | datanetbh1 | +--------------+--------------------------------------+----------+------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-list controller-0show 63a44e7b-18f4-4f9b-8504-a950cb8abb86 +------------------+--------------------------------------+ | Property | Value | +------------------+--------------------------------------+ | hostname | controller-0 | | uuid | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | | ifname | sriovfh1 | | datanetwork_name | datanet-c | +------------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-show 63a44e7b-18f4-4f9b-8504-a950cb8abb86e155e1d0-8dec-47e6-ac60-076832698a95 +------------------+--------------------------------------+ | Property | Value | +------------------+--------------------------------------+ | hostname | controller-0 | | uuid | e155e1d0-8dec-47e6-ac60-076832698a95 | | ifname | sriovfh1 | | datanetwork_name | datanet-u | +------------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# sriov device plugin logs: ===================================================================================== controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep intel_fpga_fec "resourceName": "intel_fpga_fec", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275709 138581 manager.go:193] validating resource name "intel.com/intel_fpga_fec" I0303 13:47:07.450400 138581 manager.go:116] Creating new ResourcePool: intel_fpga_fec I0303 13:47:07.450446 138581 manager.go:145] New resource server is created for intel_fpga_fec ResourcePool I0303 13:47:07.453772 138581 server.go:191] starting intel_fpga_fec device plugin endpoint at: intel.com_intel_fpga_fec.sock I0303 13:47:07.454032 138581 server.go:217] intel_fpga_fec device plugin endpoint started serving I0303 13:47:07.640208 138581 server.go:106] Plugin: intel.com_intel_fpga_fec.sock gets registered successfully at Kubelet I0303 13:47:07.640225 138581 server.go:131] ListAndWatch(intel_fpga_fec) invoked I0303 13:47:07.640342 138581 server.go:139] ListAndWatch(intel_fpga_fec): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:1d:01.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},},} controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep intel_fpga_fecpci_sriov_net_datanet_c "resourceName": "pci_sriov_net_datanet_c", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275645 138581 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanet_c" I0303 13:47:07.449979 138581 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanet_c I0303 13:47:07.450122 138581 manager.go:145] New resource server is created for pci_sriov_net_datanet_c ResourcePool I0303 13:47:07.450478 138581 server.go:191] starting pci_sriov_net_datanet_c device plugin endpoint at: intel.com_pci_sriov_net_datanet_c.sock I0303 13:47:07.451088 138581 server.go:217] pci_sriov_net_datanet_c device plugin endpoint started serving I0303 13:47:07.639929 138581 server.go:131] ListAndWatch(pci_sriov_net_datanet_c) invoked I0303 13:47:07.640068 138581 server.go:106] Plugin: intel.com_pci_sriov_net_datanet_c.sock gets registered successfully at Kubelet I0303 13:47:07.639996 138581 server.go:139] ListAndWatch(pci_sriov_net_datanet_c): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0f.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep pci_sriov_net_datanet_cu "resourceName": "pci_sriov_net_datanet_u", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275700 138581 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanet_u" I0303 13:47:07.450306 138581 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanet_u I0303 13:47:07.450388 138581 manager.go:145] New resource server is created for pci_sriov_net_datanet_u ResourcePool I0303 13:47:07.453443 138581 server.go:191] starting pci_sriov_net_datanet_u device plugin endpoint at: intel.com_pci_sriov_net_datanet_u.sock I0303 13:47:07.453750 138581 server.go:217] pci_sriov_net_datanet_u device plugin endpoint started serving I0303 13:47:07.639929 138581 server.go:131] ListAndWatch(pci_sriov_net_datanet_u) invoked I0303 13:47:07.639945 138581 server.go:139] ListAndWatch(pci_sriov_net_datanet_u): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0e.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} I0303 13:47:07.640791 138581 server.go:106] Plugin: intel.com_pci_sriov_net_datanet_u.sock gets registered successfully at Kubelet controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: stx-log-analysis.txt URL: From openinfradn at gmail.com Fri Mar 5 10:01:24 2021 From: openinfradn at gmail.com (open infra) Date: Fri, 5 Mar 2021 15:31:24 +0530 Subject: [Starlingx-discuss] Instance failed: No valid host was found. Message-ID: Hi, I have provisioned an instance using OpenStack under starlingx simplex environment. Instance creation was failed with the message "NoValidHost: No valid host was found." [1] Endpoint list: http://paste.openstack.org/show/803243/ Am I missing something? [1] http://paste.openstack.org/show/803260/ Regards, Danishka -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Fri Mar 5 14:36:23 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Fri, 5 Mar 2021 14:36:23 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210304T114947Z Message-ID: Sanity Test from 2021-March-04 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210304T114947Z/outputs/iso/ ) Status: GREEN Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210304T114947Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz =========================================== Sanity Test executed on Bare Metal AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 64 TCs ] Standard - Local Storage (2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 08 TCs [PASS] TOTAL: [ 65 TCs ] Standard External - Dedicated Storage (2+2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 09 TCs [PASS] TOTAL: [ 66 TCs ] =========================================== Sanity Test executed on Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 64 TCs ] Standard (2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 08 TCs [PASS] TOTAL: [ 65 TCs ] Standard External Storage (2+2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 09 TCs [PASS] TOTAL: [ 66 TCs ] Regards, STX Validation Team [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8408 bytes Desc: image001.png URL: From Venkata.Veldanda at radisys.com Sat Mar 6 03:32:23 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Sat, 6 Mar 2021 03:32:23 +0000 Subject: [Starlingx-discuss] Managing VFs in SRIOV resource list In-Reply-To: References: Message-ID: Hi - We have a requirement to create two SR-IOV resource lists from same physical interface. This requirement is for a use case where we are running Intel Flexran software in a Kuberenetes pod. The Intel Flexran software requires that a u-plane VLAN is assigned to a VF and passed as u-plane VF to the software command line. Similarly, a c-plane VLAN needs to be assigned to a VF and passed as c-plane VF to the software command line. The SR-IOV daemon set supports this configuration: { "resourceName": "intel_sriov_dpdk_cplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#4-7" ], "drivers": [ "igb_uio" ] } }, { "resourceName": "intel_sriov_dpdk_uplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#0-3" ], "drivers": [ "igb_uio" ] } } In order to achieve this we followed the below steps in StarlingX Create Datanetworks for C and U plane traffic $ system datanetwork-add datanet-u -m 9216 vlan $ system datanetwork-add datanet-c -m 9216 vlan $ system host-if-modify -m 9216 -n sriovfh1 -c pci-sriov -N 16 --vf-driver=vfio controller-0 enp177s0f3 $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-u $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-c And we ended up in getting 2 resource lists (one for the C-PLANE and U-PLANE) but both of them containing the same list of VFs. Is there a way I can configure separate VFs for both the resource list that I shown in the above example?. In a standard Kubernetes deployment I would directly change the configmap & re-run the SRIOV daemon set. How can do this in StarlingX and does any System API support this? $ cat /etc/pcidp/config.json { "resourceName": "pci_sriov_net_datanet_up", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, { "resourceName": "pci_sriov_net_datanet_cp", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From Venkata.Veldanda at radisys.com Sat Mar 6 05:34:44 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Sat, 6 Mar 2021 05:34:44 +0000 Subject: [Starlingx-discuss] Managing VFs in SRIOV resource list In-Reply-To: References: Message-ID: Resending with a small correction. From: Venkata Ramana Veldanda Sent: Saturday, March 6, 2021 9:02 AM To: starlingx-discuss at lists.starlingx.io Subject: Managing VFs in SRIOV resource list Hi - We have a requirement to create two SR-IOV resource lists from same physical interface. This requirement is for a use case where we are running Intel Flexran software in a Kuberenetes pod. The Intel Flexran software requires that a u-plane VLAN is assigned to a VF and passed as u-plane VF to the software command line. Similarly, a c-plane VLAN needs to be assigned to a VF and passed as c-plane VF to the software command line. The SR-IOV daemon set supports this configuration: { "resourceName": "intel_sriov_dpdk_cplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#4-7" ], "drivers": [ "igb_uio" ] } }, { "resourceName": "intel_sriov_dpdk_uplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#0-3" ], "drivers": [ "igb_uio" ] } } In order to achieve this we followed the below steps in StarlingX Create Datanetworks for C and U plane traffic $ system datanetwork-add datanet-u -m 9216 vlan $ system datanetwork-add datanet-c -m 9216 vlan $ system host-if-modify -m 9216 -n sriovfh1 -c pci-sriov -N 8 --vf-driver=vfio controller-0 enp177s0f3 $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-u $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-c And we ended up in getting 2 resource lists (one for the C-PLANE and U-PLANE) but both of them containing the same list of VFs. Is there a way I can configure separate VFs for both the resource list that I shown in the above example?. In a standard Kubernetes deployment I would directly change the configmap & re-run the SRIOV daemon set. How can do this in StarlingX and does any System API support this? $ cat /etc/pcidp/config.json { "resourceName": "pci_sriov_net_datanet_up", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, { "resourceName": "pci_sriov_net_datanet_cp", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Sat Mar 6 17:24:09 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Sat, 6 Mar 2021 17:24:09 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210305T070803Z Message-ID: Sanity Test from 2021-March-05 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210305T070803Z/outputs/iso/ ) Status: GREEN Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210305T070803Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz =========================================== Sanity Test executed on Bare Metal AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 64 TCs ] Standard - Local Storage (2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 08 TCs [PASS] TOTAL: [ 65 TCs ] Standard External - Dedicated Storage (2+2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 09 TCs [PASS] TOTAL: [ 66 TCs ] =========================================== Sanity Test executed on Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 64 TCs ] Standard (2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 08 TCs [PASS] TOTAL: [ 65 TCs ] Standard External Storage (2+2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 09 TCs [PASS] TOTAL: [ 66 TCs ] Regards, STX Validation Team [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8408 bytes Desc: image001.png URL: From alexandru.dimofte at intel.com Sun Mar 7 07:11:26 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Sun, 7 Mar 2021 07:11:26 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210306T023358Z Message-ID: Sanity Test from 2021-March-06 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210306T023358Z/outputs/iso/ ) Status: GREEN Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210306T023358Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz =========================================== Sanity Test executed on Bare Metal AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 64 TCs ] Standard - Local Storage (2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 08 TCs [PASS] TOTAL: [ 65 TCs ] Standard External - Dedicated Storage (2+2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 09 TCs [PASS] TOTAL: [ 66 TCs ] =========================================== Sanity Test executed on Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 64 TCs ] Standard (2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 08 TCs [PASS] TOTAL: [ 65 TCs ] Standard External Storage (2+2+2) Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 09 TCs [PASS] TOTAL: [ 66 TCs ] Regards, STX Validation Team [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8408 bytes Desc: image001.png URL: From sanathukumar14 at gmail.com Mon Mar 8 10:07:14 2021 From: sanathukumar14 at gmail.com (sanath kumar) Date: Mon, 8 Mar 2021 15:37:14 +0530 Subject: [Starlingx-discuss] =?utf-8?q?=28no_subject=29?= Message-ID: Hello StarrlingX Team, 1. As a reply to the previous meet, I am posting these screenshot and documentation which has information regarding the memory allocated to controller-0. Memory allocated to controller-0 was 20GB, and my machine has 2.2T of memory. And my question was, Is there any method where we can increase the controller-0 memory allocation. 2. Since the *availability *of *controller-0* is *degraded*, Is there any way we make *the availability *of controller-0 available? Below are the links which have the information regarding controller-0 1. https://drive.google.com/file/d/1phZPTh3IlpoqRLJQJTJA2puJxTtHWai_/view 2. https://drive.google.com/file/d/1vHx-GZ5mxAbnAiegK8jl7GqnjtokmaWf/view Note: Virtual All-in-one Simplex Installation R4.0 Regards, Sanath Kumar +91 8971546076 -------------- next part -------------- An HTML attachment was scrubbed... URL: From sanathukumar14 at gmail.com Mon Mar 8 10:10:22 2021 From: sanathukumar14 at gmail.com (sanath kumar) Date: Mon, 8 Mar 2021 15:40:22 +0530 Subject: [Starlingx-discuss] Controller-0 Degraded In-Reply-To: References: Message-ID: Regards, Sanath Kumar +91 8971546076 On Mon, 8 Mar 2021 at 15:37, sanath kumar wrote: > Hello StarrlingX Team, > > 1. As a reply to the previous meet, I am posting these screenshot and > documentation which has information regarding the memory allocated to > controller-0. Memory allocated to controller-0 was 20GB, and my machine has > 2.2T of memory. And my question was, Is there any method where we can > increase the controller-0 memory allocation. > 2. Since the *availability *of *controller-0* is *degraded*, Is there > any way we make *the availability *of controller-0 available? > > > Below are the links which have the information regarding controller-0 > > 1. > https://drive.google.com/file/d/1phZPTh3IlpoqRLJQJTJA2puJxTtHWai_/view > 2. > https://drive.google.com/file/d/1vHx-GZ5mxAbnAiegK8jl7GqnjtokmaWf/view > > Note: Virtual All-in-one Simplex Installation R4.0 > > Regards, > Sanath Kumar > +91 8971546076 > -------------- next part -------------- An HTML attachment was scrubbed... URL: From openinfradn at gmail.com Mon Mar 8 11:14:52 2021 From: openinfradn at gmail.com (open infra) Date: Mon, 8 Mar 2021 16:44:52 +0530 Subject: [Starlingx-discuss] StarlingX distributed deployment and openstack Message-ID: Hi, When we deploy starlings as a distributed model, how OpenStack services distributed across the environment? Can we have control over the distribution of OpenStack components/service? Imagine a situation where the central cloud disconnected with an edge cloud and only controller(s) of the edge cloud up and running. Do the controllers in the central cloud sync with the edge cloud once the central cloud is back in operation? Regards, Danishka -------------- next part -------------- An HTML attachment was scrubbed... URL: From kennelson11 at gmail.com Mon Mar 8 18:09:35 2021 From: kennelson11 at gmail.com (Kendall Nelson) Date: Mon, 8 Mar 2021 10:09:35 -0800 Subject: [Starlingx-discuss] vPTG April 2021 Team Signup Message-ID: Greetings! As you hopefully already know, our next PTG will be virtual again, and held from Monday, April 19 to Friday, April 23. We will have the same schedule set up available as last time with three windows of time spread across the day to cover all timezones with breaks in between. *To signup your team, you must complete **BOTH** the survey[1] AND reserve time in the ethercalc[2] by March 25 at 7:00 UTC.* We ask that the PTL/SIG Chair/Team lead sign up for time to have their discussions in with 4 rules/guidelines. 1. Cross project discussions (like SIGs or support project teams) should be scheduled towards the start of the week so that any discussions that might shape those of other teams happen first. 2. No team should sign up for more than 4 hours per UTC day to help keep participants actively engaged. 3. No team should sign up for more than 16 hours across all time slots to avoid burning out our contributors and to enable participation in multiple teams discussions. Again, you need to fill out BOTH the ethercalc AND the survey to complete your team's sign up. If you have any issues with signing up your team, due to conflict or otherwise, please let me know! While we are trying to empower you to make your own decisions as to when you meet and for how long (after all, you know your needs and teams timezones better than we do), we are here to help! Once your team is signed up, please register! And remind your team to register! Registration is free, but since it will be how we contact you with passwords, event details, etc. it is still important! Continue to check back for updates at openstack.org/ptg. -the Kendalls (diablo_rojo & wendallkaters) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi [3] PTG Registration: https://april2021-ptg.eventbrite.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at optimcloud.com Tue Mar 9 08:56:12 2021 From: lists at optimcloud.com (lists at optimcloud.com) Date: Tue, 09 Mar 2021 15:56:12 +0700 Subject: [Starlingx-discuss] openstack installation help Message-ID: <2d0f39cc642a38393bb050b0f2eb77f6@optimcloud.com> okay so just redeployed a 4.0 dupolex on bare metal .... cluster is up and nodes are available can i ask someone for a pointed walk through of creating tenant networks for openstack images to get on the internet, i have a /25 with 120 free ips i need to crank out some images and get them online.. the pice i am having issues understanding is tenant networks thanks From lists at optimcloud.com Tue Mar 9 09:22:44 2021 From: lists at optimcloud.com (lists at optimcloud.com) Date: Tue, 09 Mar 2021 16:22:44 +0700 Subject: [Starlingx-discuss] HostFs update failed: Not enough free space Message-ID: according to https://docs.starlingx.io/deploy_install_guides/r4_release/openstack/install.html Install application manifest and helm-charts Modify the size of the docker_lv filesystem. By default, the size of the docker_lv filesystem is 30G, which is not enough for stx-openstack installation. Use the host-fs-modify CLI to increase the filesystem size. however it fails..... system host-fs-modify controller-0 docker=60 HostFs update failed: Not enough free space on cgts-vg. Current free space 1 GiB, requested total increase 30 GiB [sysadmin at controller-0 ~(keystone_admin)]$ sudo lvdisplay Password: Sorry, try again. Password: --- Logical volume --- LV Path /dev/nova-local/instances_lv LV Name instances_lv VG Name nova-local LV UUID qyXBio-pIvE-ECnz-m7wf-Gl49-H9nb-pGBEf0 LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 14:08:50 +0000 LV Status available # open 1 LV Size <34.00 GiB Current LE 8703 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:0 --- Logical volume --- LV Path /dev/cgts-vg/scratch-lv LV Name scratch-lv VG Name cgts-vg LV UUID g56V4Z-7Zz4-n2Gx-eoAl-DJ6G-aL54-waYh2g LV Write Access read/write LV Creation host, time localhost, 2021-03-06 11:49:56 +0000 LV Status available # open 1 LV Size 16.00 GiB Current LE 512 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:1 --- Logical volume --- LV Path /dev/cgts-vg/log-lv LV Name log-lv VG Name cgts-vg LV UUID ZF7Krt-6zF7-wkT9-9FAq-0fSy-5uIV-P0EvMN LV Write Access read/write LV Creation host, time localhost, 2021-03-06 11:49:57 +0000 LV Status available # open 1 LV Size 7.81 GiB Current LE 250 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:2 --- Logical volume --- LV Path /dev/cgts-vg/extension-lv LV Name extension-lv VG Name cgts-vg LV UUID dlb63u-Xqdf-6j9E-gOhs-4Li3-WNLW-M7IUC0 LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:32 +0000 LV Status available # open 2 LV Size 1.00 GiB Current LE 32 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:3 --- Logical volume --- LV Path /dev/cgts-vg/pgsql-lv LV Name pgsql-lv VG Name cgts-vg LV UUID hRYe8m-jtUz-lS7s-y3WM-1BWg-aZf5-mdY4Cb LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:34 +0000 LV Status available # open 2 LV Size 20.00 GiB Current LE 640 Segments 3 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:4 --- Logical volume --- LV Path /dev/cgts-vg/docker-lv LV Name docker-lv VG Name cgts-vg LV UUID pAzJGO-qFBv-XVkd-qLXT-HD6k-c1gO-OSukIG LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:34 +0000 LV Status available # open 1 LV Size 30.00 GiB Current LE 960 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:5 --- Logical volume --- LV Path /dev/cgts-vg/kubelet-lv LV Name kubelet-lv VG Name cgts-vg LV UUID pxiOsd-oNRm-I9E2-60nU-Xk1Z-MrVr-2jDrqY LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:38 +0000 LV Status available # open 1 LV Size 10.00 GiB Current LE 320 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:6 --- Logical volume --- LV Path /dev/cgts-vg/etcd-lv LV Name etcd-lv VG Name cgts-vg LV UUID rSVfsi-iZkG-kfbk-ooCe-xxBR-Em6K-S2SiVH LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:40 +0000 LV Status available # open 2 LV Size 5.00 GiB Current LE 160 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:7 --- Logical volume --- LV Path /dev/cgts-vg/backup-lv LV Name backup-lv VG Name cgts-vg LV UUID a0IgZQ-HsD5-1XdN-z2QH-nfQ9-A5bt-hHJuAM LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:42 +0000 LV Status available # open 1 LV Size 25.00 GiB Current LE 800 Segments 3 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:8 --- Logical volume --- LV Path /dev/cgts-vg/dockerdistribution-lv LV Name dockerdistribution-lv VG Name cgts-vg LV UUID WkCmKI-Vixg-2LWz-OE1R-oSNW-3apR-ka1FeM LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:44 +0000 LV Status available # open 2 LV Size 16.00 GiB Current LE 512 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:9 --- Logical volume --- LV Path /dev/cgts-vg/rabbit-lv LV Name rabbit-lv VG Name cgts-vg LV UUID uoqfAO-3LdO-sgBm-c1SO-bdGC-skBg-LYK2cp LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:45 +0000 LV Status available # open 2 LV Size 2.00 GiB Current LE 64 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:10 --- Logical volume --- LV Path /dev/cgts-vg/platform-lv LV Name platform-lv VG Name cgts-vg LV UUID ZhK3yO-SyMl-HNc0-3QFk-lDdp-to34-BuCtoC LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:50 +0000 LV Status available # open 2 LV Size 10.00 GiB Current LE 320 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:11 --- Logical volume --- LV Path /dev/cgts-vg/ceph-mon-lv LV Name ceph-mon-lv VG Name cgts-vg LV UUID ejlvoZ-Rjtn-GxLu-XAzH-0lzL-kXY3-gbNMs1 LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:49:54 +0000 LV Status available # open 2 LV Size 20.00 GiB Current LE 640 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:12 From austin.sun at intel.com Tue Mar 9 12:35:19 2021 From: austin.sun at intel.com (Sun, Austin) Date: Tue, 9 Mar 2021 12:35:19 +0000 Subject: [Starlingx-discuss] HostFs update failed: Not enough free space In-Reply-To: References: Message-ID: Please check this command : node=controller-0;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') change controller-0 to any node you want to check , check the lvm_pv_size_gib, if this is somehow too small ,then lvm can not extended . -----Original Message----- From: lists at optimcloud.com Sent: Tuesday, March 9, 2021 5:23 PM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] HostFs update failed: Not enough free space according to https://docs.starlingx.io/deploy_install_guides/r4_release/openstack/install.html Install application manifest and helm-charts Modify the size of the docker_lv filesystem. By default, the size of the docker_lv filesystem is 30G, which is not enough for stx-openstack installation. Use the host-fs-modify CLI to increase the filesystem size. however it fails..... system host-fs-modify controller-0 docker=60 HostFs update failed: Not enough free space on cgts-vg. Current free space 1 GiB, requested total increase 30 GiB [sysadmin at controller-0 ~(keystone_admin)]$ sudo lvdisplay Password: Sorry, try again. Password: --- Logical volume --- LV Path /dev/nova-local/instances_lv LV Name instances_lv VG Name nova-local LV UUID qyXBio-pIvE-ECnz-m7wf-Gl49-H9nb-pGBEf0 LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 14:08:50 +0000 LV Status available # open 1 LV Size <34.00 GiB Current LE 8703 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:0 --- Logical volume --- LV Path /dev/cgts-vg/scratch-lv LV Name scratch-lv VG Name cgts-vg LV UUID g56V4Z-7Zz4-n2Gx-eoAl-DJ6G-aL54-waYh2g LV Write Access read/write LV Creation host, time localhost, 2021-03-06 11:49:56 +0000 LV Status available # open 1 LV Size 16.00 GiB Current LE 512 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:1 --- Logical volume --- LV Path /dev/cgts-vg/log-lv LV Name log-lv VG Name cgts-vg LV UUID ZF7Krt-6zF7-wkT9-9FAq-0fSy-5uIV-P0EvMN LV Write Access read/write LV Creation host, time localhost, 2021-03-06 11:49:57 +0000 LV Status available # open 1 LV Size 7.81 GiB Current LE 250 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:2 --- Logical volume --- LV Path /dev/cgts-vg/extension-lv LV Name extension-lv VG Name cgts-vg LV UUID dlb63u-Xqdf-6j9E-gOhs-4Li3-WNLW-M7IUC0 LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:32 +0000 LV Status available # open 2 LV Size 1.00 GiB Current LE 32 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:3 --- Logical volume --- LV Path /dev/cgts-vg/pgsql-lv LV Name pgsql-lv VG Name cgts-vg LV UUID hRYe8m-jtUz-lS7s-y3WM-1BWg-aZf5-mdY4Cb LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:34 +0000 LV Status available # open 2 LV Size 20.00 GiB Current LE 640 Segments 3 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:4 --- Logical volume --- LV Path /dev/cgts-vg/docker-lv LV Name docker-lv VG Name cgts-vg LV UUID pAzJGO-qFBv-XVkd-qLXT-HD6k-c1gO-OSukIG LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:34 +0000 LV Status available # open 1 LV Size 30.00 GiB Current LE 960 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:5 --- Logical volume --- LV Path /dev/cgts-vg/kubelet-lv LV Name kubelet-lv VG Name cgts-vg LV UUID pxiOsd-oNRm-I9E2-60nU-Xk1Z-MrVr-2jDrqY LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:38 +0000 LV Status available # open 1 LV Size 10.00 GiB Current LE 320 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:6 --- Logical volume --- LV Path /dev/cgts-vg/etcd-lv LV Name etcd-lv VG Name cgts-vg LV UUID rSVfsi-iZkG-kfbk-ooCe-xxBR-Em6K-S2SiVH LV Write Access read/write LV Creation host, time localhost, 2021-03-06 13:05:40 +0000 LV Status available # open 2 LV Size 5.00 GiB Current LE 160 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:7 --- Logical volume --- LV Path /dev/cgts-vg/backup-lv LV Name backup-lv VG Name cgts-vg LV UUID a0IgZQ-HsD5-1XdN-z2QH-nfQ9-A5bt-hHJuAM LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:42 +0000 LV Status available # open 1 LV Size 25.00 GiB Current LE 800 Segments 3 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:8 --- Logical volume --- LV Path /dev/cgts-vg/dockerdistribution-lv LV Name dockerdistribution-lv VG Name cgts-vg LV UUID WkCmKI-Vixg-2LWz-OE1R-oSNW-3apR-ka1FeM LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:44 +0000 LV Status available # open 2 LV Size 16.00 GiB Current LE 512 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:9 --- Logical volume --- LV Path /dev/cgts-vg/rabbit-lv LV Name rabbit-lv VG Name cgts-vg LV UUID uoqfAO-3LdO-sgBm-c1SO-bdGC-skBg-LYK2cp LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:45 +0000 LV Status available # open 2 LV Size 2.00 GiB Current LE 64 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:10 --- Logical volume --- LV Path /dev/cgts-vg/platform-lv LV Name platform-lv VG Name cgts-vg LV UUID ZhK3yO-SyMl-HNc0-3QFk-lDdp-to34-BuCtoC LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:05:50 +0000 LV Status available # open 2 LV Size 10.00 GiB Current LE 320 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:11 --- Logical volume --- LV Path /dev/cgts-vg/ceph-mon-lv LV Name ceph-mon-lv VG Name cgts-vg LV UUID ejlvoZ-Rjtn-GxLu-XAzH-0lzL-kXY3-gbNMs1 LV Write Access read/write LV Creation host, time controller-0, 2021-03-06 13:49:54 +0000 LV Status available # open 2 LV Size 20.00 GiB Current LE 640 Segments 1 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:12 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Bill.Zvonar at windriver.com Tue Mar 9 16:41:12 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Tue, 9 Mar 2021 16:41:12 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 10, 2021) Message-ID: Hi all, reminder of the weekly TSC/Community calls coming up tomorrow. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210310T1500 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at optimcloud.com Wed Mar 10 02:41:42 2021 From: lists at optimcloud.com (lists at optimcloud.com) Date: Wed, 10 Mar 2021 09:41:42 +0700 Subject: [Starlingx-discuss] Duplex active/active Message-ID: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> okay so i get the stx services are set /active/active3 looking thropugh sm-dump is there no way to utilize both servers for pods via scaling also ? right now its all running on 1 box, the second, is kinda just sitting there waiting for something drastic to occur or is this where i really need a worker node also thanks From lists at optimcloud.com Wed Mar 10 04:05:58 2021 From: lists at optimcloud.com (Embedded Devel) Date: Wed, 10 Mar 2021 11:05:58 +0700 Subject: [Starlingx-discuss] HostFs update failed: Not enough free space In-Reply-To: References: Message-ID: <8edad6fc-62a9-5d63-1a30-14c72b902d97@optimcloud.com> where the hardware guide states Primary disk 500 GB SSD or NVMe (see Configure NVMe Drive as Primary Disk ) Additional disks * 1 or more 500 GB (min. 10K RPM) for Ceph OSD * Recommended, but not required: 1 or more SSDs or NVMe drives for Ceph journals (min. 1024 MiB per OSD journal) * For OpenStack, recommend 1 or more 500 GB (min. 10K RPM) for VM local ephemeral storage both nodes have 3 1TB drives, 1TB primary, 2 1TB OSD so im curious why im even seeing the error [    8.241106] sd 0:2:0:0: [sda] 1952448512 512-byte logical blocks: (1000 GB/931 GiB) [    8.241427] sd 0:2:1:0: [sdb] 1952448512 512-byte logical blocks: (1000 GB/931 GiB) [    8.249716] sd 0:2:2:0: [sdc] 1952448512 512-byte logical blocks: (1000 GB/931 GiB) node=controller-0;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') +--------------------------+-------------------------------------------------------+ | Property                 | Value                                                 | +--------------------------+-------------------------------------------------------+ | uuid                     | 8ce1afab-7eb6-460e-8f58-6d17fd904e1e                  | | pv_state                 | provisioned                                           | | pv_type                  | partition                                             | | disk_or_part_uuid        | 99e5a6ef-ec84-4922-b053-d0ac19cf2b5b                  | | disk_or_part_device_node | /dev/sda5                                             | | disk_or_part_device_path | /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0-part5 | | lvm_pv_name              | /dev/sda5                                             | | lvm_vg_name              | cgts-vg                                               | | lvm_pv_uuid              | KZ3cFY-rNnu-t7cF-wguw-Z0ey-9uYQ-ufZLcj                | | lvm_pv_size_gib          | 163.968                                               | | lvm_pe_total             | 5247                                                  | | lvm_pe_alloced           | 5210                                                  | | ihost_uuid               | 353c9099-43a6-47ce-a92a-56d382abde2f                  | | created_at               | 2021-03-06T13:09:20.082017+00:00                      | | updated_at               | 2021-03-10T03:46:53.573286+00:00                      | +--------------------------+-------------------------------------------------------+ [sysadmin at controller-1 ~(keystone_admin)]$ node=controller-1;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') +--------------------------+-------------------------------------------------------+ | Property                 | Value                                                 | +--------------------------+-------------------------------------------------------+ | uuid                     | 13071ae3-1636-41df-b114-b3ccb4c97fd5                  | | pv_state                 | provisioned                                           | | pv_type                  | partition                                             | | disk_or_part_uuid        | 120eb244-4c5c-4fcc-beba-9de368067ba6                  | | disk_or_part_device_node | /dev/sda5                                             | | disk_or_part_device_path | /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0-part5 | | lvm_pv_name              | /dev/sda5                                             | | lvm_vg_name              | cgts-vg                                               | | lvm_pv_uuid              | 776vC0-7yEs-kHqB-73gv-mrOQ-q1j8-hjEcmR                | | lvm_pv_size_gib          | 163.968                                               | | lvm_pe_total             | 5247                                                  | | lvm_pe_alloced           | 5210                                                  | | ihost_uuid               | 37fe69a1-80d8-436b-9765-93c901cb4c12                  | | created_at               | 2021-03-09T05:38:54.185540+00:00                      | | updated_at               | 2021-03-10T03:46:41.316696+00:00                      | +--------------------------+-------------------------------------------------------+ [sysadmin at controller-1 ~(keystone_admin)]$ On 3/9/21 7:35 PM, Sun, Austin wrote: > node=controller-0;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') -------------- next part -------------- An HTML attachment was scrubbed... URL: From dongqix.chen at intel.com Wed Mar 10 07:18:49 2021 From: dongqix.chen at intel.com (Chen, DongqiX) Date: Wed, 10 Mar 2021 07:18:49 +0000 Subject: [Starlingx-discuss] HostFs update failed: Not enough free space In-Reply-To: References: <8edad6fc-62a9-5d63-1a30-14c72b902d97@optimcloud.com> Message-ID: Hi: Create a disk partition of the size, set 200G here system host-disk-partition-add controller-0 /dev/sda 200 [cid:image002.jpg at 01D715C0.A6081290] Check the newly created partition and add it to vg system host-disk-partition-list controller-0 system host-pv-add controller-0 cgts-vg 3df6abcc-df58-46f3-b99f-02ff7504032f (uuid) [cid:image004.jpg at 01D715C0.A6081290] [cid:image009.jpg at 01D715C0.A6081290] From: Sun, Austin Sent: 2021年3月10日 15:02 To: chen.dq at neusoft.com; Chen, DongqiX Subject: FW: [Starlingx-discuss] HostFs update failed: Not enough free space From: Embedded Devel > Sent: Wednesday, March 10, 2021 12:06 PM To: Sun, Austin >; starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] HostFs update failed: Not enough free space where the hardware guide states Primary disk 500 GB SSD or NVMe (see Configure NVMe Drive as Primary Disk) Additional disks * 1 or more 500 GB (min. 10K RPM) for Ceph OSD * Recommended, but not required: 1 or more SSDs or NVMe drives for Ceph journals (min. 1024 MiB per OSD journal) * For OpenStack, recommend 1 or more 500 GB (min. 10K RPM) for VM local ephemeral storage both nodes have 3 1TB drives, 1TB primary, 2 1TB OSD so im curious why im even seeing the error [ 8.241106] sd 0:2:0:0: [sda] 1952448512 512-byte logical blocks: (1000 GB/931 GiB) [ 8.241427] sd 0:2:1:0: [sdb] 1952448512 512-byte logical blocks: (1000 GB/931 GiB) [ 8.249716] sd 0:2:2:0: [sdc] 1952448512 512-byte logical blocks: (1000 GB/931 GiB) node=controller-0;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') +--------------------------+-------------------------------------------------------+ | Property | Value | +--------------------------+-------------------------------------------------------+ | uuid | 8ce1afab-7eb6-460e-8f58-6d17fd904e1e | | pv_state | provisioned | | pv_type | partition | | disk_or_part_uuid | 99e5a6ef-ec84-4922-b053-d0ac19cf2b5b | | disk_or_part_device_node | /dev/sda5 | | disk_or_part_device_path | /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0-part5 | | lvm_pv_name | /dev/sda5 | | lvm_vg_name | cgts-vg | | lvm_pv_uuid | KZ3cFY-rNnu-t7cF-wguw-Z0ey-9uYQ-ufZLcj | | lvm_pv_size_gib | 163.968 | | lvm_pe_total | 5247 | | lvm_pe_alloced | 5210 | | ihost_uuid | 353c9099-43a6-47ce-a92a-56d382abde2f | | created_at | 2021-03-06T13:09:20.082017+00:00 | | updated_at | 2021-03-10T03:46:53.573286+00:00 | +--------------------------+-------------------------------------------------------+ [sysadmin at controller-1 ~(keystone_admin)]$ node=controller-1;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') +--------------------------+-------------------------------------------------------+ | Property | Value | +--------------------------+-------------------------------------------------------+ | uuid | 13071ae3-1636-41df-b114-b3ccb4c97fd5 | | pv_state | provisioned | | pv_type | partition | | disk_or_part_uuid | 120eb244-4c5c-4fcc-beba-9de368067ba6 | | disk_or_part_device_node | /dev/sda5 | | disk_or_part_device_path | /dev/disk/by-path/pci-0000:02:00.0-scsi-0:2:0:0-part5 | | lvm_pv_name | /dev/sda5 | | lvm_vg_name | cgts-vg | | lvm_pv_uuid | 776vC0-7yEs-kHqB-73gv-mrOQ-q1j8-hjEcmR | | lvm_pv_size_gib | 163.968 | | lvm_pe_total | 5247 | | lvm_pe_alloced | 5210 | | ihost_uuid | 37fe69a1-80d8-436b-9765-93c901cb4c12 | | created_at | 2021-03-09T05:38:54.185540+00:00 | | updated_at | 2021-03-10T03:46:41.316696+00:00 | +--------------------------+-------------------------------------------------------+ [sysadmin at controller-1 ~(keystone_admin)]$ On 3/9/21 7:35 PM, Sun, Austin wrote: node=controller-0;system host-pv-show $node $(system host-pv-list $node | grep cgts-vg | awk -F'|' '{print $2}') -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.jpg Type: image/jpeg Size: 35025 bytes Desc: image002.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image004.jpg Type: image/jpeg Size: 46198 bytes Desc: image004.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image009.jpg Type: image/jpeg Size: 59148 bytes Desc: image009.jpg URL: From Venkata.Veldanda at radisys.com Wed Mar 10 08:56:17 2021 From: Venkata.Veldanda at radisys.com (Venkata Ramana Veldanda) Date: Wed, 10 Mar 2021 08:56:17 +0000 Subject: [Starlingx-discuss] Managing VFs in SRIOV resource list In-Reply-To: References: Message-ID: Hi - Any help or suggestions around this? From: Venkata Ramana Veldanda Sent: 06 March 2021 11:05 To: starlingx-discuss at lists.starlingx.io Cc: Srinivas Sadagopan Subject: RE: Managing VFs in SRIOV resource list Resending with a small correction. From: Venkata Ramana Veldanda Sent: Saturday, March 6, 2021 9:02 AM To: starlingx-discuss at lists.starlingx.io Subject: Managing VFs in SRIOV resource list Hi - We have a requirement to create two SR-IOV resource lists from same physical interface. This requirement is for a use case where we are running Intel Flexran software in a Kuberenetes pod. The Intel Flexran software requires that a u-plane VLAN is assigned to a VF and passed as u-plane VF to the software command line. Similarly, a c-plane VLAN needs to be assigned to a VF and passed as c-plane VF to the software command line. The SR-IOV daemon set supports this configuration: { "resourceName": "intel_sriov_dpdk_cplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#4-7" ], "drivers": [ "igb_uio" ] } }, { "resourceName": "intel_sriov_dpdk_uplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#0-3" ], "drivers": [ "igb_uio" ] } } In order to achieve this we followed the below steps in StarlingX Create Datanetworks for C and U plane traffic $ system datanetwork-add datanet-u -m 9216 vlan $ system datanetwork-add datanet-c -m 9216 vlan $ system host-if-modify -m 9216 -n sriovfh1 -c pci-sriov -N 8 --vf-driver=vfio controller-0 enp177s0f3 $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-u $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-c And we ended up in getting 2 resource lists (one for the C-PLANE and U-PLANE) but both of them containing the same list of VFs. Is there a way I can configure separate VFs for both the resource list that I shown in the above example?. In a standard Kubernetes deployment I would directly change the configmap & re-run the SRIOV daemon set. How can do this in StarlingX and does any System API support this? $ cat /etc/pcidp/config.json { "resourceName": "pci_sriov_net_datanet_up", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, { "resourceName": "pci_sriov_net_datanet_cp", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From nicolae.jascanu at intel.com Wed Mar 10 11:28:35 2021 From: nicolae.jascanu at intel.com (Jascanu, Nicolae) Date: Wed, 10 Mar 2021 11:28:35 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210309T000306Z Message-ID: Sanity Test from 2021-March-09 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210309T000306Z/outputs/iso/) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210309T000306Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Nicolae Jascanu -------------- next part -------------- An HTML attachment was scrubbed... URL: From bruce.e.jones at intel.com Wed Mar 10 15:12:27 2021 From: bruce.e.jones at intel.com (Jones, Bruce E) Date: Wed, 10 Mar 2021 15:12:27 +0000 Subject: [Starlingx-discuss] TSC call notes Mar 10 2021 Message-ID: Mar 10 2021 * Standing topics - None * PTG registration: o [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey o [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi o [3] PTG Registration: https://april2021-ptg.eventbrite.com * We completed the survey and signed up for two 4 hour sessions on the ethercalc * All community members are welcome to join the PTG. Please register at the link [3] above. -------------- next part -------------- An HTML attachment was scrubbed... URL: From nicolae.jascanu at intel.com Wed Mar 10 15:28:12 2021 From: nicolae.jascanu at intel.com (Jascanu, Nicolae) Date: Wed, 10 Mar 2021 15:28:12 +0000 Subject: [Starlingx-discuss] files.starlingx.kube.cengn.ca is not working Message-ID: Hi All, I'm trying to upload the logs collected at: https://files.starlingx.kube.cengn.ca/ but I'm getting a mysql connection error pymysql.err.OperationalError pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on 'db' (timed out)") Regards, Nicolae Jascanu, Ph.D. Software Engineer IOTG Galati, Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: From Frank.Miller at windriver.com Wed Mar 10 15:30:45 2021 From: Frank.Miller at windriver.com (Miller, Frank) Date: Wed, 10 Mar 2021 15:30:45 +0000 Subject: [Starlingx-discuss] stx 4.0.1 kubernetes sriov resources suddenly disappears In-Reply-To: References: Message-ID: The kubelet logs are in /var/log/daemon.log From: Venkata Ramana Veldanda Sent: Friday, March 05, 2021 4:30 AM To: starlingx-discuss at lists.starlingx.io Cc: Srinivas Sadagopan Subject: Re: [Starlingx-discuss] stx 4.0.1 kubernetes sriov resources suddenly disappears [Please note: This e-mail is from an EXTERNAL e-mail address] Adding more info to this question as this is becoming a bit show stopper for us. Any help is appreciated. Until SRIOV everything seems to be configured properly and they reflecting under /etc/pcidp/config.json When we compared the faulty resource intel_fpga_fec with another stable SRIOV resource 'pci_sriov_net_datanetmh1' the log doesn't show any issues nor it is different. However from kubelet perspective there seems to be something wrong and resources are not showing up in "kubectl describe nodes". Attached the log comparison. How do we dump the kubelet logs? The command 'journalctl -u kubelet' works on my CentOS Kubernetes but not on StarlingX [root at local ~]# journalctl -u kubelet -- No entries -- Also raised a launch pad bug with logs https://bugs.launchpad.net/starlingx/+bug/1917857 From: Venkata Ramana Veldanda Sent: Wednesday, March 3, 2021 9:50 PM To: starlingx-discuss at lists.starlingx.io Cc: Srinivas Sadagopan > Subject: stx 4.0.1 kubernetes sriov resources suddenly disappears Hi, We are using STX 4.0.1 to install our Flexran based 5G solution in AIO-SX mode . We had created VFs on the N3000 device and some of the NIC interfaces. These resources were reflected in the Kuberenets allocatable resources. During the course of using the system, the allocatable resources for N3000 and one of the NIC interface crad started coming up as 0. The following is a part of kubectl describe nodes output. The affected resources are intel.com/intel_fpga_fec, intel.com/pci_sriov_net_datanet_c, and intel.com/pci_sriov_net_datanet_u We already tried lock/unlock, delete and re-create the resources, but none of these help to recover the resources [root at controller-0 sysadmin(keystone_admin)]# cat /etc/build.info ### ### StarlingX ### Release 20.06 ### OS="centos" SW_VERSION="20.06" BUILD_TARGET="Host Installer" BUILD_TYPE="Formal" BUILD_ID="r/stx.4.0" JOB="STX_4.0_build_layer_flock" BUILD_BY="starlingx.build at cengn.ca" BUILD_NUMBER="22" BUILD_HOST="starlingx_mirror" BUILD_DATE="2020-08-05 12:25:52 +0000" FLOCK_OS="centos" FLOCK_JOB="STX_4.0_build_layer_flock" FLOCK_BUILD_BY="starlingx.build at cengn.ca" FLOCK_BUILD_NUMBER="22" FLOCK_BUILD_HOST="starlingx_mirror" FLOCK_BUILD_DATE="2020-08-05 12:25:52 +0000" Capacity: cpu: 96 ephemeral-storage: 10190100Ki hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 memory: 97436728Ki pods: 110 Allocatable: cpu: 92 ephemeral-storage: 9391196145 hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 It seems like everything is "OK" upto sriov device plugin because the sriov device plugin pod logs do show that the correct number of resources are getting updated towards kubernetes Here are some of the CLI outputs: [root at controller-0 sysadmin(keystone_admin)]# system host-device-show controller-0 pci_0000_1d_00_0 +-----------------------+---------------------------------------------------------------------------------------------------------+ | Property | Value | +-----------------------+---------------------------------------------------------------------------------------------------------+ | name | pci_0000_1d_00_0 | | address | 0000:1d:00.0 | | class id | 120000 | | vendor id | 8086 | | device id | 0d8f | | class name | Processing accelerators | | vendor name | Intel Corporation | | device name | Device 0d8f | | numa_node | 0 | | enabled | True | | sriov_totalvfs | 8 | | sriov_numvfs | 8 | | sriov_vfs_pci_address | 0000:1d:00.1,0000:1d:00.2,0000:1d:00.3,0000:1d:00.4,0000:1d:00.5,0000:1d:00.6,0000:1d:00.7,0000:1d:01.0 | | sriov_vf_pdevice_id | 0d90 | | extra_info | | | created_at | 2021-03-03T13:46:26.363470+00:00 | | updated_at | 2021-03-03T13:47:12.684827+00:00 | | root_key | None | | revoked_key_ids | None | | boot_page | None | | bitstream_id | None | | bmc_build_version | None | | bmc_fw_version | None | | driver | igb_uio | | sriov_vf_driver | igb_uio | +-----------------------+---------------------------------------------------------------------------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system host-if-show controller-0 sriovfh1 +-----------------+--------------------------------------+ | Property | Value | +-----------------+--------------------------------------+ | ifname | sriovfh1 | | iftype | ethernet | | ports | [u'enp177s0f3'] | | imac | 40:a6:b7:34:e4:a3 | | imtu | 9216 | | ifclass | pci-sriov | | ptp_role | none | | aemode | None | | schedpolicy | None | | txhashpolicy | None | | uuid | 6f30a690-2414-424f-b5fc-d324d63cc502 | | ihost_uuid | 8075e0db-4cc5-4d74-8601-849adce97b7e | | vlan_id | None | | uses | [] | | used_by | [] | | created_at | | | updated_at | | | sriov_numvfs | 16 | | sriov_vf_driver | vfio | | accelerated | [True] | +-----------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-list controller-0 +--------------+--------------------------------------+----------+------------------+ | hostname | uuid | ifname | datanetwork_name | +--------------+--------------------------------------+----------+------------------+ | controller-0 | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | sriovfh1 | datanet-c | | controller-0 | 6aff29d7-cfaf-48b4-9802-b17b8a025efc | sriovdn1 | datanetdn1 | | controller-0 | 76a2da50-11a6-408e-90b3-3a316cef6557 | sriovmh1 | datanetmh1 | | controller-0 | e155e1d0-8dec-47e6-ac60-076832698a95 | sriovfh1 | datanet-u | | controller-0 | e569db46-a31b-4b8f-b7ca-175b1168798f | sriovbh1 | datanetbh1 | +--------------+--------------------------------------+----------+------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-show datanet-c controller-0 datanet-ccontroller-0 datanet-c datanet-clist controller-0 +--------------+--------------------------------------+----------+------------------+ | hostname | uuid | ifname | datanetwork_name | +--------------+--------------------------------------+----------+------------------+ | controller-0 | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | sriovfh1 | datanet-c | | controller-0 | 6aff29d7-cfaf-48b4-9802-b17b8a025efc | sriovdn1 | datanetdn1 | | controller-0 | 76a2da50-11a6-408e-90b3-3a316cef6557 | sriovmh1 | datanetmh1 | | controller-0 | e155e1d0-8dec-47e6-ac60-076832698a95 | sriovfh1 | datanet-u | | controller-0 | e569db46-a31b-4b8f-b7ca-175b1168798f | sriovbh1 | datanetbh1 | +--------------+--------------------------------------+----------+------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-list controller-0show 63a44e7b-18f4-4f9b-8504-a950cb8abb86 +------------------+--------------------------------------+ | Property | Value | +------------------+--------------------------------------+ | hostname | controller-0 | | uuid | 63a44e7b-18f4-4f9b-8504-a950cb8abb86 | | ifname | sriovfh1 | | datanetwork_name | datanet-c | +------------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# system interface-datanetwork-show 63a44e7b-18f4-4f9b-8504-a950cb8abb86e155e1d0-8dec-47e6-ac60-076832698a95 +------------------+--------------------------------------+ | Property | Value | +------------------+--------------------------------------+ | hostname | controller-0 | | uuid | e155e1d0-8dec-47e6-ac60-076832698a95 | | ifname | sriovfh1 | | datanetwork_name | datanet-u | +------------------+--------------------------------------+ [root at controller-0 sysadmin(keystone_admin)]# sriov device plugin logs: ===================================================================================== controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep intel_fpga_fec "resourceName": "intel_fpga_fec", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275709 138581 manager.go:193] validating resource name "intel.com/intel_fpga_fec" I0303 13:47:07.450400 138581 manager.go:116] Creating new ResourcePool: intel_fpga_fec I0303 13:47:07.450446 138581 manager.go:145] New resource server is created for intel_fpga_fec ResourcePool I0303 13:47:07.453772 138581 server.go:191] starting intel_fpga_fec device plugin endpoint at: intel.com_intel_fpga_fec.sock I0303 13:47:07.454032 138581 server.go:217] intel_fpga_fec device plugin endpoint started serving I0303 13:47:07.640208 138581 server.go:106] Plugin: intel.com_intel_fpga_fec.sock gets registered successfully at Kubelet I0303 13:47:07.640225 138581 server.go:131] ListAndWatch(intel_fpga_fec) invoked I0303 13:47:07.640342 138581 server.go:139] ListAndWatch(intel_fpga_fec): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:1d:01.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},},} controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep intel_fpga_fecpci_sriov_net_datanet_c "resourceName": "pci_sriov_net_datanet_c", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275645 138581 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanet_c" I0303 13:47:07.449979 138581 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanet_c I0303 13:47:07.450122 138581 manager.go:145] New resource server is created for pci_sriov_net_datanet_c ResourcePool I0303 13:47:07.450478 138581 server.go:191] starting pci_sriov_net_datanet_c device plugin endpoint at: intel.com_pci_sriov_net_datanet_c.sock I0303 13:47:07.451088 138581 server.go:217] pci_sriov_net_datanet_c device plugin endpoint started serving I0303 13:47:07.639929 138581 server.go:131] ListAndWatch(pci_sriov_net_datanet_c) invoked I0303 13:47:07.640068 138581 server.go:106] Plugin: intel.com_pci_sriov_net_datanet_c.sock gets registered successfully at Kubelet I0303 13:47:07.639996 138581 server.go:139] ListAndWatch(pci_sriov_net_datanet_c): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0f.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} controller-0:/home/sysadmin# kubectl logs kube-sriov-device-plugin-amd64-h9kp8 -n kube-system | grep pci_sriov_net_datanet_cu "resourceName": "pci_sriov_net_datanet_u", I0303 13:47:07.275600 138581 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanet_c DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260320} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c960 SelectorObj:0xc0002603c0} {ResourcePrefix: ResourceName:pci_sriov_net_datanet_u DeviceType:netDevice Selectors:0xc00000c9a0 SelectorObj:0xc000260460} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c9c0 SelectorObj:0xc00014c820}] I0303 13:47:07.275700 138581 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanet_u" I0303 13:47:07.450306 138581 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanet_u I0303 13:47:07.450388 138581 manager.go:145] New resource server is created for pci_sriov_net_datanet_u ResourcePool I0303 13:47:07.453443 138581 server.go:191] starting pci_sriov_net_datanet_u device plugin endpoint at: intel.com_pci_sriov_net_datanet_u.sock I0303 13:47:07.453750 138581 server.go:217] pci_sriov_net_datanet_u device plugin endpoint started serving I0303 13:47:07.639929 138581 server.go:131] ListAndWatch(pci_sriov_net_datanet_u) invoked I0303 13:47:07.639945 138581 server.go:139] ListAndWatch(pci_sriov_net_datanet_u): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0e.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0e.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0f.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} I0303 13:47:07.640791 138581 server.go:106] Plugin: intel.com_pci_sriov_net_datanet_u.sock gets registered successfully at Kubelet controller-0:/home/sysadmin# controller-0:/home/sysadmin# controller-0:/home/sysadmin# Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From Bill.Zvonar at windriver.com Wed Mar 10 15:57:30 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 10 Mar 2021 15:57:30 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 10, 2021) In-Reply-To: References: Message-ID: From today's call... * Standing Topics * Build/Sanity * build is ok * sanity is yellow, per http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010978.html * Frank will have the Containers team look into this * some issues with the database where we store log files, Nicolae will send more details to the mailing list * Gerrit Reviews in Need of Attention * https://review.opendev.org/c/starlingx/openstack-armada-app/+/768388, Bob add Jim as reviewer, but no feedback from jim. * Topics for this Week * PTG April 19-23 * PTG is happening on April 19-23 and the community needs to decide how much time they need during the event to meet and discuss project related matters * deadline to request time slots is March 25 - this was done during the TSC call * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010969.html * https://etherpad.opendev.org/p/stx-ptg-planning-april-2021 * ARs from Previous Meetings * nothing to discuss * Open Requests for Help * How to load SCTP module persistently * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010951.html * not supported, requester could work on introducing the SCTP module to StarlingX * stx 4.0.1 kubernetes sriov resources suddenly disappears * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010959.html * Frank responded * issue with customize horizon openstack dashboard * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010955.html * no response * CPU Isolation discrepancy * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010957.html * Frank will ask Chris F to respond * Kubernetes support Juju Charms? * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010958.html * no response * Instance failed: No valid host was found * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010960.html * not enough info, they need to look through Nova scheduler logs & Nova compute logs to see why it couldn’t find a valid host * Managing VFs in SRIOV resource list * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010977.html * Bill will ask Steve W to have a look at this * Controller-0 Degraded * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010967.html * we discussed on the call with Sanath * Duplex active/active * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/010974.html * Bill will ask them to review https://docs.starlingx.io/deploy/deployment-config-options-all-in-one-duplex-configuration.html * Build Matters (if required) * nothing this week From: Zvonar, Bill Sent: Tuesday, March 9, 2021 11:41 AM To: starlingx-discuss at lists.starlingx.io Subject: Community (& TSC) Call (Mar 10, 2021) Hi all, reminder of the weekly TSC/Community calls coming up tomorrow. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210310T1500 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From Bill.Zvonar at windriver.com Wed Mar 10 16:19:00 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 10 Mar 2021 16:19:00 +0000 Subject: [Starlingx-discuss] Duplex active/active In-Reply-To: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> References: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> Message-ID: Hi there - we discussed on the Community Call today & it was suggested that you should refer to this section of the documentation: https://docs.starlingx.io/deploy/deployment-config-options-all-in-one-duplex-configuration.html Thanks, Bill... -----Original Message----- From: lists at optimcloud.com Sent: Tuesday, March 9, 2021 9:42 PM To: Starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] Duplex active/active [Please note: This e-mail is from an EXTERNAL e-mail address] okay so i get the stx services are set /active/active3 looking thropugh sm-dump is there no way to utilize both servers for pods via scaling also ? right now its all running on 1 box, the second, is kinda just sitting there waiting for something drastic to occur or is this where i really need a worker node also thanks _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Steven.Webster at windriver.com Wed Mar 10 16:43:16 2021 From: Steven.Webster at windriver.com (Webster, Steven) Date: Wed, 10 Mar 2021 16:43:16 +0000 Subject: [Starlingx-discuss] Managing VFs in SRIOV resource list In-Reply-To: References: Message-ID: Hi Venkata, You should be able to 'split the nic' by creating a vf type interface as a child of the sriovfh1 with a subset of VFs, then assign each interface to its own data network. For example, if you wanted to give 4 VFs to each u-plane and c-plane: system host-if-modify -m 9216 -n sriovfh1 -c pci-sriov -N 8 --vf-driver=vfio controller-0 enp177s0f3 system host-if-add -c pci-sriov controller-0 sriovfh2 vf sriovfh1 -N 4 --vf-driver=vfio system interface-datanetwork-assign controller-0 sriovfh1 datanet-u system interface-datanetwork-assign controller-0 sriovfh2 datanet-c Then you can create separate network attachment definitions for the c-plane and u-plane with your desired vlan(s). Steve From: Venkata Ramana Veldanda Sent: Saturday, March 6, 2021 12:35 AM To: starlingx-discuss at lists.starlingx.io Cc: Srinivas Sadagopan Subject: Re: [Starlingx-discuss] Managing VFs in SRIOV resource list [Please note: This e-mail is from an EXTERNAL e-mail address] Resending with a small correction. From: Venkata Ramana Veldanda Sent: Saturday, March 6, 2021 9:02 AM To: starlingx-discuss at lists.starlingx.io Subject: Managing VFs in SRIOV resource list Hi - We have a requirement to create two SR-IOV resource lists from same physical interface. This requirement is for a use case where we are running Intel Flexran software in a Kuberenetes pod. The Intel Flexran software requires that a u-plane VLAN is assigned to a VF and passed as u-plane VF to the software command line. Similarly, a c-plane VLAN needs to be assigned to a VF and passed as c-plane VF to the software command line. The SR-IOV daemon set supports this configuration: { "resourceName": "intel_sriov_dpdk_cplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#4-7" ], "drivers": [ "igb_uio" ] } }, { "resourceName": "intel_sriov_dpdk_uplane", "resourcePrefix": "radisys.com", "selectors": { "rootDevices": [ "0000:18:00.3#0-3" ], "drivers": [ "igb_uio" ] } } In order to achieve this we followed the below steps in StarlingX Create Datanetworks for C and U plane traffic $ system datanetwork-add datanet-u -m 9216 vlan $ system datanetwork-add datanet-c -m 9216 vlan $ system host-if-modify -m 9216 -n sriovfh1 -c pci-sriov -N 8 --vf-driver=vfio controller-0 enp177s0f3 $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-u $ system interface-datanetwork-assign controller-0 sriovfh1 datanet-c And we ended up in getting 2 resource lists (one for the C-PLANE and U-PLANE) but both of them containing the same list of VFs. Is there a way I can configure separate VFs for both the resource list that I shown in the above example?. In a standard Kubernetes deployment I would directly change the configmap & re-run the SRIOV daemon set. How can do this in StarlingX and does any System API support this? $ cat /etc/pcidp/config.json { "resourceName": "pci_sriov_net_datanet_up", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, { "resourceName": "pci_sriov_net_datanet_cp", "selectors": { "vendors": [ "8086" ], "drivers": [ "vfio-pci" ], "devices": [ "154c" ], "pfNames": [ "enp177s0f3#0,1,2,3,4,5,6,7" ] } }, Venkata Veldanda -------------- next part -------------- An HTML attachment was scrubbed... URL: From maryx.camp at intel.com Wed Mar 10 21:10:50 2021 From: maryx.camp at intel.com (Camp, MaryX) Date: Wed, 10 Mar 2021 21:10:50 +0000 Subject: [Starlingx-discuss] [docs] [meeting] Docs team notes 10-Mar-21 Message-ID: Hello all, Here are this week's docs team meeting minutes (short form). Details in [2]. Join us if you have interest in StarlingX docs! We meet on Wednesdays 12:30 PST. [1] Call logistics: https://wiki.openstack.org/wiki/Starlingx/Meetings [2] Tracking Etherpad: https://etherpad.openstack.org/p/stx-documentation thanks, Mary Camp ========== 10-Mar-21 Reviews merged since last meeting: 3 Bug status -- 17 total - team agrees to defer all low priority LP until the upstreaming effort is completed. 13 LP are WIP against API documentation, which is generated from source code (low priority). Those reviews are here: https://review.opendev.org/#/q/project:starlingx/config New on 10Feb21: Documentation needs to be updated for LAG and VLAN type interfaces [https://bugs.launchpad.net/starlingx/+bug/1915285] Status/questions/opens Greg told us that a LP is coming to update the CLI guides. The team agrees that the CLIs need to be updated (last published in R3). Greg has an AR to gather the snapshot of what the R5 CLIs look like. We want to store the CLI dump in the repo so we can use it for future comparisons. A CephFS review is coming from the WR team, it will be part of the storage guide. Juanita and Rafael are working on this. Story: https://storyboard.openstack.org/#!/story/2008162 Rafael has submitted 7 reviews already to close the gap between pre- and post-upstream docs. He's making good progress. Release Notes - Mary has the AR to send email to the STX discuss list that the WIP release notes file is available. Feature leads are asked to add comments by 16 April. Comments should be a couple of sentences about the feature and link to the documentation (if any). Theme updates - first review is merged. Waiting a week or so before next review to see if any issues crop up. From lists at optimcloud.com Thu Mar 11 01:41:03 2021 From: lists at optimcloud.com (Embedded Devel) Date: Thu, 11 Mar 2021 08:41:03 +0700 Subject: [Starlingx-discuss] Duplex active/active In-Reply-To: References: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> Message-ID: <47be054f-1f8d-5d9f-e4f0-352b96f17e67@optimcloud.com> On 3/10/21 11:19 PM, Zvonar, Bill wrote: > Hi there - we discussed on the Community Call today & it was suggested that you should refer to this section of the documentation: > > https://docs.starlingx.io/deploy/deployment-config-options-all-in-one-duplex-configuration.html > > Thanks, Bill... Yupp i read that before i deployed, however i was hoping both servers could act as workers also instead of just the one, but yeah i get it.... i need the HA of duplex, so simplex + a worker not going to be good, but dont need 3-5 boxes to run what ive got. however 1 is a bit shy of capacity, 2 would be perfect. :) > > -----Original Message----- > From: lists at optimcloud.com > Sent: Tuesday, March 9, 2021 9:42 PM > To: Starlingx-discuss at lists.starlingx.io > Subject: [Starlingx-discuss] Duplex active/active > > [Please note: This e-mail is from an EXTERNAL e-mail address] > > okay so i get the stx services are set /active/active3 looking thropugh sm-dump is there no way to utilize both servers for pods via scaling also ? > > right now its all running on 1 box, the second, is kinda just sitting there waiting for something drastic to occur or is this where i really need a worker node also > > thanks > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From lists at optimcloud.com Thu Mar 11 06:08:30 2021 From: lists at optimcloud.com (Embedded Devel) Date: Thu, 11 Mar 2021 13:08:30 +0700 Subject: [Starlingx-discuss] Application Upload Failure Message-ID: Newly deployed duplex system, seeing these 2 errors, how to resolve ?  750.001  | Application Upload Failure | k8s_application=oidc- | warning  | 2021-03-10T15: | |          |                            | auth-apps |          | 07:12.435159   | | 750.001  | Application Upload Failure | k8s_application=      | warning  | 2021-03-10T15: | |          |                            | platform-integ-apps |          | 06:41.695345   | From lists at optimcloud.com Thu Mar 11 08:44:47 2021 From: lists at optimcloud.com (Embedded Devel) Date: Thu, 11 Mar 2021 15:44:47 +0700 Subject: [Starlingx-discuss] Application Upload Failure In-Reply-To: References: Message-ID: <8eac1c63-8f25-10bc-5b98-369c5d1a8b11@optimcloud.com> On 3/11/21 1:08 PM, Embedded Devel wrote: > Newly deployed duplex system, seeing these 2 errors, how to resolve ? > >  750.001  | Application Upload Failure | k8s_application=oidc- | > warning  | 2021-03-10T15: | > |          |                            | auth-apps |          | > 07:12.435159   | > > > | 750.001  | Application Upload Failure | k8s_application=      | > warning  | 2021-03-10T15: | > |          |                            | platform-integ-apps > |          | 06:41.695345   | > okay nevermind i got it sorted, application-delete and they re-uploaded fine.... all good now > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Greg.Waines at windriver.com Thu Mar 11 12:18:46 2021 From: Greg.Waines at windriver.com (Waines, Greg) Date: Thu, 11 Mar 2021 12:18:46 +0000 Subject: [Starlingx-discuss] Duplex active/active In-Reply-To: <47be054f-1f8d-5d9f-e4f0-352b96f17e67@optimcloud.com> References: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> <47be054f-1f8d-5d9f-e4f0-352b96f17e67@optimcloud.com> Message-ID: Not sure I follow what you're saying ... in AIO-Duplex, both servers do 'act as workers'. I.e. both servers are dual role being both master and worker; dedicating a small subset of resources (cpu, mem, disk) to master role and a larger subset of resources to worker role. Gre.g -----Original Message----- From: Embedded Devel Sent: Wednesday, March 10, 2021 8:41 PM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] Duplex active/active [Please note: This e-mail is from an EXTERNAL e-mail address] On 3/10/21 11:19 PM, Zvonar, Bill wrote: > Hi there - we discussed on the Community Call today & it was suggested that you should refer to this section of the documentation: > > https://docs.starlingx.io/deploy/deployment-config-options-all-in-one- > duplex-configuration.html > > Thanks, Bill... Yupp i read that before i deployed, however i was hoping both servers could act as workers also instead of just the one, but yeah i get it.... i need the HA of duplex, so simplex + a worker not going to be good, but dont need 3-5 boxes to run what ive got. however 1 is a bit shy of capacity, 2 would be perfect. :) > > -----Original Message----- > From: lists at optimcloud.com > Sent: Tuesday, March 9, 2021 9:42 PM > To: Starlingx-discuss at lists.starlingx.io > Subject: [Starlingx-discuss] Duplex active/active > > [Please note: This e-mail is from an EXTERNAL e-mail address] > > okay so i get the stx services are set /active/active3 looking thropugh sm-dump is there no way to utilize both servers for pods via scaling also ? > > right now its all running on 1 box, the second, is kinda just sitting > there waiting for something drastic to occur or is this where i really > need a worker node also > > thanks > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From lists at optimcloud.com Thu Mar 11 12:24:54 2021 From: lists at optimcloud.com (Embedded Devel) Date: Thu, 11 Mar 2021 19:24:54 +0700 Subject: [Starlingx-discuss] Duplex active/active In-Reply-To: References: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> <47be054f-1f8d-5d9f-e4f0-352b96f17e67@optimcloud.com> Message-ID: <7f636d7b-addc-a1bb-a363-2c02d5d6821d@optimcloud.com> On 3/11/21 7:18 PM, Waines, Greg wrote: > Not sure I follow what you're saying ... in AIO-Duplex, both servers do 'act as workers'. > I.e. both servers are dual role being both master and worker; dedicating a small subset of resources (cpu, mem, disk) to master role and a larger subset of resources to worker role. > Gre.g say i deploy X app ... its web based with an ingress, nginx web service for instance, can i scale the pod to both nodes, and loadbalance it or does it only run on the one node, until a failure occurs. > > -----Original Message----- > From: Embedded Devel > Sent: Wednesday, March 10, 2021 8:41 PM > To: starlingx-discuss at lists.starlingx.io > Subject: Re: [Starlingx-discuss] Duplex active/active > > [Please note: This e-mail is from an EXTERNAL e-mail address] > > On 3/10/21 11:19 PM, Zvonar, Bill wrote: >> Hi there - we discussed on the Community Call today & it was suggested that you should refer to this section of the documentation: >> >> https://docs.starlingx.io/deploy/deployment-config-options-all-in-one- >> duplex-configuration.html >> >> Thanks, Bill... > Yupp i read that before i deployed, however i was hoping both servers could act as workers also instead of just the one, but yeah i get it.... > i need the HA of duplex, so simplex + a worker not going to be good, but dont need 3-5 boxes to run what ive got. however 1 is a bit shy of capacity, 2 would be perfect. :) > > >> -----Original Message----- >> From: lists at optimcloud.com >> Sent: Tuesday, March 9, 2021 9:42 PM >> To: Starlingx-discuss at lists.starlingx.io >> Subject: [Starlingx-discuss] Duplex active/active >> >> [Please note: This e-mail is from an EXTERNAL e-mail address] >> >> okay so i get the stx services are set /active/active3 looking thropugh sm-dump is there no way to utilize both servers for pods via scaling also ? >> >> right now its all running on 1 box, the second, is kinda just sitting >> there waiting for something drastic to occur or is this where i really >> need a worker node also >> >> thanks >> >> _______________________________________________ >> Starlingx-discuss mailing list >> Starlingx-discuss at lists.starlingx.io >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss >> _______________________________________________ >> Starlingx-discuss mailing list >> Starlingx-discuss at lists.starlingx.io >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Greg.Waines at windriver.com Thu Mar 11 13:16:41 2021 From: Greg.Waines at windriver.com (Waines, Greg) Date: Thu, 11 Mar 2021 13:16:41 +0000 Subject: [Starlingx-discuss] Duplex active/active In-Reply-To: <7f636d7b-addc-a1bb-a363-2c02d5d6821d@optimcloud.com> References: <5a6aaa6ba405a1a004750dc810c3b16e@optimcloud.com> <47be054f-1f8d-5d9f-e4f0-352b96f17e67@optimcloud.com> <7f636d7b-addc-a1bb-a363-2c02d5d6821d@optimcloud.com> Message-ID: Yes, you can scale your application's deployment to multiple replicas and the replicas will get distributed across both nodes. Greg. -----Original Message----- From: Embedded Devel Sent: Thursday, March 11, 2021 7:25 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] Duplex active/active [Please note: This e-mail is from an EXTERNAL e-mail address] On 3/11/21 7:18 PM, Waines, Greg wrote: > Not sure I follow what you're saying ... in AIO-Duplex, both servers do 'act as workers'. > I.e. both servers are dual role being both master and worker; dedicating a small subset of resources (cpu, mem, disk) to master role and a larger subset of resources to worker role. > Gre.g say i deploy X app ... its web based with an ingress, nginx web service for instance, can i scale the pod to both nodes, and loadbalance it or does it only run on the one node, until a failure occurs. > > -----Original Message----- > From: Embedded Devel > Sent: Wednesday, March 10, 2021 8:41 PM > To: starlingx-discuss at lists.starlingx.io > Subject: Re: [Starlingx-discuss] Duplex active/active > > [Please note: This e-mail is from an EXTERNAL e-mail address] > > On 3/10/21 11:19 PM, Zvonar, Bill wrote: >> Hi there - we discussed on the Community Call today & it was suggested that you should refer to this section of the documentation: >> >> https://docs.starlingx.io/deploy/deployment-config-options-all-in-one >> - >> duplex-configuration.html >> >> Thanks, Bill... > Yupp i read that before i deployed, however i was hoping both servers could act as workers also instead of just the one, but yeah i get it.... > i need the HA of duplex, so simplex + a worker not going to be good, > but dont need 3-5 boxes to run what ive got. however 1 is a bit shy of > capacity, 2 would be perfect. :) > > >> -----Original Message----- >> From: lists at optimcloud.com >> Sent: Tuesday, March 9, 2021 9:42 PM >> To: Starlingx-discuss at lists.starlingx.io >> Subject: [Starlingx-discuss] Duplex active/active >> >> [Please note: This e-mail is from an EXTERNAL e-mail address] >> >> okay so i get the stx services are set /active/active3 looking thropugh sm-dump is there no way to utilize both servers for pods via scaling also ? >> >> right now its all running on 1 box, the second, is kinda just sitting >> there waiting for something drastic to occur or is this where i >> really need a worker node also >> >> thanks >> >> _______________________________________________ >> Starlingx-discuss mailing list >> Starlingx-discuss at lists.starlingx.io >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss >> _______________________________________________ >> Starlingx-discuss mailing list >> Starlingx-discuss at lists.starlingx.io >> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From lists at optimcloud.com Thu Mar 11 14:05:32 2021 From: lists at optimcloud.com (Embedded Devel) Date: Thu, 11 Mar 2021 21:05:32 +0700 Subject: [Starlingx-discuss] openstack networking Message-ID: <75ee4d48-fd2e-4165-c1ce-12832a1bd5d4@optimcloud.com> can someone explain, in short detail what this screen is asking for, trying to get through tenant networking https://pasteboard.co/JS7WpED.png Thanks From alexandru.dimofte at intel.com Thu Mar 11 14:31:40 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Thu, 11 Mar 2021 14:31:40 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210310T071056Z Message-ID: Sanity Test from 2021-March-10 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210310T071056Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210310T071056Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From scott.little at windriver.com Thu Mar 11 14:32:39 2021 From: scott.little at windriver.com (Scott Little) Date: Thu, 11 Mar 2021 09:32:39 -0500 Subject: [Starlingx-discuss] files.starlingx.kube.cengn.ca is not working In-Reply-To: References: Message-ID: <29d6c339-bc91-32da-d47a-29bc651671b1@windriver.com> CENGN thinks they have it fixed.  Try now. Scott On 2021-03-10 10:28 a.m., Jascanu, Nicolae wrote: > > **[Please note: This e-mail is from an EXTERNAL e-mail address] > > Hi All, > > I’m trying to upload the logs collected at: > https://files.starlingx.kube.cengn.ca/ > but I’m getting a mysql > connection error > > pymysql.err.OperationalError > > pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on > 'db' (timed out)") > > Regards, > > Nicolae Jascanu, Ph.D. > > Software Engineer > > IOTG > > Galati, Romania > > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From Frank.Miller at windriver.com Thu Mar 11 14:34:48 2021 From: Frank.Miller at windriver.com (Miller, Frank) Date: Thu, 11 Mar 2021 14:34:48 +0000 Subject: [Starlingx-discuss] files.starlingx.kube.cengn.ca is not working In-Reply-To: References: Message-ID: Thanks Nicolae for highlighting this issue. Scott was able to contact the CENGN folks and get this service back up and running. Let us know if there are any new issues with the logfile service. Frank From: Jascanu, Nicolae Sent: Wednesday, March 10, 2021 10:28 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] files.starlingx.kube.cengn.ca is not working [Please note: This e-mail is from an EXTERNAL e-mail address] Hi All, I'm trying to upload the logs collected at: https://files.starlingx.kube.cengn.ca/ but I'm getting a mysql connection error pymysql.err.OperationalError pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on 'db' (timed out)") Regards, Nicolae Jascanu, Ph.D. Software Engineer IOTG Galati, Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: From ildiko.vancsa at gmail.com Thu Mar 11 16:48:52 2021 From: ildiko.vancsa at gmail.com (Ildiko Vancsa) Date: Thu, 11 Mar 2021 17:48:52 +0100 Subject: [Starlingx-discuss] openstack networking In-Reply-To: <75ee4d48-fd2e-4165-c1ce-12832a1bd5d4@optimcloud.com> References: <75ee4d48-fd2e-4165-c1ce-12832a1bd5d4@optimcloud.com> Message-ID: <59D5563E-0C49-43C6-AFF9-41B147430845@gmail.com> Hi, I’m not the expert of how OpenStack networking works, but found some materials that go into explaining the networking terms and concepts that Neutron is using: * https://superuser.openstack.org/articles/tenant-networks-vs-provider-networks-in-the-private-cloud-context/ * https://superuser.openstack.org/articles/spot-the-difference-tenant-provider-and-external-neutron-networks/ * https://www.redhat.com/en/blog/four-types-neutron-networks-you-must-understand They are not necessarily the latest documents, but I believe the basics haven’t changed completely since they were published. I would also suggest to try to reach out to the Neutron team on the #openstack-neutron IRC channel as they are the experts of how that service works and might be able to advise on how it would be beneficial for you to set it up for your use case. I hope this helps. Thanks, Ildikó > On Mar 11, 2021, at 15:05, Embedded Devel wrote: > > can someone explain, in short detail what this screen is asking for, trying to get through tenant networking > > https://pasteboard.co/JS7WpED.png > > Thanks > > > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Ghada.Khalil at windriver.com Fri Mar 12 02:34:00 2021 From: Ghada.Khalil at windriver.com (Khalil, Ghada) Date: Fri, 12 Mar 2021 02:34:00 +0000 Subject: [Starlingx-discuss] stx.5.0 Milestone-3 Declared Message-ID: Hello all, Based on the stx.5.0 release review on Mar 10/2021, the relase team is declaring Milestone-3 with a date of Mar 10/2021. Feature Status: https://docs.google.com/spreadsheets/d/1JbOQELqXG_GDoP1jo6YoRDytpTkJEs89TVimzvrqc_A/edit#gid=1107209846 Feature Testing Status: https://docs.google.com/spreadsheets/d/1jro4ItdSobB0-fseK_4cOZJHhUyuh_eCBBsDOp_A5Pc/edit#gid=968103774 Thank you to all community members who helped achieve this milestone. Regards, Ghada & the stx release team From Ghada.Khalil at windriver.com Fri Mar 12 02:44:34 2021 From: Ghada.Khalil at windriver.com (Khalil, Ghada) Date: Fri, 12 Mar 2021 02:44:34 +0000 Subject: [Starlingx-discuss] Minutes: StarlingX Release Meeting - Mar 10/2021 Message-ID: Agenda/Minutes are posted at: https://etherpad.openstack.org/p/stx-releases Release Team Meeting - March 10 2021 stx.5.0 - Milestone-3 Declaration - Agreed to declare milestone on 3/10 - Feature Status: https://docs.google.com/spreadsheets/d/1JbOQELqXG_GDoP1jo6YoRDytpTkJEs89TVimzvrqc_A/edit#gid=1107209846 - Feature Test: https://docs.google.com/spreadsheets/d/1jro4ItdSobB0-fseK_4cOZJHhUyuh_eCBBsDOp_A5Pc/edit#gid=968103774 - Regression Test - Regression started last week - Tracking: https://docs.google.com/spreadsheets/d/10PcWeT2N1_wSONCCfDF_WGePyNK0c_tqUTTkypNkNiE/edit#gid=1717644237 - Docs - Added by MaryC for March 10 meeting: - The docs team has created a WIP review for STX 5.0 Release Notes: https://review.opendev.org/c/starlingx/docs/+/777433 - We're asking all feature leads to add a comment with a short feature description and link to doc as their features are completed. - Target Deadline: April 16 stx.6.0 - PTG Week: April 19 - Team would like to review feature proposals for stx.6.0 during the PTG - TSC team to create an etherpad to collect feature ideas for the PTG - - Ghada to create a release plan google sheet for primes/resourcing info - https://docs.google.com/spreadsheets/d/13p0BMlBgJXUVForOFsblAJq9jA1-FMBlmhV5TIc70IE/edit#gid=0 - For PTG, primes can create slides for feature proposals as needed - Release Folder: https://drive.google.com/drive/folders/1exEyxC1M0wDaQeCdqjOGgt409PfPDNl2 From alexandru.dimofte at intel.com Fri Mar 12 07:29:31 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Fri, 12 Mar 2021 07:29:31 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210311T065832Z Message-ID: Sanity Test from 2021-March-11 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210311T065832Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210311T065832Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From susendra.selvaraj at intel.com Fri Mar 12 09:24:21 2021 From: susendra.selvaraj at intel.com (Selvaraj, Susendra) Date: Fri, 12 Mar 2021 09:24:21 +0000 Subject: [Starlingx-discuss] Controller-0 Degraded In-Reply-To: References: Message-ID: Hello Sanath, You could cleanup some space in the root partition, controller-0 can get back to ‘available’ state automatically. Yeah, cleaning up space is messy. We need to have the proper solution. Attached mail in regards to space consumed by tmpfs – wondering its allocation around 63GB & only 1% is used. Need to justify. Regards, Susendra. From: sanath kumar Sent: Monday, March 8, 2021 3:40 PM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] Controller-0 Degraded Regards, Sanath Kumar +91 8971546076 On Mon, 8 Mar 2021 at 15:37, sanath kumar > wrote: Hello StarrlingX Team, 1. As a reply to the previous meet, I am posting these screenshot and documentation which has information regarding the memory allocated to controller-0. Memory allocated to controller-0 was 20GB, and my machine has 2.2T of memory. And my question was, Is there any method where we can increase the controller-0 memory allocation. 2. Since the availability of controller-0 is degraded, Is there any way we make the availability of controller-0 available? Below are the links which have the information regarding controller-0 1. https://drive.google.com/file/d/1phZPTh3IlpoqRLJQJTJA2puJxTtHWai_/view 2. https://drive.google.com/file/d/1vHx-GZ5mxAbnAiegK8jl7GqnjtokmaWf/view Note: Virtual All-in-one Simplex Installation R4.0 Regards, Sanath Kumar +91 8971546076 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded message was scrubbed... From: "Selvaraj, Susendra" Subject: RE: space consumption on STX machine Date: Thu, 4 Mar 2021 08:33:18 +0000 Size: 1178793 URL: From sanathukumar14 at gmail.com Fri Mar 12 12:42:53 2021 From: sanathukumar14 at gmail.com (sanath kumar) Date: Fri, 12 Mar 2021 18:12:53 +0530 Subject: [Starlingx-discuss] Controller-0 Degraded In-Reply-To: References: Message-ID: Thank You so much, I will look into it. Regards, Sanath Kumar +91 8971546076 On Fri, 12 Mar 2021 at 14:54, Selvaraj, Susendra < susendra.selvaraj at intel.com> wrote: > Hello Sanath, > > > > You could cleanup some space in the root partition, *controller-0 can get > back to ‘available’ state* automatically. > > Yeah, cleaning up space is messy. We need to have the proper solution. > > > > Attached mail in regards to space consumed by tmpfs – wondering its > allocation around 63GB & only 1% is used. Need to justify. > > > > Regards, > > Susendra. > > > > *From:* sanath kumar > *Sent:* Monday, March 8, 2021 3:40 PM > *To:* starlingx-discuss at lists.starlingx.io > *Subject:* Re: [Starlingx-discuss] Controller-0 Degraded > > > > > Regards, > > Sanath Kumar > > +91 8971546076 > > > > > > On Mon, 8 Mar 2021 at 15:37, sanath kumar > wrote: > > Hello StarrlingX Team, > > 1. As a reply to the previous meet, I am posting these screenshot and > documentation which has information regarding the memory allocated to > controller-0. Memory allocated to controller-0 was 20GB, and my machine has > 2.2T of memory. And my question was, Is there any method where we can > increase the controller-0 memory allocation. > 2. Since the *availability *of *controller-0* is *degraded*, Is there > any way we make *the availability *of controller-0 available? > > > > Below are the links which have the information regarding controller-0 > > 1. > https://drive.google.com/file/d/1phZPTh3IlpoqRLJQJTJA2puJxTtHWai_/view > 2. > https://drive.google.com/file/d/1vHx-GZ5mxAbnAiegK8jl7GqnjtokmaWf/view > > Note: Virtual All-in-one Simplex Installation R4.0 > > > > Regards, > > Sanath Kumar > > +91 8971546076 > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Fri Mar 12 16:18:10 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Fri, 12 Mar 2021 16:18:10 +0000 Subject: [Starlingx-discuss] How to generate the keystone token ? Message-ID: Hi, How to generate the keystone token if stx-openstack is not installed in the system? The token is required in order to access the FaultMgmt Rest API. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Fri Mar 12 16:36:12 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Fri, 12 Mar 2021 16:36:12 +0000 Subject: [Starlingx-discuss] how to enable HTTPS for StarlingX Horizon GUI Message-ID: What is required to enable the HHTPS access for STX-Horizon GUI. By default only HTTP is supported (http://:8080) Regards, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From build.starlingx at gmail.com Fri Mar 12 22:34:13 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Fri, 12 Mar 2021 17:34:13 -0500 (EST) Subject: [Starlingx-discuss] [build-report] STX_build_lst_audit - Build # 1632 - Failure! Message-ID: <160284049.34.1615588455010.JavaMail.javamailuser@localhost> Project: STX_build_lst_audit Build #: 1632 Status: Failure Timestamp: 20210312T222944Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/compiler/20210312T181344Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-compiler/20210312T181344Z DOCKER_BUILD_ID: jenkins-master-compiler-20210312T181344Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master-compiler/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/compiler/20210312T181344Z/logs PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/compiler/20210312T181344Z/logs MASTER_JOB_NAME: STX_build_layer_compiler_master_master LAYER: compiler MY_REPO_ROOT: /localdisk/designer/jenkins/master-compiler PUBLISH_DISTRO_BASE: /export/mirror/starlingx/master/centos/compiler From nicolae.jascanu at intel.com Fri Mar 12 22:41:33 2021 From: nicolae.jascanu at intel.com (Jascanu, Nicolae) Date: Fri, 12 Mar 2021 22:41:33 +0000 Subject: [Starlingx-discuss] files.starlingx.kube.cengn.ca is not working In-Reply-To: <29d6c339-bc91-32da-d47a-29bc651671b1@windriver.com> References: <29d6c339-bc91-32da-d47a-29bc651671b1@windriver.com> Message-ID: Hi Scott, Just tried from inside and outside Intel and I'm getting the same error. Regards, Nicolae Jascanu, Ph.D. Software Engineer IOTG Galati, Romania From: Scott Little Sent: Thursday, March 11, 2021 16:33 To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] files.starlingx.kube.cengn.ca is not working CENGN thinks they have it fixed. Try now. Scott On 2021-03-10 10:28 a.m., Jascanu, Nicolae wrote: [Please note: This e-mail is from an EXTERNAL e-mail address] Hi All, I'm trying to upload the logs collected at: https://files.starlingx.kube.cengn.ca/ but I'm getting a mysql connection error pymysql.err.OperationalError pymysql.err.OperationalError: (2003, "Can't connect to MySQL server on 'db' (timed out)") Regards, Nicolae Jascanu, Ph.D. Software Engineer IOTG Galati, Romania _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From build.starlingx at gmail.com Fri Mar 12 23:04:48 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Fri, 12 Mar 2021 18:04:48 -0500 (EST) Subject: [Starlingx-discuss] [build-report] STX_BUILD_container_setup_layered - Build # 1512 - Failure! Message-ID: <469467410.37.1615590294701.JavaMail.javamailuser@localhost> Project: STX_BUILD_container_setup_layered Build #: 1512 Status: Failure Timestamp: 20210312T223609Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210312T223350Z/logs -------------------------------------------------------------------------------- Parameters PROJECT: master-distro MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-distro/20210312T223350Z DOCKER_BUILD_ID: jenkins-master-distro-20210312T223350Z-builder PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210312T223350Z/logs DOCKER_BUILD_TAG: master-distro-20210312T223350Z-builder-image PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/distro/20210312T223350Z/logs LAYER: distro MY_REPO_ROOT: /localdisk/designer/jenkins/master-distro From build.starlingx at gmail.com Fri Mar 12 23:04:57 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Fri, 12 Mar 2021 18:04:57 -0500 (EST) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_distro_master_master - Build # 429 - Failure! Message-ID: <327566358.40.1615590298381.JavaMail.javamailuser@localhost> Project: STX_build_layer_distro_master_master Build #: 429 Status: Failure Timestamp: 20210312T223350Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210312T223350Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From build.starlingx at gmail.com Sat Mar 13 03:00:30 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Fri, 12 Mar 2021 22:00:30 -0500 (EST) Subject: [Starlingx-discuss] [build-report] STX_BUILD_container_setup_layered - Build # 1514 - Failure! Message-ID: <1214821212.45.1615604431395.JavaMail.javamailuser@localhost> Project: STX_BUILD_container_setup_layered Build #: 1514 Status: Failure Timestamp: 20210313T023156Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210313T023103Z/logs -------------------------------------------------------------------------------- Parameters PROJECT: master-distro MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-distro/20210313T023103Z DOCKER_BUILD_ID: jenkins-master-distro-20210313T023103Z-builder PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210313T023103Z/logs DOCKER_BUILD_TAG: master-distro-20210313T023103Z-builder-image PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/distro/20210313T023103Z/logs LAYER: distro MY_REPO_ROOT: /localdisk/designer/jenkins/master-distro From build.starlingx at gmail.com Sat Mar 13 03:00:32 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Fri, 12 Mar 2021 22:00:32 -0500 (EST) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_distro_master_master - Build # 430 - Still Failing! In-Reply-To: <1747697854.38.1615590296767.JavaMail.javamailuser@localhost> References: <1747697854.38.1615590296767.JavaMail.javamailuser@localhost> Message-ID: <633780450.48.1615604433239.JavaMail.javamailuser@localhost> Project: STX_build_layer_distro_master_master Build #: 430 Status: Still Failing Timestamp: 20210313T023103Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210313T023103Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From alexandru.dimofte at intel.com Sat Mar 13 10:17:28 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Sat, 13 Mar 2021 10:17:28 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210312T023317Z Message-ID: Sanity Test from 2021-March-12 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210312T023317Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210312T023317Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From build.starlingx at gmail.com Sun Mar 14 03:02:25 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Sat, 13 Mar 2021 22:02:25 -0500 (EST) Subject: [Starlingx-discuss] [build-report] STX_BUILD_container_setup_layered - Build # 1516 - Failure! Message-ID: <1315478915.52.1615690946241.JavaMail.javamailuser@localhost> Project: STX_BUILD_container_setup_layered Build #: 1516 Status: Failure Timestamp: 20210314T023305Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210314T023120Z/logs -------------------------------------------------------------------------------- Parameters PROJECT: master-distro MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-distro/20210314T023120Z DOCKER_BUILD_ID: jenkins-master-distro-20210314T023120Z-builder PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210314T023120Z/logs DOCKER_BUILD_TAG: master-distro-20210314T023120Z-builder-image PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/distro/20210314T023120Z/logs LAYER: distro MY_REPO_ROOT: /localdisk/designer/jenkins/master-distro From build.starlingx at gmail.com Sun Mar 14 03:02:27 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Sat, 13 Mar 2021 22:02:27 -0500 (EST) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_distro_master_master - Build # 431 - Still Failing! In-Reply-To: <2041665810.46.1615604431797.JavaMail.javamailuser@localhost> References: <2041665810.46.1615604431797.JavaMail.javamailuser@localhost> Message-ID: <348503024.55.1615690948201.JavaMail.javamailuser@localhost> Project: STX_build_layer_distro_master_master Build #: 431 Status: Still Failing Timestamp: 20210314T023120Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210314T023120Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From Ankush.Rai at commscope.com Sat Mar 13 19:18:17 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Sat, 13 Mar 2021 19:18:17 +0000 Subject: [Starlingx-discuss] Startup logs of other nodes are not visual on console Message-ID: Why the startup logs of other than active controller, not visual on console. How to debug the issues during node startup? In my case secondary controller-node is keep restarting without any trace in the console. Any pointer to starlingx logging documentation will be very helpful. Regards, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From haochuan.z.chen at intel.com Mon Mar 15 07:26:14 2021 From: haochuan.z.chen at intel.com (Chen, Haochuan Z) Date: Mon, 15 Mar 2021 07:26:14 +0000 Subject: [Starlingx-discuss] patch for rook-ceph enhancement Message-ID: Hi Bob I have two patch for rook-ceph, one to enable cephfs and the other one enable rook-ceph report alarm to fm. Please review. https://review.opendev.org/c/starlingx/rook-ceph/+/765693 https://review.opendev.org/c/starlingx/rook-ceph/+/774576 Thanks! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Don.Penney at windriver.com Mon Mar 15 12:39:04 2021 From: Don.Penney at windriver.com (Penney, Don) Date: Mon, 15 Mar 2021 12:39:04 +0000 Subject: [Starlingx-discuss] Startup logs of other nodes are not visual on console In-Reply-To: References: Message-ID: You can setup the console when configuring your nodes, depending on your config. The default will go to the graphical console, tty0. For serial console, for example, you can set "console=ttyS0,115200" with the "system host-update" command when you're setting the node personality. From: Rai, Ankush Sent: Saturday, March 13, 2021 2:18 PM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] Startup logs of other nodes are not visual on console [Please note: This e-mail is from an EXTERNAL e-mail address] Why the startup logs of other than active controller, not visual on console. How to debug the issues during node startup? In my case secondary controller-node is keep restarting without any trace in the console. Any pointer to starlingx logging documentation will be very helpful. Regards, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Andy.Ning at windriver.com Mon Mar 15 13:13:57 2021 From: Andy.Ning at windriver.com (Ning, Antai (Andy)) Date: Mon, 15 Mar 2021 13:13:57 +0000 Subject: [Starlingx-discuss] How to generate the keystone token ? In-Reply-To: References: Message-ID: openstack command "openstack token issue" can be used to issue a token. Or you can use keystoneclient python module programmatically. Andy ________________________________ From: Rai, Ankush Sent: Friday, March 12, 2021 11:18 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] How to generate the keystone token ? [Please note: This e-mail is from an EXTERNAL e-mail address] Hi, How to generate the keystone token if stx-openstack is not installed in the system? The token is required in order to access the FaultMgmt Rest API. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Andy.Ning at windriver.com Mon Mar 15 13:18:00 2021 From: Andy.Ning at windriver.com (Ning, Antai (Andy)) Date: Mon, 15 Mar 2021 13:18:00 +0000 Subject: [Starlingx-discuss] how to enable HTTPS for StarlingX Horizon GUI In-Reply-To: References: Message-ID: HTTPS for Horizon can be enabled by: system modify --https_enabled true Refer to "system help modify" for details. After HTTPS is enabled, a self-signed certificate is installed, you can then install a custom certificate by "system certificate-install -m ssl " Andy ________________________________ From: Rai, Ankush Sent: Friday, March 12, 2021 11:36 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] how to enable HTTPS for StarlingX Horizon GUI [Please note: This e-mail is from an EXTERNAL e-mail address] What is required to enable the HHTPS access for STX-Horizon GUI. By default only HTTP is supported (http://:8080) Regards, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Saul.Wold at windriver.com Mon Mar 15 20:28:38 2021 From: Saul.Wold at windriver.com (Wold, Saul) Date: Mon, 15 Mar 2021 20:28:38 +0000 Subject: [Starlingx-discuss] Multi-OS Meeting (Updated) Tuesday 1430UTC / 0730PT Message-ID: ________________________________ Welcome to the new bi-weekly StarlingX Mulit-OS team meeting. You are invited to join a meeting. Join the meeting: https://meet.jit.si/starlingx-multios To join by phone instead, tap this: +1.512.647.1431,,2792742287# Looking for a different dial-in number? See meeting dial-in numbers: https://meet.jit.si/static/dialInInfo.html?room=starlingx-multios If also dialing-in through a room phone, join without connecting to audio: https://meet.jit.si/starlingx-multios#config.startSilent=true -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 4563 bytes Desc: not available URL: From austin.sun at intel.com Tue Mar 16 05:57:38 2021 From: austin.sun at intel.com (Sun, Austin) Date: Tue, 16 Mar 2021 05:57:38 +0000 Subject: [Starlingx-discuss] Cancel StarlingX Distro-OpenStack: Bi-weekly Project Meeting -- 03/16 Message-ID: Hi All: Cancel today openstack distro meeting since there is not new bugs and major topic. Thanks. BR Austin Sun -------------- next part -------------- An HTML attachment was scrubbed... URL: From austin.sun at intel.com Tue Mar 16 05:54:36 2021 From: austin.sun at intel.com (Sun, Austin) Date: Tue, 16 Mar 2021 05:54:36 +0000 Subject: [Starlingx-discuss] Canceled: StarlingX Distro-OpenStack: Bi-weekly Project Meeting Message-ID: Hi folks, This is a new series of bi-weekly project meeting on StarlingX Distro-OpenStack. Your participation to this meeting and/or other offline contribution by all means are highly appreciated! Project Team Etherpad: https://etherpad.openstack.org/p/stx-distro-openstack-meetings The Winter Time Slot for this meeting : CST: 10:00 PM(China, Shanghai ) PST: 7:00 AM (US West , US, Oregon) EST: 9:00 AM (East Canada , Canada Ottawa) Thanks BR Austin Sun. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 3554 bytes Desc: not available URL: From alexandru.dimofte at intel.com Tue Mar 16 07:26:19 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Tue, 16 Mar 2021 07:26:19 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210314T120003Z Message-ID: Sanity Test from 2021-March-14 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210314T120003Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210314T120003Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From susendra.selvaraj at intel.com Tue Mar 16 09:39:10 2021 From: susendra.selvaraj at intel.com (Selvaraj, Susendra) Date: Tue, 16 Mar 2021 09:39:10 +0000 Subject: [Starlingx-discuss] Controller-0 Degraded In-Reply-To: References: Message-ID: Sure Sanath. Is there a bug in launchpad for this? This is becoming a critical issue. From: sanath kumar Sent: Friday, March 12, 2021 6:13 PM To: Selvaraj, Susendra Cc: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] Controller-0 Degraded Thank You so much, I will look into it. Regards, Sanath Kumar +91 8971546076 On Fri, 12 Mar 2021 at 14:54, Selvaraj, Susendra > wrote: Hello Sanath, You could cleanup some space in the root partition, controller-0 can get back to ‘available’ state automatically. Yeah, cleaning up space is messy. We need to have the proper solution. Attached mail in regards to space consumed by tmpfs – wondering its allocation around 63GB & only 1% is used. Need to justify. Regards, Susendra. From: sanath kumar > Sent: Monday, March 8, 2021 3:40 PM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] Controller-0 Degraded Regards, Sanath Kumar +91 8971546076 On Mon, 8 Mar 2021 at 15:37, sanath kumar > wrote: Hello StarrlingX Team, 1. As a reply to the previous meet, I am posting these screenshot and documentation which has information regarding the memory allocated to controller-0. Memory allocated to controller-0 was 20GB, and my machine has 2.2T of memory. And my question was, Is there any method where we can increase the controller-0 memory allocation. 2. Since the availability of controller-0 is degraded, Is there any way we make the availability of controller-0 available? Below are the links which have the information regarding controller-0 1. https://drive.google.com/file/d/1phZPTh3IlpoqRLJQJTJA2puJxTtHWai_/view 2. https://drive.google.com/file/d/1vHx-GZ5mxAbnAiegK8jl7GqnjtokmaWf/view Note: Virtual All-in-one Simplex Installation R4.0 Regards, Sanath Kumar +91 8971546076 -------------- next part -------------- An HTML attachment was scrubbed... URL: From scott.little at windriver.com Tue Mar 16 15:22:58 2021 From: scott.little at windriver.com (Scott Little) Date: Tue, 16 Mar 2021 11:22:58 -0400 Subject: [Starlingx-discuss] files.starlingx.cengn.ca is working again Message-ID: <32fa7ef2-c652-819a-5b7b-9bef2a8cbf62@windriver.com> files.starlingx.cengn.ca is up and working. You can once again upload files and associate them with your launchpads.  Remember only archival formats are accepted  ... e.g. tar.gz So far we haven't managed to restored the files from before their CENGN's power event. Scott From Saul.Wold at windriver.com Tue Mar 16 22:48:27 2021 From: Saul.Wold at windriver.com (Wold, Saul) Date: Tue, 16 Mar 2021 22:48:27 +0000 Subject: [Starlingx-discuss] Weekly StarlingX OS Distro & Multi-OS meeting Message-ID: Hi All: Update meeting time for DST 1330 UTC / 2130 China. * Cadence and time slot: * Bi-Weekly Wednesday 0930 EDT (1330 UTC, 2130 China time, 0630 PT time) * Call Details: * Zoom link: https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 * Dialing in from phone: * Dial(for higher quality, dial a number based on your current location): US: +1 669 900 6833 or +1 646 876 9923 * Meeting ID: 342 730 236 * Passcode: 419405 * International numbers available: https://zoom.us/u/ed95sU7aQ * Meeting Agenda and Minutes: * https://etherpad.openstack.org/p/stx-distro-other Sau! -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 7677 bytes Desc: not available URL: From alexandru.dimofte at intel.com Wed Mar 17 07:27:42 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Wed, 17 Mar 2021 07:27:42 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210315T230316Z Message-ID: Sanity Test from 2021-March-15 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210315T230316Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210315T230316Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Bill.Zvonar at windriver.com Wed Mar 17 12:53:03 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 17 Mar 2021 12:53:03 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 17, 2021) Message-ID: Hi all, reminder of the weekly TSC/Community calls coming up later today. Please note that due to the switch to DST in Ottawa, the meeting may start an hour earlier for you, see [2]. And please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210317T1400 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From Saul.Wold at windriver.com Wed Mar 17 14:04:27 2021 From: Saul.Wold at windriver.com (Saul Wold) Date: Wed, 17 Mar 2021 07:04:27 -0700 Subject: [Starlingx-discuss] Userspace Transition Specification has been pushed Message-ID: <9a5d820d-b20e-faf3-d970-2e008abc895c@windriver.com> TSC & Community: As many of you know, CentOS-7 (and then CentOS-8) are transitioning to CentOS-Stream, as we previously talked, CentOS-stream as a rolling release does not meet the requirements of StarlingX Userspace. We have discussed this in the Distro and MultiOS team meetings, I have pushed the first of likely many related specifications. I have pushed the userspace transition specification to Gerrit [0] and you can see the doc preview version [1]. [0] https://review.opendev.org/c/starlingx/specs/+/780332 [1] https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_56e/780332/1/check/openstack-tox-docs/56ee4ff/docs/specs/stx-6.0/approved/starlingx_2008704_debian_transition.html -- Sau! From bruce.e.jones at intel.com Wed Mar 17 14:24:05 2021 From: bruce.e.jones at intel.com (Jones, Bruce E) Date: Wed, 17 Mar 2021 14:24:05 +0000 Subject: [Starlingx-discuss] TSC call minutes Mar 17 2021 Message-ID: * Standing topics * No new governance reviews posted * Two new specs have been posted - TSC members please review! * https://review.opendev.org/c/starlingx/specs/+/779866 * https://review.opendev.org/c/starlingx/specs/+/780332 * PTG preparation * "State of the project" session * We plan to hold a "retrospective" session to have an open discussion around project issues * We will hold that session to start off the PTG, for an hour or two * We have an Etherpad open for PTG agenda items. Please add any items you want to discuss here: * https://etherpad.opendev.org/p/stx-ptg-planning-april-2021 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Bill.Zvonar at windriver.com Wed Mar 17 14:29:14 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 17 Mar 2021 14:29:14 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 17, 2021) In-Reply-To: References: Message-ID: >From today... * Standing Topics * Build/Sanity * builds ok, sanity issue from last week still there - Frank will have someone from the Containers team look into it * re: http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011025.html * Gerrit Reviews in Need of Attention * none this week * Topics for this Week * per Scott, the file repository is available again, but the history is lost, i.e. links from Launchpads will go nowhere * see http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011023.html * ARs from Previous Meetings * nothing to discuss this week * Open Requests for Help * several requests last week, none went unanswered! * Build Matters (if required) * nothing to discuss this week -----Original Message----- From: Zvonar, Bill Sent: Wednesday, March 17, 2021 8:53 AM To: Starlingx-discuss at lists.starlingx.io Subject: Community (& TSC) Call (Mar 17, 2021) Hi all, reminder of the weekly TSC/Community calls coming up later today. Please note that due to the switch to DST in Ottawa, the meeting may start an hour earlier for you, see [2]. And please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210317T1400 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From alexandru.dimofte at intel.com Wed Mar 17 16:40:32 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Wed, 17 Mar 2021 16:40:32 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210317T013430Z Message-ID: Sanity Test from 2021-March-17 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210317T013430Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210317T013430Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From maryx.camp at intel.com Wed Mar 17 19:56:00 2021 From: maryx.camp at intel.com (Camp, MaryX) Date: Wed, 17 Mar 2021 19:56:00 +0000 Subject: [Starlingx-discuss] [docs] [meeting] Docs team notes 17-Mar-21 Message-ID: Hello all, Here are this week's docs team meeting minutes (short form). Details in [2]. Join us if you have interest in StarlingX docs! We meet on Wednesdays 12:30 PST. [1] Call logistics: https://wiki.openstack.org/wiki/Starlingx/Meetings [2] Tracking Etherpad: https://etherpad.openstack.org/p/stx-documentation thanks, Mary Camp ========== 17-Mar-21 All -- reviews merged since last meeting: 2 All -- bug status -- 18 total - team agrees to defer all low priority LP until the upstreaming effort is completed. 13 LP are WIP against API documentation, which is generated from source code (low priority). Those reviews are here: https://review.opendev.org/#/q/project:starlingx/config New on 10Feb21: Documentation needs to be updated for LAG and VLAN type interfaces [https://bugs.launchpad.net/starlingx/+bug/1915285] New on 15Mar21: Rook-ceph documentation - wrong values.yaml for rook-ceph-apps [https://bugs.launchpad.net/starlingx/+bug/1919162] Status/questions/opens Closing the gap effort is moving along. The WR team is working on the downstream publishing process. PTP is under review - will be upstreamed soon. New guide will be called Container Integration. "Manange" typo in PTP API reference - wait a few days for the author to sort it out. From haochuan.z.chen at intel.com Thu Mar 18 13:16:33 2021 From: haochuan.z.chen at intel.com (Chen, Haochuan Z) Date: Thu, 18 Mar 2021 13:16:33 +0000 Subject: [Starlingx-discuss] patch for rook-ceph enhancement In-Reply-To: References: Message-ID: Hi Bob Please review my patch. https://review.opendev.org/c/starlingx/rook-ceph/+/765693 https://review.opendev.org/c/starlingx/rook-ceph/+/774576 Thanks Martin, Chen IOTG, Software Engineer 021-61164330 From: Chen, Haochuan Z Sent: Monday, March 15, 2021 3:26 PM To: Church, Robert Cc: starlingx-discuss at lists.starlingx.io Subject: patch for rook-ceph enhancement Hi Bob I have two patch for rook-ceph, one to enable cephfs and the other one enable rook-ceph report alarm to fm. Please review. https://review.opendev.org/c/starlingx/rook-ceph/+/765693 https://review.opendev.org/c/starlingx/rook-ceph/+/774576 Thanks! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Thu Mar 18 20:01:02 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Thu, 18 Mar 2021 20:01:02 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210318T063229Z Message-ID: Sanity Test from 2021-March-18 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210318T063229Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210318T063229Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From alexandru.dimofte at intel.com Fri Mar 19 10:57:04 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Fri, 19 Mar 2021 10:57:04 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210318T063229Z Message-ID: Sanity Test from 2021-March-19 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210319T013254Z/outputs/iso/ ) Status: RED I opened this bug explaining the issue: https://bugs.launchpad.net/starlingx/+bug/1920137 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210319T013254Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Kind regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From haochuan.z.chen at intel.com Fri Mar 19 15:28:27 2021 From: haochuan.z.chen at intel.com (Chen, Haochuan Z) Date: Fri, 19 Mar 2021 15:28:27 +0000 Subject: [Starlingx-discuss] issue debug on 1917308 Message-ID: Hi bob I comment on this bug, add my debug find. https://bugs.launchpad.net/starlingx/+bug/1917308 After host-swact, and quickly type in command "system application-apply stx-openstack", container tiller in pod armada-api will list installed release saved in postgres. But this list request will be failed with this log. 5432 is postgres listen port. 172.16.192.176 is armada-api pod cluster ip. 2021-03-01T11:38:56.600564874Z stderr F [storage/driver] 2021/03/01 11:38:56 list: failed to list: write tcp 172.16.192.176:35854->10.10.59.10:5432: write: broken pipe And after a while it will recovery, then "system application-apply", it will succeed. Any idea about this, maybe after host-swact, postgres is still launching and not ready for connection? You can reproduce this issue with latest daily build. BR! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at optimcloud.com Sat Mar 20 01:02:08 2021 From: lists at optimcloud.com (Embedded Devel) Date: Sat, 20 Mar 2021 08:02:08 +0700 Subject: [Starlingx-discuss] add docker proxy after install Message-ID: <564df7cc-1e76-2e2b-9ff2-154d61c4db04@optimcloud.com> so trying to add a docker proxy configuration now, after the install was completed due to firewall changes blocking OAM, according to https://docs.starlingx.io/configuration/docker_proxy_config.html#set-https-proxy-url Set HTTP proxy URL To specify the HTTP proxy URL, use the commands: system service-parameter-modify platform docker http_proxy http://my.proxy.com:1080 system service-parameter-apply platform however, this appears not to work system service-parameter-modify platform docker https_proxy https://proxy.domain.com:3128 Service Parameter not found: service platform, section docker, name https_proxy Service Parameter not found: service platform, section docker, name https://proxy.domain.com:3128 -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Sat Mar 20 07:58:50 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Sat, 20 Mar 2021 07:58:50 +0000 Subject: [Starlingx-discuss] add docker proxy after install In-Reply-To: <564df7cc-1e76-2e2b-9ff2-154d61c4db04@optimcloud.com> References: <564df7cc-1e76-2e2b-9ff2-154d61c4db04@optimcloud.com> Message-ID: Hello, Please try like: system service-parameter-add docker proxy http_proxy=http://my.proxy.com:1080 system service-parameter-add docker proxy https_proxy=http://my.proxy.com:1080 For me this worked few days ago.. BR, Alex From: Embedded Devel Sent: Saturday, March 20, 2021 3:02 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] add docker proxy after install so trying to add a docker proxy configuration now, after the install was completed due to firewall changes blocking OAM, according to https://docs.starlingx.io/configuration/docker_proxy_config.html#set-https-proxy-url Set HTTP proxy URL To specify the HTTP proxy URL, use the commands: system service-parameter-modify platform docker http_proxy http://my.proxy.com:1080 system service-parameter-apply platform however, this appears not to work system service-parameter-modify platform docker https_proxy https://proxy.domain.com:3128 Service Parameter not found: service platform, section docker, name https_proxy Service Parameter not found: service platform, section docker, name https://proxy.domain.com:3128 -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at optimcloud.com Sat Mar 20 10:07:43 2021 From: lists at optimcloud.com (Embedded Devel) Date: Sat, 20 Mar 2021 17:07:43 +0700 Subject: [Starlingx-discuss] add docker proxy after install In-Reply-To: References: <564df7cc-1e76-2e2b-9ff2-154d61c4db04@optimcloud.com> Message-ID: On 3/20/21 2:58 PM, Dimofte, Alexandru wrote: > > Hello, > > Please try like: > > system service-parameter-add docker proxy > http_proxy=http://my.proxy.com:1080 > > system service-parameter-add docker proxy > https_proxy=http://my.proxy.com:1080 > > For me this worked few days ago.. > Bravo, that worked! Thanks > BR, > > Alex > > *From:* Embedded Devel > *Sent:* Saturday, March 20, 2021 3:02 AM > *To:* starlingx-discuss at lists.starlingx.io > *Subject:* [Starlingx-discuss] add docker proxy after install > > so trying to add a docker proxy configuration now, after the install > was completed due to firewall changes blocking OAM, according to > > https://docs.starlingx.io/configuration/docker_proxy_config.html#set-https-proxy-url > > > > Set HTTP proxy URL > ¶ > > > To specify the HTTP proxy URL, use the commands: > > system service-parameter-modify platform docker http_proxy http://my.proxy.com:1080 > system service-parameter-apply platform > however, this appears not to work > > system service-parameter-modify platform docker https_proxy > https://proxy.domain.com:3128 > Service Parameter not found: service platform, section docker, name > https_proxy > Service Parameter not found: service platform, section docker, name > https://proxy.domain.com:3128 > > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Sat Mar 20 11:08:47 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Sat, 20 Mar 2021 11:08:47 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210320T013302Z Message-ID: Sanity Test from 2021-March-20 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210320T013302Z/outputs/iso/ ) Status: RED I opened this bug explaining the issue: https://bugs.launchpad.net/starlingx/+bug/1920137 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210320T013302Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Kind regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From sinlam at hotmail.com Sat Mar 20 15:15:41 2021 From: sinlam at hotmail.com (Sin Lam Tan) Date: Sat, 20 Mar 2021 15:15:41 +0000 Subject: [Starlingx-discuss] Bare metal installation with single network interface In-Reply-To: References: Message-ID: Hi all, Is it possible to install bare metal Starlingx with Openstack support using single network interface? My PC only have one Ethernet network interface, can I share it to use as OAM network and data network? If it requires at least two network interfaces, can I use USB to Ethernet adapter as data network interface? I tried it but my Starlingx cannot detect the USB network adapter. Hope to hear suggestions from you all. Thank you! Regards, Sin Lam -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Mon Mar 22 07:39:33 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Mon, 22 Mar 2021 07:39:33 +0000 Subject: [Starlingx-discuss] executing script from rc.local Message-ID: Hi, I made some changes in rc.local, to execute a custom script during a startup of a node. But due to this change, a node getting reboot continuously. Any pointer how to invoke custom script during node startup ? Regards, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From kennelson11 at gmail.com Mon Mar 22 18:22:54 2021 From: kennelson11 at gmail.com (Kendall Nelson) Date: Mon, 22 Mar 2021 11:22:54 -0700 Subject: [Starlingx-discuss] vPTG April 2021 Team Signup In-Reply-To: References: Message-ID: Hey Everyone! Friendly reminder that the deadline to sign your team up for the upcoming PTG is this *Thursday, March 25 at 7:00 UTC.* To signup your team, you must complete *BOTH* the survey[1] AND reserve time in the ethercalc[2]. Once your team is signed up, please register! And remind your team to register! Registration is free, but since it is how we contact you with passwords, event details, etc. it is important! Continue to check back for updates at openstack.org/ptg. -the Kendalls (diablo_rojo & wendallkaters) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi [3] PTG Registration: https://april2021-ptg.eventbrite.com On Mon, Mar 8, 2021 at 10:09 AM Kendall Nelson wrote: > Greetings! > > As you hopefully already know, our next PTG will be virtual again, and > held from Monday, April 19 to Friday, April 23. We will have the same > schedule set up available as last time with three windows of time spread > across the day to cover all timezones with breaks in between. > > *To signup your team, you must complete **BOTH** the survey[1] AND > reserve time in the ethercalc[2] by March 25 at 7:00 UTC.* > > We ask that the PTL/SIG Chair/Team lead sign up for time to have their > discussions in with 4 rules/guidelines. > > 1. Cross project discussions (like SIGs or support project teams) should > be scheduled towards the start of the week so that any discussions that > might shape those of other teams happen first. > 2. No team should sign up for more than 4 hours per UTC day to help keep > participants actively engaged. > 3. No team should sign up for more than 16 hours across all time slots to > avoid burning out our contributors and to enable participation in multiple > teams discussions. > > Again, you need to fill out BOTH the ethercalc AND the survey to complete > your team's sign up. > > If you have any issues with signing up your team, due to conflict or > otherwise, please let me know! While we are trying to empower you to make > your own decisions as to when you meet and for how long (after all, you > know your needs and teams timezones better than we do), we are here to help! > > Once your team is signed up, please register! And remind your team to > register! Registration is free, but since it will be how we contact you > with passwords, event details, etc. it is still important! > > Continue to check back for updates at openstack.org/ptg. > > -the Kendalls (diablo_rojo & wendallkaters) > > > [1] Team Survey: > https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey > [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi > [3] PTG Registration: https://april2021-ptg.eventbrite.com > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bruce.e.jones at intel.com Mon Mar 22 18:54:25 2021 From: bruce.e.jones at intel.com (Jones, Bruce E) Date: Mon, 22 Mar 2021 18:54:25 +0000 Subject: [Starlingx-discuss] vPTG April 2021 Team Signup In-Reply-To: References: Message-ID: Hi Kendalls! The StarlingX project has already completed both the survey and has reserved time in the ethercalc. Everyone is welcome to join the PTG! The TSC encourages all community members to register for the PTG and join in the calls, which we hope are in a reasonable time slot for our global community. brucej From: Kendall Nelson Sent: Monday, March 22, 2021 11:23 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] vPTG April 2021 Team Signup Hey Everyone! Friendly reminder that the deadline to sign your team up for the upcoming PTG is this Thursday, March 25 at 7:00 UTC. To signup your team, you must complete BOTH the survey[1] AND reserve time in the ethercalc[2]. Once your team is signed up, please register! And remind your team to register! Registration is free, but since it is how we contact you with passwords, event details, etc. it is important! Continue to check back for updates at openstack.org/ptg. -the Kendalls (diablo_rojo & wendallkaters) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi [3] PTG Registration: https://april2021-ptg.eventbrite.com On Mon, Mar 8, 2021 at 10:09 AM Kendall Nelson > wrote: Greetings! As you hopefully already know, our next PTG will be virtual again, and held from Monday, April 19 to Friday, April 23. We will have the same schedule set up available as last time with three windows of time spread across the day to cover all timezones with breaks in between. To signup your team, you must complete BOTH the survey[1] AND reserve time in the ethercalc[2] by March 25 at 7:00 UTC. We ask that the PTL/SIG Chair/Team lead sign up for time to have their discussions in with 4 rules/guidelines. 1. Cross project discussions (like SIGs or support project teams) should be scheduled towards the start of the week so that any discussions that might shape those of other teams happen first. 2. No team should sign up for more than 4 hours per UTC day to help keep participants actively engaged. 3. No team should sign up for more than 16 hours across all time slots to avoid burning out our contributors and to enable participation in multiple teams discussions. Again, you need to fill out BOTH the ethercalc AND the survey to complete your team's sign up. If you have any issues with signing up your team, due to conflict or otherwise, please let me know! While we are trying to empower you to make your own decisions as to when you meet and for how long (after all, you know your needs and teams timezones better than we do), we are here to help! Once your team is signed up, please register! And remind your team to register! Registration is free, but since it will be how we contact you with passwords, event details, etc. it is still important! Continue to check back for updates at openstack.org/ptg. -the Kendalls (diablo_rojo & wendallkaters) [1] Team Survey: https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi [3] PTG Registration: https://april2021-ptg.eventbrite.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From IsacSacchi.Souza at windriver.com Mon Mar 22 19:32:45 2021 From: IsacSacchi.Souza at windriver.com (Isac Sacchi Souza) Date: Mon, 22 Mar 2021 16:32:45 -0300 Subject: [Starlingx-discuss] New nginx-ingress-controller images Message-ID: Hi StarlingX community, The nginx-ingress-controller is being upversioned from 0.23.0 to 0.41.2. If anyone is using a private container registry to install from, please pull the following images and push them to your private container registry. New images and tags are: docker.io/jettech/kube-webhook-certgen:v1.5.0 k8s.gcr.io/ingress-nginx/controller:v0.41.2 Additionally, this image was used by the old version and will continue to be used by the new version: k8s.gcr.io/defaultbackend:1.4 We will submit a review with the code changes shortly. Regards, -------------- next part -------------- An HTML attachment was scrubbed... URL: From kennelson11 at gmail.com Mon Mar 22 22:55:15 2021 From: kennelson11 at gmail.com (Kendall Nelson) Date: Mon, 22 Mar 2021 15:55:15 -0700 Subject: [Starlingx-discuss] vPTG April 2021 Team Signup In-Reply-To: References: Message-ID: Perfect! Thanks Bruce :) I saw after I sent the email :) Good registration reminder though! -Kendall On Mon, Mar 22, 2021 at 11:54 AM Jones, Bruce E wrote: > Hi Kendalls! The StarlingX project has already completed both the survey > and has reserved time in the ethercalc. > > > > Everyone is welcome to join the PTG! The TSC encourages all community > members to register for the PTG and join in the calls, which we hope are in > a reasonable time slot for our global community. > > > > brucej > > > > *From:* Kendall Nelson > *Sent:* Monday, March 22, 2021 11:23 AM > *To:* starlingx-discuss at lists.starlingx.io > *Subject:* Re: [Starlingx-discuss] vPTG April 2021 Team Signup > > > > Hey Everyone! > > > > Friendly reminder that the deadline to sign your team up for the upcoming > PTG is this *Thursday, March 25 at 7:00 UTC.* To signup your team, you > must complete *BOTH* the survey[1] AND reserve time in the ethercalc[2]. > > > > Once your team is signed up, please register! And remind your team to > register! Registration is free, but since it is how we contact you with > passwords, event details, etc. it is important! > > > > Continue to check back for updates at openstack.org/ptg. > > > > -the Kendalls (diablo_rojo & wendallkaters) > > > > > > [1] Team Survey: > https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey > > [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi > > [3] PTG Registration: https://april2021-ptg.eventbrite.com > > > > On Mon, Mar 8, 2021 at 10:09 AM Kendall Nelson > wrote: > > Greetings! > > > > As you hopefully already know, our next PTG will be virtual again, and > held from Monday, April 19 to Friday, April 23. We will have the same > schedule set up available as last time with three windows of time spread > across the day to cover all timezones with breaks in between. > > > > *To signup your team, you must complete BOTH the survey[1] AND reserve > time in the ethercalc[2] by March 25 at 7:00 UTC.* > > > > We ask that the PTL/SIG Chair/Team lead sign up for time to have their > discussions in with 4 rules/guidelines. > > > > 1. Cross project discussions (like SIGs or support project teams) should > be scheduled towards the start of the week so that any discussions that > might shape those of other teams happen first. > > 2. No team should sign up for more than 4 hours per UTC day to help keep > participants actively engaged. > > 3. No team should sign up for more than 16 hours across all time slots to > avoid burning out our contributors and to enable participation in multiple > teams discussions. > > > > Again, you need to fill out BOTH the ethercalc AND the survey to complete > your team's sign up. > > > > If you have any issues with signing up your team, due to conflict or > otherwise, please let me know! While we are trying to empower you to make > your own decisions as to when you meet and for how long (after all, you > know your needs and teams timezones better than we do), we are here to help! > > > > Once your team is signed up, please register! And remind your team to > register! Registration is free, but since it will be how we contact you > with passwords, event details, etc. it is still important! > > > > Continue to check back for updates at openstack.org/ptg. > > > > -the Kendalls (diablo_rojo & wendallkaters) > > > > > > [1] Team Survey: > https://openinfrafoundation.formstack.com/forms/april2021_vptg_survey > > [2] Ethercalc Signup: https://ethercalc.net/oz7q0gds9zfi > > [3] PTG Registration: https://april2021-ptg.eventbrite.com > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From pvmpublic at gmail.com Tue Mar 23 08:49:11 2021 From: pvmpublic at gmail.com (Pratik M.) Date: Tue, 23 Mar 2021 14:19:11 +0530 Subject: [Starlingx-discuss] Questions on StarlingX upgrades In-Reply-To: References: Message-ID: Barton, this information was very helpful. Thanks. On Wed, Feb 17, 2021 at 9:17 PM Wensley, Barton < Barton.Wensley at windriver.com> wrote: > Pratik – see my responses to your questions below. > > > > Bart > > > > *From:* Pratik M. > *Sent:* Wednesday, February 17, 2021 1:33 AM > *To:* starlingx-discuss at lists.starlingx.io > *Subject:* [Starlingx-discuss] Questions on StarlingX upgrades > > > > [Please note: This e-mail is from an EXTERNAL e-mail address] > > Hi, > Looking at the URL below, I had a few questions to understand the overall > upgrade strategy. > > https://docs.starlingx.io/specs/specs/stx-4.0/approved/starlingx-2007403-platform-upgrades.html > > Q1: Can I assume that from R4.0 onwards, the intent is that all future > releases will support seamless upgrades for both minor and major versions. > > *[Bart] You can’t assume this because:* > > 1. *Upgrades are not supported for minor versions – moving from one > minor version to the next would be done by building patches for the updated > packages and applying them. The starlingx community does not provide > patches – you would need to do this on your own (or use a commercial > distribution of starlingx that supports patching).* > 2. *Upgrades between major versions are supported by the > infrastructure described in the specification you referenced above. > However, the starlingx community does not test or support upgrades. To do > an upgrade, you would need to do your own upgrade testing and fix any > issues you uncover. Upgrades often require additional changes on the “from” > release side, so you would likely need to build your own patches as well.* > > > Q2: Is downgrade an explicit non-goal? > > *[Bart] Correct – starlingx does not support downgrades.* > > Q3: Any hooks for non-stx applications to backup and restore their state? > > *[Bart] No* > > Q4: For a simplex edge node, it involves a N+1 ISO (re)installation. Is a > more seamless option on the roadmap > > *[Bart] No* > > Q5. For a simplex edge subcloud, possible to orchestrate this from the > central cloud? > > *[Bart] Similar to upgrades, there is an infrastructure for this (i.e. > dcmanager upgrade-strategy commands). These commands haven’t been included > in the starlingx documentation yet and similar to upgrades, the starlingx > community does not test or support these commands.* > > Q6: Any non-goals for the seamless upgrade, like say CentOS upgrade?. > > *[Bart] There has been no decision yet on whether starlingx will be moving > to a new version of CentOS or to a different Linux distribution so I can’t > comment on this yet.* > > Any pointers to additional info are very welcome. > > Thanks in advance > Pratik > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Tue Mar 23 14:52:53 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Tue, 23 Mar 2021 14:52:53 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210322T230300Z Message-ID: Sanity Test from 2021-March-22 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210322T230300Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210322T230300Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Ankush.Rai at commscope.com Tue Mar 23 11:30:27 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Tue, 23 Mar 2021 11:30:27 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud Message-ID: Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From maryx.camp at intel.com Tue Mar 23 23:58:47 2021 From: maryx.camp at intel.com (Camp, MaryX) Date: Tue, 23 Mar 2021 23:58:47 +0000 Subject: [Starlingx-discuss] STX 5.0 Release Notes: need input from feature leads Message-ID: Hi StarlingX team, The docs team has created a WIP review for STX 5.0 Release Notes here: https://review.opendev.org/c/starlingx/docs/+/777433 We're asking all feature leads to add comments with a short feature description and link to doc as their features are completed. Target Deadline: April 16 For reference, you can view the Release Notes for STX 4.0 here: https://docs.starlingx.io/releasenotes/r4_release.html If you have any questions or issues, please let me know. thanks, Mary Camp Kelly Services Technical Writer | mailto:maryx.camp at intel.com From build.starlingx at gmail.com Wed Mar 24 02:24:28 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Tue, 23 Mar 2021 22:24:28 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] STX_BUILD_container_setup_layered - Build # 1550 - Failure! Message-ID: <378331004.88.1616552669893.JavaMail.javamailuser@localhost> Project: STX_BUILD_container_setup_layered Build #: 1550 Status: Failure Timestamp: 20210324T013410Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210324T013255Z/logs -------------------------------------------------------------------------------- Parameters PROJECT: master-flock MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-flock/20210324T013255Z DOCKER_BUILD_ID: jenkins-master-flock-20210324T013255Z-builder PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210324T013255Z/logs DOCKER_BUILD_TAG: master-flock-20210324T013255Z-builder-image PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/flock/20210324T013255Z/logs LAYER: flock MY_REPO_ROOT: /localdisk/designer/jenkins/master-flock From build.starlingx at gmail.com Wed Mar 24 02:24:31 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Tue, 23 Mar 2021 22:24:31 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 433 - Failure! Message-ID: <658370470.91.1616552672958.JavaMail.javamailuser@localhost> Project: STX_build_layer_flock_master_master Build #: 433 Status: Failure Timestamp: 20210324T013255Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210324T013255Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From pvmpublic at gmail.com Wed Mar 24 05:55:37 2021 From: pvmpublic at gmail.com (Pratik M.) Date: Wed, 24 Mar 2021 11:25:37 +0530 Subject: [Starlingx-discuss] Question on remote install of subcloud Message-ID: Hi, Does the StarlingX central cloud support remote installation of a distributed cloud using IPMI/Redfish? To get it to a stage that config_management commands can be run. For unattended or zero-touch installs. I looked at the distcloud and bare-metal APIs and could not find a method to specify a ISO or HDD image as the initial installation source. https://docs.starlingx.io/api-ref/stx-distcloud/ https://docs.starlingx.io/api-ref/metal/api-ref-sysinv-v1-metal.html The R4.0 release notes talk about "Redfish virtual media support". Can it be used for this? I looked at the source and see the following script, but can't determine if it's instrumented to any StarlingX CLI. https://opendev.org/starlingx/metal/src/branch/master/tools/rvmc/centos/docker/rvmc.py Any pointers would be appreciated. Thanks Pratik -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at optimcloud.com Wed Mar 24 10:47:46 2021 From: lists at optimcloud.com (Embedded Devel) Date: Wed, 24 Mar 2021 17:47:46 +0700 Subject: [Starlingx-discuss] Bare metal Duplex - extending Message-ID: <12997cd9-731d-828b-5e16-efcc7be90cee@optimcloud.com> is it possible to extend a bare metal duplex to 3 controllers ?? curosity arose when im reading master nodes should be 3 or 5, where stx uses 2 From Bill.Zvonar at windriver.com Wed Mar 24 12:50:24 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 24 Mar 2021 12:50:24 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 24, 2021) Message-ID: Hi all, reminder of the weekly TSC/Community calls coming up in about an hour. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210324T1400 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From austin.sun at intel.com Wed Mar 24 13:06:37 2021 From: austin.sun at intel.com (Sun, Austin) Date: Wed, 24 Mar 2021 13:06:37 +0000 Subject: [Starlingx-discuss] StarlingX Distro-OpenStack: Bi-weekly Project Meeting(Summer Time) Message-ID: Hi folks, This is a new series of bi-weekly project meeting on StarlingX Distro-OpenStack. Your participation to this meeting and/or other offline contribution by all means are highly appreciated! Project Team Etherpad: https://etherpad.openstack.org/p/stx-distro-openstack-meetings The Summer Time Slot for this meeting : CST: 9:00 PM (China, Shanghai ) PST: 7:00 AM (US West , US, Oregon) EST: 9:00 AM (East Canada , Canada Ottawa) Thanks. BR Austin Sun. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2309 bytes Desc: not available URL: From Bill.Zvonar at windriver.com Wed Mar 24 14:38:56 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 24 Mar 2021 14:38:56 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 24, 2021) In-Reply-To: References: Message-ID: >From today's meeting... * Standing Topics * Build/Sanity * was red due to https://bugs.launchpad.net/starlingx/+bug/1920137 * root cause was Sanity team didn't know about the new containers * the change with the new containers was backed out & the communication about them has happened now http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011044.html * Nic will update the image list that Sanity uses, based on this email * back to yellow for same issue(s) from previous weeks * per Frank, this is an intermittent thing * Douglas has someone looking into https://bugs.launchpad.net/starlingx/+bug/1917308 * Martin is looking into https://bugs.launchpad.net/starlingx/+bug/1918420 * Gerrit Reviews in Need of Attention * nothing this week * Topics for this Week * gating bugs for stx.5.0 * currently at 59 open, 1 critical, 10 high * full list: https://bugs.launchpad.net/starlingx/+bugs?field.tag=stx.5.0 * critical & high query below * blog post for stx.5.0 * see the list of ideas so far on the release team etherpad https://etherpad.opendev.org/p/stx-releases * add other ideas here or on the release team etherpad (anonymously!) or via the mailing list * ARs from Previous Meetings * nothing this week * Open Requests for Help * executing script from rc.local * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011041.html * per Greg, he doesn't think this is supported - he'll think about it & respond or let Bill know how to respond * Build Matters (if required) * there was a temporary glitch around build containers, but it has been resolved * Query for Critical/High stx.5.0 Launchpads * https://bugs.launchpad.net/starlingx/+bugs?field.searchtext=&orderby=-importance&search=Search&field.status%3Alist=NEW&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.status%3Alist=FIXCOMMITTED&field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE&field.importance%3Alist=CRITICAL&field.importance%3Alist=HIGH&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.structural_subscriber=&field.tag=&field.tags_combinator=ANY&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on -----Original Message----- From: Zvonar, Bill Sent: Wednesday, March 24, 2021 8:50 AM To: Starlingx-discuss at lists.starlingx.io Subject: Community (& TSC) Call (Mar 24, 2021) Hi all, reminder of the weekly TSC/Community calls coming up in about an hour. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210324T1400 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From Ankush.Rai at commscope.com Wed Mar 24 06:04:13 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Wed, 24 Mar 2021 06:04:13 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: Message-ID: Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From austin.sun at intel.com Wed Mar 24 13:02:55 2021 From: austin.sun at intel.com (Sun, Austin) Date: Wed, 24 Mar 2021 13:02:55 +0000 Subject: [Starlingx-discuss] Canceled: StarlingX Distro-OpenStack: Bi-weekly Project Meeting Message-ID: Hi folks, This is a new series of bi-weekly project meeting on StarlingX Distro-OpenStack. Your participation to this meeting and/or other offline contribution by all means are highly appreciated! Project Team Etherpad: https://etherpad.openstack.org/p/stx-distro-openstack-meetings The Winter Time Slot for this meeting : CST: 10:00 PM(China, Shanghai ) PST: 7:00 AM (US West , US, Oregon) EST: 9:00 AM (East Canada , Canada Ottawa) Thanks BR Austin Sun. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 3914 bytes Desc: not available URL: From Barton.Wensley at windriver.com Wed Mar 24 15:39:04 2021 From: Barton.Wensley at windriver.com (Wensley, Barton) Date: Wed, 24 Mar 2021 15:39:04 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: Message-ID: It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 - are you using an earlier release? Bart From: Rai, Ankush Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Barton.Wensley at windriver.com Wed Mar 24 15:40:03 2021 From: Barton.Wensley at windriver.com (Wensley, Barton) Date: Wed, 24 Mar 2021 15:40:03 +0000 Subject: [Starlingx-discuss] Bare metal Duplex - extending In-Reply-To: <12997cd9-731d-828b-5e16-efcc7be90cee@optimcloud.com> References: <12997cd9-731d-828b-5e16-efcc7be90cee@optimcloud.com> Message-ID: That is not possible - StarlingX only supports two controllers (two k8s master nodes). Bart -----Original Message----- From: Embedded Devel Sent: Wednesday, March 24, 2021 6:48 AM To: Starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] Bare metal Duplex - extending [Please note: This e-mail is from an EXTERNAL e-mail address] is it possible to extend a bare metal duplex to 3 controllers ?? curosity arose when im reading master nodes should be 3 or 5, where stx uses 2 _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Barton.Wensley at windriver.com Wed Mar 24 15:47:49 2021 From: Barton.Wensley at windriver.com (Wensley, Barton) Date: Wed, 24 Mar 2021 15:47:49 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: , Message-ID: My mistake - the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 release. Bart From: Rai, Ankush Sent: Wednesday, March 24, 2021 11:41 AM To: Wensley, Barton ; starlingx-discuss at lists.starlingx.io Subject: Re: unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] No it's 4.0 only. 20.06 Thanks Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:09:04 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io > Subject: RE: unable to add 3ed edge on central-cloud It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 - are you using an earlier release? Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Wed Mar 24 15:40:52 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Wed, 24 Mar 2021 15:40:52 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: , Message-ID: No it’s 4.0 only. 20.06 Thanks Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton Sent: Wednesday, March 24, 2021 9:09:04 PM To: Rai, Ankush ; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 – are you using an earlier release? Bart ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ External (barton.wensley at windriver.com) Report This Email FAQ Protection by INKY It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 – are you using an earlier release? Bart From: Rai, Ankush Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From bruce.e.jones at intel.com Wed Mar 24 16:15:12 2021 From: bruce.e.jones at intel.com (Jones, Bruce E) Date: Wed, 24 Mar 2021 16:15:12 +0000 Subject: [Starlingx-discuss] TSC call Mar 23 2021 Message-ID: Mar 23 2021 * Standing topics * No new governance reviews * Two specs open for review - TSC member please review * https://review.opendev.org/c/starlingx/specs/+/779866 * https://review.opendev.org/c/starlingx/specs/+/780332 * PTG Prep * Reminder: We have an Etherpad open for PTG agenda items. Please add any items you want to discuss here: * https://etherpad.opendev.org/p/stx-ptg-planning-april-2021 * Expecting new features to be presented at the PTG for discussion and awareness * Having specs for the new features prior to the PTG would be much appreciated! -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Wed Mar 24 16:10:26 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Wed, 24 Mar 2021 16:10:26 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: , , Message-ID: Ok please describe the issue here? Is there any workaround available for this? Thanks, Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton Sent: Wednesday, March 24, 2021 9:17:49 PM To: Rai, Ankush ; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud My mistake – the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 re External (barton.wensley at windriver.com) Report This Email FAQ Protection by INKY My mistake – the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 release. Bart From: Rai, Ankush Sent: Wednesday, March 24, 2021 11:41 AM To: Wensley, Barton ; starlingx-discuss at lists.starlingx.io Subject: Re: unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] No it’s 4.0 only. 20.06 Thanks Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:09:04 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io > Subject: RE: unable to add 3ed edge on central-cloud It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 – are you using an earlier release? Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Wed Mar 24 17:01:49 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Wed, 24 Mar 2021 17:01:49 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: , Message-ID: Will disabling this clean-up service avoid this issue? systemctl disable systemd-tmpfiles-clean.timer Thanks, Ankush From: Wensley, Barton Sent: Wednesday, March 24, 2021 9:18 PM To: Rai, Ankush ; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud My mistake - the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 re External (barton.wensley at windriver.com) Report This Email FAQ Protection by INKY My mistake - the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 release. Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 11:41 AM To: Wensley, Barton >; starlingx-discuss at lists.starlingx.io Subject: Re: unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] No it's 4.0 only. 20.06 Thanks Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:09:04 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io > Subject: RE: unable to add 3ed edge on central-cloud It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 - are you using an earlier release? Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From maryx.camp at intel.com Wed Mar 24 20:24:51 2021 From: maryx.camp at intel.com (Camp, MaryX) Date: Wed, 24 Mar 2021 20:24:51 +0000 Subject: [Starlingx-discuss] [docs] [meeting] Docs team notes 24-Mar-21 Message-ID: Hello all, Here are this week's docs team meeting minutes (short form). Details in [2]. Join us if you have interest in StarlingX docs! We meet on Wednesdays 12:30 PST.   [1]   Call logistics: https://wiki.openstack.org/wiki/Starlingx/Meetings   [2]   Tracking Etherpad: https://etherpad.openstack.org/p/stx-documentation thanks, Mary Camp ========== 24-Mar-21 All -- reviews merged since last meeting: 9 All -- bug status -- 17 total - team agrees to defer all low priority LP until the upstreaming effort is completed. 13 LP are WIP against API documentation, which is generated from source code (low priority). Those reviews are here: https://review.opendev.org/#/q/project:starlingx/config New on 10Feb21: Documentation needs to be updated for LAG and VLAN type interfaces [https://bugs.launchpad.net/starlingx/+bug/1915285] Status/questions/opens Ron has an open question: the tox "keep-going" flag for doc builds is not doing what he expected. Warnings at the end aren't as detailed as we'd like. Reminder to scroll up into the "tox -e docs" output. Typically, the warning messages are between 100% reading sources and 0% writing output. You can also view build errors in gerrit: Scroll to the bottom of the review where the comments are. Click the "Verified -1" button, then click the link below openstack-tox-doc to open the Zuul window. The build log is shown in the Task Summary tab. Click "More" to show the full log and look between 100% reading sources and 0% writing output for warnings. AR Mary: don't merge this review https://review.opendev.org/c/starlingx/docs/+/782315 It has a merge conflict that we will resolve live in next week's meeting for practice. STX 5.0 Update: 3 features are already upstreamed. A couple more are still coming. From build.starlingx at gmail.com Wed Mar 24 23:25:01 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Wed, 24 Mar 2021 19:25:01 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer_layered - Build # 1372 - Failure! Message-ID: <1133862850.99.1616628307169.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer_layered Build #: 1372 Status: Failure Timestamp: 20210324T231219Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210324T184200Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-flock/20210324T184200Z DOCKER_BUILD_ID: jenkins-master-flock-20210324T184200Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master-flock/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210324T184200Z/logs BUILD_IMG: true FULL_BUILD: false PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/flock/20210324T184200Z/logs MASTER_JOB_NAME: STX_build_layer_flock_master_master LAYER: flock MY_REPO_ROOT: /localdisk/designer/jenkins/master-flock BUILD_ISO: true From build.starlingx at gmail.com Wed Mar 24 23:25:08 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Wed, 24 Mar 2021 19:25:08 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 434 - Still Failing! In-Reply-To: <1823311470.89.1616552670331.JavaMail.javamailuser@localhost> References: <1823311470.89.1616552670331.JavaMail.javamailuser@localhost> Message-ID: <1865780311.102.1616628309224.JavaMail.javamailuser@localhost> Project: STX_build_layer_flock_master_master Build #: 434 Status: Still Failing Timestamp: 20210324T184200Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210324T184200Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From build.starlingx at gmail.com Thu Mar 25 03:22:58 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Wed, 24 Mar 2021 23:22:58 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer_layered - Build # 1375 - Failure! Message-ID: <394339556.106.1616642578852.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer_layered Build #: 1375 Status: Failure Timestamp: 20210325T031125Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210325T013212Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-flock/20210325T013212Z DOCKER_BUILD_ID: jenkins-master-flock-20210325T013212Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master-flock/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210325T013212Z/logs BUILD_IMG: true FULL_BUILD: false PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/flock/20210325T013212Z/logs MASTER_JOB_NAME: STX_build_layer_flock_master_master LAYER: flock MY_REPO_ROOT: /localdisk/designer/jenkins/master-flock BUILD_ISO: true From build.starlingx at gmail.com Thu Mar 25 03:23:00 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Wed, 24 Mar 2021 23:23:00 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_flock_master_master - Build # 435 - Still Failing! In-Reply-To: <1126382581.100.1616628307670.JavaMail.javamailuser@localhost> References: <1126382581.100.1616628307670.JavaMail.javamailuser@localhost> Message-ID: <600312630.109.1616642581029.JavaMail.javamailuser@localhost> Project: STX_build_layer_flock_master_master Build #: 435 Status: Still Failing Timestamp: 20210325T013212Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210325T013212Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From build.starlingx at gmail.com Thu Mar 25 08:27:53 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Thu, 25 Mar 2021 04:27:53 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer - Build # 1054 - Failure! Message-ID: <1875916747.114.1616660874621.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer Build #: 1054 Status: Failure Timestamp: 20210325T061141Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210325T043000Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master/20210325T043000Z DOCKER_BUILD_ID: jenkins-master-20210325T043000Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210325T043000Z/logs PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/monolithic/20210325T043000Z/logs MASTER_JOB_NAME: STX_build_master_master MY_REPO_ROOT: /localdisk/designer/jenkins/master From build.starlingx at gmail.com Thu Mar 25 08:27:56 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Thu, 25 Mar 2021 04:27:56 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] master STX_build_master_master - Build # 866 - Failure! Message-ID: <1660069219.117.1616660876637.JavaMail.javamailuser@localhost> Project: STX_build_master_master Build #: 866 Status: Failure Timestamp: 20210325T043000Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210325T043000Z/logs -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: false FORCE_BUILD: true From Barton.Wensley at windriver.com Thu Mar 25 11:12:58 2021 From: Barton.Wensley at windriver.com (Wensley, Barton) Date: Thu, 25 Mar 2021 11:12:58 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: , Message-ID: Make the change from the fix I referenced below to /usr/lib/ocf/resource.d/openstack/dcmanager-manager (on both controllers) and then restart the dcmanager-manager on the active controller with: sm-restart service dcmanager-manager Bart From: Rai, Ankush Sent: Thursday, March 25, 2021 6:07 AM To: Wensley, Barton ; starlingx-discuss at lists.starlingx.io Cc: Sambandan, Devaraj ; Dharwadkar, Sriram Subject: RE: unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please suggest any work-around for this issue. Thanks, Ankush From: Rai, Ankush Sent: Wednesday, March 24, 2021 10:32 PM To: Wensley, Barton >; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud Will disabling this clean-up service avoid this issue? systemctl disable systemd-tmpfiles-clean.timer Thanks, Ankush From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:18 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud My mistake - the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 release. Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 11:41 AM To: Wensley, Barton >; starlingx-discuss at lists.starlingx.io Subject: Re: unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] No it's 4.0 only. 20.06 Thanks Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:09:04 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io > Subject: RE: unable to add 3ed edge on central-cloud It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 - are you using an earlier release? Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Thu Mar 25 10:06:59 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Thu, 25 Mar 2021 10:06:59 +0000 Subject: [Starlingx-discuss] unable to add 3ed edge on central-cloud In-Reply-To: References: , Message-ID: Please suggest any work-around for this issue. Thanks, Ankush From: Rai, Ankush Sent: Wednesday, March 24, 2021 10:32 PM To: Wensley, Barton ; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud Will disabling this clean-up service avoid this issue? systemctl disable systemd-tmpfiles-clean.timer Thanks, Ankush From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:18 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io Subject: RE: unable to add 3ed edge on central-cloud My mistake - the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 re External (barton.wensley at windriver.com) Report This Email FAQ Protection by INKY My mistake - the fix you need did not make it into stx.4.0: https://opendev.org/starlingx/distcloud/commit/e8d916756d439cf63eed52f347a2a547fc5124cb The fix will be available in the upcoming stx.5.0 release. Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 11:41 AM To: Wensley, Barton >; starlingx-discuss at lists.starlingx.io Subject: Re: unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] No it's 4.0 only. 20.06 Thanks Ankush Get Outlook for iOS ________________________________ From: Wensley, Barton > Sent: Wednesday, March 24, 2021 9:09:04 PM To: Rai, Ankush >; starlingx-discuss at lists.starlingx.io > Subject: RE: unable to add 3ed edge on central-cloud It looks like you may have hit this issue: https://bugs.launchpad.net/starlingx/+bug/1883599 I believe this was fixed in stx.4.0 - are you using an earlier release? Bart From: Rai, Ankush > Sent: Wednesday, March 24, 2021 2:04 AM To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] unable to add 3ed edge on central-cloud [Please note: This e-mail is from an EXTERNAL e-mail address] Please reply on this. I am stuck here. Thanks, Ankush From: Rai, Ankush Sent: Tuesday, March 23, 2021 5:00 PM To: starlingx-discuss at lists.starlingx.io Subject: unable to add 3ed edge on central-cloud Hi, Sub-cloud addition is failing for 3ed edge. Not understanding what is going wrong here. Please help me to debug the issue. dcmanager subcloud add --bootstrap-address 10.214.5.1 --bootstrap-values $HOME/edge3/bootstrap.yml Enter the sysadmin password for the subcloud: Re-enter sysadmin password to confirm: +-----------------------------+----------------------------+ | Field | Value | +-----------------------------+----------------------------+ | id | 13 | | name | edge3 | | description | StarlingX edge3 | | location | COMMSCOPE_LAB | | software_version | 20.06 | | management | unmanaged | | availability | offline | | deploy_status | not-deployed | | management_subnet | 10.214.6.0/24 | | management_start_ip | 10.214.6.2 | | management_end_ip | 10.214.6.20 | | management_gateway_ip | 10.214.6.254 | | systemcontroller_gateway_ip | 10.214.2.254 | | group_id | 1 | | created_at | 2021-03-23 11:16:56.943669 | | updated_at | None | +-----------------------------+----------------------------+ subcloud list +----+-------+------------+--------------+--------------------+---------+ | id | name | management | availability | deploy status | sync | +----+-------+------------+--------------+--------------------+---------+ | 3 | edge1 | managed | online | complete | in-sync | | 6 | edge | managed | offline | complete | unknown | | 13 | edge3 | unmanaged | offline | deploy-prep-failed | unknown | +----+-------+------------+--------------+--------------------+---------+ ==> /var/log/dcmanager/dcmanager.log <== 2021-03-23 11:16:56.949 118088 INFO eventlet.wsgi.server [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3 "POST /v1.0/subclouds/ HTTP/1.1" status: 200 len: 770 time: 2.0502820 2021-03-23 11:16:56.950 116829 INFO dcmanager.manager.service [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Handling add_subcloud request for: edge3 2021-03-23 11:16:56.951 116829 INFO dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Adding subcloud edge3. 2021-03-23 11:16:58.859 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 814ed6e8-d700-4140-9c62-0d3d18535664 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:05.067 116829 INFO dccommon.drivers.openstack.sysinv_v1 [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Creating route: interface: 14e4aec4-2f41-4bc9-9ec9-d704ac460787 dest: 10.214.6.0/24 gateway: 10.214.2.254 metric 1 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager [req-4dbde86f-545a-4e34-948a-401bf7795450 8a78866e123740abaa939956db6a949b - - default default] Failed to create subcloud edge3: ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager Traceback (most recent call last): 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 353, in add_subcloud 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._create_intermediate_ca_cert(payload) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dcmanager/manager/subcloud_manager.py", line 160, in _create_intermediate_ca_cert 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager kube.apply_cert_manager_certificate(CERT_NAMESPACE, cert_name, cert) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 112, in apply_cert_manager_certificate 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager custom_object_api = self._get_kubernetesclient_custom_objects() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 52, in _get_kubernetesclient_custom_objects 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_kube_config() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/dccommon/kubeoperator.py", line 31, in _load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager config.load_kube_config(KUBE_CONFIG_PATH) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 531, in load_kube_config 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager loader.load_and_set(config) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 413, in load_and_set 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager self._load_cluster_info() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 395, in _load_cluster_info 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager file_base_path=self._config_base_path).as_file() 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager File "/usr/lib/python2.7/site-packages/kubernetes/config/kube_config.py", line 116, in as_file 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager raise ConfigException("File does not exists: %s" % self._file) 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager ConfigException: File does not exists: /tmp/tmpADel38 2021-03-23 11:17:12.880 116829 ERROR dcmanager.manager.subcloud_manager 2021-03-23 11:17:20.778 118089 INFO eventlet.wsgi.server [req-59e03ba0-a0ca-4194-9b04-21b62dffe4bd 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/alarms/ HTTP/1.1" status: 200 len: 728 time: 0.0075271 2021-03-23 11:17:20.785 118088 INFO eventlet.wsgi.server [req-eeb598dd-38d7-4165-af67-f663cf513828 8a78866e123740abaa939956db6a949b - - default default] 10.214.2.3,10.214.2.3 "GET /v1.0/subclouds/ HTTP/1.1" status: 200 len: 3023 time: 0.0140100 +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | created_at | updated_at | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ | 3 | edge1 | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | online | complete | 10.214.4.0/24 | 10.214.4.2 | 10.214.4.20 | 10.214.4.254 | 10.214.2.254 | 1 | 2021-02-24 08:17:01.698138 | 2021-03-12 11:21:57.684272 | | 6 | edge | StarlingX edge1 | COMMSCOPE_LAB | 20.06 | managed | offline | complete | 10.207.7.0/24 | 10.207.7.2 | 10.207.7.20 | 10.207.7.254 | 10.214.2.254 | 1 | 2021-03-03 18:56:52.779913 | 2021-03-23 11:18:51.674364 | | 13 | edge3 | StarlingX edge3 | COMMSCOPE_LAB | 20.06 | unmanaged | offline | deploy-prep-failed | 10.214.6.0/24 | 10.214.6.2 | 10.214.6.20 | 10.214.6.254 | 10.214.2.254 | 1 | 2021-03-23 11:16:56.943669 | 2021-03-23 11:17:12.899548 | +----+-------+-----------------+---------------+------------------+------------+--------------+--------------------+-------------------+---------------------+-------------------+-----------------------+-----------------------------+----------+----------------------------+----------------------------+ cat /home/sysadmin/edge3/bootstrap.yml system_mode: duplex name: "edge3" description: "StarlingX edge3" location: "COMMSCOPE_LAB" management_subnet: 10.214.6.0/24 management_floating_address: 10.214.6.1 management_start_address: 10.214.6.2 management_end_address: 10.214.6.20 management_gateway_address: 10.214.6.254 external_oam_subnet: 10.214.5.0/24 external_oam_gateway_address: 10.214.5.254 external_oam_floating_address: 10.214.5.1 external_oam_start_address: 10.214.5.2 external_oam_end_address: 10.214.5.7 systemcontroller_gateway_address: 10.214.2.254 docker_registries: k8s.gcr.io: url: 10.214.1.1/starlingx quay.io: url: 10.214.1.1/starlingx docker.io: url: 10.214.1.1/starlingx gcr.io: url: 10.214.1.1/starlingx defaults: url: 10.214.1.1/starlingx username: admin password: XYZ ssl_ca_cert: /home/sysadmin/centralharborcert/ca.crt Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Davlet.Panech at windriver.com Thu Mar 25 15:23:55 2021 From: Davlet.Panech at windriver.com (Panech, Davlet) Date: Thu, 25 Mar 2021 15:23:55 +0000 Subject: [Starlingx-discuss] [build-report] master STX_build_master_master - Build # 866 - Failure! In-Reply-To: <1660069219.117.1616660876637.JavaMail.javamailuser@localhost> References: <1660069219.117.1616660876637.JavaMail.javamailuser@localhost> Message-ID: Flock build failed due to a bad commit related to build scripts. We reverted it (https://review.opendev.org/c/starlingx/root/+/783006) -- new build in progress. ________________________________ From: build.starlingx at gmail.com Sent: March 25, 2021 4:27 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] [build-report] master STX_build_master_master - Build # 866 - Failure! [Please note: This e-mail is from an EXTERNAL e-mail address] Project: STX_build_master_master Build #: 866 Status: Failure Timestamp: 20210325T043000Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210325T043000Z/logs -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: false FORCE_BUILD: true -------------- next part -------------- An HTML attachment was scrubbed... URL: From scott.little at windriver.com Thu Mar 25 16:29:50 2021 From: scott.little at windriver.com (Scott Little) Date: Thu, 25 Mar 2021 12:29:50 -0400 Subject: [Starlingx-discuss] Reviews Please: Setting SW_VERSION to 12.05 in prep for StarlingX 5.0 Message-ID: The time has come advance the SW_VERSION to 21.05 in prep for StarlingX 5.0. Code reviews are requested ... https://review.opendev.org/q/topic:%22release-21.05%22+(status:open%20OR%20status:merged) Thanks  Scott From yatindra.shashi at intel.com Thu Mar 25 18:05:07 2021 From: yatindra.shashi at intel.com (Shashi, Yatindra) Date: Thu, 25 Mar 2021 18:05:07 +0000 Subject: [Starlingx-discuss] starlingx.io is down ?? Message-ID: Hi team, I see erorr msg like below while trying to access starlingx site ( https://www.starlingx.io/). This site can't be reached The webpage at https://www.starlingx.io/ might be temporarily down or it may have moved permanently to a new web address. ERR_FAILED Mit freundlichen Grüßen/ with best regards, Yatindra Shashi IoTG DE- Intel Corporation Munich, Germany Intel Deutschland GmbH Registered Address: Am Campeon 10, 85579 Neubiberg, Germany Tel: +49 89 99 8853-0, www.intel.de Managing Directors: Christin Eisenschmid, Sharon Heck, Tiffany Doon Silva Chairperson of the Supervisory Board: Nicole Lau Registered Office: Munich Commercial Register: Amtsgericht Muenchen HRB 186928 -------------- next part -------------- An HTML attachment was scrubbed... URL: From fungi at yuggoth.org Thu Mar 25 18:21:12 2021 From: fungi at yuggoth.org (Jeremy Stanley) Date: Thu, 25 Mar 2021 18:21:12 +0000 Subject: [Starlingx-discuss] starlingx.io is down ?? In-Reply-To: References: Message-ID: <20210325182112.t6swmkbhauglpcwg@yuggoth.org> On 2021-03-25 18:05:07 +0000 (+0000), Shashi, Yatindra wrote: > I see erorr msg like below while trying to access starlingx site ( > https://www.starlingx.io/). > > This site can't be reached The webpage at > https://www.starlingx.io/ might be temporarily down or it may have > moved permanently to a new web address. ERR_FAILED The site is hosted with Netlify, who seems to be suffering a mass outage at the moment: https://www.netlifystatus.com/ Sorry about that. Hopefully they'll have it resolved shortly. -- Jeremy Stanley -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 833 bytes Desc: not available URL: From Davlet.Panech at windriver.com Thu Mar 25 20:39:39 2021 From: Davlet.Panech at windriver.com (Panech, Davlet) Date: Thu, 25 Mar 2021 20:39:39 +0000 Subject: [Starlingx-discuss] [build]: py2 starlingx images locked to python modules from June build? In-Reply-To: References: <3ff5c16a-2e08-81bb-aeee-bf8d6eba024e@windriver.com>, Message-ID: Hi Zhipeng, Could you explain how this is meant to work? Should we run get-stx-wheels.sh after every stx/master build-pkgs and replace the stx-centos-py2_stable-wheels.tar file every time? Note that this script extracts only a few wheels; but the stx-centos-py2_stable-wheels.tar currently in place contains many more files. is that normal? Thanks, D. ________________________________ From: Liu, ZhipengS Sent: September 1, 2020 9:43 PM To: Little, Scott ; starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] [build]: py2 starlingx images locked to python modules from June build? Hi Scott, You might utilize below script, get-stx-wheels.sh to get latest local StarlingX wheels produced by the StarlingX build. Then update them to current stx-centos-py2_stable-wheels.tar Thanks! Zhipeng From: Scott Little Sent: 2020年9月1日 22:21 To: starlingx-discuss at lists.starlingx.io Subject: Re: [Starlingx-discuss] [build]: py2 starlingx images locked to python modules from June build? Zhipemg Can you provide a method to generate an updated stx-centos-py2_stable-wheels.tar that I can implement on the CENGN side? In this way, we can have the tarball automatically update when new updates arrive. Scott \ On 2020-08-14 10:47 a.m., Liu, ZhipengS wrote: Hi Frank and Don, This is exactly a workaround for 4 python2 base images build after I discussed with Scott and Chant in mailing list. Please see my attached email for more detail. We cannot revert this patch directly as it will block ussuri openstack image build. Chant and I also tried several solutions before, including 1. Try to find all python2 dependent wheels Need add almost all old python2 wheels and fix conflict and dependency issues. 1. Try to find wheels support both python2 and python3 Some wheels could not support both. 1. Try to build these 4 images with python3 enabled But these local packages have several local dependencies, which are all python2 based. stx-nova-api-proxy (This one can be upgraded to py3) stx-fm-rest-api stx-keystone-api-proxy stx-platformclients Thanks! Zhipeng From: Miller, Frank Sent: 2020年8月14日 4:07 To: Khalil, Ghada ; Penney, Don ; 'starlingx-discuss at lists.starlingx.io' ; Liu, ZhipengS Subject: RE: [build]: py2 starlingx images locked to python modules from June build? Zhipeng: Please suggest a solution to this issue. One option is to back out the commit that introduced this issue. Can you identify a solution that doesn’t require you to back out your commit? Frank From: Khalil, Ghada > Sent: Wednesday, August 12, 2020 10:06 PM To: Penney, Don >; 'starlingx-discuss at lists.starlingx.io' >; Liu, ZhipengS (zhipengs.liu at intel.com) >; Miller, Frank > Subject: RE: [build]: py2 starlingx images locked to python modules from June build? The launchpad is: https://bugs.launchpad.net/starlingx/+bug/1891416 From: Penney, Don > Sent: Wednesday, August 12, 2020 9:21 PM To: 'starlingx-discuss at lists.starlingx.io' >; Liu, ZhipengS (zhipengs.liu at intel.com) >; Miller, Frank > Subject: [Starlingx-discuss] [build]: py2 starlingx images locked to python modules from June build? Hi folks, It was discovered that the recent stx-platformclients image was not picking up recent changes made to the distributedcloud-client package (I believe a Launchpad will be raised shortly). Tracing back through the CENGN build logs, the problem appears to stem from the changes introduced by: https://review.opendev.org/#/c/737456/11/build-tools/build-docker-images/docker-image-build.cfg So for specific images, including stx-platformclients, the image build is now using a reference to a presumably static tarball: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/stx-centos-py2_stable-wheels.tar Looking at the dir listing, we can see this tarball is dated June 23rd: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/ What this means is that these particular images will be using this locked tarball for installing python modules from the wheels (ie. The PIP_PACKAGES list)… which means that an image like stx-platformclients, which is getting various starlingx clients from wheels, will only ever have content from that June 23rd build. Was this the intended behavior? Instead of this “alternate wheels tarball”, shouldn’t we be generating a wheels tarball with both py2 and py3 support, as long as we’re building any py2 images? Thanks, Don. _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Fri Mar 26 07:23:13 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Fri, 26 Mar 2021 07:23:13 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210325T152555Z Message-ID: Sanity Test from 2021-March-25 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210325T152555Z/outputs/iso/) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210325T152555Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Ankush.Rai at commscope.com Fri Mar 26 03:34:54 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Fri, 26 Mar 2021 03:34:54 +0000 Subject: [Starlingx-discuss] How to package and run user application in starlingx Message-ID: Hi, As starlingx provides application management interface and by default it runs some applications like cert-manager and nginx. How can I use this interface to package my own application and run it using the system CLI or via rest API? Please point to any documentation which describes the application packaging and running process. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From pvmpublic at gmail.com Fri Mar 26 13:06:58 2021 From: pvmpublic at gmail.com (Pratik M.) Date: Fri, 26 Mar 2021 18:36:58 +0530 Subject: [Starlingx-discuss] How to package and run user application in starlingx In-Reply-To: References: Message-ID: Pl. see if this helps: https://opendev.org/starlingx/tools/src/branch/master/app-gen-tool On Fri, Mar 26, 2021, 13:30 Rai, Ankush wrote: > Hi, > > > > As starlingx provides application management interface and by default it > runs some applications like cert-manager and nginx. How can I use this > interface to package my own application and run it using the system CLI or > via rest API? > > > > Please point to any documentation which describes the application > packaging and running process. > > > > Thanks, > > Ankush > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ghada.Khalil at windriver.com Fri Mar 26 14:17:05 2021 From: Ghada.Khalil at windriver.com (Khalil, Ghada) Date: Fri, 26 Mar 2021 14:17:05 +0000 Subject: [Starlingx-discuss] New nginx-ingress-controller images In-Reply-To: References: Message-ID: All, The new version of the nginx was merged in stx master yesterday: https://review.opendev.org/c/starlingx/nginx-ingress-controller-armada-app/+/782326 Please update your local registries accordingly. Regards, Ghada From: Isac Sacchi Souza Sent: Monday, March 22, 2021 3:33 PM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] New nginx-ingress-controller images Hi StarlingX community, The nginx-ingress-controller is being upversioned from 0.23.0 to 0.41.2. If anyone is using a private container registry to install from, please pull the following images and push them to your private container registry. New images and tags are: docker.io/jettech/kube-webhook-certgen:v1.5.0 k8s.gcr.io/ingress-nginx/controller:v0.41.2 Additionally, this image was used by the old version and will continue to be used by the new version: k8s.gcr.io/defaultbackend:1.4 We will submit a review with the code changes shortly. Regards, -------------- next part -------------- An HTML attachment was scrubbed... URL: From haochuan.z.chen at intel.com Fri Mar 26 16:17:15 2021 From: haochuan.z.chen at intel.com (Chen, Haochuan Z) Date: Fri, 26 Mar 2021 16:17:15 +0000 Subject: [Starlingx-discuss] patch review for docker image build Message-ID: Hi Scott Little and Don Penney Please review my patch for docker image build. https://review.opendev.org/c/starlingx/utilities/+/783128 Thanks! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Fri Mar 26 21:38:46 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Fri, 26 Mar 2021 21:38:46 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210326T013301Z Message-ID: Sanity Test from 2021-March-26 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210326T013301Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210326T013301Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Ankush.Rai at commscope.com Sat Mar 27 06:15:36 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Sat, 27 Mar 2021 06:15:36 +0000 Subject: [Starlingx-discuss] Where to find a list of starlingx images Message-ID: Hi, I am trying to store all the starlingx images in the local repository, can some-one provides me a list of images, required to bring up the distributed starlingx? Currently I am maintaining these images but not sure whether it is enough for all the underlying applications or not. starlingx/quay.io/external_storage/rbd-provisioner starlingx/calico/node starlingx/airshipit/armada starlingx/calico/cni starlingx/calico/pod2daemon-flexvol starlingx/kube-apiserver starlingx/kube-controller-manager starlingx/kube-proxy starlingx/kube-scheduler starlingx/starlingx/n3000-opae starlingx/pause starlingx/starlingx/k8s-plugins-sriov-network-device starlingx/etcd starlingx/coredns starlingx/kubernetes-helm/tiller starlingx/calico/kube-controllers starlingx/nfvpe/multus starlingx/kubernetes-ingress-controller/nginx-ingress-controller starlingx/starlingx/k8s-cni-sriov starlingx/stackanetes/kubernetes-entrypoint starlingx/jetstack/cert-manager-webhook starlingx/jetstack/cert-manager-controller starlingx/starlingx/ceph-config-helper starlingx/jetstack/cert-manager-cainjector starlingx/starlingx/stx-keystone-api-proxy starlingx/k8scsi/snapshot-controller starlingx/jetstack/cert-manager-acmesolver starlingx/starlingx/rvmc starlingx/defaultbackend starlingx/starlingx/stx-panko starlingx/external_storage/rbd-provisioner Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Sat Mar 27 06:51:25 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Sat, 27 Mar 2021 06:51:25 +0000 Subject: [Starlingx-discuss] Not able to access Horizon UI Message-ID: What causing this horizon issue, any pointers to debug it ? Alarms: +----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+ | Alarm ID | Reason Text | Entity ID | Severity | Time Stamp | +----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+ | 100.114 | NTP cannot reach external time source; syncing with peer controller only | host=controller-1.ntp | minor | 2021-03-27T06:31:53 | | | | | | .869431 | | | | | | | | 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-1.ntp=10.194 | minor | 2021-03-25T17:51:56 | | | | .248.250 | | .064694 | | | | | | | | 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-0.ntp=10.194 | minor | 2021-03-25T06:32:26 | | | | .248.250 | | .035234 | | | | | | | | 280.001 | edge is offline | subcloud=edge | critical | 2021-03-20T14:19:25 | | | | | | .650795 | | | | | | | | 100.114 | NTP configuration does not contain any valid or reachable NTP servers. | host=controller-0.ntp | major | 2021-02-20T13:11:39 | | | | | | .604729 | | | | | | | | 100.103 | Platform Memory threshold exceeded ; threshold 90.00%, actual 98.86% | host=controller-0 | critical | 2021-02-20T11:34:39 | | | | | | .542948 | | | | | | Horizon Logs: 2021-03-27 06:45:04,264 [ERROR] django.request: Internal Server Error: /admin/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 52, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 113, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 84, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 88, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 120, in get self.load_tabs() File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 88, in load_tabs tab_group = self.get_tabs(self.request, **self.kwargs) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/views.py", line 36, in get_tabs return self.tab_group_class(request, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 118, in __init__ self._tabs = self._load_tabs(request) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 128, in _load_tabs for tab in tabs]) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 479, in __init__ super(TableTab, self).__init__(tab_group, request) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 325, in __init__ self._allowed = self.allowed(request) and ( File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/tabs.py", line 227, in allowed return not stx_api.sysinv.is_system_mode_simplex(request) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 2656, in is_system_mode_simplex systems = system_list(request) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 1045, in system_list systems = cgtsclient(request).isystem.list() File "/usr/lib64/python2.7/site-packages/cgtsclient/v1/isystem.py", line 30, in list return self._list(self._path(), "isystems") File "/usr/lib64/python2.7/site-packages/cgtsclient/common/base.py", line 71, in _list _, body = self.api.json_request('GET', url) File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 245, in json_request self.authenticate() File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 347, in authenticate content_type="application/json") File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 219, in _cs_request error_json.get('debuginfo'), *args) HTTPNotFound: None ^C controller-0:~$ Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: starling_horizon_issue.png Type: image/png Size: 18756 bytes Desc: starling_horizon_issue.png URL: From Ankush.Rai at commscope.com Sat Mar 27 08:05:44 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Sat, 27 Mar 2021 08:05:44 +0000 Subject: [Starlingx-discuss] Not able to access Horizon UI In-Reply-To: References: Message-ID: Looks like browser-cash issue, it goes corrupted when I try to get the newly added edge details. From: Rai, Ankush Sent: Saturday, March 27, 2021 12:21 PM To: starlingx-discuss at lists.starlingx.io Subject: Not able to access Horizon UI What causing this horizon issue, any pointers to debug it ? Alarms: +----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+ | Alarm ID | Reason Text | Entity ID | Severity | Time Stamp | +----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+ | 100.114 | NTP cannot reach external time source; syncing with peer controller only | host=controller-1.ntp | minor | 2021-03-27T06:31:53 | | | | | | .869431 | | | | | | | | 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-1.ntp=10.194 | minor | 2021-03-25T17:51:56 | | | | .248.250 | | .064694 | | | | | | | | 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-0.ntp=10.194 | minor | 2021-03-25T06:32:26 | | | | .248.250 | | .035234 | | | | | | | | 280.001 | edge is offline | subcloud=edge | critical | 2021-03-20T14:19:25 | | | | | | .650795 | | | | | | | | 100.114 | NTP configuration does not contain any valid or reachable NTP servers. | host=controller-0.ntp | major | 2021-02-20T13:11:39 | | | | | | .604729 | | | | | | | | 100.103 | Platform Memory threshold exceeded ; threshold 90.00%, actual 98.86% | host=controller-0 | critical | 2021-02-20T11:34:39 | | | | | | .542948 | | | | | | Horizon Logs: 2021-03-27 06:45:04,264 [ERROR] django.request: Internal Server Error: /admin/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 52, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 113, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 84, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 88, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 120, in get self.load_tabs() File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 88, in load_tabs tab_group = self.get_tabs(self.request, **self.kwargs) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/views.py", line 36, in get_tabs return self.tab_group_class(request, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 118, in __init__ self._tabs = self._load_tabs(request) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 128, in _load_tabs for tab in tabs]) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 479, in __init__ super(TableTab, self).__init__(tab_group, request) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 325, in __init__ self._allowed = self.allowed(request) and ( File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/tabs.py", line 227, in allowed return not stx_api.sysinv.is_system_mode_simplex(request) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 2656, in is_system_mode_simplex systems = system_list(request) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 1045, in system_list systems = cgtsclient(request).isystem.list() File "/usr/lib64/python2.7/site-packages/cgtsclient/v1/isystem.py", line 30, in list return self._list(self._path(), "isystems") File "/usr/lib64/python2.7/site-packages/cgtsclient/common/base.py", line 71, in _list _, body = self.api.json_request('GET', url) File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 245, in json_request self.authenticate() File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 347, in authenticate content_type="application/json") File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 219, in _cs_request error_json.get('debuginfo'), *args) HTTPNotFound: None ^C controller-0:~$ Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Sat Mar 27 08:43:32 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Sat, 27 Mar 2021 08:43:32 +0000 Subject: [Starlingx-discuss] Do distributed starlingx supports remote edge upgrade Message-ID: Can I upgrade remote edge from central cloud ? If yes, please point out to the appropriate documentation. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Sat Mar 27 18:03:10 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Sat, 27 Mar 2021 18:03:10 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210327T013338Z Message-ID: Sanity Test from 2021-March-27 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210327T013338Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210327T013338Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From build.starlingx at gmail.com Mon Mar 29 00:43:53 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Sun, 28 Mar 2021 20:43:53 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer_layered - Build # 1389 - Failure! Message-ID: <2102300388.139.1616978646169.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer_layered Build #: 1389 Status: Failure Timestamp: 20210329T003554Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210328T230118Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master-distro/20210328T230118Z DOCKER_BUILD_ID: jenkins-master-distro-20210328T230118Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master-distro/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210328T230118Z/logs BUILD_IMG: false FULL_BUILD: false PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/distro/20210328T230118Z/logs MASTER_JOB_NAME: STX_build_layer_distro_master_master LAYER: distro MY_REPO_ROOT: /localdisk/designer/jenkins/master-distro BUILD_ISO: false From build.starlingx at gmail.com Mon Mar 29 00:44:07 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Sun, 28 Mar 2021 20:44:07 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] master STX_build_layer_distro_master_master - Build # 449 - Failure! Message-ID: <1057961636.142.1616978648346.JavaMail.javamailuser@localhost> Project: STX_build_layer_distro_master_master Build #: 449 Status: Failure Timestamp: 20210328T230118Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/distro/20210328T230118Z/logs -------------------------------------------------------------------------------- Parameters FULL_BUILD: false FORCE_BUILD: false From build.starlingx at gmail.com Mon Mar 29 08:03:56 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Mon, 29 Mar 2021 04:03:56 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] STX_build_pre_installer - Build # 1059 - Failure! Message-ID: <2119496739.145.1617005037613.JavaMail.javamailuser@localhost> Project: STX_build_pre_installer Build #: 1059 Status: Failure Timestamp: 20210329T061044Z Branch: Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210329T043000Z/logs -------------------------------------------------------------------------------- Parameters MY_WORKSPACE: /localdisk/loadbuild/jenkins/master/20210329T043000Z DOCKER_BUILD_ID: jenkins-master-20210329T043000Z-builder OS: centos MY_REPO: /localdisk/designer/jenkins/master/cgcs-root PUBLISH_LOGS_URL: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210329T043000Z/logs PUBLISH_LOGS_BASE: /export/mirror/starlingx/master/centos/monolithic/20210329T043000Z/logs MASTER_JOB_NAME: STX_build_master_master MY_REPO_ROOT: /localdisk/designer/jenkins/master From build.starlingx at gmail.com Mon Mar 29 08:03:59 2021 From: build.starlingx at gmail.com (build.starlingx at gmail.com) Date: Mon, 29 Mar 2021 04:03:59 -0400 (EDT) Subject: [Starlingx-discuss] [build-report] master STX_build_master_master - Build # 871 - Failure! Message-ID: <1236087635.148.1617005040949.JavaMail.javamailuser@localhost> Project: STX_build_master_master Build #: 871 Status: Failure Timestamp: 20210329T043000Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210329T043000Z/logs -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: false FORCE_BUILD: true From Ghada.Khalil at windriver.com Mon Mar 29 13:48:53 2021 From: Ghada.Khalil at windriver.com (Khalil, Ghada) Date: Mon, 29 Mar 2021 13:48:53 +0000 Subject: [Starlingx-discuss] Minutes: StarlingX Release Meeting - Mar 24/2021 Message-ID: Agenda/Minutes are posted at: https://etherpad.openstack.org/p/stx-releases stx.5.0 - Upcoming Milestones: - Regression Completion Plan: April 7 - RC1 / Branch Creation: week of April 12 - Main concern is with bug volume - Feature Status / Test - Feature Status: https://docs.google.com/spreadsheets/d/1JbOQELqXG_GDoP1jo6YoRDytpTkJEs89TVimzvrqc_A/edit#gid=1107209846 - Feature Test: https://docs.google.com/spreadsheets/d/1jro4ItdSobB0-fseK_4cOZJHhUyuh_eCBBsDOp_A5Pc/edit#gid=968103774 - Regression Test - Tracking is up-to-date: https://docs.google.com/spreadsheets/d/10PcWeT2N1_wSONCCfDF_WGePyNK0c_tqUTTkypNkNiE/edit#gid=1717644237 - WR Testing on track to finish by Apr 2 - Intel Testing on track to finish by Apr 7 - Bugs - https://bugs.launchpad.net/starlingx/+bugs?field.tag=stx.5.0 - Total: 64 / Critical: 2 / High: 10 - Request to all PLs to scrub with their teams - Communication - Press Release / Blog Post - Ildiko requesting which features to highlight in a blog post / press release - Jeff Gowan is working on blog posts related to ptp - This should cover the ptp-notification stx.5.0 feature - Need to be confirmed - Austin to follow-up with team to create a blog post for "Edge Worker for Industrial Deployments" - Austin to follow-up with team to create a blog post for "Ceph Rook" - Ghada to ask Dariush/Bart if there is something that can be highlighted related to DC scalability / Orchestration stx.6.0 - Not discussed in meeting due to time constraints - Release Folder: https://drive.google.com/drive/folders/1exEyxC1M0wDaQeCdqjOGgt409PfPDNl2 - Release Planning spreadsheet: https://docs.google.com/spreadsheets/d/13p0BMlBgJXUVForOFsblAJq9jA1-FMBlmhV5TIc70IE/edit#gid=0 - PTG Etherpad: https://etherpad.opendev.org/p/stx-ptg-planning-april-2021 From Davlet.Panech at windriver.com Mon Mar 29 14:07:44 2021 From: Davlet.Panech at windriver.com (Panech, Davlet) Date: Mon, 29 Mar 2021 14:07:44 +0000 Subject: [Starlingx-discuss] [build-report] master STX_build_master_master - Build # 871 - Failure! In-Reply-To: <1236087635.148.1617005040949.JavaMail.javamailuser@localhost> References: <1236087635.148.1617005040949.JavaMail.javamailuser@localhost> Message-ID: Build failed due to a bad commit: https://review.opendev.org/c/starlingx/integ/+/778446 . We reverted it -- will restart the build shortly. D. ________________________________ From: build.starlingx at gmail.com Sent: March 29, 2021 4:03 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] [build-report] master STX_build_master_master - Build # 871 - Failure! [Please note: This e-mail is from an EXTERNAL e-mail address] Project: STX_build_master_master Build #: 871 Status: Failure Timestamp: 20210329T043000Z Branch: master Check logs at: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/monolithic/20210329T043000Z/logs -------------------------------------------------------------------------------- Parameters BUILD_CONTAINERS_DEV: false BUILD_CONTAINERS_STABLE: false FORCE_BUILD: true -------------- next part -------------- An HTML attachment was scrubbed... URL: From austin.sun at intel.com Tue Mar 30 02:49:12 2021 From: austin.sun at intel.com (Sun, Austin) Date: Tue, 30 Mar 2021 02:49:12 +0000 Subject: [Starlingx-discuss] Agenda StarlingX Distro-OpenStack: Bi-weekly Project Meeting -- 03/30 Message-ID: Hi All: As planned , we will have openstack distro meeting. The topic will be : -stx 5.0 release progress - Bugs review https://bugs.launchpad.net/starlingx/+bugs?field.tag=stx.distro.openstack -stx.6.0 feature. If any topic, please add https://etherpad.opendev.org/p/stx-distro-openstack-meetings Thanks. BR Austin Sun. -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Tue Mar 30 09:08:13 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Tue, 30 Mar 2021 09:08:13 +0000 Subject: [Starlingx-discuss] Question regarding nginx-ingress-controller which was upversioned to 0.41.2 Message-ID: Hello guys, One of our tests is checking the kube services and after the upgrade of nginx-ingress-controller I found that some services names were changed: E AssertionError: One or more services are missing from the list E assert ['ic-nginx-in...', 'kube-dns'] == ['ic-nginx-ing...', 'kube-dns'] E At index 0 diff: 'ic-nginx-ingress-controller' != 'ic-nginx-ingress-ingress-nginx-controller' E Full diff: E - ['ic-nginx-ingress-controller', 'ic-nginx-ingress-default-backend', 'kube-dns'] E + ['ic-nginx-ingress-ingress-nginx-controller', E + 'ic-nginx-ingress-ingress-nginx-controller-admission', E + 'kube-dns'] Is this an expected behavior, a known issue? Should we open a bug or we actually need to update our test? Thanks! Kind regards, Alex Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From lists at optimcloud.com Tue Mar 30 11:11:43 2021 From: lists at optimcloud.com (Embedded Devel) Date: Tue, 30 Mar 2021 18:11:43 +0700 Subject: [Starlingx-discuss] adding packages to running bare metal duplex Message-ID: <9bc9306e-0ab0-5eeb-0471-56f5c86475bb@optimcloud.com> Hi, i have a need to add a few packages to a running bare metal duplex, one being a kernel module i dont see where you can "dnf install" anything based on the repos configuration, and i dont want to blow up the cluster, any ideas or pointers ??? From isouza at daitan.com Tue Mar 30 11:42:59 2021 From: isouza at daitan.com (Isac Sacchi Souza) Date: Tue, 30 Mar 2021 08:42:59 -0300 Subject: [Starlingx-discuss] Question regarding nginx-ingress-controller which was upversioned to 0.41.2 In-Reply-To: References: Message-ID: Hi Alexandru. That is a side-effect of updating the helm charts used to deploy the nginx ingress controller. It should not cause any problems as this service is not intended to be used directly by other applications. The test should be updated to check for the new service names. Regards, Isac. On Tue, Mar 30, 2021 at 6:08 AM Dimofte, Alexandru < alexandru.dimofte at intel.com> wrote: > [Please note: This e-mail is from an EXTERNAL e-mail address] > > Hello guys, > > > > One of our tests is checking the kube services and after the upgrade of > nginx-ingress-controller I found that some services names were changed: > > > > E AssertionError: One or more services are missing from the list > > E assert ['ic-nginx-in...', 'kube-dns'] == ['ic-nginx-ing...', > 'kube-dns'] > > E At index 0 diff: *'ic-nginx-ingress-controller'* != > *'ic-nginx-ingress-ingress-nginx-controller'* > > E Full diff: > > E - [*'ic-nginx-ingress-controller'*, > *'ic-nginx-ingress-default-backend'*, 'kube-dns'] > > E + [*'ic-nginx-ingress-ingress-nginx-controller'*, > > E + *'ic-nginx-ingress-ingress-nginx-controller-admission'*, > > E + 'kube-dns'] > > > > Is this an expected behavior, a known issue? > > Should we open a bug or we actually need to update our test? > > Thanks! > > > > Kind regards, > > Alex Dimofte > > > > [image: Logo Description automatically generated] > > Dimofte Alexandru > > Software Engineer > > STARLINGX TEAM > > Skype no: +40 336403734 > > Personal Mobile: +40 743167456 > > alexandru.dimofte at intel.com > > Intel Romania > > > > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > -- *Isac Sacchi e Souza**, Systems Architect* *DAITAN |* *Accelerating **|* www.daitan.com *Privileged and confidential. If this message has been received in error, please notify the sender and delete it immediately.* *Conteúdo confidencial. Se esta mensagem foi recebida por engano, favor avisar o remetente e apagá-la imediatamente.* -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: not available URL: From IsacSacchi.Souza at windriver.com Tue Mar 30 11:44:36 2021 From: IsacSacchi.Souza at windriver.com (Isac Sacchi Souza) Date: Tue, 30 Mar 2021 08:44:36 -0300 Subject: [Starlingx-discuss] Question regarding nginx-ingress-controller which was upversioned to 0.41.2 In-Reply-To: References: Message-ID: Hi Alexandru. That is a side-effect of updating the helm charts used to deploy the nginx ingress controller. It should not cause any problems as this service is not intended to be used directly by other applications. The test should be updated to check for the new service names. Regards, Isac. On Tue, Mar 30, 2021 at 6:08 AM Dimofte, Alexandru < alexandru.dimofte at intel.com> wrote: > [Please note: This e-mail is from an EXTERNAL e-mail address] > > Hello guys, > > > > One of our tests is checking the kube services and after the upgrade of > nginx-ingress-controller I found that some services names were changed: > > > > E AssertionError: One or more services are missing from the list > > E assert ['ic-nginx-in...', 'kube-dns'] == ['ic-nginx-ing...', > 'kube-dns'] > > E At index 0 diff: *'ic-nginx-ingress-controller'* != > *'ic-nginx-ingress-ingress-nginx-controller'* > > E Full diff: > > E - [*'ic-nginx-ingress-controller'*, > *'ic-nginx-ingress-default-backend'*, 'kube-dns'] > > E + [*'ic-nginx-ingress-ingress-nginx-controller'*, > > E + *'ic-nginx-ingress-ingress-nginx-controller-admission'*, > > E + 'kube-dns'] > > > > Is this an expected behavior, a known issue? > > Should we open a bug or we actually need to update our test? > > Thanks! > > > > Kind regards, > > Alex Dimofte > > > > [image: Logo Description automatically generated] > > Dimofte Alexandru > > Software Engineer > > STARLINGX TEAM > > Skype no: +40 336403734 > > Personal Mobile: +40 743167456 > > alexandru.dimofte at intel.com > > Intel Romania > > > > > _______________________________________________ > Starlingx-discuss mailing list > Starlingx-discuss at lists.starlingx.io > http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: not available URL: From lists at optimcloud.com Tue Mar 30 13:00:52 2021 From: lists at optimcloud.com (Embedded Devel) Date: Tue, 30 Mar 2021 20:00:52 +0700 Subject: [Starlingx-discuss] openstack - configure tenant networking / paid work Message-ID: since i cant make heads or tails of tenant networking for openstack instances i need someone to jump in here and do it for us, this is paid work so we can get it done and utilize the cluster properly. whos interested in a few hours, extra money.... PLEASE...! From alexandru.dimofte at intel.com Tue Mar 30 17:29:32 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Tue, 30 Mar 2021 17:29:32 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210329T161223Z Message-ID: Sanity Test from 2021-March-29 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210329T161223Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210329T161223Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From pvmpublic at gmail.com Tue Mar 30 18:26:28 2021 From: pvmpublic at gmail.com (Pratik M.) Date: Tue, 30 Mar 2021 23:56:28 +0530 Subject: [Starlingx-discuss] Question on remote install of subcloud In-Reply-To: References: Message-ID: Hello everyone, Any pointers here would be great. Thanks in advance On Wed, Mar 24, 2021, 11:25 Pratik M. wrote: > Hi, > Does the StarlingX central cloud support remote installation of a > distributed cloud using IPMI/Redfish? To get it to a stage that > config_management commands can be run. For unattended or zero-touch > installs. > > I looked at the distcloud and bare-metal APIs and could not find a method > to specify a ISO or HDD image as the initial installation source. > https://docs.starlingx.io/api-ref/stx-distcloud/ > https://docs.starlingx.io/api-ref/metal/api-ref-sysinv-v1-metal.html > > The R4.0 release notes talk about "Redfish virtual media support". Can it > be used for this? > I looked at the source and see the following script, but can't determine > if it's instrumented to any StarlingX CLI. > > https://opendev.org/starlingx/metal/src/branch/master/tools/rvmc/centos/docker/rvmc.py > > Any pointers would be appreciated. > > Thanks > Pratik > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Tue Mar 30 19:56:11 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Tue, 30 Mar 2021 19:56:11 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210330T021921Z Message-ID: Sanity Test from 2021-March-30 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210330T021921Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210330T021921Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From haochuan.z.chen at intel.com Wed Mar 31 00:32:32 2021 From: haochuan.z.chen at intel.com (Chen, Haochuan Z) Date: Wed, 31 Mar 2021 00:32:32 +0000 Subject: [Starlingx-discuss] patch review for docker image build In-Reply-To: References: Message-ID: Hi Don Penney & Scott Please review my patch. Thanks! https://review.opendev.org/c/starlingx/utilities/+/783128 BR! Martin, Chen IOTG, Software Engineer 021-61164330 From: Chen, Haochuan Z Sent: Monday, March 29, 2021 7:37 PM To: Scott Little ; Penney, Don Subject: patch review for docker image build Hi Don Penney & Scott Please review my patch. Thanks! https://review.opendev.org/c/starlingx/utilities/+/783128 BR! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From haochuan.z.chen at intel.com Wed Mar 31 00:38:24 2021 From: haochuan.z.chen at intel.com (Chen, Haochuan Z) Date: Wed, 31 Mar 2021 00:38:24 +0000 Subject: [Starlingx-discuss] patch review for rook-ceph to fix bug Message-ID: Hi Bob Please review my patch for rook-ceph. This is bug fix I wish to merge in R5 release https://review.opendev.org/c/starlingx/rook-ceph/+/783584 BR! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Don.Penney at windriver.com Wed Mar 31 03:19:43 2021 From: Don.Penney at windriver.com (Penney, Don) Date: Wed, 31 Mar 2021 03:19:43 +0000 Subject: [Starlingx-discuss] patch review for docker image build In-Reply-To: References: Message-ID: I've been reviewing your patch, thanks. My last review added a comment with multiple points and a question. You dealt with the first part of the comment, but not the second, and didn't respond to the comment or question. But I can certainly add that second part again in another comment. Cheers, Don. From: Chen, Haochuan Z Sent: Tuesday, March 30, 2021 8:33 PM To: Little, Scott ; Penney, Don Cc: starlingx-discuss at lists.starlingx.io Subject: patch review for docker image build [Please note: This e-mail is from an EXTERNAL e-mail address] Hi Don Penney & Scott Please review my patch. Thanks! https://review.opendev.org/c/starlingx/utilities/+/783128 BR! Martin, Chen IOTG, Software Engineer 021-61164330 From: Chen, Haochuan Z Sent: Monday, March 29, 2021 7:37 PM To: Scott Little >; Penney, Don > Subject: patch review for docker image build Hi Don Penney & Scott Please review my patch. Thanks! https://review.opendev.org/c/starlingx/utilities/+/783128 BR! Martin, Chen IOTG, Software Engineer 021-61164330 -------------- next part -------------- An HTML attachment was scrubbed... URL: From Ankush.Rai at commscope.com Wed Mar 31 03:27:16 2021 From: Ankush.Rai at commscope.com (Rai, Ankush) Date: Wed, 31 Mar 2021 03:27:16 +0000 Subject: [Starlingx-discuss] How to access Virtualized central cloud from outside the Host Message-ID: Hi, I have installed the central cloud (All in one Duplex) in a virtualized environment. But not sure what NAT rules are required, to access it from outside the Host machine. * Below is my deployment. [Diagram Description automatically generated] * Starlingx is installed. system host-list +----+--------------+-------------+----------------+-------------+--------------+ | id | hostname | personality | administrative | operational | availability | +----+--------------+-------------+----------------+-------------+--------------+ | 1 | controller-0 | controller | unlocked | enabled | available | | 2 | controller-1 | controller | unlocked | enabled | available | +----+--------------+-------------+----------------+-------------+--------------+ * Packets are reaching to the Host machine listening on ens1, link-type EN10MB (Ethernet), capture size 262144 bytes 11:35:56.144807 IP 14.141.56.230.61002 > 172.31.21.86.8080: Flags [S], seq 1632511605, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 11:35:56.145030 IP 14.141.56.230.48775 > 172.31.21.86.8080: Flags [S], seq 455906092, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 11:35:56.396487 IP 14.141.56.230.57030 > 172.31.21.86.8080: Flags [S], seq 4106471277, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 11:36:00.145533 IP 14.141.56.230.61002 > 172.31.21.86.8080: Flags [S], seq 1632511605, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 * I have tried below rules. iptables -t nat -I PREROUTING -i ens1 -p tcp --dport 8080 -j DNAT --to-destination 10.10.10.2:8080 iptables -A FORWARD -j ACCEPT iptables -t nat -I POSTROUTING -s 10.10.11.0/24 -o enp125s0 -j MASQUERADE iptables -t nat -I POSTROUTING -s 10.10.10.0/24 -o ens1 -j MASQUERADE * Ipv4 forwarding is enabled on the host and from Host I can reach the controllers. But still could not see packet reaching to the controller. Any suggestion would be very helpful. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 26134 bytes Desc: image001.jpg URL: From Bill.Zvonar at windriver.com Wed Mar 31 13:18:15 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 31 Mar 2021 13:18:15 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 31, 2021) Message-ID: Hi all, reminder of the weekly TSC/Community calls coming up shortly. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210331T1400 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From Saul.Wold at windriver.com Wed Mar 31 13:51:52 2021 From: Saul.Wold at windriver.com (Saul Wold) Date: Wed, 31 Mar 2021 06:51:52 -0700 Subject: [Starlingx-discuss] Multi-OS / Non-OpenStack Distro Meeting Notes 3/31 Message-ID: <4660e8f6-42c7-5b7f-866a-8602ee82bf2a@windriver.com> 03/31 Meeting * Python3 Status - Continue to work in CentOS-8 - Back to building and able to run ansible - No services running yet - fault services are running on CentOS-7 with hacks for py3 modules - This is what prompted the CentOS-8 branch work. * Debian Activities - OBS Package builds - Investigating creating a good workflow between OSB/Gerrit/Zuul - Debootstrap to build ISO - Base package set translated from rpm->deb - Custom Kernel - WRL initramfs as initial development initramfs / installer tools * Next Steps - Create initramfs for installation - Install ISO - Basic OS level sanity checks for StarlingX related packages - Unmodified 3rd party packages available from Debian repos - Ansible, puppet, k8s, qemu - Tools for creating initramfs with custom scripts - More Specifications! -- Sau! From Barton.Wensley at windriver.com Wed Mar 31 14:34:12 2021 From: Barton.Wensley at windriver.com (Wensley, Barton) Date: Wed, 31 Mar 2021 14:34:12 +0000 Subject: [Starlingx-discuss] adding packages to running bare metal duplex In-Reply-To: <9bc9306e-0ab0-5eeb-0471-56f5c86475bb@optimcloud.com> References: <9bc9306e-0ab0-5eeb-0471-56f5c86475bb@optimcloud.com> Message-ID: StarlingX doesn't support installing packages directly with dnf or rpm commands. You would need to do this by generating a StarlingX patch and applying it to the system as described here: https://docs.starlingx.io/developer_resources/starlingx_patching.html Bart -----Original Message----- From: Embedded Devel Sent: Tuesday, March 30, 2021 7:12 AM To: Starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] adding packages to running bare metal duplex [Please note: This e-mail is from an EXTERNAL e-mail address] Hi, i have a need to add a few packages to a running bare metal duplex, one being a kernel module i dont see where you can "dnf install" anything based on the repos configuration, and i dont want to blow up the cluster, any ideas or pointers ??? _______________________________________________ Starlingx-discuss mailing list Starlingx-discuss at lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss From Bill.Zvonar at windriver.com Wed Mar 31 14:45:25 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 31 Mar 2021 14:45:25 +0000 Subject: [Starlingx-discuss] Community (& TSC) Call (Mar 31, 2021) In-Reply-To: References: Message-ID: >From today... * Standing Topics * Build/Sanity * build ok, sanity about where it was last week re: OpenStack reapply - Gustavo progressing on the first issue * Gerrit Reviews in Need of Attention * nothing this week * Topics for this Week * Gating Bugs for stx.5.0 * Critical (2) & High (5) importance bugs need to be resolved by ~3rd week of April * same for as many Medium (38) importance bugs as we can fix * Bill will send an update to the mailing list * ARs from Previous Meetings * nothing to discuss today * Open Requests for Help * How to access Virtualized central cloud from outside the Host * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011109.html * Cole will look into this * adding packages to running bare metal duplex * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011099.html * Bart will respond * Do distributed starlingx supports remote edge upgrade * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011089.html * Bill will respond re: Upgrades not supported * Not able to access Horizon UI * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011088.html * Bill will respond, suggest he opens a Launchpad * Where to find a list of starlingx images * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011086.html * Bill will ask Don about this * openstack - configure tenant networking / paid work * http://lists.starlingx.io/pipermail/starlingx-discuss/2021-March/011102.html * no takers so far ; ) * Build Matters (if required) * nothing this week -----Original Message----- From: Zvonar, Bill Sent: Wednesday, March 31, 2021 9:18 AM To: Starlingx-discuss at lists.starlingx.io Subject: Community (& TSC) Call (Mar 31, 2021) Hi all, reminder of the weekly TSC/Community calls coming up shortly. Please feel free to add items to the agenda [0] for the community call. Bill... [0] etherpad: https://etherpad.openstack.org/p/stx-status [1] call details: https://wiki.openstack.org/wiki/Starlingx/Meetings#7am_Pacific_-_Technical_Steering_Committee_.26_Community_Call [2] meeting start time in various time-zones: https://www.timeanddate.com/worldclock/fixedtime.html?iso=20210331T1400 [3] https://zoom.us/j/342730236?pwd=N21CUXNXVlJXMlcyZjZ0SE96cVNjQT09 From Bill.Zvonar at windriver.com Wed Mar 31 14:52:36 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 31 Mar 2021 14:52:36 +0000 Subject: [Starlingx-discuss] Do distributed starlingx supports remote edge upgrade In-Reply-To: References: Message-ID: Hi Ankush - upgrades are not supported by the StarlingX project. Bill... From: Rai, Ankush Sent: Saturday, March 27, 2021 4:44 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] Do distributed starlingx supports remote edge upgrade [Please note: This e-mail is from an EXTERNAL e-mail address] Can I upgrade remote edge from central cloud ? If yes, please point out to the appropriate documentation. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From bruce.e.jones at intel.com Wed Mar 31 14:53:32 2021 From: bruce.e.jones at intel.com (Jones, Bruce E) Date: Wed, 31 Mar 2021 14:53:32 +0000 Subject: [Starlingx-discuss] TSC meeting nodes Mar 31 2021 Message-ID: Mar 31 2021 * Standing topics * No new governance reviews * Two specs open for review * https://review.opendev.org/c/starlingx/specs/+/779866 * https://review.opendev.org/c/starlingx/specs/+/780332 * TSC members please review these specs - if you believe they are ready please +2 * Please try to approve (or comment on) the specs by the TSC call next week!!! * Please post specs for any other new features SOON so we can review them before the PTG * PTG Prep * Reminder: We have an Etherpad open for PTG agenda items. Please add any items you want to discuss here: * https://etherpad.opendev.org/p/stx-ptg-planning-april-2021 * Expecting new features to be presented at the PTG for discussion and awareness -------------- next part -------------- An HTML attachment was scrubbed... URL: From Bill.Zvonar at windriver.com Wed Mar 31 14:53:56 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 31 Mar 2021 14:53:56 +0000 Subject: [Starlingx-discuss] Not able to access Horizon UI In-Reply-To: References: Message-ID: Hi Ankush - suggest that you open a Launchpad for this. Bill... From: Rai, Ankush Sent: Saturday, March 27, 2021 2:51 AM To: starlingx-discuss at lists.starlingx.io Subject: [Starlingx-discuss] Not able to access Horizon UI [Please note: This e-mail is from an EXTERNAL e-mail address] What causing this horizon issue, any pointers to debug it ? Alarms: +----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+ | Alarm ID | Reason Text | Entity ID | Severity | Time Stamp | +----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+ | 100.114 | NTP cannot reach external time source; syncing with peer controller only | host=controller-1.ntp | minor | 2021-03-27T06:31:53 | | | | | | .869431 | | | | | | | | 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-1.ntp=10.194 | minor | 2021-03-25T17:51:56 | | | | .248.250 | | .064694 | | | | | | | | 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-0.ntp=10.194 | minor | 2021-03-25T06:32:26 | | | | .248.250 | | .035234 | | | | | | | | 280.001 | edge is offline | subcloud=edge | critical | 2021-03-20T14:19:25 | | | | | | .650795 | | | | | | | | 100.114 | NTP configuration does not contain any valid or reachable NTP servers. | host=controller-0.ntp | major | 2021-02-20T13:11:39 | | | | | | .604729 | | | | | | | | 100.103 | Platform Memory threshold exceeded ; threshold 90.00%, actual 98.86% | host=controller-0 | critical | 2021-02-20T11:34:39 | | | | | | .542948 | | | | | | Horizon Logs: 2021-03-27 06:45:04,264 [ERROR] django.request: Internal Server Error: /admin/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 52, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 113, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 84, in dec return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 88, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 120, in get self.load_tabs() File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 88, in load_tabs tab_group = self.get_tabs(self.request, **self.kwargs) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/views.py", line 36, in get_tabs return self.tab_group_class(request, **kwargs) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 118, in __init__ self._tabs = self._load_tabs(request) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 128, in _load_tabs for tab in tabs]) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 479, in __init__ super(TableTab, self).__init__(tab_group, request) File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 325, in __init__ self._allowed = self.allowed(request) and ( File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/tabs.py", line 227, in allowed return not stx_api.sysinv.is_system_mode_simplex(request) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 2656, in is_system_mode_simplex systems = system_list(request) File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 1045, in system_list systems = cgtsclient(request).isystem.list() File "/usr/lib64/python2.7/site-packages/cgtsclient/v1/isystem.py", line 30, in list return self._list(self._path(), "isystems") File "/usr/lib64/python2.7/site-packages/cgtsclient/common/base.py", line 71, in _list _, body = self.api.json_request('GET', url) File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 245, in json_request self.authenticate() File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 347, in authenticate content_type="application/json") File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 219, in _cs_request error_json.get('debuginfo'), *args) HTTPNotFound: None ^C controller-0:~$ Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexandru.dimofte at intel.com Wed Mar 31 15:06:57 2021 From: alexandru.dimofte at intel.com (Dimofte, Alexandru) Date: Wed, 31 Mar 2021 15:06:57 +0000 Subject: [Starlingx-discuss] Sanity Master Test LAYERED build ISO 20210331T031417Z Message-ID: Sanity Test from 2021-March-31 (http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210331T031417Z/outputs/iso/ ) Status: YELLOW The Setup and Provision are PASSING. The daily sanity is FAILING on all configurations for test: test_reapply_openstack, but openstack commands are working correctly. This might be related to bugs: https://bugs.launchpad.net/starlingx/+bug/1917308 https://bugs.launchpad.net/starlingx/+bug/1918420 Helm-Chart used: http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/20210331T031417Z/outputs/helm-charts/helm-charts-stx-openstack-centos-stable-versioned.tgz Regards, Alexandru Dimofte [Logo Description automatically generated] Dimofte Alexandru Software Engineer STARLINGX TEAM Skype no: +40 336403734 Personal Mobile: +40 743167456 alexandru.dimofte at intel.com Intel Romania -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8413 bytes Desc: image001.png URL: From Bill.Zvonar at windriver.com Wed Mar 31 16:28:16 2021 From: Bill.Zvonar at windriver.com (Zvonar, Bill) Date: Wed, 31 Mar 2021 16:28:16 +0000 Subject: [Starlingx-discuss] stx.5.0 Launchpads Message-ID: Hi all, As discussed in the Community & Release Team calls, as we near the end of stx.5.0, we need to focus on fixing stx.5.0 launchpads Per the stx.5.0 release plan [0], we have 2 weeks until RC1 (4/14) and just over a month until the forecast release date (5/5). Generally, we want to have fixes for all known issues in place by RC1, so let's say we have 2 weeks. And this means all Critical & High importance Launchpads, and as many Medium importance Launchpads as possible. We currently have 1 Critical, 5 High & ~33 Medium, as of a snapshot this morning. The full list of stx.5.0 Launchpads is at [2]. So, let's put focus on fixing the bugs in our respective domains. I created an etherpad [1] with a snapshot of the bugs per domain & copied that list below. Bill... [0] https://docs.google.com/spreadsheets/d/1JbOQELqXG_GDoP1jo6YoRDytpTkJEs89TVimzvrqc_A/edit#gid=0 [1] https://etherpad.opendev.org/p/stx-gating-bugs [2] https://bugs.launchpad.net/starlingx/+bugs?field.tag=stx.5.0 *Importance = Critical OpenStack 1917308: Stx-openstack apply-fail after swact standby controller, lock, unlock standby controller https://bugs.launchpad.net/starlingx/+bug/1917308 *Importance = High Apps 1917352: stx-sdo apply fails to pull images from registry.local https://bugs.launchpad.net/starlingx/+bug/1917352 Build 1891416: stx-platformclients docker image build doesn't include the correct content https://bugs.launchpad.net/starlingx/+bug/1891416 Config 1918943: Regression - Bootstrap replay following a cluster_host_subnet reconfiguration fails https://bugs.launchpad.net/starlingx/+bug/1918943 Security 1921511: kubernetes-ca cert/key are replaced by etcd-ca cert/key https://bugs.launchpad.net/starlingx/+bug/1921511 Update 1913455: Fail to swact to controller-1 after upgrade https://bugs.launchpad.net/starlingx/+bug/1913455 *Importance = Medium Apps 1888900: System remove,apply fails to start the vault pods with TLS handshake error https://bugs.launchpad.net/starlingx/+bug/1888900 Apps, Containers 1882485: cert-manager application in apply-failed status since initial controller-1 unlock https://bugs.launchpad.net/starlingx/+bug/1882485 1883555: applying custom system application on controller-1 failed https://bugs.launchpad.net/starlingx/+bug/1883555 Build 1904893: clarity of Layered Build Reference in StarlingX https://bugs.launchpad.net/starlingx/+bug/1904893 1921149: centos7: Python < 2.7.9 not supported by PyPI https://bugs.launchpad.net/starlingx/+bug/1921149 Config 1884335: DC: Worker node went for second reboot after all nodes power down/up https://bugs.launchpad.net/starlingx/+bug/1884335 1889101: 100.114 alarm "NTP cannot reach external time source; syncing with peer controller only " raised when other external NTP servers are available https://bugs.launchpad.net/starlingx/+bug/1889101 1890970: controller unable to unlock after reinstall (inv_state stuck at reinstalling) https://bugs.launchpad.net/starlingx/+bug/1890970 1895555: OAM IP change needs double lock/unlock controllers for IPV6 system https://bugs.launchpad.net/starlingx/+bug/1895555 1918139: On AIO hosts, kuberenetes is starting before key resources are initialized https://bugs.launchpad.net/starlingx/+bug/1918139 Containers 1883791: DC subcloud bootsrap failed - nginx-ingress-controller apply failed https://bugs.launchpad.net/starlingx/+bug/1883791 1883953: Cert-manager app failed to apply after controller-1 of the system controller is upgraded https://bugs.launchpad.net/starlingx/+bug/1883953 1887105: Using python helm plugin to dynamically override helmchart will cause an issue https://bugs.launchpad.net/starlingx/+bug/1887105 1887438: Controller-0 Not Ready after force rebooting active controller (Controller-1) https://bugs.launchpad.net/starlingx/+bug/1887438 1901911: platform-integration-manifest apply failed due to error Install release: stx-rbd-provisioner https://bugs.launchpad.net/starlingx/+bug/1901911 1903090: DC: helm operation failure during merging helm overrides https://bugs.launchpad.net/starlingx/+bug/1903090 Containers, DC 1902266: Failed scheduling of armada pod resulting in subcloud bootstrap failure https://bugs.launchpad.net/starlingx/+bug/1902266 DC, GUI 1886536: Horizon: error occurred when attempt to download subcloud openrc file https://bugs.launchpad.net/starlingx/+bug/1886536 GUI 1890503: starlingx gui dc_admin deploy status field needs updating https://bugs.launchpad.net/starlingx/+bug/1890503 HA 1893669: swact is not triggered after killing dnsmasq process within 90 seconds https://bugs.launchpad.net/starlingx/+bug/1893669 Networking 1911213: Global network policy not found in default namespace https://bugs.launchpad.net/starlingx/+bug/1911213 OpenStack 1888178: Neturon vm in error status after resize revert due to "Virtual Interface creation failed" https://bugs.launchpad.net/starlingx/+bug/1888178 1904729: Deprecate vcpu_pin_set for stx-openstack in favor of new configs https://bugs.launchpad.net/starlingx/+bug/1904729 Storage 1883975: Disk partitions not aligned https://bugs.launchpad.net/starlingx/+bug/1883975 1884136: file system modify give error and modifies fs https://bugs.launchpad.net/starlingx/+bug/1884136 1884184: Storage node configuration failed after performing DOR https://bugs.launchpad.net/starlingx/+bug/1884184 1890293: ceph-osds are down after swact operation generating a coredump https://bugs.launchpad.net/starlingx/+bug/1890293 1892907: Ceph storage condition alarm was not cleared after lock and unlock controller and swact https://bugs.launchpad.net/starlingx/+bug/1892907 1896628: rook-ceph-apps upload failed to find an application tarball https://bugs.launchpad.net/starlingx/+bug/1896628 Tools 1886868: Need detailed resource cpu and memory info in collect https://bugs.launchpad.net/starlingx/+bug/1886868 1911935: collect is missing etcdctl output https://bugs.launchpad.net/starlingx/+bug/1911935 Update 1894050: AIO-DX: Backup and Restore: After Reinstall controller-1, auto apply cert-manager and platform-integration failed https://bugs.launchpad.net/starlingx/+bug/1894050 1913465: AIODX upgrade:cgts-vg partition space is decreased on controller-0 https://bugs.launchpad.net/starlingx/+bug/1913465 From Sriram.Dharwadkar at commscope.com Wed Mar 31 19:29:20 2021 From: Sriram.Dharwadkar at commscope.com (Dharwadkar, Sriram) Date: Wed, 31 Mar 2021 19:29:20 +0000 Subject: [Starlingx-discuss] Securing the traffic between Central cloud and edge cloud Message-ID: Hi Team, We are using distributed starlingx 4.0. Is there anyway to secure the traffic between central cloud to edge cloud ? There is bootstrapping traffic originated from central to edge and also alarms/events generated from edge to central. Is there any recommendation from starlingx to secure this traffic ? Regards, Sriram -------------- next part -------------- An HTML attachment was scrubbed... URL: From Andy.Ning at windriver.com Wed Mar 31 22:00:18 2021 From: Andy.Ning at windriver.com (Ning, Antai (Andy)) Date: Wed, 31 Mar 2021 22:00:18 +0000 Subject: [Starlingx-discuss] How to access Virtualized central cloud from outside the Host In-Reply-To: References: Message-ID: Usually you need a NAT rule from your host to the OAM IP. For example a nat rule like this: host:1022 -> OAM-IP:22 >From outside: ssh -p 1022 sysadmin at host Andy ________________________________ From: Rai, Ankush Sent: Tuesday, March 30, 2021 11:27 PM To: starlingx-discuss at lists.starlingx.io Cc: Dharwadkar, Sriram ; Sambandan, Devaraj Subject: [Starlingx-discuss] How to access Virtualized central cloud from outside the Host [Please note: This e-mail is from an EXTERNAL e-mail address] Hi, I have installed the central cloud (All in one Duplex) in a virtualized environment. But not sure what NAT rules are required, to access it from outside the Host machine. * Below is my deployment. [Diagram Description automatically generated] * Starlingx is installed. system host-list +----+--------------+-------------+----------------+-------------+--------------+ | id | hostname | personality | administrative | operational | availability | +----+--------------+-------------+----------------+-------------+--------------+ | 1 | controller-0 | controller | unlocked | enabled | available | | 2 | controller-1 | controller | unlocked | enabled | available | +----+--------------+-------------+----------------+-------------+--------------+ * Packets are reaching to the Host machine listening on ens1, link-type EN10MB (Ethernet), capture size 262144 bytes 11:35:56.144807 IP 14.141.56.230.61002 > 172.31.21.86.8080: Flags [S], seq 1632511605, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 11:35:56.145030 IP 14.141.56.230.48775 > 172.31.21.86.8080: Flags [S], seq 455906092, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 11:35:56.396487 IP 14.141.56.230.57030 > 172.31.21.86.8080: Flags [S], seq 4106471277, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 11:36:00.145533 IP 14.141.56.230.61002 > 172.31.21.86.8080: Flags [S], seq 1632511605, win 65280, options [mss 1360,nop,wscale 8,nop,nop,sackOK], length 0 * I have tried below rules. iptables -t nat -I PREROUTING -i ens1 -p tcp --dport 8080 -j DNAT --to-destination 10.10.10.2:8080 iptables -A FORWARD -j ACCEPT iptables -t nat -I POSTROUTING -s 10.10.11.0/24 -o enp125s0 -j MASQUERADE iptables -t nat -I POSTROUTING -s 10.10.10.0/24 -o ens1 -j MASQUERADE * Ipv4 forwarding is enabled on the host and from Host I can reach the controllers. But still could not see packet reaching to the controller. Any suggestion would be very helpful. Thanks, Ankush -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 26134 bytes Desc: image001.jpg URL: