[Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0
Hi guys, When I install AIO Simplex following this guide(https://docs.starlingx.io/deploy_install_guides/r3_release/virtual/aio_simpl...), drdb fails after unlock controller-0. It seems that not all lvm are mounted successfully. Can anyone give some advice on this problem? controller-0:~$ drbd-overview 1:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 2:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 5:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 7:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 8:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s controller-0:~$ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 600G 0 disk ├─sda1 8:1 0 1M 0 part ├─sda2 8:2 0 500M 0 part /boot ├─sda3 8:3 0 19.5G 0 part / ├─sda4 8:4 0 229G 0 part │ ├─cgts--vg-scratch--lv 253:0 0 8G 0 lvm /scratch │ ├─cgts--vg-log--lv 253:1 0 7.8G 0 lvm /var/log │ ├─cgts--vg-extension--lv 253:2 0 1G 0 lvm │ │ └─drbd5 147:5 0 1024M 1 disk │ ├─cgts--vg-pgsql--lv 253:3 0 20G 0 lvm │ ├─cgts--vg-docker--lv 253:4 0 30G 0 lvm /var/lib/docker │ ├─cgts--vg-kubelet--lv 253:5 0 10G 0 lvm /var/lib/kubelet │ ├─cgts--vg-etcd--lv 253:6 0 5G 0 lvm │ │ └─drbd7 147:7 0 5G 1 disk │ ├─cgts--vg-backup--lv 253:7 0 25G 0 lvm /opt/backups │ ├─cgts--vg-dockerdistribution--lv 253:8 0 16G 0 lvm │ │ └─drbd8 147:8 0 16G 1 disk │ ├─cgts--vg-rabbit--lv 253:9 0 2G 0 lvm │ │ └─drbd1 147:1 0 2G 1 disk │ ├─cgts--vg-platform--lv 253:10 0 10G 0 lvm │ │ └─drbd2 147:2 0 10G 1 disk │ └─cgts--vg-ceph--mon--lv 253:11 0 20G 0 lvm /var/lib/ceph/mon └─sda5 8:5 0 34G 0 part sdb 8:16 0 200G 0 disk ├─sdb1 8:17 0 199G 0 part /var/lib/ceph/osd/ceph-0 └─sdb2 8:18 0 1G 0 part sdc 8:32 0 200G 0 disk sr0 11:0 1 1.9G 0 rom Thanks, Tianhao
Can you verify you used “system_mode: simplex” in your ansible override? Maybe provide your override file? Can you also do a “cat /etc/platform/platform.conf” and maybe a “system host-show controller-0”? From: 胡天昊 [mailto:hu.tianhao@99cloud.net] Sent: Friday, January 17, 2020 3:48 AM To: starlingx-discuss Subject: [Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0 Hi guys, When I install AIO Simplex following this guide(https://docs.starlingx.io/deploy_install_guides/r3_release/virtual/aio_simpl...), drdb fails after unlock controller-0. It seems that not all lvm are mounted successfully. Can anyone give some advice on this problem? controller-0:~$ drbd-overview 1:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 2:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 5:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 7:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 8:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s controller-0:~$ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 600G 0 disk ├─sda1 8:1 0 1M 0 part ├─sda2 8:2 0 500M 0 part /boot ├─sda3 8:3 0 19.5G 0 part / ├─sda4 8:4 0 229G 0 part │ ├─cgts--vg-scratch--lv 253:0 0 8G 0 lvm /scratch │ ├─cgts--vg-log--lv 253:1 0 7.8G 0 lvm /var/log │ ├─cgts--vg-extension--lv 253:2 0 1G 0 lvm │ │ └─drbd5 147:5 0 1024M 1 disk │ ├─cgts--vg-pgsql--lv 253:3 0 20G 0 lvm │ ├─cgts--vg-docker--lv 253:4 0 30G 0 lvm /var/lib/docker │ ├─cgts--vg-kubelet--lv 253:5 0 10G 0 lvm /var/lib/kubelet │ ├─cgts--vg-etcd--lv 253:6 0 5G 0 lvm │ │ └─drbd7 147:7 0 5G 1 disk │ ├─cgts--vg-backup--lv 253:7 0 25G 0 lvm /opt/backups │ ├─cgts--vg-dockerdistribution--lv 253:8 0 16G 0 lvm │ │ └─drbd8 147:8 0 16G 1 disk │ ├─cgts--vg-rabbit--lv 253:9 0 2G 0 lvm │ │ └─drbd1 147:1 0 2G 1 disk │ ├─cgts--vg-platform--lv 253:10 0 10G 0 lvm │ │ └─drbd2 147:2 0 10G 1 disk │ └─cgts--vg-ceph--mon--lv 253:11 0 20G 0 lvm /var/lib/ceph/mon └─sda5 8:5 0 34G 0 part sdb 8:16 0 200G 0 disk ├─sdb1 8:17 0 199G 0 part /var/lib/ceph/osd/ceph-0 └─sdb2 8:18 0 1G 0 part sdc 8:32 0 200G 0 disk sr0 11:0 1 1.9G 0 rom Thanks, Tianhao [http://mailhz.qiye.163.com/qiyeimage/logo/60511048/1576638602260.jpg]
Hi Don, Thank you for your reply, this is my override file. system_mode: simplex timezone: UTC dns_servers: - 114.114.114.114 - 8.8.8.8 admin_username: admin admin_password: 99cloud@SH ansible_become_pass: 99cloud@SH external_oam_subnet: 172.16.140.0/24 external_oam_gateway_address: 172.16.140.1 external_oam_floating_address: 172.16.140.188 management_subnet: 192.168.2.0/24 management_start_address: 192.168.2.2 management_end_address: 192.168.2.20 cluster_host_subnet: 192.168.68.0/24 # cluster_host_start_address: # cluster_host_end_address: docker_registries: k8s.gcr.io: url: gcr.azk8s.cn/google-containers gcr.io: url: gcr.azk8s.cn quay.io: url: quay.azk8s.cn And I'm sure I install StarlingX AIO Simplex, but after unlock controller-0, some pods fails to be up because of drab failed. controller-0:~$ cat /etc/platform/platform.conf nodetype=controller subfunction=controller,worker system_type=All-in-one security_profile=standard management_interface=lo http_port=8080 INSTALL_UUID=7edaf118-e70b-41f9-bfab-562c3219578c UUID=aef8f074-3bf9-4dea-8e77-9df1d82a1ae0 sdn_enabled=no region_config=no system_mode=simplex sw_version=19.09 security_feature="nopti nospectre_v2" vswitch_type=none region_config=False oam_interface=enp2s1 cluster_host_interface=lo 发件人："Penney, Don" <Don.Penney@windriver.com> 发送日期：2020-01-18 04:06:54 收件人："胡天昊" <hu.tianhao@99cloud.net>,starlingx-discuss <starlingx-discuss@lists.starlingx.io> 主题：RE: [Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0 Can you verify you used “system_mode: simplex” in your ansible override? Maybe provide your override file? Can you also do a “cat /etc/platform/platform.conf” and maybe a “system host-show controller-0”? From: 胡天昊 [mailto:hu.tianhao@99cloud.net] Sent: Friday, January 17, 2020 3:48 AM To: starlingx-discuss Subject: [Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0 Hi guys, When I install AIO Simplex following this guide(https://docs.starlingx.io/deploy_install_guides/r3_release/virtual/aio_simpl...), drdb fails after unlock controller-0. It seems that not all lvm are mounted successfully. Can anyone give some advice on this problem? controller-0:~$ drbd-overview 1:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 2:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 5:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 7:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 8:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s controller-0:~$ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 600G 0 disk ├─sda1 8:1 0 1M 0 part ├─sda2 8:2 0 500M 0 part /boot ├─sda3 8:3 0 19.5G 0 part / ├─sda4 8:4 0 229G 0 part │ ├─cgts--vg-scratch--lv 253:0 0 8G 0 lvm /scratch │ ├─cgts--vg-log--lv 253:1 0 7.8G 0 lvm /var/log │ ├─cgts--vg-extension--lv 253:2 0 1G 0 lvm │ │ └─drbd5 147:5 0 1024M 1 disk │ ├─cgts--vg-pgsql--lv 253:3 0 20G 0 lvm │ ├─cgts--vg-docker--lv 253:4 0 30G 0 lvm /var/lib/docker │ ├─cgts--vg-kubelet--lv 253:5 0 10G 0 lvm /var/lib/kubelet │ ├─cgts--vg-etcd--lv 253:6 0 5G 0 lvm │ │ └─drbd7 147:7 0 5G 1 disk │ ├─cgts--vg-backup--lv 253:7 0 25G 0 lvm /opt/backups │ ├─cgts--vg-dockerdistribution--lv 253:8 0 16G 0 lvm │ │ └─drbd8 147:8 0 16G 1 disk │ ├─cgts--vg-rabbit--lv 253:9 0 2G 0 lvm │ │ └─drbd1 147:1 0 2G 1 disk │ ├─cgts--vg-platform--lv 253:10 0 10G 0 lvm │ │ └─drbd2 147:2 0 10G 1 disk │ └─cgts--vg-ceph--mon--lv 253:11 0 20G 0 lvm /var/lib/ceph/mon └─sda5 8:5 0 34G 0 part sdb 8:16 0 200G 0 disk ├─sdb1 8:17 0 199G 0 part /var/lib/ceph/osd/ceph-0 └─sdb2 8:18 0 1G 0 part sdc 8:32 0 200G 0 disk sr0 11:0 1 1.9G 0 rom Thanks, Tianhao
Next thing to check will be if the puppet manifest application failed. I expect if you run “sudo sm-dump”, you’re seeing everything in an “initial” state - if the initial configuration failed, SM is unable to allocate IP addresses and bring up services, which would be why DRBD is not up. You can look at the logs in /var/log/puppet to see what the failure was, if that’s what’s happening (“grep -e Error -e Warning /var/log/puppet/latest/puppet.log”). From: 胡天昊 [mailto:hu.tianhao@99cloud.net] Sent: Saturday, January 18, 2020 9:17 PM To: Penney, Don Cc: starlingx-discuss Subject: Re:RE: [Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0 Hi Don, Thank you for your reply, this is my override file. system_mode: simplex timezone: UTC dns_servers: - 114.114.114.114 - 8.8.8.8 admin_username: admin admin_password: 99cloud@SH ansible_become_pass: 99cloud@SH external_oam_subnet: 172.16.140.0/24 external_oam_gateway_address: 172.16.140.1 external_oam_floating_address: 172.16.140.188 management_subnet: 192.168.2.0/24 management_start_address: 192.168.2.2 management_end_address: 192.168.2.20 cluster_host_subnet: 192.168.68.0/24 # cluster_host_start_address: # cluster_host_end_address: docker_registries: k8s.gcr.io: url: gcr.azk8s.cn/google-containers gcr.io: url: gcr.azk8s.cn quay.io: url: quay.azk8s.cn And I'm sure I install StarlingX AIO Simplex, but after unlock controller-0, some pods fails to be up because of drab failed. controller-0:~$ cat /etc/platform/platform.conf nodetype=controller subfunction=controller,worker system_type=All-in-one security_profile=standard management_interface=lo http_port=8080 INSTALL_UUID=7edaf118-e70b-41f9-bfab-562c3219578c UUID=aef8f074-3bf9-4dea-8e77-9df1d82a1ae0 sdn_enabled=no region_config=no system_mode=simplex sw_version=19.09 security_feature="nopti nospectre_v2" vswitch_type=none region_config=False oam_interface=enp2s1 cluster_host_interface=lo [Image removed by sender.] 发件人："Penney, Don" <Don.Penney@windriver.com> 发送日期：2020-01-18 04:06:54 收件人："胡天昊" <hu.tianhao@99cloud.net>,starlingx-discuss <starlingx-discuss@lists.starlingx.io> 主题：RE: [Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0 Can you verify you used “system_mode: simplex” in your ansible override? Maybe provide your override file? Can you also do a “cat /etc/platform/platform.conf” and maybe a “system host-show controller-0”? From: 胡天昊 [mailto:hu.tianhao@99cloud.net] Sent: Friday, January 17, 2020 3:48 AM To: starlingx-discuss Subject: [Starlingx-discuss] Drdb fails for AIO Simplex after unlock controller-0 Hi guys, When I install AIO Simplex following this guide(https://docs.starlingx.io/deploy_install_guides/r3_release/virtual/aio_simpl...), drdb fails after unlock controller-0. It seems that not all lvm are mounted successfully. Can anyone give some advice on this problem? controller-0:~$ drbd-overview 1:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 2:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 5:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 7:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s 8:??not-found?? WFConnection Secondary/Unknown UpToDate/DUnknown C r----s controller-0:~$ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 600G 0 disk ├─sda1 8:1 0 1M 0 part ├─sda2 8:2 0 500M 0 part /boot ├─sda3 8:3 0 19.5G 0 part / ├─sda4 8:4 0 229G 0 part │ ├─cgts--vg-scratch--lv 253:0 0 8G 0 lvm /scratch │ ├─cgts--vg-log--lv 253:1 0 7.8G 0 lvm /var/log │ ├─cgts--vg-extension--lv 253:2 0 1G 0 lvm │ │ └─drbd5 147:5 0 1024M 1 disk │ ├─cgts--vg-pgsql--lv 253:3 0 20G 0 lvm │ ├─cgts--vg-docker--lv 253:4 0 30G 0 lvm /var/lib/docker │ ├─cgts--vg-kubelet--lv 253:5 0 10G 0 lvm /var/lib/kubelet │ ├─cgts--vg-etcd--lv 253:6 0 5G 0 lvm │ │ └─drbd7 147:7 0 5G 1 disk │ ├─cgts--vg-backup--lv 253:7 0 25G 0 lvm /opt/backups │ ├─cgts--vg-dockerdistribution--lv 253:8 0 16G 0 lvm │ │ └─drbd8 147:8 0 16G 1 disk │ ├─cgts--vg-rabbit--lv 253:9 0 2G 0 lvm │ │ └─drbd1 147:1 0 2G 1 disk │ ├─cgts--vg-platform--lv 253:10 0 10G 0 lvm │ │ └─drbd2 147:2 0 10G 1 disk │ └─cgts--vg-ceph--mon--lv 253:11 0 20G 0 lvm /var/lib/ceph/mon └─sda5 8:5 0 34G 0 part sdb 8:16 0 200G 0 disk ├─sdb1 8:17 0 199G 0 part /var/lib/ceph/osd/ceph-0 └─sdb2 8:18 0 1G 0 part sdc 8:32 0 200G 0 disk sr0 11:0 1 1.9G 0 rom Thanks, Tianhao [Image removed by sender.]
participants (2)
-
Penney, Don
-
胡天昊