<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I also find that when the ovs-vswitchd is restarted, I will lose the connections to VMs.<div class=""><br class=""></div><div class="">Before restart ovs:</div><div class=""><br class=""></div><div class=""><div class=""><span style="font-size: 11px;" class="">controller-0:/home/wrsroot# ip a</span></div><div class=""><span style="font-size: 11px;" class="">1: lo: <LOOPBACK,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00</span></div><div class=""><span style="font-size: 11px;" class=""> inet 127.0.0.1/8 scope host lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet 127.168.204.3/24 brd 127.168.204.255 scope host lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet 169.254.202.2/24 scope global lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet 127.168.204.2/24 scope host secondary lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet 127.168.204.5/24 scope host secondary lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet 127.168.204.6/24 scope host secondary lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet 127.168.204.152/24 scope host secondary lo</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet6 ::1/128 scope host</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class="">3: enp59s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:01:21 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class="">4: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:72:fb:63 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class=""> inet 172.16.180.154/24 brd 172.16.180.255 scope global eno1</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class=""> inet6 fe80::4ed9:8fff:fe72:fb63/64 scope link</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class="">5: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:72:fb:64 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class="">6: enp94s0f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:5e:ab:88 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class="">7: enp94s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:5e:ab:89 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class="">8: enp175s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:80:60 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class=""> inet6 fe80::faf2:1eff:fe64:8060/64 scope link</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class="">9: enp175s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:80:61 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class=""> inet6 fe80::faf2:1eff:fe64:8061/64 scope link</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class="">10: ovs-netdev: <BROADCAST,PROMISC> mtu 1500 qdisc noop state DOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether 62:34:73:47:50:be brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class="">13: br-int: <BROADCAST,PROMISC> mtu 1500 qdisc noop state DOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether c6:91:5d:27:b4:43 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class="">16: br-phy0: <BROADCAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:01:20 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class=""> inet6 fe80::faf2:1eff:fe64:120/64 scope link</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div class=""><span style="font-size: 11px;" class="">17: lldp16ba3755-27: <BROADCAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000</span></div><div class=""><span style="font-size: 11px;" class=""> link/ether 7e:3a:87:a3:98:03 brd ff:ff:ff:ff:ff:ff</span></div><div class=""><span style="font-size: 11px;" class=""> inet6 fe80::7c3a:87ff:fea3:9803/64 scope link</span></div><div class=""><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><br class=""></div><div>After:</div><div><span style="font-size: 11px;" class=""><br class=""></span></div><div><div><span style="font-size: 11px;" class="">controller-0:/home/wrsroot# systemctl restart ovs-vswitchd</span></div><div><span style="font-size: 11px;" class="">controller-0:/home/wrsroot# ip a</span></div><div><span style="font-size: 11px;" class="">1: lo: <LOOPBACK,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00</span></div><div><span style="font-size: 11px;" class=""> inet 127.0.0.1/8 scope host lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet 127.168.204.3/24 brd 127.168.204.255 scope host lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet 169.254.202.2/24 scope global lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet 127.168.204.2/24 scope host secondary lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet 127.168.204.5/24 scope host secondary lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet 127.168.204.6/24 scope host secondary lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet 127.168.204.152/24 scope host secondary lo</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet6 ::1/128 scope host</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class="">3: enp59s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:01:21 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">4: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:72:fb:63 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class=""> inet 172.16.180.154/24 brd 172.16.180.255 scope global eno1</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class=""> inet6 fe80::4ed9:8fff:fe72:fb63/64 scope link</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class="">5: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:72:fb:64 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">6: enp94s0f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:5e:ab:88 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">7: enp94s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 4c:d9:8f:5e:ab:89 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">8: enp175s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:80:60 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class=""> inet6 fe80::faf2:1eff:fe64:8060/64 scope link</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class="">9: enp175s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:80:61 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class=""> inet6 fe80::faf2:1eff:fe64:8061/64 scope link</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class="">10: ovs-netdev: <BROADCAST,PROMISC> mtu 1500 qdisc noop state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 62:34:73:47:50:be brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">13: br-int: <BROADCAST,PROMISC> mtu 1500 qdisc noop state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether c6:91:5d:27:b4:43 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">16: br-phy0: <BROADCAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether f8:f2:1e:64:01:20 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class=""> inet6 fe80::faf2:1eff:fe64:120/64 scope link</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class="">17: lldp16ba3755-27: <BROADCAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 7e:3a:87:a3:98:03 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class=""> inet6 fe80::7c3a:87ff:fea3:9803/64 scope link</span></div><div><span style="font-size: 11px;" class=""> valid_lft forever preferred_lft forever</span></div><div><span style="font-size: 11px;" class="">20: tapfb74713e-cc: <BROADCAST,PROMISC> mtu 1500 qdisc noop state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 0e:2d:36:ee:2d:85 brd ff:ff:ff:ff:ff:ff</span></div><div><span style="font-size: 11px;" class="">21: tap1a965902-0b: <BROADCAST,PROMISC> mtu 1500 qdisc noop state DOWN group default qlen 1000</span></div><div><span style="font-size: 11px;" class=""> link/ether 5e:f6:81:31:54:21 brd ff:ff:ff:ff:ff:ff</span></div></div><div><br class=""></div><div>One of the VMs:</div><div><br class=""></div><div><img apple-inline="yes" id="455F63BD-E58E-4B30-96BC-7B3200C9230F" src="cid:7CE53B98-9701-4938-9841-298B8132C61C" class=""></div><div><br class=""><blockquote type="cite" class=""><div class="">On Jul 18, 2019, at 18:09, 张鲲鹏 <<a href="mailto:zhang.kunpeng@99cloud.net" class="">zhang.kunpeng@99cloud.net</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi Xu,Chenjie<div class=""><br class=""></div><div class="">I have tried to create VM with 2 pci_passthrough network ports without DPDK, there was the same problem when I rebooted it.</div><div class="">Also, it was same when I reboot the VM with 2 SR-IOV VFs.</div><div class="">Do you have any ideas to debug this problem?</div><div class=""><br class=""></div><div class="">Thanks </div><div class="">Kunpeng </div><div class=""><div class=""><br class=""><blockquote type="cite" class=""><div class="">On Jul 17, 2019, at 14:59, Xu, Chenjie <<a href="mailto:chenjie.xu@intel.com" class="">chenjie.xu@intel.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="WordSection1" style="page: WordSection1; caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Hi Kunpeng,<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Maybe you can use SR-IOV and passthrough the VF which has similar performance to physical NIC<a name="_MailEndCompose" class=""><span class="Apple-converted-space"> </span>to the VM. And then you can use DPDK inside the VM with the VF.<o:p class=""></o:p></a></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Sorry, I don’t have easy way to disable DPDK in stx1.0. The following command is used for stx2.0 which is still in progress:<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体; text-indent: 15.75pt;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">system modify --vswitch_type none<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Best Regards,<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Xu, Chenjie<o:p class=""></o:p></span></div><div class=""><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(225, 225, 225); padding: 3pt 0cm 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><a name="_____replyseparator" class=""></a><b class=""><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class="">From:</span></b><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class="Apple-converted-space"> </span></span><span style="font-size: 11pt;" class="">张鲲鹏</span><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class="Apple-converted-space"> </span>[<a href="mailto:zhang.kunpeng@99cloud.net" class="">mailto:zhang.kunpeng@99cloud.net</a>]<span class="Apple-converted-space"> </span><br class=""><b class="">Sent:</b><span class="Apple-converted-space"> </span>Tuesday, July 16, 2019 5:40 PM<br class=""><b class="">To:</b><span class="Apple-converted-space"> </span>Xu, Chenjie <<a href="mailto:chenjie.xu@intel.com" class="">chenjie.xu@intel.com</a>><br class=""><b class="">Cc:</b><span class="Apple-converted-space"> </span><a href="mailto:starlingx-discuss@lists.starlingx.io" class="">starlingx-discuss@lists.starlingx.io</a><br class=""><b class="">Subject:</b><span class="Apple-converted-space"> </span>Re: [Starlingx-discuss] [Starlingx-disscuss][ovs-dpdk] Reboot instance with physical pci-passthrough NIC causes OVS restart<o:p class=""></o:p></span></div></div></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Hi Chenjie,<o:p class=""></o:p></span></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""><o:p class=""> </o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Well, I will try the network topology as you said. But passthrough NIC with DPDK is our customer’s requirement.<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">And do you have some easy ways to disable dpdk of openvswitch in stx1.0? <o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">I had tried to execute “<span style="color: rgb(255, 157, 0);" class="">system modify --vswitch_type none</span>” before “<span style="color: rgb(255, 157, 0);" class="">system host-unlock controller-0</span>", but it doesn’t work well.<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""><o:p class=""> </o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Thanks <o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Kunpeng<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""><o:p class=""> </o:p></span></div></div><div class=""><div class=""><blockquote style="margin-top: 5pt; margin-bottom: 5pt;" class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">On Jul 16, 2019, at 16:49, Xu, Chenjie <<a href="mailto:chenjie.xu@intel.com" style="color: purple; text-decoration: underline;" class="">chenjie.xu@intel.com</a>> wrote:<o:p class=""></o:p></span></div></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""><o:p class=""> </o:p></span></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Hi Kunpeng,</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">When you reboot the VM with two physical pci-passthrough NICs, ovs-vswtichd is restarted and the interfaces and bridges are down. The virtual networks used by the VMs are based on these interfaces and bridges. So other VMs will lost connections.</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""> </span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Typically you should not pass through a PCI device which is bound to DPDK to the VM. Are the 2 network ports which is used to passthrough to the VM bound to DPDK? If so, could you please try OVS-DPDK with the following network topology:</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体; text-indent: 15.75pt;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">2 network port without DPDK > VM</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体; text-indent: 15.75pt;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">2 network port with DPDK > Data Network</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体; text-indent: 15.75pt;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">1 network port without DPDK > OAM</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""> </span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Best Regards,</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Xu, Chenjie</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""> </span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(225, 225, 225); padding: 3pt 0cm 0cm;" class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><b class=""><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class="">From:</span></b><span class="apple-converted-space"><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class=""> </span></span><span style="font-size: 11pt;" class="">张鲲鹏</span><span class="apple-converted-space"><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class=""> </span></span><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class="">[<a href="mailto:zhang.kunpeng@99cloud.net" style="color: purple; text-decoration: underline;" class="">mailto:zhang.kunpeng@99cloud.net</a>]<span class="apple-converted-space"> </span><br class=""><b class="">Sent:</b><span class="apple-converted-space"> </span>Tuesday, July 16, 2019 3:54 PM<br class=""><b class="">To:</b><span class="apple-converted-space"> </span><a href="mailto:starlingx-discuss@lists.starlingx.io" style="color: purple; text-decoration: underline;" class="">starlingx-discuss@lists.starlingx.io</a><br class=""><b class="">Subject:</b><span class="apple-converted-space"> </span>[Starlingx-discuss] [Starlingx-disscuss][ovs-dpdk] Reboot instance with physical pci-passthrough NIC causes OVS restart</span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Hi guys,<o:p class=""></o:p></span></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Recently I got a strange problem in StarlingX. When I reboot one VM with two physical pci-passthrough NICs, then all of VMs cannot be connected. I lost connections with all VMs and also the VMs lost each others. <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Below is the StarlingX environment.<o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">1. stx1.0 version, bootimage[1] <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">2. Simplex deployment<o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">3. 5 Network ports. Only one don</span>’<span lang="EN-US" class="">t support DPDK</span>，<span lang="EN-US" class="">and it is used to OAM Network. In the rest, two are used to data network, and another two are used to passthrough to a VM.<o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">4. The VM was attached two more virtual networks. I have tested the case of attaching one virtual net, it was no problem. <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">When I reboot the VM, something were happened. The interfaces and bridges were down, all the virtual dhcp services were down and ovs-vswitchd was restarted. But when I up the interfaces and dhcp services and reboot the other VMs, I have got the connections with them again.<o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">It</span>’<span lang="EN-US" class="">s ok when to reboot the VM without physical NIC. We think it may be caused by ovs-dpdk, so we stop to use ovs-dpdk and start the ovs manually, the problem was gone.<o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">I cannot understand the problem, anybody could give me some comments for it? Thanks a lot.<o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">[1] <a href="http://mirror.starlingx.cengn.ca/mirror/starlingx/r2018.10/centos/2018.10.0/outputs/iso/bootimage.iso" style="color: purple; text-decoration: underline;" class=""><span style="color: purple;" class="">http://mirror.starlingx.cengn.ca/mirror/starlingx/r2018.10/centos/2018.10.0/outputs/iso/bootimage.iso</span></a><o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""> <o:p class=""></o:p></span></div></div></div><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class="">Kunpeng<o:p class=""></o:p></span></div></div></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Menlo-Regular, serif;" class="">_______________________________________________<br class="">Starlingx-discuss mailing list<br class=""><a href="mailto:Starlingx-discuss@lists.starlingx.io" style="color: purple; text-decoration: underline;" class="">Starlingx-discuss@lists.starlingx.io</a><br class=""><a href="http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss" style="color: purple; text-decoration: underline;" class="">http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss</a></span><span lang="EN-US" class=""><o:p class=""></o:p></span></div></div></blockquote></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 宋体;" class=""><span lang="EN-US" class=""><o:p class=""> </o:p></span></div></div></div><span style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">_______________________________________________</span><br style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">Starlingx-discuss mailing list</span><br style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><a href="mailto:Starlingx-discuss@lists.starlingx.io" class="">Starlingx-discuss@lists.starlingx.io</a></span><br style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Menlo-Regular; font-size: 14px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""><a href="http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss" class="">http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss</a></span></div></blockquote></div><br class=""></div></div>_______________________________________________<br class="">Starlingx-discuss mailing list<br class=""><a href="mailto:Starlingx-discuss@lists.starlingx.io" class="">Starlingx-discuss@lists.starlingx.io</a><br class="">http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss<br class=""></div></blockquote></div><br class=""></div></body></html>