Hi Joseph: This is based on latest master. I have tried several times . The good news is that after increasing VM memory (from 18G to 24G) , This issue is gone. (same iso, same pc) Thanks your support. Thanks. BR Austin Sun. From: Richard, Joseph [mailto:Joseph.Richard@windriver.com] Sent: Thursday, February 21, 2019 3:28 AM To: Sun, Austin <austin.sun@intel.com>; starlingx-discuss@lists.starlingx.io Subject: RE: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent Which build is this? Has you reproduced this failure? Do you see any errors in your puppet logs on controller-0 from when you unlocked it? From: Sun, Austin [mailto:austin.sun@intel.com] Sent: Wednesday, February 20, 2019 2:36 AM To: Richard, Joseph; starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent Hi Joseph: Thanks. The result of ovs-vsctl show is below: I have pasted the yaml files with below link. /opt/platform/helm/19.01/openstack-neutron.yaml http://paste.openstack.org/show/745435/ /opt/platform/puppet/19.01/hieradata/192.168.204.3.yaml http://paste.openstack.org/show/745436/ /opt/platform/puppet/19.01/hieradata/192.168.204.4.yaml http://paste.openstack.org/show/745437/ 168464a5-d278-47b8-a3b0-01f86cfec2bb Manager "ptcp:6640:127.0.0.1" Bridge "br-phy1" Port "lldp160b8b4f-a3" Interface "lldp160b8b4f-a3" type: internal Port "eth1" Interface "eth1" type: dpdk options: {dpdk-devargs="0000:02:04.0", n_rxq="2"} Port "br-phy1" Interface "br-phy1" type: internal Bridge "br-phy0" Port "eth0" Interface "eth0" type: dpdk options: {dpdk-devargs="0000:02:03.0", n_rxq="2"} Port "br-phy0" Interface "br-phy0" type: internal Port "lldp706c54b4-b5" Interface "lldp706c54b4-b5" type: internal ovs_version: "2.9.0" Thanks. BR Austin Sun. From: Richard, Joseph [mailto:Joseph.Richard@windriver.com] Sent: Wednesday, February 20, 2019 1:10 AM To: Sun, Austin <austin.sun@intel.com<mailto:austin.sun@intel.com>>; starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: RE: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent Which build is this? Can you provide the contents of these files on your lab? /opt/platform/helm/19.01/openstack-neutron.yaml /opt/platform/puppet/19.01/hieradata/192.168.204.3.yaml /opt/platform/puppet/19.01/hieradata/192.168.204.4.yaml Also, please provide the output of this command run on controller-0: ovs-vsctl show From: Sun, Austin [mailto:austin.sun@intel.com] Sent: Tuesday, February 19, 2019 9:38 AM To: starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent Hi All: I'm deploying duplex container mode with latest code . meet some error for neutron-ovs-agent Both controller have same configuration and deploy in virtual machine (qemu kvm env) . Does anyone have similar experience and suggest how to solve it ? *) The status of neutron-ovs-agent: neutron-ovs-agent-controller-0-a762cb46-h9xqw 0/1 Init:CrashLoopBackOff 11 42m neutron-ovs-agent-controller-1-f2c6aeed-427h8 1/1 Running 0 42m *) The log of neutron-ovs-agent-controller-0-a762cb46-h9xqw is : + timeout 3m neutron-sanity-check --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/openvswitch_agent.ini --ovsdb_native --nokeepalived_ipv6_support Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so pleas e use SIGUSR2 to generate reports. 2019-02-19 13:12:44.720 254 INFO neutron.common.config [-] Logging enabled! 2019-02-19 13:12:44.720 254 INFO neutron.common.config [-] /var/lib/openstack/bin/neutron-sanity-check version 11.0.0 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl [-] Post-commit checks failed: VswitchdInterfaceAddException: Failed to add interfaces: vxlantest-fe9ff 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl Traceback (most recent call last): 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch/impl_idl.py", line 38, in post_commit 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl self.do_post_commit(txn) 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch /impl_idl.py", line 50, in do_post_commit 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl ifaces=", ".join(failed)) 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl VswitchdInterfaceAddException: Failed to add interfaces: vxlantest-fe9ff 2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl [-] Post-commit checks failed: VswitchdInterfaceAddException: Failed to add interfa ces: 192.0.2.1 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl Traceback (most recent call last): 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch /impl_idl.py", line 38, in post_commit 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl self.do_post_commit(txn) 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch /impl_idl.py", line 50, in do_post_commit 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl ifaces=", ".join(failed)) 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl VswitchdInterfaceAddException: Failed to add interfaces: 192.0.2.1 2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib [-] Timed out retrieving ofport on port 192.0.2.1.: RetryError: RetryError[<Future at 0x7fa2 43407d90 state=finished returned list>] 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib Traceback (most recent call last): 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", lin e 321, in get_port_ofport 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib ofport = self._get_port_val(port_name, "ofport") 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 89, in wrapped 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib return new_fn(*args, **kwargs) 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 171, in wrapped_f 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib return self.call(f, *args, **kw) 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 248, in call 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib start_time=start_time) 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 216, in iter 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib raise RetryError(fut).reraise() 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 298, in reraise 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib raise self 2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib RetryError: RetryError[<Future at 0x7fa243407d90 state=finished retu Thanks. BR Austin Sun.