Hi Joseph:

This is based on latest master. I have tried several times .

The good news is that after increasing VM memory (from 18G to 24G) , This issue is gone. (same iso, same pc)

Thanks your support.

Thanks.
BR

Austin Sun.

From: Richard, Joseph [mailto:Joseph.Richard@windriver.com]
Sent: Thursday, February 21, 2019 3:28 AM
To: Sun, Austin <austin.sun@intel.com>; starlingx-discuss@lists.starlingx.io
Subject: RE: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent

Which build is this?

Has you reproduced this failure?

Do you see any errors in your puppet logs on controller-0 from when you unlocked it?

From: Sun, Austin [mailto:austin.sun@intel.com]
Sent: Wednesday, February 20, 2019 2:36 AM
To: Richard, Joseph; starlingx-discuss@lists.starlingx.io
Subject: RE: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent

Hi Joseph:

Thanks. The result of ovs-vsctl show is below:

I have pasted the yaml files with below link.

/opt/platform/helm/19.01/openstack-neutron.yaml

http://paste.openstack.org/show/745435/

/opt/platform/puppet/19.01/hieradata/192.168.204.3.yaml

http://paste.openstack.org/show/745436/

/opt/platform/puppet/19.01/hieradata/192.168.204.4.yaml

http://paste.openstack.org/show/745437/

168464a5-d278-47b8-a3b0-01f86cfec2bb

Manager "ptcp:6640:127.0.0.1"

Bridge "br-phy1"

Port "lldp160b8b4f-a3"

Interface "lldp160b8b4f-a3"

type: internal

Port "eth1"

Interface "eth1"

type: dpdk

options: {dpdk-devargs="0000:02:04.0", n_rxq="2"}

Port "br-phy1"

Interface "br-phy1"

type: internal

Bridge "br-phy0"

Port "eth0"

Interface "eth0"

type: dpdk

options: {dpdk-devargs="0000:02:03.0", n_rxq="2"}

Port "br-phy0"

Interface "br-phy0"

type: internal

Port "lldp706c54b4-b5"

Interface "lldp706c54b4-b5"

type: internal

ovs_version: "2.9.0"

Thanks.

BR
Austin Sun.

From: Richard, Joseph [mailto:Joseph.Richard@windriver.com]
Sent: Wednesday, February 20, 2019 1:10 AM
To: Sun, Austin <austin.sun@intel.com>; starlingx-discuss@lists.starlingx.io
Subject: RE: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent

Which build is this?

Can you provide the contents of these files on your lab?

/opt/platform/helm/19.01/openstack-neutron.yaml

/opt/platform/puppet/19.01/hieradata/192.168.204.3.yaml

/opt/platform/puppet/19.01/hieradata/192.168.204.4.yaml

Also, please provide the output of this command run on controller-0:

ovs-vsctl show

From: Sun, Austin [mailto:austin.sun@intel.com]
Sent: Tuesday, February 19, 2019 9:38 AM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] duplex deploy failed neutron-ovs-agent

Hi All:

I’m deploying duplex container mode with latest code . meet some error for neutron-ovs-agent

Both controller have same configuration and deploy in virtual machine (qemu kvm env) .

Does anyone have similar experience and suggest how to solve it ?

*) The status of neutron-ovs-agent:

neutron-ovs-agent-controller-0-a762cb46-h9xqw 0/1 Init:CrashLoopBackOff 11 42m

neutron-ovs-agent-controller-1-f2c6aeed-427h8 1/1 Running 0 42m

*) The log of neutron-ovs-agent-controller-0-a762cb46-h9xqw is :

+ timeout 3m neutron-sanity-check --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/openvswitch_agent.ini --ovsdb_native --nokeepalived_ipv6_support

Guru meditation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so pleas

e use SIGUSR2 to generate reports.

2019-02-19 13:12:44.720 254 INFO neutron.common.config [-] Logging enabled!

2019-02-19 13:12:44.720 254 INFO neutron.common.config [-] /var/lib/openstack/bin/neutron-sanity-check version 11.0.0

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl [-] Post-commit checks failed: VswitchdInterfaceAddException: Failed to add interfaces: vxlantest-fe9ff

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl Traceback (most recent call last):

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch/impl_idl.py", line 38, in post_commit

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl self.do_post_commit(txn)

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch

/impl_idl.py", line 50, in do_post_commit

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl ifaces=", ".join(failed))

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl VswitchdInterfaceAddException: Failed to add interfaces: vxlantest-fe9ff

2019-02-19 13:12:45.083 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl [-] Post-commit checks failed: VswitchdInterfaceAddException: Failed to add interfa

ces: 192.0.2.1

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl Traceback (most recent call last):

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch

/impl_idl.py", line 38, in post_commit

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl self.do_post_commit(txn)

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl File "/var/lib/openstack/lib/python2.7/site-packages/ovsdbapp/schema/open_vswitch

/impl_idl.py", line 50, in do_post_commit

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl ifaces=", ".join(failed))

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl VswitchdInterfaceAddException: Failed to add interfaces: 192.0.2.1

2019-02-19 13:12:45.102 254 ERROR ovsdbapp.schema.open_vswitch.impl_idl

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib [-] Timed out retrieving ofport on port 192.0.2.1.: RetryError: RetryError[<Future at 0x7fa2

43407d90 state=finished returned list>]

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib Traceback (most recent call last):

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", lin

e 321, in get_port_ofport

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib ofport = self._get_port_val(port_name, "ofport")

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 89, in wrapped

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib return new_fn(*args, **kwargs)

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 171, in wrapped_f

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib return self.call(f, *args, **kw)

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 248, in call

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib start_time=start_time)

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 216, in iter

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib raise RetryError(fut).reraise()

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib File "/var/lib/openstack/lib/python2.7/site-packages/tenacity/__init__.py", line 298, in reraise

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib raise self

2019-02-19 13:12:55.412 254 ERROR neutron.agent.common.ovs_lib RetryError: RetryError[<Future at 0x7fa243407d90 state=finished retu

Thanks.

BR
Austin Sun.