[Starlingx-discuss] OVS-DPDK Upgrade Testing

Wed Apr 3 07:20:28 UTC 2019

Hi Ghada,
The output of following commands on compute-0 have been attached:
sudo lscpu
sudo virsh capabilities

My controllers are wolf pass servers and have skylake processors. I'm reinstalling the standard 0322 ISO image and this time I will use wolf pass servers as compute node.

Best Regards,
Xu, Chenjie

From: Xu, Chenjie
Sent: Wednesday, April 3, 2019 11:48 AM
To: Peters, Matt <Matt.Peters at windriver.com>; Liu, ZhipengS <zhipengs.liu at intel.com>; He, Yongli <yongli.he at intel.com>
Cc: 'starlingx-discuss at lists.starlingx.io' <starlingx-discuss at lists.starlingx.io>; 'Khalil, Ghada' <Ghada.Khalil at windriver.com>; Zhao, Forrest <forrest.zhao at intel.com>; Rowsell, Brent <Brent.Rowsell at windriver.com>; Gauld, James <James.Gauld at windriver.com>; Le, Huifeng <huifeng.le at intel.com>; Martinez Monroy, Elio <elio.martinez.monroy at intel.com>; Perez, Ricardo O <ricardo.o.perez at intel.com>; Cabrales, Ada <ada.cabrales at intel.com>; Lin, Shuicheng <shuicheng.lin at intel.com>
Subject: RE: [Starlingx-discuss] OVS-DPDK Upgrade Testing

Hi Matt,
Zhipeng is working on "PCI Affinity dependency on Nova NUMA topology". This may relate to BUG "VM can't send packet through vhostuser port due to missing numa settings in domain xml":
      https://bugs.launchpad.net/starlingx/+bug/1820378

According to him, after cutting over to nova master, the NUMA topology and PCI device info has been removed from nova. Before nova master, StarlingX uses nova stage which has NUMA topology. Some detailed information are listed below:
     *  PCI Affinity dependency on Nova NUMA topology - Zhipeng
o      This affinity agent could not get both pci_device info and numa info of server from nova.
o      In nova stage version, we added below two for server.
o                server["wrs-res:topology"]
o                server["wrs-res:pci_devices"]
o      In nova master, no these attributions for server.
o      For topology, I can see that there is a patch of adding numa topology pending for merge
o      https://review.openstack.org/#/c/621476  Add server sub-resource topology API
o      Next step - Zhipeng to investigate alternative implementations that don't have dependencies on Nova.

Best Regards,
Xu, Chenjie

From: Khalil, Ghada [mailto:Ghada.Khalil at windriver.com]
Sent: Tuesday, April 2, 2019 11:50 PM
To: Xu, Chenjie <chenjie.xu at intel.com<mailto:chenjie.xu at intel.com>>; Martinez Monroy, Elio <elio.martinez.monroy at intel.com<mailto:elio.martinez.monroy at intel.com>>; Peters, Matt <Matt.Peters at windriver.com<mailto:Matt.Peters at windriver.com>>; Lin, Shuicheng <shuicheng.lin at intel.com<mailto:shuicheng.lin at intel.com>>; Cabrales, Ada <ada.cabrales at intel.com<mailto:ada.cabrales at intel.com>>; Perez, Ricardo O <ricardo.o.perez at intel.com<mailto:ricardo.o.perez at intel.com>>
Cc: 'starlingx-discuss at lists.starlingx.io' <starlingx-discuss at lists.starlingx.io<mailto:starlingx-discuss at lists.starlingx.io>>; Zhao, Forrest <forrest.zhao at intel.com<mailto:forrest.zhao at intel.com>>; Rowsell, Brent <Brent.Rowsell at windriver.com<mailto:Brent.Rowsell at windriver.com>>; Gauld, James <James.Gauld at windriver.com<mailto:James.Gauld at windriver.com>>
Subject: RE: [Starlingx-discuss] OVS-DPDK Upgrade Testing

Thanks Chenjie.
Can you please run the following on your compute nodes and attach the output?
sudo lscpu
sudo virsh capabilities

Richardo / Juan P,
Please provide the cpu models and the above output from your two hardware systems as well.

Thanks,
Ghada

From: Xu, Chenjie [mailto:chenjie.xu at intel.com]
Sent: Tuesday, April 02, 2019 2:55 AM
To: Khalil, Ghada; Martinez Monroy, Elio; Peters, Matt; Lin, Shuicheng; Cabrales, Ada; Perez, Ricardo O
Cc: 'starlingx-discuss at lists.starlingx.io'; Zhao, Forrest; Rowsell, Brent
Subject: RE: [Starlingx-discuss] OVS-DPDK Upgrade Testing

Hi Ghada,
Compute-0 and compute-1 don't have skylake processors. The processors both are:
Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz

Compute-0 and compute-1's server model both are:
Manufacturer: Intel Corporation
       Product Name: S2600JF
Sub-NUMA Clustering doesn't exist in my BIOS. Only NUMA Optimized exists. An image for "Memory RAS and Performance Configuration" has been attached.
Best Regards,
Xu, Chenjie

From: Khalil, Ghada [mailto:Ghada.Khalil at windriver.com]
Sent: Tuesday, April 2, 2019 6:52 AM
To: Xu, Chenjie <chenjie.xu at intel.com<mailto:chenjie.xu at intel.com>>; Martinez Monroy, Elio <elio.martinez.monroy at intel.com<mailto:elio.martinez.monroy at intel.com>>; Peters, Matt <Matt.Peters at windriver.com<mailto:Matt.Peters at windriver.com>>; Lin, Shuicheng <shuicheng.lin at intel.com<mailto:shuicheng.lin at intel.com>>; Cabrales, Ada <ada.cabrales at intel.com<mailto:ada.cabrales at intel.com>>; Perez, Ricardo O <ricardo.o.perez at intel.com<mailto:ricardo.o.perez at intel.com>>
Cc: 'starlingx-discuss at lists.starlingx.io' <starlingx-discuss at lists.starlingx.io<mailto:starlingx-discuss at lists.starlingx.io>>; Zhao, Forrest <forrest.zhao at intel.com<mailto:forrest.zhao at intel.com>>; Rowsell, Brent <Brent.Rowsell at windriver.com<mailto:Brent.Rowsell at windriver.com>>
Subject: RE: [Starlingx-discuss] OVS-DPDK Upgrade Testing

Hi Chenjie,
Can you let us know the model of your server? Does it have skylake processors?
Can you also double-check that you have Sub-NUMA Clustering disabled in the BIOS?

On a wolfpass, the BIOS setting is at:
Enter Setup
> Advanced
  > Memory Configuration
   > Memory RAS and Performance Configuration
       Sub-NUMA Cluster  <Disabled>

Thanks,
Ghada

From: Xu, Chenjie [mailto:chenjie.xu at intel.com]
Sent: Wednesday, March 27, 2019 9:59 PM
To: Martinez Monroy, Elio; Peters, Matt; Khalil, Ghada; Lin, Shuicheng; Cabrales, Ada; Perez, Ricardo O
Cc: 'starlingx-discuss at lists.starlingx.io'; Zhao, Forrest; Rowsell, Brent
Subject: RE: [Starlingx-discuss] OVS-DPDK Upgrade Testing

Hi Matt,
I run the following commands on compute-0. The outputs of commands have been attached.
sudo /usr/sbin/dmidecode > dmidecode.txt
virsh nodeinfo > nodeinfo.txt
/usr/bin/topology > topology.txt
grep -i numa /var/log/dmesg > dmesg.txt

And the StarlingX is installed with standard 0322 ISO image:
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190322T174230Z/outputs/iso/

Best Regards,
Xu, Chenjie

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190403/228eff63/attachment-0001.html>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: lscpu.txt
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190403/228eff63/attachment-0002.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: virsh_capabilities.txt
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190403/228eff63/attachment-0003.txt>