<div dir="ltr"><div dir="ltr"><div dir="ltr">Hi Peters,</div><div dir="ltr"><br></div><div>Error logs ovs-vswitched.log:</div><div>#######################################</div><div><div>2019-01-24T18:42:04.213Z|00830|dpdk|INFO|EAL: PCI device 0000:02:00.0 on NUMA socket 0</div><div>2019-01-24T18:42:04.213Z|00831|dpdk|INFO|EAL: probe driver: 8086:10fb net_ixgbe</div><div>2019-01-24T18:42:04.215Z|00832|dpdk|ERR|EAL: 0000:02:00.0 failed to select IOMMU type</div><div>2019-01-24T18:42:04.215Z|00833|dpdk|ERR|EAL: Driver cannot attach the device (0000:02:00.0)</div><div>2019-01-24T18:42:04.215Z|00834|netdev_dpdk|WARN|Error attaching device '0000:02:00.0' to DPDK</div><div>2019-01-24T18:42:04.215Z|00835|netdev|WARN|eth0: could not set configuration (Invalid argument)</div><div>########################################</div></div><div><br></div><div>Please find attached log file also.</div><div><br></div><div>Regards,</div><div>Himanshu Goyal</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jan 24, 2019 at 6:32 PM Peters, Matt <<a href="mailto:Matt.Peters@windriver.com">Matt.Peters@windriver.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-CA">
<div class="gmail-m_813280902505587688WordSection1">
<p class="MsoNormal">The name of eth0 is correct. It is just an assigned name by configuration management.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">What err logs are present in /var/log/openvswitch/ovs-vswitchd.log?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Thursday, January 24, 2019 at 6:52 AM<br>
<b>To: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>><br>
<b>Cc: </b>"<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Thanks a lot Yong, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Checked OVS/DPDK status, It is giving me the error as output shown below:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">In br-phy0 is attaching a port name as eth0, but my compute port name is ens513f0, i think that may be the issue. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">################################################################################# <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>ovs-vsctl show output:</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$ sudo ovs-vsctl show<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">543d08f4-ff1e-4a8d-8e48-11f01356750d<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Manager "ptcp:6640:127.0.0.1"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Bridge "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Controller "tcp:<a href="http://127.0.0.1:6633" target="_blank">127.0.0.1:6633</a>"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> fail_mode: secure<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "phy-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "phy-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: patch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {peer="int-br-phy0"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "lldpabeb30a6-6c"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "lldpabeb30a6-6c"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "eth0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <b> Interface "eth0"</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: dpdk<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {dpdk-devargs="0000:02:00.0", n_rxq="2"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <b>error: "Error attaching device '0000:02:00.0' to DPDK"</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Bridge br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Controller "tcp:<a href="http://127.0.0.1:6633" target="_blank">127.0.0.1:6633</a>"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> fail_mode: secure<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "int-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "int-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: patch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {peer="phy-br-phy0"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ovs_version: "2.9.0"<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal">#####################################################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">##############################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>Output of dpdk-devbind.py:</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$ python /usr/share/openvswitch/scripts/dpdk-devbind.py --status<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Network devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:02:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' drv=vfio-pci unused=<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Network devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:02:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' if=ens513f1 drv=ixgbe unused=vfio-pci *Active*<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:04:00.0 'I350 Gigabit Network Connection 1521' if=<b>enp4s0f0</b> drv=igb unused=vfio-pci<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:04:00.3 'I350 Gigabit Network Connection 1521' if=enp4s0f3 drv=igb unused=vfio-pci<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Network devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Crypto devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===========================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Crypto devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">==================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Crypto devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Eventdev devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Eventdev devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">====================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Eventdev devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">======================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Mempool devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Mempool devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Mempool devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> #############################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Both management and OAM ports support DPDK.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><b>lspci output:</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>##################################################</b><u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$ lspci -nn | grep Eth<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">02:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">02:00.1 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">04:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">04:00.3 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">###############################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Many Thanks,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Jan 24, 2019 at 2:24 PM Hu, Yong <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">I saw you enabled VT-D, how about VT-x in BIOS?<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Another possibility is that your ethernet NIC is not compatible with OVS/DPDK.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Please follow these steps, to dig out more info<u></u><u></u></span></p>
<ol start="1" type="1">
<li class="gmail-m_813280902505587688gmail-m8115904817176701266msolistparagraph">
<span lang="EN-US">lock your compute-node<u></u><u></u></span></li><li class="gmail-m_813280902505587688gmail-m8115904817176701266msolistparagraph">
<span lang="EN-US">ssh to your compute-node and check OVS/DPDK status by “sudo ovs-vsctl show” and “python /usr/share/openvswitch/scripts/dpdk-devbind.py --status”
<u></u><u></u></span></li></ol>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:12pt;color:black">From:
</span></b><span lang="EN-US" style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Thursday, 24 January 2019 at 4:46 PM<br>
<b>To: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>><br>
<b>Cc: </b>"Alonso, Juan Carlos" <<a href="mailto:juan.carlos.alonso@intel.com" target="_blank">juan.carlos.alonso@intel.com</a>>, "<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)</span><span lang="EN-US"><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><a name="m_813280902505587688_m_8115904817176701266__MailOriginalBody"><span lang="EN-US">Hi Yong,
</span></a><span lang="EN-US"><u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I checked server BIOS setting Intel VT-D is enabled in my compute machine<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">compute machine is rebooting only after unlocking, Before reboot it came in unlocked, enabled & online.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Please suggest how can i debug this.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Many Thanks,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Himanshu Goyal<u></u><u></u></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, Jan 23, 2019 at 9:40 PM Hu, Yong <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>> wrote:<u></u><u></u></span></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Intel_iommu=on and immmu are for PCI PT and SR-IOV, as far as I know.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">There are other 2, like VT-x and VT-d flags, to be enabled. Please have a look in BIOS.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US"> <u></u><u></u></span></p>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> <u></u><u></u></span></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote></div></div></div>