<div dir="ltr">Thanks Matt,<div><br></div><div>Please find attached mtcAgent.log</div><div><br></div><div>Regards,</div><div>Himanshu Goyal</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jan 25, 2019 at 6:36 PM Peters, Matt <<a href="mailto:Matt.Peters@windriver.com">Matt.Peters@windriver.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-CA">
<div class="gmail-m_7255863767652377459WordSection1">
<p class="MsoNormal">The DPDK and OVS status look fine now.<u></u><u></u></p>
<p class="MsoNormal">I would check the /var/log/mtcAgent.log on the active controller host to determine what is being reported for the reboot.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Friday, January 25, 2019 at 3:56 AM<br>
<b>To: </b>"Peters, Matt" <<a href="mailto:Matt.Peters@windriver.com" target="_blank">Matt.Peters@windriver.com</a>><br>
<b>Cc: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>>, "<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Matt, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Please find below output of dpdk-devbind.py --status also:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">compute-0:/var/log/puppet/latest# python /usr/share/openvswitch/scripts/dpdk-devbind.py --status<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">##########################################################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">python /usr/share/openvswitch/scripts/dpdk-devbind.py --status<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Network devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:04:00.0 'I350 Gigabit Network Connection 1521' drv=vfio-pci unused=<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Network devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:02:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' if=ens513f1 drv=ixgbe unused=vfio-pci<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:04:00.3 'I350 Gigabit Network Connection 1521' if=enp4s0f3 drv=igb unused=vfio-pci *Active*<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Network devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:02:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' unused=vfio-pci<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Crypto devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===========================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Crypto devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">==================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Crypto devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Eventdev devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Eventdev devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">====================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Eventdev devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">======================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Mempool devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Mempool devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Other Mempool devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/var/log/puppet/latest#<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal">################################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Fri, Jan 25, 2019 at 2:14 PM Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal">Hi Matt, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Sorry, interrupt remapping was disabled in my BIOS, I tried again after enable that, Now in dmesg & ovs-vsct there is no errors.<b> But compute still rebooting in loop</b>.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Please find attached dmesg log output for reference.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">#######################################################################<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">compute-0:/home/wrsroot#<b> sudo ovs-vsctl show</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">8a1f7179-2014-4b4e-ad23-2065b8024964<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Manager "ptcp:6640:127.0.0.1"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Bridge "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Controller "tcp:<a href="http://127.0.0.1:6633" target="_blank">127.0.0.1:6633</a>"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> fail_mode: secure<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "lldp64416a6d-7d"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "lldp64416a6d-7d"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "phy-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "phy-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: patch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {peer="int-br-phy0"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "eth0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "eth0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: dpdk<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {dpdk-devargs="0000:04:00.0", n_rxq="2"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Bridge br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Controller "tcp:<a href="http://127.0.0.1:6633" target="_blank">127.0.0.1:6633</a>"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> fail_mode: secure<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "int-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "int-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: patch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {peer="phy-br-phy0"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ovs_version: "2.9.0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/home/wrsroot#<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal">#############################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Please suggest me any other logs that i can check.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Fri, Jan 25, 2019 at 12:21 PM Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<div>
<p class="MsoNormal">Thanks Matt, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Below are the details of my server BIOS, Currently in my Server Bios Version: SE5C610.86B.01.01.0014.121820151719, <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Please suggest which version of Bios we can use & this version is up-gradable or not with required version.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">#################################################################<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">compute-0:/home/wrsroot# dmidecode -t1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"># dmidecode 3.0<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Getting SMBIOS data from sysfs.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">SMBIOS 2.7 present.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Handle 0x0001, DMI type 1, 27 bytes<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">System Information<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Manufacturer: Intel Corporation<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Product Name: S2600WT2<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Version: ....................<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Serial Number: ............<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> UUID: 803BBEFB-BFC1-E511-906E-0012795D96DD<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Wake-up Type: Power Switch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> SKU Number: SKU Number<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Family: Family<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">#############################################################################<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">################################################################################<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">compute-0:/home/wrsroot# sudo dmidecode --type bios<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"># dmidecode 3.0<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Getting SMBIOS data from sysfs.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">SMBIOS 2.7 present.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Handle 0x0000, DMI type 0, 24 bytes<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">BIOS Information<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Vendor: Intel Corporation<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Version: SE5C610.86B.01.01.0014.121820151719<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Release Date: 12/18/2015<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Address: 0xF0000<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Runtime Size: 64 kB<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ROM Size: 16384 kB<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Characteristics:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> PCI is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> PNP is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> BIOS is upgradeable<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> BIOS shadowing is allowed<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Boot from CD is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Selectable boot is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> EDD is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> 5.25"/1.2 MB floppy services are supported (int 13h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> 3.5"/720 kB floppy services are supported (int 13h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> 3.5"/2.88 MB floppy services are supported (int 13h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Print screen service is supported (int 5h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> 8042 keyboard services are supported (int 9h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Serial services are supported (int 14h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Printer services are supported (int 17h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> CGA/mono video services are supported (int 10h)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ACPI is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> USB legacy is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> LS-120 boot is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ATAPI Zip drive boot is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> BIOS boot specification is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Function key-initiated network boot is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Targeted content distribution is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> UEFI is supported<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> BIOS Revision: 0.0<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Firmware Revision: 0.0<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Handle 0x000B, DMI type 13, 22 bytes<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">BIOS Language Information<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Language Description Format: Abbreviated<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Installable Languages: 1<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> enUS<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Currently Installed Language: enUS<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">########################################################################################################<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Jan 24, 2019 at 10:55 PM Peters, Matt <<a href="mailto:Matt.Peters@windriver.com" target="_blank">Matt.Peters@windriver.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal">Based on the logs, it looks like you have an older system that doesn’t fully support VT-d IOMMU remapping. You can try updating your BIOS if there is a newer version available.
We don’t currently support setting arbitrary module parameters, so we don’t have a way to implement the workaround module param specified in the logs (i.e. disabling interrupt remapping).<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Maybe there are others on the distribution list that could offer additional suggestions. <u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From:
</span></b><span style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Thursday, January 24, 2019 at 11:32 AM<br>
<b>To: </b>"Peters, Matt" <<a href="mailto:Matt.Peters@windriver.com" target="_blank">Matt.Peters@windriver.com</a>><br>
<b>Cc: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>>, "<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Hi Peters,
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Please find output of required command in attached file.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal <u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal">On Thu, Jan 24, 2019 at 6:56 PM Peters, Matt <<a href="mailto:Matt.Peters@windriver.com" target="_blank">Matt.Peters@windriver.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal">Can you confirm that VT-d is enabled properly by running the following?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">dmesg | grep -i -e DMAR -e IOMMU<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From:
</span></b><span style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Thursday, January 24, 2019 at 8:19 AM<br>
<b>To: </b>"Peters, Matt" <<a href="mailto:Matt.Peters@windriver.com" target="_blank">Matt.Peters@windriver.com</a>><br>
<b>Cc: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>>, "<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Peters,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Error logs ovs-vswitched.log:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">#######################################<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">2019-01-24T18:42:04.213Z|00830|dpdk|INFO|EAL: PCI device 0000:02:00.0 on NUMA socket 0<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2019-01-24T18:42:04.213Z|00831|dpdk|INFO|EAL: probe driver: 8086:10fb net_ixgbe<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2019-01-24T18:42:04.215Z|00832|dpdk|ERR|EAL: 0000:02:00.0 failed to select IOMMU type<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2019-01-24T18:42:04.215Z|00833|dpdk|ERR|EAL: Driver cannot attach the device (0000:02:00.0)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2019-01-24T18:42:04.215Z|00834|netdev_dpdk|WARN|Error attaching device '0000:02:00.0' to DPDK<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">2019-01-24T18:42:04.215Z|00835|netdev|WARN|eth0: could not set configuration (Invalid argument)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">########################################<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Please find attached log file also.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Regards,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Jan 24, 2019 at 6:32 PM Peters, Matt <<a href="mailto:Matt.Peters@windriver.com" target="_blank">Matt.Peters@windriver.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal">The name of eth0 is correct. It is just an assigned name by configuration management.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">What err logs are present in /var/log/openvswitch/ovs-vswitchd.log?<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From:
</span></b><span style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Thursday, January 24, 2019 at 6:52 AM<br>
<b>To: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>><br>
<b>Cc: </b>"<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Thanks a lot Yong,
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Checked OVS/DPDK status, It is giving me the error as output shown below:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">In br-phy0 is attaching a port name as eth0, but my compute port name is ens513f0, i think that may be the issue. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">################################################################################# <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>ovs-vsctl show output:</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$ sudo ovs-vsctl show<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">543d08f4-ff1e-4a8d-8e48-11f01356750d<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Manager "ptcp:6640:127.0.0.1"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Bridge "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Controller "tcp:<a href="http://127.0.0.1:6633" target="_blank">127.0.0.1:6633</a>"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> fail_mode: secure<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "phy-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "phy-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: patch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {peer="int-br-phy0"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "lldpabeb30a6-6c"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "lldpabeb30a6-6c"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "eth0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">
<b> Interface "eth0"</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: dpdk<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {dpdk-devargs="0000:02:00.0", n_rxq="2"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">
<b>error: "Error attaching device '0000:02:00.0' to DPDK"</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Bridge br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Controller "tcp:<a href="http://127.0.0.1:6633" target="_blank">127.0.0.1:6633</a>"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> is_connected: true<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> fail_mode: secure<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port "int-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface "int-br-phy0"<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: patch<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> options: {peer="phy-br-phy0"}<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Port br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> Interface br-int<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> type: internal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ovs_version: "2.9.0"<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal">#####################################################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">##############################################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>Output of dpdk-devbind.py:</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$ python /usr/share/openvswitch/scripts/dpdk-devbind.py --status<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Network devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:02:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' drv=vfio-pci unused=<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Network devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:02:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection 10fb' if=ens513f1 drv=ixgbe unused=vfio-pci *Active*<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:04:00.0 'I350 Gigabit Network Connection 1521' if=<b>enp4s0f0</b> drv=igb unused=vfio-pci<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">0000:04:00.3 'I350 Gigabit Network Connection 1521' if=enp4s0f3 drv=igb unused=vfio-pci<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Other Network devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Crypto devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===========================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Crypto devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">==================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Other Crypto devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Eventdev devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Eventdev devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">====================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Other Eventdev devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">======================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Mempool devices using DPDK-compatible driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">============================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Mempool devices using kernel driver<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">===================================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Other Mempool devices<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">=====================<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><none><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> #############################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Both management and OAM ports support DPDK.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>lspci output:</b><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><b>##################################################</b><u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$ lspci -nn | grep Eth<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">02:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">02:00.1 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">04:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">04:00.3 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">###############################################################<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">compute-0:/usr/share/openvswitch/scripts$<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Many Thanks,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Himanshu Goyal<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Jan 24, 2019 at 2:24 PM Hu, Yong <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">I saw you enabled VT-D, how about VT-x in BIOS?</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Another possibility is that your ethernet NIC is not compatible with OVS/DPDK.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Please follow these steps, to dig out more info</span><u></u><u></u></p>
<ol start="1" type="1">
<li class="gmail-m_7255863767652377459gmail-m-1023530240415125694gmail-m5466489043390386735gmail-m7501301641403685515gmail-m1793099413912731401gmail-m-1324562221060511449gmail-m813280902505587688gmail-m8115904817176701266msolistparagraph">
<span lang="EN-US">lock your compute-node</span><u></u><u></u></li><li class="gmail-m_7255863767652377459gmail-m-1023530240415125694gmail-m5466489043390386735gmail-m7501301641403685515gmail-m1793099413912731401gmail-m-1324562221060511449gmail-m813280902505587688gmail-m8115904817176701266msolistparagraph">
<span lang="EN-US">ssh to your compute-node and check OVS/DPDK status by “sudo ovs-vsctl show” and “python /usr/share/openvswitch/scripts/dpdk-devbind.py --status”
</span><u></u><u></u></li></ol>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:12pt;color:black">From:
</span></b><span lang="EN-US" style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Thursday, 24 January 2019 at 4:46 PM<br>
<b>To: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>><br>
<b>Cc: </b>"Alonso, Juan Carlos" <<a href="mailto:juan.carlos.alonso@intel.com" target="_blank">juan.carlos.alonso@intel.com</a>>, "<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><a name="m_7255863767652377459_m_-1023530240415125694_m_546648904339038"><span lang="EN-US">Hi Yong,
</span></a><u></u><u></u></p>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I checked server BIOS setting Intel VT-D is enabled in my compute machine</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">compute machine is rebooting only after unlocking, Before reboot it came in unlocked, enabled & online.</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Please suggest how can i debug this.</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Many Thanks,</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Himanshu Goyal</span><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, Jan 23, 2019 at 9:40 PM Hu, Yong <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>> wrote:</span><u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Intel_iommu=on and immmu are for PCI PT and SR-IOV, as far as I know.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">There are other 2, like VT-x and VT-d flags, to be enabled. Please have a look in BIOS.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal" style="margin-left:11.55pt">
<span lang="EN-US"> </span><u></u><u></u></p>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</blockquote>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote></div>