<div dir="ltr"><div dir="ltr">Hi Yong,<div><br></div><div>Yes, virtualization setting are enabled in BIOS.</div><div>Below are the dmesg logs for IOMMU</div><div><br></div><div><div><br></div><div>[ 0.000000] Policy zone: Normal</div><div>[ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.10.0-862.11.6.el7.36.tis.x86_64 root=UUID=8c9ba8fa-ecae-4d66-98ac-a77fb66faae2 ro security_profile=standard module_blacklist=integrity,ima audit=0 tboot=false crashkernel=auto biosdevname=0 console=ttyS0,115200 iommu=pt usbcore.autosuspend=-1 hugepagesz=1G hugepages=2 selinux=0 enforcing=0 nmi_watchdog=panic,1 softlockup_panic=1<b> intel_iommu=on </b>user_namespace.enable=1 hugepagesz=2M hugepages=0 default_hugepagesz=2M isolcpus=1,2 rcu_nocbs=1-35 kthread_cpus=0 irqaffinity=0 nopti nospectre_v2</div><div>[ 0.000000] audit: disabled (until reboot)</div><div><b>[ 0.000000] DMAR: IOMMU enabled</b></div><div>[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)</div></div><div><br></div><div><br></div><div>Many Thanks,</div><div>Himanshu Goyal</div><div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jan 23, 2019 at 7:43 PM Hu, Yong <<a href="mailto:yong.hu@intel.com">yong.hu@intel.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div class="gmail-m_-7391713535423830462WordSection1">
<p class="MsoNormal">Hi Himanshu,<u></u><u></u></p>
<p class="MsoNormal">For compute/worker node, please make sure Virtualization settings (such as VT-X and VT-D) ENABLED in BIOS.<u></u><u></u></p>
<p class="MsoNormal">They are mandatory requirements for compute node.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Regards,<u></u><u></u></p>
<p class="MsoNormal">Yong <u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black">Himanshu Goyal <<a href="mailto:himanshugoyal500@gmail.com" target="_blank">himanshugoyal500@gmail.com</a>><br>
<b>Date: </b>Wednesday, 23 January 2019 at 6:33 PM<br>
<b>To: </b>"Hu, Yong" <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>><br>
<b>Cc: </b>"Alonso, Juan Carlos" <<a href="mailto:juan.carlos.alonso@intel.com" target="_blank">juan.carlos.alonso@intel.com</a>>, "<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>" <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option (error: compute boot in loop)<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><a name="m_-7391713535423830462__MailOriginalBody">Thanks a lot Juan and Yong, <u></u>
<u></u></a></p>
<div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Able to see compute host in "system-host-list" after connecting with a hub. starlingX Compute installation has been done.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>But <span style="color:black">after unlocking the compute nodes the compute node come into an endless boot loop.
</span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black"><br>
<br>
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black">dmesg log shows below error:</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black"><br>
<br>
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black">[ 20.967137] iTCO_vendor_support: vendor-support=0 [ 20.968785] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 20.968840] iTCO_wdt: unable to reset NO_REBOOT flag,
device disabled by hardware/BIOS [ 21.066607] device-mapper: uevent: version 1.0.3 [ 21.067124] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised:
</span></span><a href="mailto:dm-devel@redhat.com" target="_blank"><span>dm-devel@redhat.com</span><span></span></a><span><span style="color:black">
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black"><br>
<br>
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black">Checked the BIOS setting those are as mentioned in installation document.
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black"><br>
<br>
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black">I'm using ISO Image available at below path:</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span></span><a href="http://mirror.starlingx.cengn.ca/mirror/starlingx/centos/2018.10/20181110/outputs/iso/" target="_blank"><span>http://mirror.starlingx.cengn.ca/mirror/starlingx/centos/2018.10/20181110/outputs/iso/</span><span></span></a><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black"><br>
<br>
</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black">Regards,</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><span style="color:black">Himanshu Goyal</span></span><span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span>On Tue, Jan 22, 2019 at 12:43 PM Hu, Yong <</span><a href="mailto:yong.hu@intel.com" target="_blank"><span>yong.hu@intel.com</span><span></span></a><span>>
wrote:<u></u><u></u></span></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal"><span>Himanshu,<u></u><u></u></span></p>
<p class="MsoNormal"><span>Could you have a try with a hub which 2 mgt ports (from controller and compute) are plugged into?<u></u><u></u></span></p>
<p class="MsoNormal"><span>Let’s assure the normal setup works first, and then figure out why the direct linkage of cable doesn’t work.<u></u><u></u></span></p>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<p class="MsoNormal"><span>BTW: “worker” and “compute” are just different “personality” names in different STX version.
<u></u><u></u></span></p>
<p class="MsoNormal"><span>On your current setup “compute” will do, supposedly.<u></u><u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><span><b><span style="font-size:12pt;color:black">From:
</span></b></span><span><span style="font-size:12pt;color:black">Himanshu Goyal <</span></span><a href="mailto:himanshugoyal500@gmail.com" target="_blank"><span><span style="font-size:12pt">himanshugoyal500@gmail.com</span></span><span></span></a><span><span style="font-size:12pt;color:black">><br>
<b>Date: </b>Tuesday, 22 January 2019 at 12:32 AM<br>
<b>To: </b>"Alonso, Juan Carlos" <</span></span><a href="mailto:juan.carlos.alonso@intel.com" target="_blank"><span><span style="font-size:12pt">juan.carlos.alonso@intel.com</span></span><span></span></a><span><span style="font-size:12pt;color:black">><br>
<b>Cc: </b>"Hu, Yong" <</span></span><a href="mailto:yong.hu@intel.com" target="_blank"><span><span style="font-size:12pt">yong.hu@intel.com</span></span><span></span></a><span><span style="font-size:12pt;color:black">>,
"</span></span><a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank"><span><span style="font-size:12pt">starlingx-discuss@lists.starlingx.io</span></span><span></span></a><span><span style="font-size:12pt;color:black">"
<</span></span><a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank"><span><span style="font-size:12pt">starlingx-discuss@lists.starlingx.io</span></span><span></span></a><span><span style="font-size:12pt;color:black">><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option</span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span><a name="m_-7391713535423830462_m_-7913367967387394793__MailOriginalBody">Thanks Juan ,Yong
</a><u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>I tried both the commands output shows as below:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>1) [wrsroot@controller-0 ~(keystone_admin)]$
<b>system host-add -n compute-0 -p worker -m 00:1e:67:fd:3d:fe</b><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>usage: system host-add [-n <hostname>] [-p <personality>] [-s <subfunctions>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> [-m <mgmt_mac>] [-i <mgmt_ip>] [-I <bm_ip>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> [-T <bm_type>] [-U <bm_username>] [-P <bm_password>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> [-b <boot_device>] [-r <rootfs_device>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> [-o <install_output>] [-c <console>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> [-v <vsc_controllers>] [-l <location>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> [-D <true/false>]<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>system host-add: error: argument -p/--personality: invalid choice: 'worker' (choose from 'controller', 'compute', 'storage', 'network',
'profile')<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>[wrsroot@controller-0 ~(keystone_admin)]$<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>[wrsroot@controller-0 ~(keystone_admin)]$<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>2) [wrsroot@controller-0 ~(keystone_admin)]$
<b>system host-add -n compute-0 -p compute -m 00:1e:67:fd:3d:fe</b><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Host-add Rejected: Cannot add a compute host without specifying a mgmt_ip when static address allocation is configured.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>[wrsroot@controller-0 ~(keystone_admin)]$<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Regards,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Himanshu Goyal<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<div>
<div>
<p class="MsoNormal"><span>On Mon, Jan 21, 2019 at 8:42 PM Alonso, Juan Carlos <</span><a href="mailto:juan.carlos.alonso@intel.com" target="_blank"><span>juan.carlos.alonso@intel.com</span><span></span></a><span>>
wrote:<u></u><u></u></span></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)">Hi,</span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)"> </span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)">The personality of computes changed to “worker”, so the command should be:</span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)"> </span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="font-family:"Courier New";color:rgb(31,73,125)">system host-add -n compute-0 -p worker -m ${mac_address}</span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)"> </span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)">Regards.</span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)">Juan Carlos Alonso</span><u></u><u></u></span></p>
<p class="MsoNormal"><span><span style="color:rgb(31,73,125)"> </span><u></u><u></u></span></p>
<div>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(225,225,225);padding:3pt 0cm 0cm">
<p class="MsoNormal"><span><b>From:</b> Hu, Yong
<br>
<b>Sent:</b> Monday, January 21, 2019 8:51 AM<br>
<b>To:</b> Himanshu Goyal <</span><a href="mailto:himanshugoyal500@gmail.com" target="_blank"><span>himanshugoyal500@gmail.com</span><span></span></a><span>>;
Alonso, Juan Carlos <</span><a href="mailto:juan.carlos.alonso@intel.com" target="_blank"><span>juan.carlos.alonso@intel.com</span><span></span></a><span>><br>
<b>Cc:</b> </span><a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank"><span>starlingx-discuss@lists.starlingx.io</span><span></span></a><span><br>
<b>Subject:</b> Re: [Starlingx-discuss] Deployment Option<u></u><u></u></span></p>
</div>
</div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<p class="MsoNormal"><span>Hi Himanshu,<u></u><u></u></span></p>
<p class="MsoNormal"><span>“system host-list” doesn’t “see” your compute node and LLDP won’t work,
<u></u><u></u></span></p>
<p class="MsoNormal"><span>because the mgt port on compute node directly connects to mgt port on controller-0 (rather than both connecting to a hub).<u></u><u></u></span></p>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<p class="MsoNormal"><span>Anyway, given you know the MAC of mgt port on compute node, you can have a try to run the following cmd:<u></u><u></u></span></p>
<p class="gmail-m_-7391713535423830462gmail-m-7913367967387394793gmail-m1395769068875318488p1"><span># system host-add -n compute-0 -p compute -m <compute_node_mgt_port_mac><span class="gmail-m_-7391713535423830462gmail-m-7913367967387394793gmail-m1395769068875318488apple-converted-space"> </span><u></u><u></u></span></p>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<p class="MsoNormal"><span>Regards,<u></u><u></u></span></p>
<p class="MsoNormal"><span>yong<u></u><u></u></span></p>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><span><b><span style="font-size:12pt;color:black">From:
</span></b></span><span><span style="font-size:12pt;color:black">Himanshu Goyal <</span></span><a href="mailto:himanshugoyal500@gmail.com" target="_blank"><span><span style="font-size:12pt">himanshugoyal500@gmail.com</span></span><span></span></a><span><span style="font-size:12pt;color:black">><br>
<b>Date: </b>Monday, 21 January 2019 at 8:14 PM<br>
<b>To: </b>"Alonso, Juan Carlos" <</span></span><a href="mailto:juan.carlos.alonso@intel.com" target="_blank"><span><span style="font-size:12pt">juan.carlos.alonso@intel.com</span></span><span></span></a><span><span style="font-size:12pt;color:black">><br>
<b>Cc: </b>"</span></span><a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank"><span><span style="font-size:12pt">starlingx-discuss@lists.starlingx.io</span></span><span></span></a><span><span style="font-size:12pt;color:black">"
<</span></span><a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank"><span><span style="font-size:12pt">starlingx-discuss@lists.starlingx.io</span></span><span></span></a><span><span style="font-size:12pt;color:black">><br>
<b>Subject: </b>Re: [Starlingx-discuss] Deployment Option</span><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><span><a name="m_-7391713535423830462_m_-7913367967387394793_m_139576906887531">Thanks Juan,
</a><u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Able to unlock my controller node. But facing Issue in PXE boot of compute node. After unlocking of controller machine not able to see
compute host in "<b>system host-list</b>" command. <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>my controller machine is directly connected to compute machine. <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>I'm following the below steps<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Steps:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><b>1) system host-unlock controller-0</b><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><b>2) system host-list</b><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Output::<u></u><u></u></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span>[wrsroot@controller-0 ~(keystone_admin)]$ system host-list<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>+----+--------------+-------------+----------------+-------------+--------------+<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>| id | hostname | personality | administrative | operational | availability |<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>+----+--------------+-------------+----------------+-------------+--------------+<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>| 1 | controller-0 | controller | unlocked | enabled | available |<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>+----+--------------+-------------+----------------+-------------+--------------+<u></u><u></u></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>3) power on my compute machine. And give option to boot from PXE<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> my compute machine is directly connected with controller with mgmt port.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> But not able to see host in "system host-list".<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>4) i tried with system host-add command also, but it is giving below error:<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span><b>Error:</b><u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>[wrsroot@controller-0 ~(keystone_admin)]$ system host-add<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Host-add Rejected: Cannot add a compute host without specifying a mgmt_ip when static address allocation is configured.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Please suggest me the needful change.<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Regards,<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span>Himanshu Goyal<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt">
<div>
<div>
<div>
<p class="MsoNormal"><span> <u></u><u></u></span></p>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</blockquote></div>