<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Hi Nic & All,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We(Me, Sanjay & Sharath) have taken image from link you shared below and still facing same issue.
<o:p></o:p></p>
<p class="MsoNormal">I am not sure about type of error (it was working fine until 2 days back), Just a guess is it anywhere related to local Proxy setting ? Any input/suggestions would help.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">[sysadmin@controller-0 ~(keystone_admin)]$ tail -f /var/log/sysinv.log<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp app_applied = self._app.perform_app_apply(rpc_app, mode, lifecycle_hook_info_app_apply)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1995, in perform_app_apply<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp name=app.name, version=app.version, reason=e)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp KubeAppApplyFailure: Deployment of application stx-openstack (1.0-49-centos-stable-versioned) failed: (404)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp Reason: Not Found<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp HTTP response headers: HTTPHeaderDict({'Date': 'Fri, 05 Feb 2021 13:40:32 GMT', 'Content-Length': '210', 'Content-Type':
'application/json'})<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"secrets \"ceph-pool-kube-rbd\"
not found","reason":"NotFound","details":{"name":"ceph-pool-kube-rbd<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">","kind":"secrets"},"code":404}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-05 13:40:32.592 93081 ERROR sysinv.openstack.common.rpc.amqp</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal">Haridhar Kalvala<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Jascanu, Nicolae <nicolae.jascanu@intel.com> <br>
<b>Sent:</b> Thursday, February 4, 2021 8:22 PM<br>
<b>To:</b> Kalvala, Haridhar <haridhar.kalvala@intel.com>; starlingx-discuss@lists.starlingx.io<br>
<b>Cc:</b> Kumar, Sharath <sharath.kumar@intel.com>; Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com><br>
<b>Subject:</b> RE: Default Helm-chart apply failing (4.0.1)<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi All,<o:p></o:p></p>
<p class="MsoNormal">We installed the 4.0.1 from (<a href="http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/flock/outputs/">http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/flock/outputs/</a>) on a
<b>Virtual Standard</b> configuration in two scenarios: downloading the images from internet and using our mirror registry that already has the images.<o:p></o:p></p>
<p class="MsoNormal">We managed to fully install and execute sanity on both cases.<o:p></o:p></p>
<p class="MsoNormal">We are not able to replicate your issue. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="color:#002060">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#002060">Nicolae Jascanu, Ph.D.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN" style="font-size:10.0pt;color:#002060">Software Engineer<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;color:#002060;mso-fareast-language:EN-GB">IOTG<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;color:#002060;mso-fareast-language:EN-GB">Galati, Romania</span><span style="color:#002060"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE" style="font-size:6.0pt;color:#1F497D;mso-fareast-language:EN-GB"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Kalvala, Haridhar <<a href="mailto:haridhar.kalvala@intel.com">haridhar.kalvala@intel.com</a>>
<br>
<b>Sent:</b> Thursday, February 4, 2021 05:16<br>
<b>To:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Cc:</b> Kumar, Sharath <<a href="mailto:sharath.kumar@intel.com">sharath.kumar@intel.com</a>><br>
<b>Subject:</b> Re: [Starlingx-discuss] Default Helm-chart apply failing (4.0.1)<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hello All,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any update/comment on below issue. It still persists with any version stx-openstack app(Ex: stx-openstack-1.0-49-centos-stable-versioned.tgz) ?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you,<o:p></o:p></p>
<p class="MsoNormal">Haridhar Kalvala<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Pasting error log again :<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">ksysadmin@controller-0 ~(keystone_admin)]$ system application-apply stx-openstack<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">+---------------+----------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| Property | Value |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">+---------------+----------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| active | False |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| app_version | 1.0-49-centos-stable-versioned |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| created_at | 2021-02-04T11:08:55.408108+00:00 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| manifest_file | stx-openstack.yaml |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| manifest_name | armada-manifest |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| name | stx-openstack |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| progress | None |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| status | applying |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">| updated_at | 2021-02-04T11:09:20.815085+00:00 |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">+---------------+----------------------------------+<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">Please use 'system application-list' or 'system application-show stx-openstack' to view the current progress.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">[sysadmin@controller-0 ~(keystone_admin)]$ tail -f /var/log/sysinv.log<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp app_applied = self._app.perform_app_apply(rpc_app, mode, lifecycle_hook_info_app_apply)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1995, in perform_app_apply<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp name=app.name, version=app.version, reason=e)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp KubeAppApplyFailure: Deployment of application stx-openstack (1.0-49-centos-stable-versioned) failed: (404)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp Reason: Not Found<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp HTTP response headers: HTTPHeaderDict({'Date': 'Thu, 04 Feb 2021 11:09:38 GMT', 'Content-Length': '210', 'Content-Type':
'application/json'})<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"secrets \"ceph-pool-kube-rbd\"
not found","reason":"NotFound","details":{"name":"ceph-pool-kube-rbd","kind":"secrets"},"code":404}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-04 11:09:39.231 99042 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.070 99042 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent':
'sysinv/1.0'} payload:None<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.071 99042 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.117 99042 INFO sysinv.conductor.kube_app [-] lifecycle hook for application platform-integ-apps (1.0-9) started {'lifecycle_type': u'check', 'relative_timing':
u'pre', 'mode': u'auto', 'operation': u'apply', 'extra': {}}.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.117 99042 INFO sysinv.conductor.manager [-] Auto-apply failed prerequisites for platform-integ-apps: Automatic apply is disabled for platform-integ-apps.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.122 99042 INFO sysinv.conductor.kube_app [-] lifecycle hook for application oidc-auth-apps (1.0-29) started {'lifecycle_type': u'check', 'relative_timing':
u'pre', 'mode': u'auto', 'operation': u'apply', 'extra': {}}.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.123 99042 INFO sysinv.conductor.manager [-] Auto-apply failed prerequisites for oidc-auth-apps: Automatic apply is disabled for oidc-auth-apps.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.131 99042 INFO sysinv.api.controllers.v1.rest_api [-] GET cmd:http://localhost:30001/nfvi-plugins/v1/sw-update hdr:{'Content-type': 'application/json', 'User-Agent':
'sysinv/1.0'} payload:None<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">sysinv 2021-02-04 11:10:20.132 99042 INFO sysinv.api.controllers.v1.rest_api [-] Response={u'status': u'success', u'in-progress': None, u'sw-update-type': None}</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Kalvala, Haridhar <br>
<b>Sent:</b> Wednesday, February 3, 2021 4:39 PM<br>
<b>To:</b> Kumar, Sharath <<a href="mailto:sharath.kumar@intel.com">sharath.kumar@intel.com</a>>;
<a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> RE: Default Helm-chart apply failing (4.0.1)<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Even I am observing the same since morning (IST time zone).<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Error log:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp app_applied = self._app.perform_app_apply(rpc_app, mode, lifecycle_hook_info_app_apply)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1995, in perform_app_apply<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp name=app.name, version=app.version, reason=e)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp KubeAppApplyFailure: Deployment of application stx-openstack (1.0-49-centos-stable-versioned) failed: (404)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp Reason: Not Found<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp HTTP response headers: HTTPHeaderDict({'Date': 'Wed, 03 Feb 2021 18:37:19 GMT', 'Content-Length': '210', 'Content-Type':
'application/json'})<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"secrets \"ceph-pool-kube-rbd\"
not found","reason":"NotFound","details":{"name":"ceph-pool-kube-rbd<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">","kind":"secrets"},"code":404}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp<o:p></o:p></span></p>
<p class="MsoNormal"><span style="background:yellow;mso-highlight:yellow">2021-02-03 18:37:19.530 99042 ERROR sysinv.openstack.common.rpc.amqp</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal">Haridhar Kalvala<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Kumar, Sharath <<a href="mailto:sharath.kumar@intel.com">sharath.kumar@intel.com</a>>
<br>
<b>Sent:</b> Wednesday, February 3, 2021 4:14 PM<br>
<b>To:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> [Starlingx-discuss] Default Helm-chart apply failing (4.0.1)<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F3864">Hi All,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F3864">We are seeing stx-openstack Armanda helm chart getting failed during apply. Initial docker images are not downloading and throwing error. It was working till last night and since morning am seeing
this issue. Kindly fix the issue and do the needful. Thank you in advance.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F3864">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F3864">Sharath<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</body>
</html>