<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The list_extensions were removed from novaclient in Train.  <a href="https://review.opendev.org/#/c/686516/" id="LPlnk" style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">https://review.opendev.org/#/c/686516/</a></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span style="font-size: 12pt;">horizon followed suit and removed them in this review:  </span><a href="https://review.opendev.org/#/c/690134/" style="font-size: 12pt;">https://review.opendev.org/#/c/690134/</a><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div style="margin:0px;font-size:12pt"><br style="font-size:16px;background-color:rgb(255, 255, 255)">
</div>
<div style="margin:0px;font-size:12pt">The cengn logs for horizon indicate it pulls in novaclient 17.0.0 which has the novaclient commit</div>
<div style="margin:0px;font-size:12pt"><a href="http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/containers/logs/docker-images/" id="LPlnk941775">http://mirror.starlingx.cengn.ca/mirror/starlingx/release/4.0.1/centos/containers/logs/docker-images/</a><br>
</div>
<div style="margin:0px;font-size:12pt"><br>
</div>
<div style="margin:0px;font-size:12pt"><span style="font-size: 12pt;">It also indicates that its building using the PROJECT_REF of "stable/ussuri" that includes the above horizon change.</span></div>
<div style="margin:0px;font-size:12pt"><br>
</div>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div style="margin:0px;font-size:12pt">You may be able to login to a horizon container and determine what version of the code it is using.</div>
<div style="margin:0px;font-size:12pt">
<div style="margin:0px;font-size:12pt;background-color:rgb(255, 255, 255)"><br>
</div>
<div style="margin:0px;font-size:12pt;background-color:rgb(255, 255, 255)"><span style="font-size: 12pt;">Al</span><br>
</div>
</div>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Kumar, Sharath <sharath.kumar@intel.com><br>
<b>Sent:</b> Thursday, October 22, 2020 6:02 AM<br>
<b>To:</b> Smith, Tyler <tyler.smith@windriver.com>; Little, Scott <Scott.Little@windriver.com>; Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Bowness, Les <Les.Bowness@windriver.com>; Peters, Matt <Matt.Peters@windriver.com>;
 Bailey, Henry Albert (Al) <Al.Bailey@windriver.com><br>
<b>Cc:</b> Kalvala, Haridhar <haridhar.kalvala@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io><br>
<b>Subject:</b> RE: FM containerization Build issues</font>
<div> </div>
</div>
<style>
<!--
@font-face
        {font-family:Wingdings}
@font-face
        {font-family:"Cambria Math"}
@font-face
        {font-family:Calibri}
p.x_MsoNormal, li.x_MsoNormal, div.x_MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif}
a:link, span.x_MsoHyperlink
        {color:#0563C1;
        text-decoration:underline}
p.x_MsoListParagraph, li.x_MsoListParagraph, div.x_MsoListParagraph
        {margin-top:0cm;
        margin-right:0cm;
        margin-bottom:0cm;
        margin-left:36.0pt;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif}
span.x_EmailStyle23
        {font-family:"Calibri",sans-serif;
        color:#1F3864;
        font-weight:normal;
        font-style:normal;
        text-decoration:none none}
.x_MsoChpDefault
        {font-size:10.0pt}
@page WordSection1
        {margin:72.0pt 72.0pt 72.0pt 72.0pt}
div.x_WordSection1
        {}
ol
        {margin-bottom:0cm}
ul
        {margin-bottom:0cm}
-->
</style>
<div lang="EN-US" link="#0563C1" vlink="purple">
<div class="x_WordSection1">
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Hi Tyler,</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">I had tried to reproduce the issue once again. The steps and respective errors are captured as below.</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<ol start="1" type="1" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="color:#1F497D; margin-left:0cm; mso-list:l3 level1 lfo6">
<span style="font-size:12.0pt">Applied helm chart and operation aborted during processing of horizon.</span></li></ol>
<p class="x_MsoListParagraph"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"><img width="1088" height="170" id="x_Picture_x0020_1" style="width:11.3333in; height:1.7708in" data-outlook-trace="F:1|T:1" src="cid:image003.png@01D6A888.7BFC76D0"></span><span style="font-size:12.0pt; color:#1F497D"></span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<ol start="2" type="1" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="color:#1F497D; margin-left:0cm; mso-list:l3 level1 lfo6">
<span style="font-size:12.0pt">Horizon pod got crashed.</span></li></ol>
<p class="x_MsoListParagraph"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"><img width="862" height="649" id="x_Picture_x0020_3" style="width:8.9791in; height:6.7604in" data-outlook-trace="F:1|T:1" src="cid:image005.png@01D6A883.D645D050"></span><span style="font-size:12.0pt; color:#1F497D"></span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<ol start="3" type="1" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="color:#1F497D; margin-left:0cm; mso-list:l3 level1 lfo6">
<span style="font-size:12.0pt">Horizon pod description.</span></li></ol>
<p class="x_MsoListParagraph"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoListParagraph" style="margin-left:0cm"><span style="font-size:12.0pt; color:#1F497D"><img width="1480" height="704" id="x_Picture_x0020_4" style="width:15.4166in; height:7.3333in" data-outlook-trace="F:1|T:1" src="cid:image004.png@01D6A884.35A14840"></span><span style="font-size:12.0pt; color:#1F497D"></span></p>
<p class="x_MsoListParagraph"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<ol start="4" type="1" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="color:#1F497D; margin-left:0cm; mso-list:l3 level1 lfo6">
<span style="font-size:12.0pt">Pod log command gave below errors.</span></li></ol>
<p class="x_MsoListParagraph"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoListParagraph"><span style="font-size:12.0pt; color:#1F497D"><img width="1619" height="822" id="x_Picture_x0020_5" style="width:16.8645in; height:8.5625in" data-outlook-trace="F:1|T:1" src="cid:image006.png@01D6A884.F753C4E0"></span><span style="font-size:12.0pt; color:#1F497D"></span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Both logs are attaching for your reference, please confirm, if I open new bug in launchpad and upload these logs would be fine with you ?</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Regards,<br>
Sharath</span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal"><b>From:</b> Kumar, Sharath <br>
<b>Sent:</b> Wednesday, October 21, 2020 1:23 PM<br>
<b>To:</b> Smith, Tyler <tyler.smith@windriver.com>; Little, Scott <Scott.Little@windriver.com>; Mukherjee, Sanjay K <sanjay.k.mukherjee@intel.com>; Miller, Frank <Frank.Miller@windriver.com>; Bowness, Les <Les.Bowness@windriver.com>; Peters, Matt <Matt.Peters@windriver.com>;
 Bailey, Henry Albert (Al) <Al.Bailey@windriver.com><br>
<b>Cc:</b> Kalvala, Haridhar <haridhar.kalvala@intel.com>; Bhat, Gopalkrishna <gopalkrishna.bhat@intel.com>; starlingx-discuss@lists.starlingx.io<br>
<b>Subject:</b> RE: FM containerization Build issues</p>
</div>
</div>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Hi Tyler,</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Please find the attached log for your reference.</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Regards,<br>
Sharath</span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal"><b>From:</b> Smith, Tyler <<a href="mailto:tyler.smith@windriver.com">tyler.smith@windriver.com</a>>
<br>
<b>Sent:</b> Saturday, October 17, 2020 12:40 AM<br>
<b>To:</b> Kumar, Sharath <<a href="mailto:sharath.kumar@intel.com">sharath.kumar@intel.com</a>>; Little, Scott <<a href="mailto:Scott.Little@windriver.com">Scott.Little@windriver.com</a>>; Mukherjee, Sanjay K <<a href="mailto:sanjay.k.mukherjee@intel.com">sanjay.k.mukherjee@intel.com</a>>;
 Miller, Frank <<a href="mailto:Frank.Miller@windriver.com">Frank.Miller@windriver.com</a>>; Bowness, Les <<a href="mailto:Les.Bowness@windriver.com">Les.Bowness@windriver.com</a>>; Peters, Matt <<a href="mailto:Matt.Peters@windriver.com">Matt.Peters@windriver.com</a>>;
 Bailey, Henry Albert (Al) <<a href="mailto:Al.Bailey@windriver.com">Al.Bailey@windriver.com</a>><br>
<b>Cc:</b> Kalvala, Haridhar <<a href="mailto:haridhar.kalvala@intel.com">haridhar.kalvala@intel.com</a>>; Bhat, Gopalkrishna <<a href="mailto:gopalkrishna.bhat@intel.com">gopalkrishna.bhat@intel.com</a>>;
<a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> RE: FM containerization Build issues</p>
</div>
</div>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal"><span lang="EN-CA">Hi,</span></p>
<p class="x_MsoNormal"><span lang="EN-CA"> </span></p>
<p class="x_MsoNormal"><span lang="EN-CA">For issue 1 I would suggest looking into the container logs to see if there are errors being reported when horizon tries starting up.  If there’s nothing useful there you could try manually launching horizon from within
 the container and seeing what the output is.  I think that would involve extending the failed container timeouts so that you have enough time to connect and try.</span></p>
<p class="x_MsoNormal"><span lang="EN-CA"> </span></p>
<p class="x_MsoNormal"><span lang="EN-CA">Tyler</span></p>
<p class="x_MsoNormal"><span lang="EN-CA"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal"><b>From:</b> Kumar, Sharath <<a href="mailto:sharath.kumar@intel.com">sharath.kumar@intel.com</a>>
<br>
<b>Sent:</b> October 16, 2020 6:20 AM<br>
<b>To:</b> Little, Scott <<a href="mailto:Scott.Little@windriver.com">Scott.Little@windriver.com</a>>; Mukherjee, Sanjay K <<a href="mailto:sanjay.k.mukherjee@intel.com">sanjay.k.mukherjee@intel.com</a>>; Miller, Frank <<a href="mailto:Frank.Miller@windriver.com">Frank.Miller@windriver.com</a>>;
 Bowness, Les <<a href="mailto:Les.Bowness@windriver.com">Les.Bowness@windriver.com</a>>; Peters, Matt <<a href="mailto:Matt.Peters@windriver.com">Matt.Peters@windriver.com</a>>; Bailey, Henry Albert (Al) <<a href="mailto:Al.Bailey@windriver.com">Al.Bailey@windriver.com</a>>;
 Smith, Tyler <<a href="mailto:tyler.smith@windriver.com">tyler.smith@windriver.com</a>><br>
<b>Cc:</b> Kalvala, Haridhar <<a href="mailto:haridhar.kalvala@intel.com">haridhar.kalvala@intel.com</a>>; Bhat, Gopalkrishna <<a href="mailto:gopalkrishna.bhat@intel.com">gopalkrishna.bhat@intel.com</a>>;
<a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> RE: FM containerization Build issues</p>
</div>
</div>
<p class="x_MsoNormal"><span lang="EN-CA"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Hi Frank/Tyler,</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Currently <b>
issue 1</b> also blocking us, could you please help us to debug the issue.</span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D"> </span></p>
<p class="x_MsoNormal"><span style="font-size:12.0pt; color:#1F497D">Regards,<br>
Sharath</span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal"><b>From:</b> Scott Little <<span lang="EN-CA"><a href="mailto:scott.little@windriver.com"><span lang="EN-US">scott.little@windriver.com</span></a></span>>
<br>
<b>Sent:</b> Thursday, October 15, 2020 8:50 PM<br>
<b>To:</b> Mukherjee, Sanjay K <<span lang="EN-CA"><a href="mailto:sanjay.k.mukherjee@intel.com"><span lang="EN-US">sanjay.k.mukherjee@intel.com</span></a></span>>; Miller, Frank <<span lang="EN-CA"><a href="mailto:Frank.Miller@windriver.com"><span lang="EN-US">Frank.Miller@windriver.com</span></a></span>>;
 Bowness, Les <<span lang="EN-CA"><a href="mailto:Les.Bowness@windriver.com"><span lang="EN-US">Les.Bowness@windriver.com</span></a></span>>; Peters, Matt <<span lang="EN-CA"><a href="mailto:Matt.Peters@windriver.com"><span lang="EN-US">Matt.Peters@windriver.com</span></a></span>>;
 Bailey, Henry Albert (Al) <<span lang="EN-CA"><a href="mailto:Al.Bailey@windriver.com"><span lang="EN-US">Al.Bailey@windriver.com</span></a></span>>; Smith, Tyler <<span lang="EN-CA"><a href="mailto:tyler.smith@windriver.com"><span lang="EN-US">tyler.smith@windriver.com</span></a></span>><br>
<b>Cc:</b> Kumar, Sharath <<span lang="EN-CA"><a href="mailto:sharath.kumar@intel.com"><span lang="EN-US">sharath.kumar@intel.com</span></a></span>>; Kalvala, Haridhar <<span lang="EN-CA"><a href="mailto:haridhar.kalvala@intel.com"><span lang="EN-US">haridhar.kalvala@intel.com</span></a></span>>;
 Bhat, Gopalkrishna <<span lang="EN-CA"><a href="mailto:gopalkrishna.bhat@intel.com"><span lang="EN-US">gopalkrishna.bhat@intel.com</span></a></span>>;
<span lang="EN-CA"><a href="mailto:starlingx-discuss@lists.starlingx.io"><span lang="EN-US">starlingx-discuss@lists.starlingx.io</span></a></span><br>
<b>Subject:</b> Re: FM containerization Build issues</p>
</div>
</div>
<p class="x_MsoNormal"> </p>
<p>Re Issue 2</p>
<p>Have you failed a launchpad?</p>
<p>Please include ALL steps required to reproduce your build issue including setting environment variables, checking out source code (including how to cherry pick any of your changes), setting up docker, etc... and point out which command hung.</p>
<p>Include the content of your localrc and buildrc</p>
<p>Not knowing where you hung, it's hard to comment on which specific log would be most relevant. 
</p>
<p>Based on your attachment, perhaps it was build-stx-images.sh? In that case it would likely be one of the logs matching the pattern...</p>
<p>    ${MY_WORKSPACE}/std/build-images/docker-${LABEL}-${OS}-${BUILD_STREAM}.log</p>
<p>i.e. there is a separate log for each image.</p>
<p>You can pass the '--only <LABEL>' arg to build-stx-images.sh to speed up reproduction of the issue.</p>
<p>Catpuring and attaching the console/terminal session is also a good idea</p>
<p>Scott</p>
<p> </p>
<div>
<p class="x_MsoNormal">On 2020-10-15 12:48 a.m., Mukherjee, Sanjay K wrote:</p>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<p class="x_MsoNormal">HI Frank/Tyler/Scott</p>
<p class="x_MsoNormal">  As discussed in the containerization meeting sharing the build issues details  need your inputs :-
</p>
<p class="x_MsoNormal"> </p>
<ul type="disc" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="margin-left:0cm; mso-list:l0 level1 lfo3"><b>Issue 1</b>:- FM with Mario’s changes throws horizon not ready error on 4.0 release onwards  . Attaching the Armada log for reference .
</li></ul>
<ul type="disc" style="margin-top:0cm">
<ul type="circle" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="margin-left:0cm; mso-list:l0 level2 lfo3">Please let us know where else to look for to get more details of the issue
</li><li class="x_MsoListParagraph" style="margin-left:0cm; mso-list:l0 level2 lfo3">Need your inputs to move forward
</li></ul>
</ul>
<ul type="disc" style="margin-top:0cm">
<li class="x_MsoListParagraph" style="margin-left:0cm; mso-list:l0 level1 lfo3"><b>Issue 2</b>:- Docker build on the latest master branch is hanging, let us know if this is a known issue . Let us know if any specific log is needed
</li><li class="x_MsoListParagraph" style="margin-left:0cm; mso-list:l0 level1 lfo3"><b>Issue 3:-</b> Presence of only python 3  packages in the wheels tar. It  causes issue while building in Python 2.7 environment</li></ul>
<p class="x_MsoListParagraph"><span lang="EN-CA"><a href="http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_docker_image_build/outputs/wheels/stx-centos-stable-wheels.tar"><span lang="EN-US">http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_docker_image_build/outputs/wheels/stx-centos-stable-wheels.tar</span></a></span></p>
<p class="x_MsoListParagraph">We built using python 2.7 taking the wheel packages built locally. (docker_build_script_2.txt)</p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal">I have attached the logs and the docker scripts . Please let us know if any further details are needed.</p>
<p class="x_MsoListParagraph"> </p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal">Thanks and Regards,</p>
<p class="x_MsoNormal">Sanjay Mukherjee</p>
<p class="x_MsoNormal"> </p>
</blockquote>
</div>
</div>
</body>
</html>