<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:"Courier New";}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle25
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle26
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle27
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle28
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle29
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle31
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1317799839;
mso-list-type:hybrid;
mso-list-template-ids:1890080670 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">Looking at our in-house jenkins build output, I see:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New";color:#1F497D">$ rpm -qp --dump std/results/jenkins-STX_Feature_centos76_Build-2019-02-12_14-43-05-tis-r6-pike-std/grub2-2.02-0.76.el7.centos.tis.12/grub2-efi-x64-pxeboot-2.02-0.76.el7.centos.tis.12.x86_64.rpm<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Courier New";color:#1F497D">/pxeboot/EFI/grubx64.efi 1233016 1550007456 3d0f3ae9293f23e1ebe6f56e1eb04fc6
</span><span style="font-size:9.0pt;font-family:"Courier New";color:red">0100700 </span>
<span style="font-size:9.0pt;font-family:"Courier New";color:#1F497D">root root 0 0 0 X<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Looking at the grub.macro file, which is providing the %install and %files directives, it certainly seems like this should be 755. The %defattr being set ignores the permissions. And I don’t see anything in the
build.log that would indicate another chmod is happening after.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"> Little, Scott
<br>
<b>Sent:</b> Thursday, February 14, 2019 9:56 AM<br>
<b>To:</b> Liu, Yang; Lin, Shuicheng; Penney, Don; Xie, Cindy; Chen, Haochuan Z; Sun, Austin<br>
<b>Cc:</b> starlingx-discuss@lists.starlingx.io; Cabrales, Ada; Waheed, Numan<br>
<b>Subject:</b> Re: CentOS7.6 testing status - blocked<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">I think it's on our side.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The in house jenkins script I cloned for the 76 build does not include an installer rebuild.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Scott<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On 2019-02-14 8:36 a.m., Liu, Yang wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span style="color:#1F497D">Hi Shuicheng,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">I checked the 3 items as per your instructions, build log does contain the expected step, however the results are different.
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">@ Scott/Don, any thoughts on this?</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo2"><![if !supportLists]><span style="mso-list:Ignore">1.<span style="font:7.0pt "Times New Roman"">
</span></span><![endif]><span style="color:#1F497D">+ install -D -m 755 grubx64.efi /builddir/build/BUILDROOT/grub2-2.02-0.76.el7.centos.tis.12.x86_64/pxeboot/EFI/grubx64.efi</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo2"><![if !supportLists]><span style="mso-list:Ignore">2.<span style="font:7.0pt "Times New Roman"">
</span></span><![endif]><span style="color:#1F497D">-rwx------ 1 yliu12 users 1233016 Feb 12 16:37 ./pxeboot/EFI/grubx64.efi</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo2"><![if !supportLists]><span style="mso-list:Ignore">3.<span style="font:7.0pt "Times New Roman"">
</span></span><![endif]><span style="color:#1F497D">-rwx------ 1 jenkins mock 1233016 Feb 12 16:37 grubx64.efi</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">BR,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Yang</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Lin, Shuicheng [<a href="mailto:shuicheng.lin@intel.com">mailto:shuicheng.lin@intel.com</a>]
<br>
<b>Sent:</b> February-14-19 2:32 AM<br>
<b>To:</b> Penney, Don; Xie, Cindy; Liu, Yang; Chen, Haochuan Z; Sun, Austin<br>
<b>Cc:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a>; Cabrales, Ada; Waheed, Numan; Little, Scott<br>
<b>Subject:</b> RE: CentOS7.6 testing status - blocked</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Hi Yang/Don,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">We double checked the issue today. Here is our finding:</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">1.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">I try to revert the fix [0], then do build-pkgs and build-iso, the “grubx64.efi” in “export/dist/isolinux/pxeboot/EFI/” is with 700 permission mode.</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">Add the fix [0] back, then build-pkgs and build-iso, the “grubx64.efi” is changed to 755 permission mode.</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">I also checked the grubx64.efi file in both ISO image, it has the same mode as upper file.</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">2.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">Martin confirmed there is tftp log in the deployment:</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="color:#1F497D">2019-02-11T00:36:52.000 controller-0 dnsmasq-tftp[8262]: info sent /pxeboot/EFI/grubx64.efi to 169.254.202.76</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="color:#1F497D">controller-0:/var/log$ ls /pxeboot/EFI/grubx64.efi -l</span><o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in"><span style="color:#1F497D">-rwxr-xr-x. 1 root root 1234192 Feb 3 06:52 /pxeboot/EFI/grubx64.efi</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">3.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">Austin confirmed “install -D -m 755” will set the grubx64.efi with 755 permission mode.</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D"> -m, --mode=MODE</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D"> set permission mode (as in chmod), instead of rwxr-xr-x</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">4.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">I try to go through the build log. Here is the log from grub2’s build.log</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">+ install -m 700 grubx64.efi /builddir/build/BUILDROOT/grub2-2.02-0.76.el7.centos.tis.12.x86_64/boot/efi/EFI/centos/grubx64.efi.unsigned</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">+ install -m 700 gcdx64.efi /builddir/build/BUILDROOT/grub2-2.02-0.76.el7.centos.tis.12.x86_64/boot/efi/EFI/centos/gcdx64.efi.unsigned</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D;background:yellow;mso-highlight:yellow">+ install -D -m 755 grubx64.efi /builddir/build/BUILDROOT/grub2-2.02-0.76.el7.centos.tis.12.x86_64/pxeboot/EFI/grubx64.efi</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">+ install -m 700 grubx64.efi /builddir/build/BUILDROOT/grub2-2.02-0.76.el7.centos.tis.12.x86_64/boot/efi/EFI/centos/grubx64.efi</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">+ install -m 700 gcdx64.efi /builddir/build/BUILDROOT/grub2-2.02-0.76.el7.centos.tis.12.x86_64/boot/efi/EFI/centos/gcdx64.efi</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">And in build-iso script, the file will be extracted and copied to the EFI folder:</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">extract_pkg_from_local_repo ${MY_YUM_CONF} ${STD_REPO_ID} grub2-efi-x64-pxeboot</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">…</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">\cp --preserve=all pxeboot/EFI/grubx64.efi $OUTPUT_DIST_DIR/isolinux/pxeboot/EFI/</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">“</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Due to we cannot reproduce the issue, we are not sure which step cause the issue yet.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">So could you help me have a check with below step to narrow down the issue? Thanks.</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">1.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">Please help check whether there is “<span style="background:yellow;mso-highlight:yellow">install -D -m 755 grubx64.efi</span>” in the “loadbuild/std/results/slin14-starlingx-tis-r5-pike-std/grub2-2.02-0.76.el7.centos.tis.12/build.log”
or not.</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">2.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">Please help extract “grub2-efi-x64-pxeboot-2.02-0.76.el7.centos.tis.12.x86_64.rpm” in “loadbuild/std/rpmbuild/RPMS”, and check whether the grubx64.efi file is with 755 mode or not.</span><o:p></o:p></p>
<p class="MsoListParagraph"><span style="color:#1F497D">Extract cmd: rpm2cpio grub2-efi-x64-pxeboot-2.02-0.76.el7.centos.tis.12.x86_64.rpm | cpio -idmv</span><o:p></o:p></p>
<p class="MsoListParagraph" style="text-indent:-.25in"><span style="color:#1F497D">3.</span><span style="font-size:7.0pt">
</span><span style="color:#1F497D">Please help check the “grubx64.efi” in “export/dist/isolinux/pxeboot/EFI/” folder is with 755 mode or not.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">[0]: <a href="https://review.openstack.org/634559">
https://review.openstack.org/634559</a></span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<p class="MsoNormal"><span style="color:#1F497D">Best Regards</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Shuicheng</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Penney, Don [<a href="mailto:Don.Penney@windriver.com">mailto:Don.Penney@windriver.com</a>]
<br>
<b>Sent:</b> Thursday, February 14, 2019 6:01 AM<br>
<b>To:</b> Xie, Cindy <a href="mailto:cindy.xie@intel.com"><cindy.xie@intel.com></a>; Liu, Yang
<a href="mailto:yang.liu@windriver.com"><yang.liu@windriver.com></a><br>
<b>Cc:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a>; Cabrales, Ada
<a href="mailto:ada.cabrales@intel.com"><ada.cabrales@intel.com></a>; Waheed, Numan
<a href="mailto:Numan.Waheed@windriver.com"><Numan.Waheed@windriver.com></a>; Little, Scott
<a href="mailto:Scott.Little@windriver.com"><Scott.Little@windriver.com></a><br>
<b>Subject:</b> Re: [Starlingx-discuss] CentOS7.6 testing status - blocked<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Hi Cindy,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">In a successful case, you should see a TFTP log in daemon.log on the active controller indicating the file was transferred, such as:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">2019-02-12T13:20:45.000 controller-0 dnsmasq-tftp[200877]: info sent /pxeboot/EFI/grubx64.efi to 192.168.204.4</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">I would suggest doing something like “tail -f /var/log/daemon.log | grep -i tftp” while doing the installation of nodes from the active controller, to verify the expected file is getting transferred. If the host
installs and you don’t see this file transferred, I’d recommend reconfirming that the node is installing via UEFI.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Xie, Cindy [<a href="mailto:cindy.xie@intel.com">mailto:cindy.xie@intel.com</a>]
<br>
<b>Sent:</b> Wednesday, February 13, 2019 4:46 PM<br>
<b>To:</b> Liu, Yang<br>
<b>Cc:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a>; Cabrales, Ada; Waheed, Numan; Little, Scott<br>
<b>Subject:</b> Re: [Starlingx-discuss] CentOS7.6 testing status - blocked</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Hi, Yang <o:p></o:p></p>
<div>
<p class="MsoNormal">Sorry about the issue! It’s interesting as I did have my engineer tested the scenarios. There must be something missing from my side.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">We will redo the patch and test. In the same time, can you manually change the file permissions as temporarily workaround and unblock the test cycle?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Thanks! Cindy <o:p></o:p></p>
<div id="AppleMailSignature">
<p class="MsoNormal">Sent from my iPhone<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
On Feb 14, 2019, at 3:02 AM, Liu, Yang <<a href="mailto:yang.liu@windriver.com">yang.liu@windriver.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span style="color:#1F497D">Hi Cindy,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">We are still seeing the same file permission issue for grubx64.efi under pxeboot/EFI, causing UEFI pxeboot to fail.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">We need the grubx64.efi to be readable by others as well.
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">../pxeboot/EFI/</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">total 1220</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">drwxrwsr-x 3 jenkins mock 4096 Feb 12 16:48 .</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">drwxrwsr-x 3 jenkins mock 4096 Feb 12 16:48 ..</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">drwxrwsr-x 3 jenkins mock 4096 Feb 12 16:48 centos</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D;background:yellow;mso-highlight:yellow">-rwx------ 1 jenkins mock 1233016 Feb 12 16:37 grubx64.efi</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">The patch seems to have changed the dir permission for centos from 700 to 755, but not grubx64.efi.
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">For the dir permission for centos, I believe the original 700 should be sufficient (@Scott, please correct me if it’s wrong).</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">BR,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Yang</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Liu, Yang
<br>
<b>Sent:</b> February-12-19 9:00 AM<br>
<b>To:</b> 'Xie, Cindy'; <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a>; Cabrales, Ada; Waheed, Numan<br>
<b>Subject:</b> RE: CentOS7.6 testing status - blocked</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Thanks Cindy. Will do. </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">BR,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Yang </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Xie, Cindy [<a href="mailto:cindy.xie@intel.com">mailto:cindy.xie@intel.com</a>]
<br>
<b>Sent:</b> February-11-19 8:10 PM<br>
<b>To:</b> Liu, Yang; <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a>; Cabrales, Ada; Waheed, Numan<br>
<b>Subject:</b> RE: CentOS7.6 testing status - blocked</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Hi, Numan/Yang,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">The last pending patch (<a href="https://review.openstack.org/#/c/634559/">https://review.openstack.org/#/c/634559/</a>) which was blocking your testing (#</span><span lang="EN-CA">1814360) was just merged. Please
get new build ISO from Jason so you can continue the testing.</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">Thx. - cindy</span><o:p></o:p></p>
<p class="MsoNormal"><a name="_MailEndCompose"></a><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><a name="_____replyseparator"></a><b>From:</b> Liu, Yang [<a href="mailto:yang.liu@windriver.com">mailto:yang.liu@windriver.com</a>]
<br>
<b>Sent:</b> Saturday, February 9, 2019 10:18 AM<br>
<b>To:</b> Xie, Cindy <<a href="mailto:cindy.xie@intel.com">cindy.xie@intel.com</a>>;
<a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> RE: CentOS7.6 testing status - blocked<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Correct. </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">BR,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Yang</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Xie, Cindy [<a href="mailto:cindy.xie@intel.com">mailto:cindy.xie@intel.com</a>]
<br>
<b>Sent:</b> February-08-19 8:28 PM<br>
<b>To:</b> Liu, Yang; <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> RE: CentOS7.6 testing status - blocked</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Hi, Yang,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Thanks for the report.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Are the “two node system” below referring to Duplex? Just want to confirm because #1814360 we have a patch pending and we do want to ensure it works on Duplex as well.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Th.x - cindy</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Liu, Yang [<a href="mailto:yang.liu@windriver.com">mailto:yang.liu@windriver.com</a>]
<br>
<b>Sent:</b> Saturday, February 9, 2019 2:09 AM<br>
<b>To:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> [Starlingx-discuss] CentOS7.6 testing status - blocked<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">Hi folks,</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">Here’s an update for CentOS7.6 testing. </span>
<o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">We are currently blocked due to pxeboot from controller-0 does not work for EFI. (#1814360)</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">We will continue after that issue is resolved.</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="border-collapse:collapse">
<tbody>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">System</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border:solid windowtext 1.0pt;border-left:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">NICs</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">Mgmt;infra;data</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border:solid windowtext 1.0pt;border-left:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Special Configs</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border:solid windowtext 1.0pt;border-left:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Test coverage after Install and Config</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border:solid windowtext 1.0pt;border-left:none;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA">Status/Issues</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:35.3pt">
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:35.3pt">
<p class="MsoNormal"><span lang="EN-CA">Dedicated storage</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:35.3pt">
<p class="MsoNormal"><span lang="EN-CA">X540-AT2; X540-AT2; fortville</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:35.3pt">
<p class="MsoNormal"><span lang="EN-CA">IPv6</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:35.3pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity, nova</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in;height:35.3pt">
<p class="MsoNormal"><span lang="EN-CA">Completed. New issues logged.</span><o:p></o:p></p>
<p class="MsoNormal">#1814336 <a href="https://bugs.launchpad.net/starlingx/+bug/1814336">
CentOS7.6: Unable to launch vm directly from virsh</a> <o:p></o:p></p>
<p class="MsoNormal">#1814335 <a href="https://bugs.launchpad.net/starlingx/+bug/1814335">
CentOS7.6: Unable to launch vm with UEFI boot</a> <o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">One node system</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">none; none; X522/X577-AT</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA"> </span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity, basic regression</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA">Completed. Passed.</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Two node system </span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">fortville; fortville; fortville</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">tboot, tpm, https, </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">extended security profile</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity, security</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA" style="background:red;mso-highlight:red">Blocked by #1814360</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Multi-node system</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">BCM5720; Niantic; Niantic</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sriov(niantic),pcipt(niantic)</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity, networking</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA">Completed. Passed.</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Two node system</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Fortville; none; Fortville</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Low latency, UEFI</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity, basic regression, cyclictest</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA" style="background:red;mso-highlight:red">Blocked by #1814360</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Two node system</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Fortville; none; Fortville</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Secure boot</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity, security</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA" style="background:red;mso-highlight:red">Blocked by #1814360</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Multi-node system</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">I350; Niantic/cx3; cx3</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Pxeboot script</span><o:p></o:p></p>
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA">Sanity</span><o:p></o:p></p>
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA">Completed. Passed. </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">Only compute-0 was used, since compute-1 has CX3 data nic.</span><o:p></o:p></p>
</td>
</tr>
<tr>
<td width="179" valign="top" style="width:134.3pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA" style="background:silver;mso-highlight:silver">??</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal"><span lang="EN-CA" style="background:silver;mso-highlight:silver">CX4 on infra or mgmt, but NOT data
</span><o:p></o:p></p>
</td>
<td width="180" valign="top" style="width:134.65pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
</td>
<td width="208" valign="top" style="width:155.95pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt">
</td>
<td width="444" valign="top" style="width:333.1pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 0in 0in 0in">
<p class="MsoNormal"><span lang="EN-CA" style="background:silver;mso-highlight:silver">Won’t test. We don’t have a system have required nics.</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="EN-CA"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">BR,</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-CA">yang</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</blockquote>
</div>
</blockquote>
<p><o:p> </o:p></p>
</div>
</body>
</html>