<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Gulim;
panose-1:2 11 6 0 0 1 1 1 1 1;}
@font-face
{font-family:Gulim;
panose-1:2 11 6 0 0 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Helvetica Neue";}
@font-face
{font-family:"\@Gulim";
panose-1:2 11 6 0 0 1 1 1 1 1;}
@font-face
{font-family:"Malgun Gothic";
panose-1:2 11 5 3 2 0 0 2 0 4;}
@font-face
{font-family:"\@Malgun Gothic";
panose-1:2 11 5 3 2 0 0 2 0 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:2081441184;
mso-list-template-ids:-1320109082;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">That alarm is indication that Maintenance is failing Heartbeat over the Management network.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Please check your network and maybe specifically its support for multicast messaging.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">If you lock controller-1 can you ping it from the active controller.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">If you need further assistance please provide the active controller’s mtcAgent.log and hbsAgent.log files<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">You can always run ‘collect’ or ‘collect all’ on the active controller to get a summary of the system state and use those logs for off system debug of your
issue.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Eric MacDonald.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Hu, Yong [mailto:yong.hu@intel.com]
<br>
<b>Sent:</b> Monday, March 25, 2019 11:48 PM<br>
<b>To:</b> Sun, Austin; </span><span style="font-size:10.0pt;font-family:"Gulim","sans-serif"">오재욱</span><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">; starlingx-discuss<br>
<b>Subject:</b> Re: [Starlingx-discuss] Fwd: [starlingx-discuss] [critical error after deployment] About "persistent critical 'Management Network'"<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Jaewook,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">I just now looked through your puppet log, and there was no error message at all.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Though the alarm was about “management network” communication failure, the essence of problem might be just about controller-1 was not under a right state.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Anyway, we guess maybe something wrong with ovs on your controller-1 and it led controller-1 unlock failure.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">You can have a check with these stuffs:<o:p></o:p></span></p>
<ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Check if any errors are in “/var/log/openvswitch/ovs-vswitchd.log” in controller-1<o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Run “sudo ovs-vsctl show” on controller-1<o:p></o:p></span></li></ol>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Yong<o:p></o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="color:black">From: </span></b><span style="color:black">"Sun, Austin" <austin.sun@intel.com><br>
<b>Date: </b>Tuesday, 26 March 2019 at 11:31 AM<br>
<b>To: </b></span><span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";color:black;mso-fareast-language:ZH-CN">오재욱</span><span style="color:black"> <kyle.oh95@gmail.com>, starlingx-discuss <starlingx-discuss@lists.starlingx.io><br>
<b>Subject: </b>Re: [Starlingx-discuss] Fwd: [starlingx-discuss] [critical error after deployment] About "persistent critical 'Management Network'"<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi Jaewook:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Could you run ‘system host-list’ or ‘system host-show controller-1’ to see the status of controller-1? Is it available degrade or others ?</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">BR<br>
Austin Sun. </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">
</span><span lang="ZH-CN" style="font-size:11.0pt;font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">오재욱</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> [mailto:kyle.oh95@gmail.com]
<br>
<b>Sent:</b> Tuesday, March 26, 2019 10:59 AM<br>
<b>To:</b> starlingx-discuss <starlingx-discuss@lists.starlingx.io><br>
<b>Subject:</b> [Starlingx-discuss] Fwd: [starlingx-discuss] [critical error after deployment] About "persistent critical 'Management Network'"</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">---------- Forwarded message ---------<br>
<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">보낸사람</span>:
<strong><span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">오재욱</span></strong> <<a href="mailto:kyle.oh95@gmail.com">kyle.oh95@gmail.com</a>><br>
Date: 2019<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">년</span> 3<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">월</span> 26<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">일</span>
(<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">화</span>)
<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">
오전</span> 11:58<br>
Subject: Re: [Starlingx-discuss] [starlingx-discuss] [critical error after deployment] About "persistent critical 'Management Network'"<br>
To: Hu, Yong <<a href="mailto:yong.hu@intel.com">yong.hu@intel.com</a>><o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Hi Yong,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Umm I think the controller0 was completely installed, but the controller1 was not.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">When I unlocked the controller1, fm alarm shows the error.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">So it does mean the controller1 was not completely installed.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">If so, do you think there is a reason for the installation not being completed elsewhere?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Thank you for help,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">BR,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Jaewook.<o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">2019<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">년</span> 3<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">월</span> 26<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">일</span>
(<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">화</span>)
<span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">
오전</span> 11:53, Hu, Yong <<a href="mailto:yong.hu@intel.com" target="_blank">yong.hu@intel.com</a>><span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">님이</span><span lang="ZH-CN" style="mso-fareast-language:ZH-CN">
</span><span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";mso-fareast-language:ZH-CN">작성</span>:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Have you installed 2 controllers already?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If by far you only setup 1 controller, this alarm seems reasonable because it expects to communicate with another controller through mgt network.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Regards,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Yong<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span style="color:black">From:
</span></b><span lang="ZH-CN" style="font-family:"Malgun Gothic","sans-serif";color:black;mso-fareast-language:ZH-CN">오재욱</span><span style="color:black"> <<a href="mailto:kyle.oh95@gmail.com" target="_blank">kyle.oh95@gmail.com</a>><br>
<b>Date: </b>Tuesday, 26 March 2019 at 10:45 AM<br>
<b>To: </b>starlingx-discuss <<a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a>><br>
<b>Subject: </b>[Starlingx-discuss] [starlingx-discuss] [critical error after deployment] About "persistent critical 'Management Network'"</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hello StarlingX Teams,
<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I finally deployed duplex starlingx model on two physical servers.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">However, it was not truly deployed. The "all-in-one controller-1" has deploy failed, <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The fault management alarm shows, <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">200.005 <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#666666">Failure: <hostname> is experiencing a persistent critical 'Management Network' communication failure."</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">And I think above fault is the main reason of deploy failed </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">I followed BIOS Setup for all nodes,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">and used Feb 22 iso images.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">I have no idea what can I do :(</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Any help would be very appreciated.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Best Regards,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="color:black">Jaewook.</span> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.5pt;color:black">================================================<br>
<b>Jaewook Oh</b> (</span><span lang="ZH-CN" style="font-size:11.5pt;font-family:"Malgun Gothic","sans-serif";color:black;mso-fareast-language:ZH-CN">오재욱</span><span style="font-size:11.5pt;color:black">)<br>
IISTRC - Internet Infra System Technology Research Center<br>
369 Sangdo-ro, Dongjak-gu,<br>
06978, Seoul, Republic of Korea</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<p class="MsoNormal"><br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.5pt;font-family:"Calibri","sans-serif";color:black">================================================<br>
<b>Jaewook Oh</b> (</span><span lang="ZH-CN" style="font-size:11.5pt;font-family:"Malgun Gothic","sans-serif";color:black;mso-fareast-language:ZH-CN">오재욱</span><span style="font-size:11.5pt;font-family:"Calibri","sans-serif";color:black">)<br>
IISTRC - Internet Infra System Technology Research Center<br>
369 Sangdo-ro, Dongjak-gu,<br>
06978, Seoul, Republic of Korea</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>