<div dir="ltr"><div>Hi Austin,</div><div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Aug 15, 2021 at 7:04 AM Sun, Austin <<a href="mailto:austin.sun@intel.com">austin.sun@intel.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">





<div style="overflow-wrap: break-word;" lang="EN-US">
<div class="gmail-m_-7087066787567159926WordSection1">
<p class="MsoNormal">Hi Danishka:<u></u><u></u></p>
<p class="MsoNormal" style="text-indent:9.75pt">Mariadb-server-0 is new leading ,  but I did find any clue of server-1 crash info from log [1].
<u></u><u></u></p>
<p class="MsoNormal" style="text-indent:9.75pt"><u></u> <u></u></p>
<p class="MsoNormal">Are controllers available and any alarms ?  <u></u><u></u></p>
<p class="MsoNormal" style="text-indent:9.75pt"><u></u> </p></div></div></blockquote><div><br></div><div>Both controllers active and no alarms against controllers but 'Application Apply Failure' (stx -openstack)</div><div>I have deleted all MariaDB pods, expecting new pods to be created by Kubernetes.</div><div>But same result.</div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;" lang="EN-US"><div class="gmail-m_-7087066787567159926WordSection1"><p class="MsoNormal" style="text-indent:9.75pt"><u></u></p>
<p class="MsoNormal" style="text-indent:9.75pt"><u></u> <u></u></p>
<p class="MsoNormal" style="text-indent:9.75pt"><u></u> <u></u></p>
<p class="MsoNormal" style="text-indent:9.75pt">[1] <a href="https://paste.opendev.org/show/808067/" target="_blank">
https://paste.opendev.org/show/808067/</a><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks.<br>
BR<br>
Austin Sun. <u></u><u></u></p>
<div style="border-color:rgb(225,225,225) currentcolor currentcolor;border-style:solid none none;border-width:1pt medium medium;padding:3pt 0in 0in">
<p class="MsoNormal"><b>From:</b> open infra <<a href="mailto:openinfradn@gmail.com" target="_blank">openinfradn@gmail.com</a>> <br>
<b>Sent:</b> Saturday, August 14, 2021 2:27 PM<br>
<b>To:</b> <a href="mailto:starlingx-discuss@lists.starlingx.io" target="_blank">starlingx-discuss@lists.starlingx.io</a><br>
<b>Subject:</b> [Starlingx-discuss] Need a help to recover Openstack Inbox | specific pod is failing<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<p style="margin:0in"><span style="font-size:8.5pt;font-family:Menlo;color:black">Hi,<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">Openstack was failed and noticed that mariadb-server-1 pod is failing.<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">openstack      mariadb-server-0            0/1     Running <u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">openstack      mariadb-server-1            0/1     CrashLoopBackOff <u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">I managed to get logs of each pod.<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">mariadb-server-0 log:<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><a href="https://paste.opendev.org/show/808070/" target="_blank">https://paste.opendev.org/show/808070/</a><u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">and<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><a href="https://paste.opendev.org/show/808071/" target="_blank">https://paste.opendev.org/show/808071/</a><u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">mariadb-server-1 log:<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><a href="https://paste.opendev.org/show/808067/" target="_blank">https://paste.opendev.org/show/808067/</a><u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">I highly appreciate if I can get a hint or steps to resolve this issue.<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">Regards,<u></u><u></u></span></p>
<p style="margin:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black">Danishka<u></u><u></u></span></p>
<div>
<p style="margin-right:0in;margin-bottom:12pt;margin-left:0in;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal">
<span style="font-size:8.5pt;font-family:Menlo;color:black"><u></u> <u></u></span></p>
</div>
</div>
</div>

</blockquote></div></div>