<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">What causing this horizon issue, any pointers to debug it ?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Alarms:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoTableGrid" border="1" cellspacing="0" cellpadding="0" style="border-collapse:collapse;border:none">
<tbody>
<tr>
<td width="623" valign="top" style="width:467.5pt;border:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal">+----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+<o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">+----------+--------------------------------------------------------------------------+------------------------------+----------+---------------------+</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| 100.114 | NTP cannot reach external time source; syncing with peer controller only | host=controller-1.ntp | minor | 2021-03-27T06:31:53 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | .869431 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-1.ntp=10.194 | minor | 2021-03-25T17:51:56 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | .248.250 | | .064694 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| 100.114 | NTP address 10.194.248.250 is not a valid or a reachable NTP server. | host=controller-0.ntp=10.194 | minor | 2021-03-25T06:32:26 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | .248.250 | | .035234 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| 280.001 | edge is offline | subcloud=edge | critical | 2021-03-20T14:19:25 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | .650795 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| 100.114 | NTP configuration does not contain any valid or reachable NTP servers. | host=controller-0.ntp | major | 2021-02-20T13:11:39 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | .604729 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| 100.103 | Platform Memory threshold exceeded ; threshold 90.00%, actual 98.86% | host=controller-0 | critical | 2021-02-20T11:34:39 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | | .542948 |</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">| | | | |
</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Horizon Logs:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<table class="MsoTableGrid" border="1" cellspacing="0" cellpadding="0" style="border-collapse:collapse;border:none">
<tbody>
<tr>
<td width="791" valign="top" style="width:593.6pt;border:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt">
<p class="MsoNormal">2021-03-27 06:45:04,26<span style="color:black">4 [ERROR] django.request: Internal Server Error: /admin/</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">Traceback (most recent call last):</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> response = get_response(request)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> response = self.process_exception_by_middleware(e, request)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> response = wrapped_callback(request, *callback_args, **callback_kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 52, in dec</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return view_func(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return view_func(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 36, in dec</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return view_func(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 113, in dec</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return view_func(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/decorators.py", line 84, in dec</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return view_func(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 68, in view</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return self.dispatch(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 88, in dispatch</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return handler(request, *args, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 120, in get</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> self.load_tabs()</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/tabs/views.py", line 88, in load_tabs</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> tab_group = self.get_tabs(self.request, **self.kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/views.py", line 36, in get_tabs</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return self.tab_group_class(request, **kwargs)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 118, in __init__</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> self._tabs = self._load_tabs(request)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 128, in _load_tabs</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> for tab in tabs])</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 479, in __init__</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> super(TableTab, self).__init__(tab_group, request)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/horizon/tabs/base.py", line 325, in __init__</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> self._allowed = self.allowed(request) and (</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/starlingx_dashboard/dashboards/admin/inventory/tabs.py", line 227, in allowed</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return not stx_api.sysinv.is_system_mode_simplex(request)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 2656, in is_system_mode_simplex</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> systems = system_list(request)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib/python2.7/site-packages/starlingx_dashboard/api/sysinv.py", line 1045, in system_list</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> systems = cgtsclient(request).isystem.list()</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib64/python2.7/site-packages/cgtsclient/v1/isystem.py", line 30, in list</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> return self._list(self._path(), "isystems")</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib64/python2.7/site-packages/cgtsclient/common/base.py", line 71, in _list</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> _, body = self.api.json_request('GET', url)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 245, in json_request</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> self.authenticate()</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 347, in authenticate</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> content_type="application/json")</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> File "/usr/lib64/python2.7/site-packages/cgtsclient/common/http.py", line 219, in _cs_request</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black"> error_json.get('debuginfo'), *args)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">HTTPNotFound: None</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">^C</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">controller-0:~$</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Ankush<o:p></o:p></p>
</div>
</body>
</html>