<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body>
<div class="moz-cite-prefix">Upstream Kubernetes doesn't really know
how to handle "isolated" CPUs separately from "normal" CPUs.
Because of this sysinv will reserve the "application-isolated"
CPUs from use by Kubernetes when using the "static" CPU Manager
policy.</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">If you set the <span style="left:
180px; top: 738.491px; font-size: 16.6667px; font-family: serif;
transform: scaleX(1.11054);"></span><span style="left:
317.967px; top: 738.541px; font-size: 16.6667px; font-family:
serif; transform: scaleX(1.14001);">kube-<span class="highlight">cpu</span>-mgr-policy</span><span style="left: 479.05px; top: 738.491px; font-size: 16.6667px;
font-family: serif; transform: scaleX(1.09497);"> host label to
"none" (via Horizon or the "sysinv" CLI) Kubernetes will use the
default policy and should include the "application-isolated"
CPUs as part of the "Allocatable" cpu count. You'll have to
handle CPU affinity of containerized processes explicitly though
to ensure that they don't interfere with each other.</span></div>
<div class="moz-cite-prefix"><span style="left: 479.05px; top:
738.491px; font-size: 16.6667px; font-family: serif; transform:
scaleX(1.09497);"><br>
Commercial products based on StarlingX have support for isolated
CPUs with the "static" CPU Manager policy by modifying upstream
Kubernetes.</span><span style="left: 479.05px; top: 738.491px;
font-size: 16.6667px; font-family: serif; transform:
scaleX(1.09497);"><br>
</span></div>
<div class="moz-cite-prefix"></div>
<div class="moz-cite-prefix"><span style="left: 479.05px; top:
738.491px; font-size: 16.6667px; font-family: serif; transform:
scaleX(1.09497);"><br>
</span></div>
<div class="moz-cite-prefix"><span style="left: 479.05px; top:
738.491px; font-size: 16.6667px; font-family: serif; transform:
scaleX(1.09497);">Hope that helps,</span></div>
<div class="moz-cite-prefix"><span style="left: 479.05px; top:
738.491px; font-size: 16.6667px; font-family: serif; transform:
scaleX(1.09497);"><br>
</span></div>
<div class="moz-cite-prefix"><span style="left: 479.05px; top:
738.491px; font-size: 16.6667px; font-family: serif; transform:
scaleX(1.09497);">Chris<br>
</span></div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">On 2/18/2021 12:00 PM, Dharwadkar,
Sriram wrote:<br>
</div>
<blockquote type="cite" cite="mid:CH2PR14MB359603C58665EFE29F8F033DFE859@CH2PR14MB3596.namprd14.prod.outlook.com">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style>@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}div.WordSection1
{page:WordSection1;}</style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div>
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We are using Distributed-StarlingX-4.0. <o:p></o:p></p>
<p class="MsoNormal">Our use case requires pods to use
isolated cpu’s, so executed the
<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas;color:#172B4D;background:#F4F5F7">“system
host-cpu-modify -f application-isolated -p0 20
controller-0”
</span>command to isolate the cpus.<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas;color:#172B4D;background:#F4F5F7"><o:p> </o:p></span></p>
<p class="MsoNormal">system host-cpu-list controller-1<o:p></o:p></p>
<p class="MsoNormal">+--------------------------------------+----------+-----------+----------+--------+-------------------------------------------+----------------------+<o:p></o:p></p>
<p class="MsoNormal">| uuid |
log_core | processor | phy_core | thread |
processor_model |
assigned_function |<o:p></o:p></p>
<p class="MsoNormal">+--------------------------------------+----------+-----------+----------+--------+-------------------------------------------+----------------------+<o:p></o:p></p>
<p class="MsoNormal">| e64e0004-3096-40c7-804c-d9c79d2ceb17 |
0 | 0 | 0 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Platform |<o:p></o:p></p>
<p class="MsoNormal">| 28697ba9-c5e5-4d9b-9d97-346ec61c1fa7 |
1 | 0 | 1 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Platform |<o:p></o:p></p>
<p class="MsoNormal">| 1b111e2e-84e4-4414-870f-73c759ecbac0 |
2 | 0 | 2 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 66933896-5c9f-4e0a-9527-72025172e1f6 |
3 | 0 | 3 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 027258c8-392e-4497-9e46-6acb007e759f |
4 | 0 | 4 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 5d88a23a-68de-4062-9313-173fd91a4bc5 |
5 | 0 | 5 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| dd804bbb-191c-4499-bda1-272f9bb923af |
6 | 0 | 6 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 7ae2a90b-59ca-4af0-b20e-20635af0aceb |
7 | 0 | 8 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| ada68f62-4d06-43eb-8ed9-cd6ec6d33487 |
8 | 0 | 9 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 8c2612fd-8a7f-4732-82ff-fb4717ab9275 |
9 | 0 | 10 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 01412e4d-c9ff-41e8-8fd3-c2a0d27ac7a3 |
10 | 0 | 11 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| c8e8b15b-538b-422e-9d72-2ba96982054a |
11 | 0 | 12 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| b2efd166-3125-46b9-95ac-4fb00a0de3c7 |
12 | 0 | 13 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| c33f3dd7-0b06-40c3-93b3-82f065c6db05 |
13 | 0 | 16 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| e33cda3e-7162-45d4-af79-4dff7f0bb07f |
14 | 0 | 17 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 551b7272-371e-4c05-b5c8-7708f95d3a97 |
15 | 0 | 18 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| d0522e8f-ebd4-49fd-8a0e-26de857f2caf |
16 | 0 | 19 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 84dd71f2-ad7a-46bb-8ae2-e62b2a817cc5 |
17 | 0 | 20 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| f4761605-3208-4758-b31c-d679cb0b631e |
18 | 0 | 21 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 66423b6f-134b-4166-bdff-9643d4ec8d4d |
19 | 0 | 25 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 45d38571-ca97-4b89-b442-fe5f5282bc5f |
20 | 0 | 26 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| fc87bbd5-2954-4730-9f67-b8fe8820faa7 |
21 | 0 | 27 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
<p class="MsoNormal">| 6b3a8a78-d191-47fa-af82-15166a7924fc |
22 | 0 | 28 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application |<o:p></o:p></p>
<p class="MsoNormal">| 57739379-ab8f-4d3d-847a-f5aa9663bcfb |
23 | 0 | 29 | 0 | Intel(R) Xeon(R)
Gold 6212U CPU @ 2.40GHz | Application |<o:p></o:p></p>
<p class="MsoNormal">+--------------------------------------+----------+-----------+----------+--------+-------------------------------------------+----------------------+<o:p></o:p></p>
<p class="MsoNormal">But the k8s is not able to allocate
isolated cpus to pods. Allocatable cpus are only 2.<o:p></o:p></p>
<p class="MsoNormal"><o:p></o:p></p>
<p class="MsoNormal">controller-0:/home/sysadmin# kubectl get
node controller-0 -o json | jq '.status.allocatable'<o:p></o:p></p>
<p class="MsoNormal">{<o:p></o:p></p>
<p class="MsoNormal"><b> "cpu": "2",<o:p></o:p></b></p>
<p class="MsoNormal"> "ephemeral-storage": "9391196145",<o:p></o:p></p>
<p class="MsoNormal"> "hugepages-1Gi": "20Gi",<o:p></o:p></p>
<p class="MsoNormal"> "hugepages-2Mi": "0",<o:p></o:p></p>
<p class="MsoNormal"> "intel.com/pci_sriov_net_physnet0":
"32",<o:p></o:p></p>
<p class="MsoNormal"> "memory": "70207428Ki",<o:p></o:p></p>
<p class="MsoNormal"> "pods": "110"<o:p></o:p></p>
<p class="MsoNormal">}<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I saw this bug report, which seems to be
talking about the same issue.<o:p></o:p></p>
<p class="MsoNormal"><a href="https://bugs.launchpad.net/starlingx/+bug/1894173" moz-do-not-send="true">https://bugs.launchpad.net/starlingx/+bug/1894173</a><o:p></o:p></p>
<p class="MsoNormal">Kindly let me know when the fix is
planned. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">If there is any work around to solve this
issue, do let me know.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal">Sirram<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Starlingx-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Starlingx-discuss@lists.starlingx.io">Starlingx-discuss@lists.starlingx.io</a>
<a class="moz-txt-link-freetext" href="http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss">http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss</a>
</pre>
</blockquote>
<p><br>
</p>
</body>
</html>