<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
  </head>
  <body>
    <div class="moz-cite-prefix">Upstream Kubernetes doesn't really know
      how to handle "isolated" CPUs separately from "normal" CPUs. 
      Because of this sysinv will reserve the "application-isolated"
      CPUs from use by Kubernetes when using the "static" CPU Manager
      policy.</div>
    <div class="moz-cite-prefix"><br>
    </div>
    <div class="moz-cite-prefix">If you set the <span style="left:
        180px; top: 738.491px; font-size: 16.6667px; font-family: serif;
        transform: scaleX(1.11054);"></span><span style="left:
        317.967px; top: 738.541px; font-size: 16.6667px; font-family:
        serif; transform: scaleX(1.14001);">kube-<span class="highlight">cpu</span>-mgr-policy</span><span style="left: 479.05px; top: 738.491px; font-size: 16.6667px;
        font-family: serif; transform: scaleX(1.09497);"> host label to
        "none" (via Horizon or the "sysinv" CLI) Kubernetes will use the
        default policy and should include the "application-isolated"
        CPUs as part of the "Allocatable" cpu count.  You'll have to
        handle CPU affinity of containerized processes explicitly though
        to ensure that they don't interfere with each other.</span></div>
    <div class="moz-cite-prefix"><span style="left: 479.05px; top:
        738.491px; font-size: 16.6667px; font-family: serif; transform:
        scaleX(1.09497);"><br>
        Commercial products based on StarlingX have support for isolated
        CPUs with the "static" CPU Manager policy by modifying upstream
        Kubernetes.</span><span style="left: 479.05px; top: 738.491px;
        font-size: 16.6667px; font-family: serif; transform:
        scaleX(1.09497);"><br>
      </span></div>
    <div class="moz-cite-prefix"></div>
    <div class="moz-cite-prefix"><span style="left: 479.05px; top:
        738.491px; font-size: 16.6667px; font-family: serif; transform:
        scaleX(1.09497);"><br>
      </span></div>
    <div class="moz-cite-prefix"><span style="left: 479.05px; top:
        738.491px; font-size: 16.6667px; font-family: serif; transform:
        scaleX(1.09497);">Hope that helps,</span></div>
    <div class="moz-cite-prefix"><span style="left: 479.05px; top:
        738.491px; font-size: 16.6667px; font-family: serif; transform:
        scaleX(1.09497);"><br>
      </span></div>
    <div class="moz-cite-prefix"><span style="left: 479.05px; top:
        738.491px; font-size: 16.6667px; font-family: serif; transform:
        scaleX(1.09497);">Chris<br>
      </span></div>
    <div class="moz-cite-prefix"><br>
    </div>
    <div class="moz-cite-prefix">On 2/18/2021 12:00 PM, Dharwadkar,
      Sriram wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:CH2PR14MB359603C58665EFE29F8F033DFE859@CH2PR14MB3596.namprd14.prod.outlook.com">
      
      <meta name="Generator" content="Microsoft Word 15 (filtered
        medium)">
      <style>@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}@font-face
        {font-family:Consolas;
        panose-1:2 11 6 9 2 2 4 3 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif;}a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:#0563C1;
        text-decoration:underline;}span.EmailStyle17
        {mso-style-type:personal-compose;
        font-family:"Calibri",sans-serif;
        color:windowtext;}.MsoChpDefault
        {mso-style-type:export-only;
        font-family:"Calibri",sans-serif;}div.WordSection1
        {page:WordSection1;}</style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
      <div>
        <div class="WordSection1">
          <p class="MsoNormal">Hi,<o:p></o:p></p>
          <p class="MsoNormal"><o:p> </o:p></p>
          <p class="MsoNormal">We are using Distributed-StarlingX-4.0. <o:p></o:p></p>
          <p class="MsoNormal">Our use case requires pods to use
            isolated cpu’s, so executed the
            <o:p></o:p></p>
          <p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas;color:#172B4D;background:#F4F5F7">“system
              host-cpu-modify -f application-isolated -p0 20
              controller-0”
            </span>command to isolate the cpus.<o:p></o:p></p>
          <p class="MsoNormal"><span style="font-size:10.5pt;font-family:Consolas;color:#172B4D;background:#F4F5F7"><o:p> </o:p></span></p>
          <p class="MsoNormal">system host-cpu-list controller-1<o:p></o:p></p>
          <p class="MsoNormal">+--------------------------------------+----------+-----------+----------+--------+-------------------------------------------+----------------------+<o:p></o:p></p>
          <p class="MsoNormal">| uuid                                 |
            log_core | processor | phy_core | thread |
            processor_model                           |
            assigned_function    |<o:p></o:p></p>
          <p class="MsoNormal">+--------------------------------------+----------+-----------+----------+--------+-------------------------------------------+----------------------+<o:p></o:p></p>
          <p class="MsoNormal">| e64e0004-3096-40c7-804c-d9c79d2ceb17 |
            0        | 0         | 0        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Platform             |<o:p></o:p></p>
          <p class="MsoNormal">| 28697ba9-c5e5-4d9b-9d97-346ec61c1fa7 |
            1        | 0         | 1        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Platform             |<o:p></o:p></p>
          <p class="MsoNormal">| 1b111e2e-84e4-4414-870f-73c759ecbac0 |
            2        | 0         | 2        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 66933896-5c9f-4e0a-9527-72025172e1f6 |
            3        | 0         | 3        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 027258c8-392e-4497-9e46-6acb007e759f |
            4        | 0         | 4        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 5d88a23a-68de-4062-9313-173fd91a4bc5 |
            5        | 0         | 5        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| dd804bbb-191c-4499-bda1-272f9bb923af |
            6        | 0         | 6        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 7ae2a90b-59ca-4af0-b20e-20635af0aceb |
            7        | 0         | 8        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| ada68f62-4d06-43eb-8ed9-cd6ec6d33487 |
            8        | 0         | 9        | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 8c2612fd-8a7f-4732-82ff-fb4717ab9275 |
            9        | 0         | 10       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 01412e4d-c9ff-41e8-8fd3-c2a0d27ac7a3 |
            10       | 0         | 11       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| c8e8b15b-538b-422e-9d72-2ba96982054a |
            11       | 0         | 12       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| b2efd166-3125-46b9-95ac-4fb00a0de3c7 |
            12       | 0         | 13       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| c33f3dd7-0b06-40c3-93b3-82f065c6db05 |
            13       | 0         | 16       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| e33cda3e-7162-45d4-af79-4dff7f0bb07f |
            14       | 0         | 17       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 551b7272-371e-4c05-b5c8-7708f95d3a97 |
            15       | 0         | 18       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| d0522e8f-ebd4-49fd-8a0e-26de857f2caf |
            16       | 0         | 19       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 84dd71f2-ad7a-46bb-8ae2-e62b2a817cc5 |
            17       | 0         | 20       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| f4761605-3208-4758-b31c-d679cb0b631e |
            18       | 0         | 21       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 66423b6f-134b-4166-bdff-9643d4ec8d4d |
            19       | 0         | 25       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 45d38571-ca97-4b89-b442-fe5f5282bc5f |
            20       | 0         | 26       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| fc87bbd5-2954-4730-9f67-b8fe8820faa7 |
            21       | 0         | 27       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application-isolated |<o:p></o:p></p>
          <p class="MsoNormal">| 6b3a8a78-d191-47fa-af82-15166a7924fc |
            22       | 0         | 28       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application          |<o:p></o:p></p>
          <p class="MsoNormal">| 57739379-ab8f-4d3d-847a-f5aa9663bcfb |
            23       | 0         | 29       | 0      | Intel(R) Xeon(R)
            Gold 6212U CPU @ 2.40GHz | Application          |<o:p></o:p></p>
          <p class="MsoNormal">+--------------------------------------+----------+-----------+----------+--------+-------------------------------------------+----------------------+<o:p></o:p></p>
          <p class="MsoNormal">But the k8s is not able to allocate
            isolated cpus to pods. Allocatable cpus are only 2.<o:p></o:p></p>
          <p class="MsoNormal"><o:p></o:p></p>
          <p class="MsoNormal">controller-0:/home/sysadmin# kubectl get
            node controller-0 -o json | jq '.status.allocatable'<o:p></o:p></p>
          <p class="MsoNormal">{<o:p></o:p></p>
          <p class="MsoNormal"><b>  "cpu": "2",<o:p></o:p></b></p>
          <p class="MsoNormal">  "ephemeral-storage": "9391196145",<o:p></o:p></p>
          <p class="MsoNormal">  "hugepages-1Gi": "20Gi",<o:p></o:p></p>
          <p class="MsoNormal">  "hugepages-2Mi": "0",<o:p></o:p></p>
          <p class="MsoNormal">  "intel.com/pci_sriov_net_physnet0":
            "32",<o:p></o:p></p>
          <p class="MsoNormal">  "memory": "70207428Ki",<o:p></o:p></p>
          <p class="MsoNormal">  "pods": "110"<o:p></o:p></p>
          <p class="MsoNormal">}<o:p></o:p></p>
          <p class="MsoNormal"><o:p> </o:p></p>
          <p class="MsoNormal"><o:p> </o:p></p>
          <p class="MsoNormal">I saw this bug report, which seems to be
            talking about the same issue.<o:p></o:p></p>
          <p class="MsoNormal"><a href="https://bugs.launchpad.net/starlingx/+bug/1894173" moz-do-not-send="true">https://bugs.launchpad.net/starlingx/+bug/1894173</a><o:p></o:p></p>
          <p class="MsoNormal">Kindly let me know when the fix is
            planned. <o:p></o:p></p>
          <p class="MsoNormal"><o:p> </o:p></p>
          <p class="MsoNormal">If there is any work around to solve this
            issue, do let me know.<o:p></o:p></p>
          <p class="MsoNormal"><o:p> </o:p></p>
          <p class="MsoNormal">Regards,<o:p></o:p></p>
          <p class="MsoNormal">Sirram<o:p></o:p></p>
          <p class="MsoNormal"><o:p> </o:p></p>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
Starlingx-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Starlingx-discuss@lists.starlingx.io">Starlingx-discuss@lists.starlingx.io</a>
<a class="moz-txt-link-freetext" href="http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss">http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss</a>
</pre>
    </blockquote>
    <p><br>
    </p>
  </body>
</html>