<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
p.MsoPlainText, li.MsoPlainText, div.MsoPlainText
{mso-style-priority:99;
mso-style-link:"Plain Text Char";
margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.PlainTextChar
{mso-style-name:"Plain Text Char";
mso-style-priority:99;
mso-style-link:"Plain Text";
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-IN;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-IN" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">The reason I bring out this concern is even <b>dockerd</b> seem to be running on isolated cores. For some reason the scheduler seem to be completely ignoring
<b>isolcpus</b>. Is that correct?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The impact here is that we have certain 100% poll threads that needs to be scheduled on couple of CPUs and we do not have a clue on where to allocate because of this behaviour. Any comments are appreciated. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><img width="800" height="121" style="width:8.3333in;height:1.2604in" id="Picture_x0020_1" src="cid:image001.jpg@01D7114F.2BCF1840"><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span lang="EN-US" style="mso-fareast-language:EN-IN">From:</span></b><span lang="EN-US" style="mso-fareast-language:EN-IN"> Venkata Ramana Veldanda
<br>
<b>Sent:</b> Thursday, March 4, 2021 7:21 PM<br>
<b>To:</b> starlingx-discuss@lists.starlingx.io<br>
<b>Cc:</b> Srinivas Sadagopan <Srinivas.Sadagopan@radisys.com><br>
<b>Subject:</b> CPU Isolation discrepancy <o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoPlainText">Hi<o:p></o:p></p>
<p class="MsoPlainText">I am running StarlingX 4.0 in <b>Low Latency</b> Mode in AIO-SX. We have isolated CPUs for application as below using the supported way. However, we can<span lang="EN-US"> see that kubelet treads are scheduled on application isolated
vcpus - Ex: 49, 50, 75. <o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US">Could someone explain the behavior here?. Full log is attached.
<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">controller-0:/home/sysadmin# cat /proc/cmdline<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">BOOT_IMAGE=/vmlinuz-4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64 root=UUID=837a0268-a574-45ea-b560-a6e5afc483dd ro security_profile=standard module_blacklist=integrity,ima audit=0 tboot=false crashkernel=auto
biosdevname=0 console=tty0 iommu=pt usbcore.autosuspend=-1 selinux=0 enforcing=0 nmi_watchdog=0 softlockup_panic=0 intel_iommu=on user_namespace.enable=1 skew_tick=1 hugepagesz=1G hugepages=47 hugepagesz=2M hugepages=0 default_hugepagesz=1G irqaffinity=0,24,48,72
rcu_nocbs=1-23,25-47,49-71,73-95 nohz_full=1-23,25-47,49-71,73-95 <span style="background:yellow;mso-highlight:yellow">
isolcpus=1-22,25-46,49-70,73-94</span> kthread_cpus=0,24,48,72 nopti nospectre_v2 nospectre_v1<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">[root@controller-0 sysadmin(keystone_admin)]# pidstat -t -p 134731<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">Linux 4.18.0-147.3.1.rt24.96.el8_1.tis.8.x86_64 (controller-0) 03/03/2021 _x86_64_(96 CPU)<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow">01:26:28 AM 0 - 145642 0.00 0.00 0.00 0.00 50 |__kubelet<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">01:26:28 AM 0 - 145643 0.01 0.01 0.00 0.02 72 |__kubelet<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">01:26:28 AM 0 - 146196 0.05 0.03 0.00 0.08 24 |__kubelet<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow">01:26:28 AM 0 - 147027 0.00 0.00 0.00 0.00 75 |__kubelet<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow">01:26:28 AM 0 - 147028 0.00 0.00 0.00 0.00 49 |__kubelet<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoPlainText"><span style="font-family:"Courier New"">system host-cpu-list controller-0</span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow">| 456f11f6-231f-4c6a-b9d9-fa35a6f6bff6 | 49 | 0 | 1 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">| | | | | | @ 3.00GHz | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">| | | | | | | |<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow">| d491dd29-8603-4bf1-8620-9fbdde5d5d38 | 50 | 0 | 2 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated |<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";background:yellow;mso-highlight:yellow">| 94bb8566-e726-418a-ae1f-3264807bfbcd | 75 | 1 | 3 | 1 | Intel(R) Xeon(R) Gold 6248R CPU | Application-isolated |<o:p></o:p></span></p>
<p class="MsoPlainText"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-IN">Venkata Veldanda
<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>