[Starlingx-discuss] SRIOV in starlingx

[Sriram]

Hi,

I have installed distributed starlingx 4.0 in "All in one Duplex" mode.
There are two nodes in the central cloud and two in the edge cloud.

I have enabled SRIOV in bios settings of edge cloud nodes and set total VFs
as 16.

After that, while installing starlingX I followed the steps to enable SRIOV.

system host-label-assign controller-0 sriovdp=enabled
> system host-memory-modify controller-0 0 -1G 100
> system host-memory-modify controller-0 1 -1G 100

and ran these steps for controller-1 as well.

As I understand the first step would label the node "controller-0 and
controller-1" as "sriovdp=enabled" and set the number of 1G huge pages to
200.
Once the installation was complete, I saw that k8s sriov-device plugin was
not coming up. It complained that the resource list was empty.

I had to set
"/sys/devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/sriov_numvfs" to 8 (I
needed 8 virtual interfaces) and update the resource list in
/etc/pcidp/config.json

{
>   "resourceList": [
>             {
>                 "resourceName": "bcm_sriov_netdevice",
>                 "selectors": {
>                     "vendors": ["14e4"],
>                     "devices": ["16dc"],
>                     "drivers": ["bnxt_en"],
>                     "pfNames": ["enp59s0f0#0-7"]
>                 }
>              }
>     ]
> }


to see that sriov-dp comes up properly.

Is there any way to pass on the number of VF's( sriov_numvfs )required per
node and resourcelist during the time of installation when we label the
nodes as  sriovdp=enabled

Regards,
Sriram
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20200924/3011049b/attachment.html>