Hi,
I have installed distributed starlingx 4.0 in "All in one Duplex" mode. There are two nodes in the central cloud and two in the edge cloud.
I have enabled SRIOV in bios settings of edge cloud nodes and set total VFs as 16.
After that, while installing starlingX I followed the steps to enable SRIOV.
system host-label-assign controller-0 sriovdp=enabled
system host-memory-modify controller-0 0 -1G 100
system host-memory-modify controller-0 1 -1G 100
and ran these steps for controller-1 as well.
As I understand the first step would label the node "controller-0 and controller-1" as "sriovdp=enabled" and set the number of 1G huge pages to 200.
Once the installation was complete, I saw that k8s sriov-device plugin was not coming up. It complained that the resource list was empty.
I had to set "/sys/devices/pci0000:3a/0000:3a:00.0/0000:3b:00.0/sriov_numvfs" to 8 (I needed 8 virtual interfaces) and update the resource list in
/etc/pcidp/config.json
{
"resourceList": [
{
"resourceName": "bcm_sriov_netdevice",
"selectors": {
"vendors": ["14e4"],
"devices": ["16dc"],
"drivers": ["bnxt_en"],
"pfNames": ["enp59s0f0#0-7"]
}
}
]
}
to see that sriov-dp comes up properly.
Is there any way to pass on the number of VF's( sriov_numvfs )required per node and resourcelist during the time of installation when we label the nodes as
sriovdp=enabled
Regards,
Sriram