[root@controller-0 log(keystone_admin)]# kubectl logs kube-sriov-device-plugin-amd64-bt9pg -n kube-system | grep datanetmh1 "resourceName": "pci_sriov_net_datanetmh1", I0305 04:35:19.480450 542559 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc000260140} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c960 SelectorObj:0xc00014c820}] I0305 04:35:19.480544 542559 manager.go:193] validating resource name "intel.com/pci_sriov_net_datanetmh1" I0305 04:35:19.574001 542559 manager.go:116] Creating new ResourcePool: pci_sriov_net_datanetmh1 I0305 04:35:19.574062 542559 manager.go:145] New resource server is created for pci_sriov_net_datanetmh1 ResourcePool I0305 04:35:19.575458 542559 server.go:191] starting pci_sriov_net_datanetmh1 device plugin endpoint at: intel.com_pci_sriov_net_datanetmh1.sock I0305 04:35:19.575802 542559 server.go:217] pci_sriov_net_datanetmh1 device plugin endpoint started serving I0305 04:35:20.752363 542559 server.go:106] Plugin: intel.com_pci_sriov_net_datanetmh1.sock gets registered successfully at Kubelet I0305 04:35:20.752393 542559 server.go:131] ListAndWatch(pci_sriov_net_datanetmh1) invoked I0305 04:35:20.752402 542559 server.go:139] ListAndWatch(pci_sriov_net_datanetmh1): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:b1:0a.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},&Device{ID:0000:b1:0a.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:1,},},},},},} [root@controller-0 log(keystone_admin)]# kubectl logs kube-sriov-device-plugin-amd64-bt9pg -n kube-system | grep fec "resourceName": "intel_fpga_fec", I0305 04:35:19.480450 542559 manager.go:106] unmarshalled ResourceList: [{ResourcePrefix: ResourceName:pci_sriov_net_datanetdn1 DeviceType:netDevice Selectors:0xc00000c900 SelectorObj:0xc000260140} {ResourcePrefix: ResourceName:pci_sriov_net_datanetbh1 DeviceType:netDevice Selectors:0xc00000c920 SelectorObj:0xc0002601e0} {ResourcePrefix: ResourceName:pci_sriov_net_datanetmh1 DeviceType:netDevice Selectors:0xc00000c940 SelectorObj:0xc000260280} {ResourcePrefix: ResourceName:intel_fpga_fec DeviceType:accelerator Selectors:0xc00000c960 SelectorObj:0xc00014c820}] I0305 04:35:19.480552 542559 manager.go:193] validating resource name "intel.com/intel_fpga_fec" I0305 04:35:19.574069 542559 manager.go:116] Creating new ResourcePool: intel_fpga_fec I0305 04:35:19.574125 542559 manager.go:145] New resource server is created for intel_fpga_fec ResourcePool I0305 04:35:19.575847 542559 server.go:191] starting intel_fpga_fec device plugin endpoint at: intel.com_intel_fpga_fec.sock I0305 04:35:19.576201 542559 server.go:217] intel_fpga_fec device plugin endpoint started serving I0305 04:35:20.749833 542559 server.go:106] Plugin: intel.com_intel_fpga_fec.sock gets registered successfully at Kubelet I0305 04:35:20.749906 542559 server.go:131] ListAndWatch(intel_fpga_fec) invoked I0305 04:35:20.749917 542559 server.go:139] ListAndWatch(intel_fpga_fec): send devices &ListAndWatchResponse{Devices:[]*Device{&Device{ID:0000:1d:00.2,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.3,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.4,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.5,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.6,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.7,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:01.0,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},&Device{ID:0000:1d:00.1,Health:Healthy,Topology:&TopologyInfo{Nodes:[]*NUMANode{&NUMANode{ID:0,},},},},},} [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# vi /etc/pcidp/config.json [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# journalctl -u kubelet -- No entries -- [root@controller-0 log(keystone_admin)]# cd /var/log/ [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# grep -r "Started kubelet: The Kubernetes Node Agent" * [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]# [root@controller-0 log(keystone_admin)]#[root@controller-0 log(keystone_admin)]# kubectl describe nodes Name: controller-0 Roles: master Labels: armada=enabled beta.kubernetes.io/arch=amd64 beta.kubernetes.io/os=linux kubernetes.io/arch=amd64 kubernetes.io/hostname=controller-0 kubernetes.io/os=linux node-role.kubernetes.io/master= sriovdp=enabled Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/containerd/containerd.sock node.alpha.kubernetes.io/ttl: 0 projectcalico.org/IPv4Address: 192.168.206.2/24 projectcalico.org/IPv4IPIPTunnelAddr: 172.16.192.64 volumes.kubernetes.io/controller-managed-attach-detach: true CreationTimestamp: Thu, 04 Mar 2021 03:04:19 +0000 Taints: Unschedulable: false Lease: HolderIdentity: controller-0 AcquireTime: RenewTime: Fri, 05 Mar 2021 04:45:38 +0000 Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- NetworkUnavailable False Fri, 05 Mar 2021 03:27:46 +0000 Fri, 05 Mar 2021 03:27:46 +0000 CalicoIsUp Calico is running on this node MemoryPressure False Fri, 05 Mar 2021 03:28:31 +0000 Thu, 04 Mar 2021 17:17:02 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Fri, 05 Mar 2021 03:28:31 +0000 Thu, 04 Mar 2021 17:17:02 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Fri, 05 Mar 2021 03:28:31 +0000 Thu, 04 Mar 2021 17:17:02 +0000 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Fri, 05 Mar 2021 03:28:31 +0000 Thu, 04 Mar 2021 17:17:02 +0000 KubeletReady kubelet is posting ready status Addresses: InternalIP: 192.168.204.2 Hostname: controller-0 Capacity: cpu: 96 ephemeral-storage: 10255636Ki hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 memory: 97436736Ki pods: 110 Allocatable: cpu: 92 ephemeral-storage: 9451594122 hugepages-1Gi: 46Gi hugepages-2Mi: 0 intel.com/intel_fpga_fec: 0 intel.com/pci_sriov_net_datanet_c: 0 intel.com/pci_sriov_net_datanet_u: 0 intel.com/pci_sriov_net_datanetbh1: 8 intel.com/pci_sriov_net_datanetdn1: 8 intel.com/pci_sriov_net_datanetmh1: 8 memory: 40907840Ki pods: 110