unable to bring up the interfaces in simplex-controller-0 in libvirt
Hi, I am setting up starlingx simplex install in kvm libvirt in ubuntu 22.04 I have setup the libvirt and did setup network script and setupconfiguration -c simplex -i ./starling.iso but the interfaces are down and not assigning IP . I manually tried adding routes as mentioned in the documentation . still the internet is not working. i am not able to ping the gateway ip from the kvm machine. In the physical machine there is bond0 configuration. and I am not able to setup br0 because its conflicting bond0. can you advise how to proceed with this. Thanks -Vivek
Hi All, the below is the network setup in the hypervisor ubuntu 22.04 42: stxbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether fe:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff inet 10.10.10.1/24 scope global stxbr1 valid_lft forever preferred_lft forever inet6 fe80::c07e:1ff:fe3a:6669/64 scope link and below output is from the kvm simplex-controller-0 tagdevops@dal1:~/virtual-deployment/libvirt$ virsh console simplex-controller-0 Connected to domain 'simplex-controller-0' Escape character is ^] (Ctrl + ]) sysadmin@localhost:~$ ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 52:54:00:99:d8:b8 brd ff:ff:ff:ff:ff:ff inet 10.10.10.2/24 scope global enp3s0 valid_lft forever preferred_lft forever inet6 fe80::5054:ff:fe99:d8b8/64 scope link valid_lft forever preferred_lft forever 3: enp4s0: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:0e:d7:de brd ff:ff:ff:ff:ff:ff 4: enp2s1: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff 5: enp2s2: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:e0:36:93 brd ff:ff:ff:ff:ff:ff sysadmin@localhost:~$ ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. ^C --- 8.8.8.8 ping statistics --- 2 packets transmitted, 0 received, 100% packet loss, time 1000ms can you please assist with the networking of the controller. Thanks -Vivek On 2024-05-19 06:02, vivekanandan.rajendran.devops@tag.ooo wrote:
Hi, I am setting up starlingx simplex install in kvm libvirt in ubuntu 22.04 I have setup the libvirt and did setup network script and setupconfiguration -c simplex -i ./starling.iso but the interfaces are down and not assigning IP . I manually tried adding routes as mentioned in the documentation . still the internet is not working. i am not able to ping the gateway ip from the kvm machine. In the physical machine there is bond0 configuration. and I am not able to setup br0 because its conflicting bond0. can you advise how to proceed with this. Thanks -Vivek
On 2024-05-20 12:36, vivekanandan.rajendran.devops@tag.ooo wrote:
Hi All, the below is the network setup in the hypervisor ubuntu 22.04
42: stxbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether fe:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff inet 10.10.10.1/24 scope global stxbr1 valid_lft forever preferred_lft forever inet6 fe80::c07e:1ff:fe3a:6669/64 scope link
and below output is from the kvm simplex-controller-0
xxx@xxx:~/virtual-deployment/libvirt$ virsh console simplex-controller-0 Connected to domain 'simplex-controller-0' Escape character is ^] (Ctrl + ])
sysadmin@localhost:~$ ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 52:54:00:99:d8:b8 brd ff:ff:ff:ff:ff:ff inet 10.10.10.2/24 scope global enp3s0 valid_lft forever preferred_lft forever inet6 fe80::5054:ff:fe99:d8b8/64 scope link valid_lft forever preferred_lft forever 3: enp4s0: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:0e:d7:de brd ff:ff:ff:ff:ff:ff 4: enp2s1: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff 5: enp2s2: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:e0:36:93 brd ff:ff:ff:ff:ff:ff sysadmin@localhost:~$ ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. ^C --- 8.8.8.8 ping statistics --- 2 packets transmitted, 0 received, 100% packet loss, time 1000ms
can you please assist with the networking of the controller. Thanks -Vivek
On 2024-05-19 06:02, vivekanandan.rajendran.devops@tag.ooo wrote:
Hi, I am setting up starlingx simplex install in kvm libvirt in ubuntu 22.04 I have setup the libvirt and did setup network script and setupconfiguration -c simplex -i ./starling.iso but the interfaces are down and not assigning IP . I manually tried adding routes as mentioned in the documentation . still the internet is not working. i am not able to ping the gateway ip from the kvm machine. In the physical machine there is bond0 configuration. and I am not able to setup br0 because its conflicting bond0. can you advise how to proceed with this. Thanks -Vivek Hi All, Can anyone help on this. Its a potential blocker on my project. I can not proceed futher with the ansible playbook. Thanks -Vivek
Hi Vivek, In order of probably cause: also check in that: * the interface configured for OAM network (10.10.10.0/24) is attached to the stxbr1 (enp3s0 is configured in your example, but I usually have to configure enp2s1) * the controller has default route configured * the controller can ping the default route 10.10.10.1, * the controller can ping the host's default route, * ip forwarding is enabled on the host interfaces, and * iptables filter table default rule is "ACCEPT" on the FORWARD chain Here are some command examples that may not match the output of your virtual lab: controller:$ ip route | grep default default via 10.10.10.1 dev enp2s1 onlink controller:$ ping -c1 10.10.10.1 <snip> 1 packets transmitted, 1 received, 0% packet loss, time 0ms host:$ ip route | grep default default via xxx.xxx.xxx.xxx dev eth0 proto dhcp metric 100 controller:$ HOST_DEFAULT_ROUTE=xxx.xxx.xxx.xxx controller:$ ping -c1 $HOST_DEFAULT_ROUTE <snip> 1 packets transmitted, 1 received, 0% packet loss, time 0ms host:$ HOST_IF=eth0 host:$ cat /proc/sys/net/ipv4/ip_forward \ /proc/sys/net/ipv4/conf/all/forwarding \ /proc/sys/net/ipv4/conf/$HOST_IF/forwarding \ /proc/sys/net/ipv4/conf/stxbr1/forwarding 1 1 1 1 host:$ sudo iptables -nvL -t filter | grep FORWARD Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) M ________________________________ From: vivekanandan.rajendran.devops@tag.ooo <vivekanandan.rajendran.devops@tag.ooo> Sent: 20 May 2024 8:36 AM To: starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io> Subject: Re: unable to bring up the interfaces in simplex-controller-0 in libvirt CAUTION: This email comes from a non Wind River email account! Do not click links or open attachments unless you recognize the sender and know the content is safe. Hi All, the below is the network setup in the hypervisor ubuntu 22.04 42: stxbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether fe:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff inet 10.10.10.1/24 scope global stxbr1 valid_lft forever preferred_lft forever inet6 fe80::c07e:1ff:fe3a:6669/64 scope link and below output is from the kvm simplex-controller-0 tagdevops@dal1:~/virtual-deployment/libvirt$ virsh console simplex-controller-0 Connected to domain 'simplex-controller-0' Escape character is ^] (Ctrl + ]) sysadmin@localhost:~$ ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000 link/ether 52:54:00:99:d8:b8 brd ff:ff:ff:ff:ff:ff inet 10.10.10.2/24 scope global enp3s0 valid_lft forever preferred_lft forever inet6 fe80::5054:ff:fe99:d8b8/64 scope link valid_lft forever preferred_lft forever 3: enp4s0: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:0e:d7:de brd ff:ff:ff:ff:ff:ff 4: enp2s1: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff 5: enp2s2: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 link/ether 52:54:00:e0:36:93 brd ff:ff:ff:ff:ff:ff sysadmin@localhost:~$ ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. ^C --- 8.8.8.8 ping statistics --- 2 packets transmitted, 0 received, 100% packet loss, time 1000ms can you please assist with the networking of the controller. Thanks -Vivek On 2024-05-19 06:02, vivekanandan.rajendran.devops@tag.ooo wrote:
Hi, I am setting up starlingx simplex install in kvm libvirt in ubuntu 22.04 I have setup the libvirt and did setup network script and setupconfiguration -c simplex -i ./starling.iso but the interfaces are down and not assigning IP . I manually tried adding routes as mentioned in the documentation . still the internet is not working. i am not able to ping the gateway ip from the kvm machine. In the physical machine there is bond0 configuration. and I am not able to setup br0 because its conflicting bond0. can you advise how to proceed with this. Thanks -Vivek
On 2024-05-20 14:27, Thebeau, Michel wrote: > Hi Vivek, > > In order of probably cause: also check in that: > > * > the interface configured for OAM network (10.10.10.0/24) is attached > to the stxbr1 (enp3s0 is configured in your example, but I usually > have to configure enp2s1) > * > the controller has default route configured > * > the controller can ping the default route 10.10.10.1, > * > the controller can ping the host's default route, > * > ip forwarding is enabled on the host interfaces, and > * > iptables filter table default rule is "ACCEPT" on the FORWARD chain > > Here are some command examples that may not match the output of your > virtual lab: > > controller:$ ip route | grep default > default via 10.10.10.1 dev enp2s1 onlink > > controller:$ ping -c1 10.10.10.1 > <snip> > 1 packets transmitted, 1 received, 0% packet loss, time 0ms > > host:$ ip route | grep default > default via xxx.xxx.xxx.xxx dev eth0 proto dhcp metric 100 > > controller:$ HOST_DEFAULT_ROUTE=xxx.xxx.xxx.xxx > controller:$ ping -c1 $HOST_DEFAULT_ROUTE > <snip> > 1 packets transmitted, 1 received, 0% packet loss, time 0ms > > host:$ HOST_IF=eth0 > host:$ cat /proc/sys/net/ipv4/ip_forward \ > /proc/sys/net/ipv4/conf/all/forwarding \ > /proc/sys/net/ipv4/conf/$HOST_IF/forwarding \ > /proc/sys/net/ipv4/conf/stxbr1/forwarding > 1 > 1 > 1 > 1 > > host:$ sudo iptables -nvL -t filter | grep FORWARD > Chain FORWARD (policy ACCEPT 0 packets, 0 bytes) > > M > > ------------------------- > > From: vivekanandan.rajendran.devops@tag.ooo > <vivekanandan.rajendran.devops@tag.ooo> > Sent: 20 May 2024 8:36 AM > To: starlingx-discuss@lists.starlingx.io > <starlingx-discuss@lists.starlingx.io> > Subject: Re: unable to bring up the interfaces in simplex-controller-0 > in libvirt > > CAUTION: This email comes from a non Wind River email account! > Do not click links or open attachments unless you recognize the sender > and know the content is safe. > > Hi All, > the below is the network setup in the hypervisor ubuntu 22.04 > > 42: stxbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue > state UP group default qlen 1000 > link/ether fe:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff > inet 10.10.10.1/24 scope global stxbr1 > valid_lft forever preferred_lft forever > inet6 fe80::c07e:1ff:fe3a:6669/64 scope link > > and below output is from the kvm simplex-controller-0 > > tagdevops@dal1:~/virtual-deployment/libvirt$ virsh console > simplex-controller-0 > Connected to domain 'simplex-controller-0' > Escape character is ^] (Ctrl + ]) > > sysadmin@localhost:~$ ip a > 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN > group default qlen 1000 > link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 > inet 127.0.0.1/8 scope host lo > valid_lft forever preferred_lft forever > inet6 ::1/128 scope host > valid_lft forever preferred_lft forever > 2: enp3s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel > state UP group default qlen 1000 > link/ether 52:54:00:99:d8:b8 brd ff:ff:ff:ff:ff:ff > inet 10.10.10.2/24 scope global enp3s0 > valid_lft forever preferred_lft forever > inet6 fe80::5054:ff:fe99:d8b8/64 scope link > valid_lft forever preferred_lft forever > 3: enp4s0: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN > group default qlen 1000 > link/ether 52:54:00:0e:d7:de brd ff:ff:ff:ff:ff:ff > 4: enp2s1: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN > group default qlen 1000 > link/ether 52:54:00:ef:65:8a brd ff:ff:ff:ff:ff:ff > 5: enp2s2: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel state DOWN > group default qlen 1000 > link/ether 52:54:00:e0:36:93 brd ff:ff:ff:ff:ff:ff > sysadmin@localhost:~$ ping 8.8.8.8 > PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. > ^C > --- 8.8.8.8 ping statistics --- > 2 packets transmitted, 0 received, 100% packet loss, time 1000ms > > can you please assist with the networking of the controller. > Thanks > -Vivek > > On 2024-05-19 06:02, vivekanandan.rajendran.devops@tag.ooo wrote: >> Hi, >> I am setting up starlingx simplex install in kvm libvirt in ubuntu >> 22.04 I have setup the libvirt and did setup network script and >> setupconfiguration -c simplex -i ./starling.iso but the interfaces > are >> down and not assigning IP . I manually tried adding routes as > mentioned >> in the documentation . still the internet is not working. i am not > able >> to ping the gateway ip from the kvm machine. In the physical machine >> there is bond0 configuration. and I am not able to setup br0 because >> its conflicting bond0. can you advise how to proceed with this. >> Thanks >> -Vivek Hi Michel, Thanks for the advise. I have setup the routes in enp2s1 that solved the issue. Thank you so much. - Vivek
participants (2)
-
Thebeau, Michel
-
vivekanandan.rajendran.devops@tag.ooo