[Starlingx-discuss] Intentions toward enhancements for Starlingx Libvirt deployment method host utilization

Mon Jul 10 12:08:09 UTC 2023

Good morning Bruno,

Thank you.  I am aware of the VirtualBox deployment method and the work of your team members.

"Basically, for now, we don't remove all the detailed procedures"

The installation guides of Starlingx present a "lesson" in the use of Starlingx for those who are exploring the project.  Please consider keeping and maintaining these guides as "canonical" examples of deploying Starlingx.

Our libvirt and VirtualBox deployment methods are intended to make Starlingx more accessible to those who are learning about the project: not requiring them to have dedicated hardware to explore Starlingx.  In this sense, you may consider my intentions towards the libvirt deployment method to include this intention: to have no impact on the canonical examples.

M

________________________________
From: Bruno Drugowick Muniz <Bruno.Muniz at encora.com>
Sent: 04 July 2023 3:17 PM
To: Thebeau, Michel <Michel.Thebeau at windriver.com>; starlingx-discuss at lists.starlingx.io <starlingx-discuss at lists.starlingx.io>
Subject: Re: Intentions toward enhancements for Starlingx Libvirt deployment method host utilization

CAUTION: This email comes from a non Wind River email account!
Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hello, Mitch.

  *   "Please let me know I should follow a particular procedure.  Otherwise I intend to create a story in storyboard."

I believe that's the way to go. Just so you know, for the work under the /virtualbox directory of the same repository, we used the original story<https://urldefense.com/v3/__https://storyboard.openstack.org/*!/story/2005051__;Iw!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9ch8-6eg0$> with the Task that merged the code back in 2019, adding new Tasks to it.

Regarding the "Install StarlingX Kubernetes in a virtual environment" page, you might want to look at what we're proposing at https://review.opendev.org/c/starlingx/docs/+/886178<https://urldefense.com/v3/__https://review.opendev.org/c/starlingx/docs/*/886178__;Kw!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9cjAbdLR8$>. Basically, for now, we don't remove all the detailed procedures but provide an additional "automated install" guide at the top.

Regards,
Bruno.
________________________________
From: Thebeau, Michel <Michel.Thebeau at windriver.com>
Sent: Wednesday, June 28, 2023 16:50
To: starlingx-discuss at lists.starlingx.io <starlingx-discuss at lists.starlingx.io>
Subject: [Starlingx-discuss] Intentions toward enhancements for Starlingx Libvirt deployment method host utilization

You don't often get email from michel.thebeau at windriver.com. Learn why this is important<https://urldefense.com/v3/__https://aka.ms/LearnAboutSenderIdentification__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9cXOHYvsI$>
External Mail: Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hi,

I prepared the following description of enhancements I intend towards the libvirt virtual deployment method.  Please let me know I should follow a particular procedure.  Otherwise I intend to create a story in storyboard.

Mitch.
===
Starlingx Libvirt deployment method host utilization enhancements

References:
"Install StarlingX Kubernetes in a virtual environment" - https://docs.starlingx.io/deploy_install_guides/release/index-install-r7-8966076f0e81.html#index-install-r7-8966076f0e81<https://urldefense.com/v3/__https://docs.starlingx.io/deploy_install_guides/release/index-install-r7-8966076f0e81.html*index-install-r7-8966076f0e81__;Iw!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9c5fhrqXY$>
Libvirt deployment method in starlingx/tools - https://opendev.org/starlingx/tools/src/branch/master/deployment/libvirt<https://urldefense.com/v3/__https://opendev.org/starlingx/tools/src/branch/master/deployment/libvirt__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9cT-wq3Gs$>
Libvirt deployment method moved this week to starlingx/virtual-deployment - https://opendev.org/starlingx/virtual-deployment/src/branch/master/libvirt<https://urldefense.com/v3/__https://opendev.org/starlingx/virtual-deployment/src/branch/master/libvirt__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9cNsICzsI$>

Motivation is to:
 A) maintain attributes for more than one virtual lab
 B) improve the usage and selection of the host's resources for disk, memory and cpu
 C) isolate cluster networks where more than one virtual lab may be running

Philosophy of continuity:
Introduce changes and developments in continuity with established examples and approaches.
 - Maintain the existing examples for default setting and the 'mad' override.
 - Establish regression test based on the default setting and 'mad' override to ensure that a user of the deployment method can continue to do the same thing they used to do.
 - Maintain and extend the use of overridable variable definitions for the attributes of a lab.
 - Maintain and extend the use of command line parameters for configuration selection, such as "-c 'simplex'".
 - Maintain and extend the existing workflow: "exporting variables, setup_network.sh<https://urldefense.com/v3/__http://setup_network.sh__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9cwygZXHk$>, setup_configation.sh<https://urldefense.com/v3/__http://setup_configation.sh__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9c4LSHYJU$>, destroy_configuration.sh<https://urldefense.com/v3/__http://destroy_configuration.sh__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9csZDYZHk$>, destroy_network.sh".

A) Maintain configurations for more than one virtual cluster:

Motivation: allow a lab's attributes to be recalled from a configuration file and operate upon that lab specifically.

Establish a precedent for a configuration file used to override the default attributes.  Refer to the README.rst "Overview" section which lists environment variables CONTROLLER, WORKER, BRIDGE_INTERFACE, EXTERNAL_NETWORK, EXTERNAL_IP.

Provide a default configuration file that will reset the variables to defaults as they currently exist within the deployment/libvirt scripts, including:

    BRIDGE_INTERFACE=${BRIDGE_INTERFACE:-stxbr}
    EXTERNAL_NETWORK=${EXTERNAL_NETWORK:-10.10.10.0/24}
    EXTERNAL_IP=${EXTERNAL_IP:-10.10.10.1/24}
    CONFIGURATION=${CONFIGURATION:-simplex}
    CONTROLLER=${CONTROLLER:-controller}
    WORKER=${WORKER:-worker}
    STORAGE=${STORAGE:-storage}
    WORKER_NODES_NUMBER=${WORKER_NODES_NUMBER:-1}
    STORAGE_NODES_NUMBER=${STORAGE_NODES_NUMBER:-1}

Provide an example configuration file that sets a lab's attributes deviating from the default.  Especially, the default and the example should co-exist.  Consider honouring the "mad" example in README.rst.

If necessary provide an option to select values, or a script to set variables, from that configuration file.

B) Improve usage and selection of host's resources:

Motivation: allow lab specific attributes for the host's resources and provide tools to inspect those resources within the contexts of the virtual labs and/or overall

Note: Ensure that all changes are providing defaults that are equivalent to the existing implementation.

Values to add to the lab's attributes:
  Add DOMAIN_DIRECTORY to the set of overridable variables
  Add an override variable for the DISK file location for each node in a virtual lab. (currently hardcoded /var/lib/libvirt/images in functions.sh<https://urldefense.com/v3/__http://functions.sh__;!!AjveYdw8EvQ!fIqXGqykkhUxQQg5_KIIRmmXRwF4yIIU-KyMlN4C53gJt6JqkO0FTW5TkRDI1NT_JsZKlFaEM6gE9KGQFe9cO_AOnX0$>)
  Add an override variable for the MEMORY setting for each node (currently XML hardcoded <memory>)
  Add an override variable for the CPU setting of each node (currently XML hardcoded <vcpu>)

Add scripting to assist with supervising the host's resources, such as:
    - listing the lab's nodes and networks;
    - inspecting the lab's network configurations;
    - inspecting the host's and lab's disk usage per configured disk;
    - listing a lab's nodes' cpu and memory allocations

C) Isolate cluster networks where more than one cluster may be running:

Motivation: on a host that has a capacity to run virtual clusters, ensure that there is no networking crosstalk between the running clusters.

Provide scripting to add/remove iptables restrictions for a lab's networks. Initially assume no inter-cluster communication, and only the OAM network will route to external networks.  Include:
    - ipv4 and/or ipv6
    - a lab specific iptables CHAIN

Probably: omit running this script automatically, since it changes the deployment behaviour.  Consider adding an optional parameter to setup_network.sh.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20230710/18a5602c/attachment-0001.htm>