[Starlingx-discuss] StarlingX + STX-Openstack MASTER build ISO [20221012T045713Z] YELLOW sanity and regression results - Oct-12

Thu Oct 13 12:15:19 UTC 2022

Hi all,

Here's the results for StarlingX + STX-openstack using the latest master branch build:
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/latest_build/outputs/iso/bootimage.iso

and latest Helm-Charts:
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/latest_build/outputs/helm-charts/

controller-0:~$ cat /etc/build.info
OS="centos"
SW_VERSION="22.12"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="20221012T045713Z"

controller-0:~$ cat /opt/platform/armada/22.12/stx-openstack/1.0-220-centos-stable-versioned/metadata.yaml
app_name: stx-openstack
app_version: 1.0-220-centos-stable-versioned
build_date: 2022-10-12 07:20:21 +0000

OVERALL SANITY RESULT: YELLOW

AIO-DX baremetal with VSWITCH_TYPE=ovs:
Sanity Results:
Status: YELLOW
Automated Test Results Summary:
------------------------------------------------------
Passed: 14 (93.33%)
Failed: 1 (6.67%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------

PASS    20221013 03:47:48       test_ssh_to_hosts
FAIL    20221013 03:48:34       test_lock_unlock_host[controller]
PASS    20221013 04:14:15       test_swact_controllers
PASS    20221013 04:23:12       test_openstack_services_healthy
PASS    20221013 04:23:42       test_reapply_stx_openstack_no_change[controller-0]
PASS    20221013 04:28:25       test_reapply_stx_openstack_no_change[controller-1]
PASS    20221013 04:34:35       test_horizon_create_delete_instance
PASS    20221013 04:36:26       test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
PASS    20221013 04:40:13       test_migrate_vm[tis-centos-guest-live-None]
PASS    20221013 04:43:14       test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS    20221013 04:45:46       test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
PASS    20221013 04:48:28       test_evacuate_vms
PASS    20221013 05:17:13       test_system_coredumps_and_crashes[core_dumps]
PASS    20221013 05:17:24       test_system_coredumps_and_crashes[crash_reports]
PASS    20221013 05:17:31       test_system_alarms
-----------------------------------------------------------------------

Regression results:
Status: YELLOW
Automated Test Results Summary:
------------------------------------------------------
Passed: 11 (84.62%)
Failed: 2 (15.38%)
Total Executed: 13

List of Test Cases:
------------------------------------------------------

PASS    20221013 05:23:19       test_lldp_neighbor_remote_port
PASS    20221013 05:23:49       test_kernel_module_signatures
PASS    20221013 05:24:18       test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS    20221013 05:28:04       test_multiports_on_same_network_vm_actions[virtio_x4]
PASS    20221013 05:46:46       test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS    20221013 05:56:01       test_cpu_thread_vm_topology_nova_actions[3-dedicated-require-image-None-volume-live_migrate]
PASS    20221013 06:00:44       test_vm_mem_pool_default_config[2048]
PASS    20221013 06:02:28       test_vm_mem_pool_default_config[1048576]
PASS    20221013 06:06:13       test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS    20221013 06:11:44       test_server_group_boot_vms[affinity-2]
PASS    20221013 06:15:17       test_server_group_boot_vms[anti_affinity-2]
FAIL    20221013 06:19:02       test_vm_with_config_drive
FAIL    20221013 06:50:28       test_lock_with_vms
-----------------------------------------------------------------------

the failed tests above are related to the low-priority launchpad: STX-Openstack | Hypervisor slow to go back up<https://bugs.launchpad.net/starlingx/+bug/1988778>

AIO-DX baremetal with VSWITCH_TYPE=ovs-dpdk :

Sanity Results
Status: GREEN
Automated Test Results Summary:
------------------------------------------------------
Passed: 15 (100.0%)
Failed: 0 (0.0%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------

PASS    20221013 03:42:16       test_ssh_to_hosts
PASS    20221013 03:43:05       test_lock_unlock_host[controller]
PASS    20221013 03:59:53       test_swact_controllers
PASS    20221013 04:08:10       test_openstack_services_healthy
PASS    20221013 04:08:38       test_reapply_stx_openstack_no_change[controller-0]
PASS    20221013 04:13:03       test_reapply_stx_openstack_no_change[controller-1]
PASS    20221013 04:18:43       test_horizon_create_delete_instance
PASS    20221013 04:20:26       test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
PASS    20221013 04:24:07       test_migrate_vm[tis-centos-guest-live-None]
PASS    20221013 04:27:07       test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS    20221013 04:29:42       test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
PASS    20221013 04:32:28       test_evacuate_vms
PASS    20221013 04:59:39       test_system_coredumps_and_crashes[core_dumps]
PASS    20221013 04:59:50       test_system_coredumps_and_crashes[crash_reports]
PASS    20221013 04:59:56       test_system_alarms
-----------------------------------------------------------------------

Regression Results
Status: GREEN

Automated Test Results Summary:
------------------------------------------------------
Passed: 12 (100.0%)
Failed: 0 (0.0%)
Total Executed: 12

List of Test Cases:
------------------------------------------------------

PASS    20221013 05:05:45       test_lldp_neighbor_remote_port
PASS    20221013 05:06:13       test_kernel_module_signatures
PASS    20221013 05:06:41       test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS    20221013 05:10:08       test_multiports_on_same_network_vm_actions[virtio_x4]
PASS    20221013 05:29:26       test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS    20221013 05:39:13       test_vm_mem_pool_default_config[2048]
PASS    20221013 05:41:08       test_vm_mem_pool_default_config[1048576]
PASS    20221013 05:45:30       test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS    20221013 05:50:59       test_server_group_boot_vms[affinity-2]
PASS    20221013 05:54:34       test_server_group_boot_vms[anti_affinity-2]
PASS    20221013 05:58:20       test_vm_with_config_drive
PASS    20221013 06:17:57       test_lock_with_vms
-----------------------------------------------------------------------

Best Regards
Gabriel

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20221013/c7951c70/attachment-0001.htm>