Just a quick note:
the failed tests are related to the low-priority launchpad: STX-Openstack | Hypervisor slow to go back up


Best regards
Gabriel

From: Calixto de Paula, Gabriel
Sent: Thursday, October 6, 2022 3:16 PM
To: starlingx-discuss@lists.starlingx.io <starlingx-discuss@lists.starlingx.io>
Subject: [Starlingx-discuss] StarlingX + STX-Openstack MASTER build ISO [20221006T013744Z] YELLOW sanity and regression results - Oct-6
 
Hi all,
yesterday we had issues to execute the sanity, the ansible playbook was failing , these issues were corrected on these reverts:
#860418 - Revert "Disable openldap CA cert installation for upgrade"
#860417 - Revert "Add option for installing openldap CA cert"


Here's the results for StarlingX + STX-openstack using the latest master branch build:
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/latest_build/outputs/iso/bootimage.iso

and latest Helm-Charts:

[sysadmin@controller-1 ~(keystone_admin)]$ cat /etc/build.info
OS="centos"
SW_VERSION="22.12"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="20221006T013744Z"

controller-1:~$ cat /opt/platform/armada/22.12/stx-openstack/1.0-220-centos-stable-versioned/metadata.yaml
app_name: stx-openstack
app_version: 1.0-220-centos-stable-versioned
build_date: 2022-10-06 03:22:34 +0000

OVERALL SANITY RESULT: ​YELLOW


AIO-DX baremetal with VSWITCH_TYPE=ovs:
Sanity Results:
Status: YELLOW
Automated Test Results Summary:
------------------------------------------------------
Passed: 13 (86.67%)
Failed: 2 (13.33%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------
PASS	20221006 14:10:47	test_ssh_to_hosts
FAIL 20221006 14:11:36 test_lock_unlock_host[controller]
PASS 20221006 14:37:54 test_swact_controllers
PASS 20221006 14:45:34 test_openstack_services_healthy
PASS 20221006 14:46:04 test_reapply_stx_openstack_no_change[controller-0]
PASS 20221006 14:50:36 test_reapply_stx_openstack_no_change[controller-1]
PASS 20221006 14:56:46 test_horizon_create_delete_instance
PASS 20221006 14:58:42 test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
PASS 20221006 15:02:24 test_migrate_vm[tis-centos-guest-live-None]
PASS 20221006 15:05:26 test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS 20221006 15:08:08 test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
FAIL 20221006 15:11:04 test_evacuate_vms
PASS 20221006 15:43:13 test_system_coredumps_and_crashes[core_dumps]
PASS 20221006 15:43:25 test_system_coredumps_and_crashes[crash_reports]
PASS 20221006 15:43:31 test_system_alarms
-----------------------------------------------------------------------

Regression results:
Status: YELLOW
Automated Test Results Summary:
------------------------------------------------------
Passed: 11 (84.62%)
Failed: 2 (15.38%)
Total Executed: 13

List of Test Cases:
------------------------------------------------------
PASS	20221006 15:48:08	test_lldp_neighbor_remote_port
PASS 20221006 15:48:39 test_kernel_module_signatures
PASS 20221006 15:49:07 test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS 20221006 15:52:49 test_multiports_on_same_network_vm_actions[virtio_x4]
PASS 20221006 16:11:25 test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS 20221006 16:21:26 test_cpu_thread_vm_topology_nova_actions[3-dedicated-require-image-None-volume-live_migrate]
PASS 20221006 16:26:08 test_vm_mem_pool_default_config[2048]
PASS 20221006 16:27:51 test_vm_mem_pool_default_config[1048576]
PASS 20221006 16:31:56 test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS 20221006 16:37:34 test_server_group_boot_vms[affinity-2]
PASS 20221006 16:40:59 test_server_group_boot_vms[anti_affinity-2]
FAIL 20221006 16:44:35 test_vm_with_config_drive
FAIL 20221006 17:15:45 test_lock_with_vms
-----------------------------------------------------------------------


AIO-DX baremetal with VSWITCH_TYPE=ovs-dpdk :
Sanity Results 
Status: GREEN
Automated Test Results Summary:
------------------------------------------------------
Passed: 15 (100.0%)
Failed: 0 (0.0%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------
PASS	20221006 14:02:38	test_ssh_to_hosts
PASS 20221006 14:03:29 test_lock_unlock_host[controller]
PASS 20221006 14:20:44 test_swact_controllers
PASS 20221006 14:28:14 test_openstack_services_healthy
PASS 20221006 14:28:42 test_reapply_stx_openstack_no_change[controller-0]
PASS 20221006 14:33:05 test_reapply_stx_openstack_no_change[controller-1]
PASS 20221006 14:38:30 test_horizon_create_delete_instance
PASS 20221006 14:40:24 test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
PASS 20221006 14:44:12 test_migrate_vm[tis-centos-guest-live-None]
PASS 20221006 14:47:14 test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS 20221006 14:49:46 test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
PASS 20221006 14:52:17 test_evacuate_vms
PASS 20221006 15:18:36 test_system_coredumps_and_crashes[core_dumps]
PASS 20221006 15:18:47 test_system_coredumps_and_crashes[crash_reports]
PASS 20221006 15:18:53 test_system_alarms
-----------------------------------------------------------------------
Regression Results
Status: GREEN
Automated Test Results Summary:
------------------------------------------------------
Passed: 12 (100.0%)
Failed: 0 (0.0%)
Total Executed: 12

List of Test Cases:
------------------------------------------------------
PASS	20221006 15:23:26	test_lldp_neighbor_remote_port
PASS 20221006 15:23:55 test_kernel_module_signatures
PASS 20221006 15:24:21 test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS 20221006 15:27:40 test_multiports_on_same_network_vm_actions[virtio_x4]
PASS 20221006 15:46:57 test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS 20221006 15:56:29 test_vm_mem_pool_default_config[2048]
PASS 20221006 15:58:19 test_vm_mem_pool_default_config[1048576]
PASS 20221006 16:02:20 test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS 20221006 16:07:42 test_server_group_boot_vms[affinity-2]
PASS 20221006 16:11:29 test_server_group_boot_vms[anti_affinity-2]
PASS 20221006 16:15:25 test_vm_with_config_drive
PASS 20221006 16:37:29 test_lock_with_vms
-----------------------------------------------------------------------
Best Regards Gabriel