[Starlingx-discuss] StarlingX + STX-Openstack MASTER build ISO [20221006T013744Z] YELLOW sanity and regression results - Oct-6

Calixto de Paula, Gabriel Gabriel.CalixtodePaula at windriver.com
Thu Oct 6 18:16:02 UTC 2022


Hi all,
yesterday we had issues to execute the sanity, the ansible playbook was failing , these issues were corrected on these reverts:
#860418 - Revert "Disable openldap CA cert installation for upgrade"<https://review.opendev.org/c/starlingx/config/+/860418>
#860417 - Revert "Add option for installing openldap CA cert"<https://review.opendev.org/c/starlingx/ansible-playbooks/+/860417>


Here's the results for StarlingX + STX-openstack using the latest master branch build:
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/latest_build/outputs/iso/bootimage.iso

and latest Helm-Charts:
http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/flock/latest_build/outputs/helm-charts/

[sysadmin at controller-1 ~(keystone_admin)]$ cat /etc/build.info
OS="centos"
SW_VERSION="22.12"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="20221006T013744Z"

controller-1:~$ cat /opt/platform/armada/22.12/stx-openstack/1.0-220-centos-stable-versioned/metadata.yaml
app_name: stx-openstack
app_version: 1.0-220-centos-stable-versioned
build_date: 2022-10-06 03:22:34 +0000

OVERALL SANITY RESULT: ​YELLOW​


AIO-DX baremetal with VSWITCH_TYPE=ovs:
Sanity Results:
Status: YELLOW
Automated Test Results Summary:
------------------------------------------------------
Passed: 13 (86.67%)
Failed: 2 (13.33%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------

PASS    20221006 14:10:47       test_ssh_to_hosts
FAIL    20221006 14:11:36       test_lock_unlock_host[controller]
PASS    20221006 14:37:54       test_swact_controllers
PASS    20221006 14:45:34       test_openstack_services_healthy
PASS    20221006 14:46:04       test_reapply_stx_openstack_no_change[controller-0]
PASS    20221006 14:50:36       test_reapply_stx_openstack_no_change[controller-1]
PASS    20221006 14:56:46       test_horizon_create_delete_instance
PASS    20221006 14:58:42       test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
PASS    20221006 15:02:24       test_migrate_vm[tis-centos-guest-live-None]
PASS    20221006 15:05:26       test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS    20221006 15:08:08       test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
FAIL    20221006 15:11:04       test_evacuate_vms
PASS    20221006 15:43:13       test_system_coredumps_and_crashes[core_dumps]
PASS    20221006 15:43:25       test_system_coredumps_and_crashes[crash_reports]
PASS    20221006 15:43:31       test_system_alarms
-----------------------------------------------------------------------

Regression results:
Status: YELLOW
Automated Test Results Summary:
------------------------------------------------------
Passed: 11 (84.62%)
Failed: 2 (15.38%)
Total Executed: 13

List of Test Cases:
------------------------------------------------------

PASS    20221006 15:48:08       test_lldp_neighbor_remote_port
PASS    20221006 15:48:39       test_kernel_module_signatures
PASS    20221006 15:49:07       test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS    20221006 15:52:49       test_multiports_on_same_network_vm_actions[virtio_x4]
PASS    20221006 16:11:25       test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS    20221006 16:21:26       test_cpu_thread_vm_topology_nova_actions[3-dedicated-require-image-None-volume-live_migrate]
PASS    20221006 16:26:08       test_vm_mem_pool_default_config[2048]
PASS    20221006 16:27:51       test_vm_mem_pool_default_config[1048576]
PASS    20221006 16:31:56       test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS    20221006 16:37:34       test_server_group_boot_vms[affinity-2]
PASS    20221006 16:40:59       test_server_group_boot_vms[anti_affinity-2]
FAIL    20221006 16:44:35       test_vm_with_config_drive
FAIL    20221006 17:15:45       test_lock_with_vms
-----------------------------------------------------------------------


AIO-DX baremetal with VSWITCH_TYPE=ovs-dpdk :
Sanity Results
Status: GREEN
Automated Test Results Summary:
------------------------------------------------------
Passed: 15 (100.0%)
Failed: 0 (0.0%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------

PASS    20221006 14:02:38       test_ssh_to_hosts
PASS    20221006 14:03:29       test_lock_unlock_host[controller]
PASS    20221006 14:20:44       test_swact_controllers
PASS    20221006 14:28:14       test_openstack_services_healthy
PASS    20221006 14:28:42       test_reapply_stx_openstack_no_change[controller-0]
PASS    20221006 14:33:05       test_reapply_stx_openstack_no_change[controller-1]
PASS    20221006 14:38:30       test_horizon_create_delete_instance
PASS    20221006 14:40:24       test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
PASS    20221006 14:44:12       test_migrate_vm[tis-centos-guest-live-None]
PASS    20221006 14:47:14       test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS    20221006 14:49:46       test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
PASS    20221006 14:52:17       test_evacuate_vms
PASS    20221006 15:18:36       test_system_coredumps_and_crashes[core_dumps]
PASS    20221006 15:18:47       test_system_coredumps_and_crashes[crash_reports]
PASS    20221006 15:18:53       test_system_alarms
-----------------------------------------------------------------------

Regression Results
Status: GREEN
Automated Test Results Summary:

------------------------------------------------------

Passed: 12 (100.0%)
Failed: 0 (0.0%)
Total Executed: 12

List of Test Cases:
------------------------------------------------------

PASS    20221006 15:23:26       test_lldp_neighbor_remote_port
PASS    20221006 15:23:55       test_kernel_module_signatures
PASS    20221006 15:24:21       test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS    20221006 15:27:40       test_multiports_on_same_network_vm_actions[virtio_x4]
PASS    20221006 15:46:57       test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS    20221006 15:56:29       test_vm_mem_pool_default_config[2048]
PASS    20221006 15:58:19       test_vm_mem_pool_default_config[1048576]
PASS    20221006 16:02:20       test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS    20221006 16:07:42       test_server_group_boot_vms[affinity-2]
PASS    20221006 16:11:29       test_server_group_boot_vms[anti_affinity-2]
PASS    20221006 16:15:25       test_vm_with_config_drive
PASS    20221006 16:37:29       test_lock_with_vms
-----------------------------------------------------------------------

Best Regards Gabriel


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20221006/bac4f857/attachment-0001.htm>


More information about the Starlingx-discuss mailing list