[Starlingx-discuss] Sanity and Regression - StarlingX + STX-Openstack MASTER build [20230731T060000Z] results - Jul - 31

[Calixto de Paula, Gabriel]

Hi all,

StarlingX + STX-Openstack sanity and regression results:

Overall Status: RED

Build Info:
Build date: July 31 - 20230731T060000Z
ISO: https://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230731T060000Z/outputs/iso/starlingx-intel-x86-64-cd.iso
Helm Chart: https://mirror.starlingx.cengn.ca/mirror/starlingx/master/debian/monolithic/20230731T060000Z/outputs/helm-charts/stx-openstack-1.0-1.stx.63-debian-stable-versioned.tgz


AIO-DX Baremetal with VSWITCH_TYPE=OVS

Sanity Results:
Overall Status: RED

Automated Test Results Summary:
------------------------------------------------------
Passed: 9 (60.0%)
Failed: 6 (40.0%)
Total Executed: 15

List of Test Cases:
------------------------------------------------------

PASS    20230801 12:47:22       test_ssh_to_hosts
FAIL    20230801 12:48:41       test_lock_unlock_host
FAIL    20230801 12:51:32       test_openstack_services_healthy
FAIL    20230801 12:53:38       test_reapply_stx_openstack_no_change[controller-0]
PASS    20230801 12:59:30       test_reapply_stx_openstack_no_change[controller-1]
FAIL    20230801 13:22:13       test_horizon_create_delete_instance
PASS    20230801 13:28:56       test_swact_controllers
PASS    20230801 13:36:47       test_ping_between_two_vms[tis-centos-guest-virtio-virtio]
FAIL    20230801 13:42:55       test_migrate_vm[tis-centos-guest-live-None]
PASS    20230801 13:50:29       test_nova_actions[tis-centos-guest-dedicated-pause-unpause]
PASS    20230801 13:54:45       test_nova_actions[tis-centos-guest-dedicated-suspend-resume]
FAIL    20230801 13:58:58       test_evacuate_vms
PASS    20230801 14:32:09       test_system_coredumps_and_crashes[core_dumps]
PASS    20230801 14:32:24       test_system_coredumps_and_crashes[crash_reports]
PASS    20230801 14:32:30       test_system_alarms
-----------------------------------------------------------------------


The tcs that failed, except one, reported above are caused by #2029378 - STX | Debian: kubernetes certificates renewal failure on controller-1<https://bugs.launchpad.net/starlingx/+bug/2029378>

the test case: test_horizon_create_delete_instance failed due to #2029376 -  External application resources not accessible due to firewall changes <https://bugs.launchpad.net/starlingx/+bug/2029376>




Regression Results:

Overall Status: YELLOW

Automated Test Results Summary:

------------------------------------------------------
Passed: 9 (75.0%)
Failed: 3 (25.0%)
Total Executed: 12

List of Test Cases:
------------------------------------------------------

PASS    20230801 14:38:20       test_lldp_neighbor_remote_port
PASS    20230801 14:39:43       test_kernel_module_signatures
PASS    20230801 14:40:44       test_delete_heat_after_swact[OS_Cinder_Volume.yaml]
PASS    20230801 14:50:32       test_multiports_on_same_network_vm_actions[virtio_x4]
FAIL    20230801 15:16:32       test_cpu_pol_vm_actions[2-dedicated-image-volume]
PASS    20230801 15:28:22       test_vm_mem_pool_default_config[2048]
PASS    20230801 15:31:15       test_vm_mem_pool_default_config[1048576]
PASS    20230801 15:36:22       test_resize_vm_positive[local_image-4_1_512-5_2_1024-image]
PASS    20230801 15:43:34       test_server_group_boot_vms[affinity-2]
PASS    20230801 15:48:43       test_server_group_boot_vms[anti_affinity-2]
FAIL    20230801 15:54:06       test_vm_with_config_drive
FAIL    20230801 16:14:50       test_lock_with_vms
-----------------------------------------------------------------------

The tcs that failed reported above are caused by #2029378 - STX | Debian: kubernetes certificates renewal failure on controller-1<https://bugs.launchpad.net/starlingx/+bug/2029378>

Thanks,

STX-Openstack Distro Team

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20230802/285316c1/attachment-0001.htm>