[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 8/08/19
StarlingX 2.0 Release Status: ISO: BUILD_ID="20190802T013000Z" from (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190802T013000Z/outputs/iso/bootimage.iso>) ---------------------------------------------------------------------- MANUAL EXECUTION ---------------------------------------------------------------------- Overall Results: Total = 493 Pass = 410 Fail = 25 Blocked = 14 Not Run = 0 Obsolete = 26 Deferred = 18 Total executed = 449 Pass Rate = 94.25% Formula used : Pass Rate = pass * 100 / (pass + fail) Results per Domain: Regression - AIO-SX 25 PASS | 1 Obsolete Regression - Backup & Restore 6 Deferrer Regression - Distributed Cloud Regression - Gnoochi 15 PASS Regression - FM 3 PASS Regression - HA 11 PASS | 1 FAIL Regression - Heat 12 PASS | 1 OBSOLETE Regression - Horizon 4 PASS Regression - Install and Config 7 PASS | 1 Fail Regression - Maintenance 8 PASS | 1 FAIL Regression - Networking 121 PASS | 1 FAIL | 3 BLOCKED | 19 OBSOLETE Regression - Nova 24 PASS | 13 FAIL | 3 OBSOLETE Regression - Security 34 PASS | 1 FAIL | 2 BLOCKED | 1 OBSOLETE | 4 Deferrer Regression - Storage 23 PASS |2 BLOCKED| 2 Deferrer Regression - Inventory 30 PASS System Test 20 PASS | 2 FAIL | 7 BLOCKED | 1 OBSOLETE | 6 Deferrer Regression - new features 73 PASS | 5 FAIL --------------------------------------------------------------------------- AUTOMATED EXECUTION - INTEL --------------------------------------------------------------------------- Overall Results: Pass = 197 Fail = 38 Total executed = 235 Pass Rate = 83.82% Formula used : Pass Rate = pass * 100 / (pass + fail) Results per Domain: Fault-Management 15 PASS Gnocchi 12 PASS HEAT 6 PASS High-Availability 9 PASS | 2 FAIL Horizon 2 PASS Insallation-And-Config 8 PASS Maintenance 26 PASS | 3 FAIL Networking 45 PASS | 7 FAIL Nova 17 PASS | 2 FAIL Security 18 PASS | 5 FAIL Storage 5 PASS | 11 FAIL SYSINVENTORY 26 PASS | 5 FAIL System 8 PASS |3 FAIL ---------------------------------------------------------------------- AUTOMATED EXECUTION - Wind River ---------------------------------------------------------------------- Overall Results: Pass = 644 Fail = 123 Total executed = 767 Pass Rate = 84.0% Formula used : Pass Rate = pass * 100 / (pass + fail) Results per Domain: Horizon 57 PASS | 5 FAIL MTC General 30 PASS | 37 FAIL MTC Process Monitoring Networking 29 PASS | 9 FAIL Nova 193 PASS | 54 FAIL REST API 222 PASS | 4 FAIL Security 34 PASS | 4 FAIL Storage 63 PASS | 6 FAIL Sysinv 16 PASS | 4 FAIL Backup/Restore ---------------------------------------------------------------------- user does not login within configured time(60s) login is aborted https://bugs.launchpad.net/starlingx/+bug/1833469 After pull data cable on the compute, no alarm has triggered https://bugs.launchpad.net/starlingx/+bug/1834512 Containers: lock_host failed on a host with config_drive VM https://bugs.launchpad.net/starlingx/+bug/1821026 200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot https://bugs.launchpad.net/starlingx/+bug/1832047 stx-openstack apply takes longer time when lock and unlock on standby controller https://bugs.launchpad.net/starlingx/+bug/1834083 Port list was not showing for some computes during install https://bugs.launchpad.net/starlingx/+bug/1834245 neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute https://bugs.launchpad.net/starlingx/+bug/1835807 When creating instance with pci-passthrough port getting error https://bugs.launchpad.net/starlingx/+bug/1836682 unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633 application apply fails after compute lock and unlock https://bugs.launchpad.net/starlingx/+bug/1836609 403 error in horizon log when try to update the flavor metadata (and admin user is logged out) https://bugs.launchpad.net/starlingx/+bug/1821213 Create Volume dialog opens (from image panel in Horizon) but getting error default volume type cannot be found https://bugs.launchpad.net/starlingx/+bug/1826259 instance creating via horizon failed https://bugs.launchpad.net/starlingx/+bug/1829925 Containers: openstack pods failed after force rebooting active controller https://bugs.launchpad.net/starlingx/+bug/1816842 After active controller reboot, VM boot up failed with error "Failed to allocate the network(s), not rescheduling" https://bugs.launchpad.net/starlingx/+bug/1836928 nova instance remnant left behind after cold migration completes https://bugs.launchpad.net/starlingx/+bug/1824858 disk_available_least value updates when instance moved but not to the value expected https://bugs.launchpad.net/nova/+bug/1834527 Containers: vm unreachable for minutes after live migration or vm reboot https://bugs.launchpad.net/starlingx/+bug/1818118 100.114 NTP alarm not cleared after swact https://bugs.launchpad.net/starlingx/+bug/1834071 unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633 AIO-DX Application apply aborted Unexpected process termination while application-apply was in progress https://bugs.launchpad.net/starlingx/+bug/1838101 Uncontrolled swact on standard system is slow https://bugs.launchpad.net/starlingx/+bug/1838411 tenant-mgmt-net not reachable from external network https://bugs.launchpad.net/starlingx/+bug/1836252 VM filesystem is not RW when attached the 2nd volume https://bugs.launchpad.net/starlingx/+bug/1838546 dedicated instance on low latency worker node not appearing in C1 state https://bugs.launchpad.net/starlingx/+bug/1838524 Intermittently the openstack server show indicates that the server does not exist (in live migration tests) https://bugs.launchpad.net/starlingx/+bug/1838676 Resize to swapless flavor still looking for swap https://bugs.launchpad.net/nova/+bug/1762423 SSH to VM failed by Permission denied (publickey) https://bugs.launchpad.net/starlingx/+bug/1824174 vSwitch 1G Hugepage available size cannot be changed https://bugs.launchpad.net/starlingx/+bug/1834530 Validate re-purposing worker is getting degraded state https://bugs.launchpad.net/starlingx/+bug/1839018 hypervisor stays down after force lock and unlock due to pci-irq-affinity-agent process failure https://bugs.launchpad.net/starlingx/+bug/1839160 Image conversion fails with large qcow2 guest image due to insufficient filesystem size https://bugs.launchpad.net/starlingx/+bug/1819688 SSH to secure boot VM fails after evacuation https://bugs.launchpad.net/starlingx/+bug/1839320 platform keystone account lockout feature is not enabled https://bugs.launchpad.net/starlingx/+bug/1838100 stx-openstack application-applying stuck at osh-openstack-placement https://bugs.launchpad.net/starlingx/+bug/1837769 after changing a setting of panko stx-openstack failed to reach 'applied' status after 1800 seconds https://bugs.launchpad.net/starlingx/+bug/1828056 ----------------------------------------------------------------------------- For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc... Regards! Maria G
participants (1)
-
Perez Ibarra, Maria G