[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 8/01/19
StarlingX 2.0 Release Status:
ISO: BUILD_ID=" 20190724T013000Z" from (linkhttp://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190724T013000Z/outputs/iso/)
----------------------------------------------------------------------
MANUAL EXECUTION
----------------------------------------------------------------------
Overall Results:
Total = 493
Pass = 386
Fail = 22
Blocked = 27
Not Run = 27
Obsolete = 25
Deferred = 6
Total executed = 435
Pass Rate = 94.60%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Regression - AIO-SX 25 PASS | 1 Obsolete
Regression - Backup & Restore 6 Deferrer
Regression - Distributed Cloud
Regression - Gnoochi 15 PASS
Regression - FM 3 PASS
Regression - HA 11 PASS | 1 FAIL
Regression - Heat 12 PASS | 1 OBSOLETE
Regression - Horizon 4 PASS
Regression - Install and Config 6 PASS | 1 Fail
Regression - Maintenance 8 PASS | 1 FAIL
Regression - Networking 115 PASS | 2 FAIL | 7 BLOCKED | 19 OBSOLETE
Regression - Nova 20 PASS | 9 FAIL
Regression - Security 34 PASS | 1 FAIL | 6 BLOCKED | 1 OBSOLETE
Regression - Storage 23 PASS |2 BLOCKED| 2 OBSOLETE
Regression - Inventory 29 PASS | 1 FAIL
System Test 20 PASS | 1 FAIL | 12 BLOCKED | 1 OBSOLETE
Regression - new features 61 PASS | 5 FAIL
---------------------------------------------------------------------------
AUTOMATED EXECUTION - INTEL
---------------------------------------------------------------------------
Overall Results:
Total = 234
Pass = 178
Fail = 47
Not Run = 9
Total executed = 225
Pass Rate = 79.1%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Fault-Management 15 PASS
Gnocchi 12 PASS
HEAT 6 PASS
High-Availability 8 PASS | 2 FAIL
Horizon 2 PASS
Insallation-And-Config 6 PASS | 1 FAIL
Maintenance 22 PASS | 5 FAIL
Networking 39 PASS | 12 FAIL
Nova 14 PASS | 5 FAIL
Security 16 PASS | 7 FAIL
Storage 3 PASS | 11 FAIL
SYSINVENTORY 29 PASS | 1 FAIL
System 6 PASS |3 FAIL
----------------------------------------------------------------------
AUTOMATED EXECUTION - Wind River
----------------------------------------------------------------------
Overall Results:
Pass = 619
Fail = 127
Total executed = 746
Pass Rate = 83.0%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Horizon 46 PASS |4 FAIL
MTC General 27 PASS | 16 FAIL
Networking 30 PASS | 8 FAIL
Nova 171 PASS | 78 FAIL
REST API 220 PASS | 4 FAIL
Security 49 PASS | 4 FAIL
Storage 59 PASS | 10 FAIL
Sysinv 17 PASS | 3 FAIL
-------------------------------------------------
Bugs:
user does not login within configured time(60s) login is aborted https://bugs.launchpad.net/starlingx/+bug/1833469
After pull data cable on the compute, no alarm has triggered https://bugs.launchpad.net/starlingx/+bug/1834512
Containers: lock_host failed on a host with config_drive VM https://bugs.launchpad.net/starlingx/+bug/1821026
200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot https://bugs.launchpad.net/starlingx/+bug/1832047
3 instances launched in soft anti-affinity server group but unexpectedly ignored the 3rd host https://bugs.launchpad.net/starlingx/+bug/1834255
stx-openstack apply takes longer time when lock and unlock on standby controller https://bugs.launchpad.net/starlingx/+bug/1834083
Port list was not showing for some computes during install https://bugs.launchpad.net/starlingx/+bug/1834245
neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute https://bugs.launchpad.net/starlingx/+bug/1835807
When creating instance with pci-passthrough port getting error https://bugs.launchpad.net/starlingx/+bug/1836682
unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633
VM fail to live migrate after evacuation https://bugs.launchpad.net/starlingx/+bug/1836402
application apply fails after compute lock and unlock https://bugs.launchpad.net/starlingx/+bug/1836609
CirrOS VM login takes too much time, and throw different log errors https://bugs.launchpad.net/starlingx/+bug/1835575
Live Migration Error: Failed to live migrate instance to host "AUTO_SCHEDULE". https://bugs.launchpad.net/starlingx/+bug/1837256
403 error in horizon log when try to update the flavor metadata (and admin user is logged out) https://bugs.launchpad.net/starlingx/+bug/1821213
Create Volume dialog opens (from image panel in Horizon) but getting error default volume type can not be found https://bugs.launchpad.net/starlingx/+bug/1826259
instance creating via horizon failed https://bugs.launchpad.net/starlingx/+bug/1829925
Containers: openstack pods failed after force rebooting active controller https://bugs.launchpad.net/starlingx/+bug/1816842
After active controller reboot, VM boot up failed with error "Failed to allocate the network(s), not rescheduling" https://bugs.launchpad.net/starlingx/+bug/1836928
nova instance remnant left behind after cold migration completes https://bugs.launchpad.net/starlingx/+bug/1824858
disk_available_least value updates when instance moved but not to the value expected https://bugs.launchpad.net/nova/+bug/1834527
Containers: vm unreachable for minutes after live migration or vm reboot https://bugs.launchpad.net/starlingx/+bug/1818118
100.114 NTP alarm not cleared after swact https://bugs.launchpad.net/starlingx/+bug/1834071
unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633
after changing a setting of panko stx-openstack failed to reach 'applied' status after 1800 seconds https://bugs.launchpad.net/starlingx/+bug/1828056
AIO-DX Application apply aborted Unexpected process termination while application-apply was in progress https://bugs.launchpad.net/starlingx/+bug/1838101
Uncontrolled swact on standard system is slow https://bugs.launchpad.net/starlingx/+bug/1838411
tenant-mgmt-net not reachable from external network https://bugs.launchpad.net/starlingx/+bug/1836252
VM filesystem is not RW when attached the 2nd volume https://bugs.launchpad.net/starlingx/+bug/1838546
dedicated instance on low latency worker node not appearing in C1 state https://bugs.launchpad.net/starlingx/+bug/1838524
Intermittently the openstack server show indicates that the server does not exist (in live migration tests) https://bugs.launchpad.net/starlingx/+bug/1838676
host-unlock compute node rejected: Total allocated memory exceeds the total memory https://bugs.launchpad.net/starlingx/+bug/1837749
Resize to swapless flavor still looking for swap https://bugs.launchpad.net/nova/+bug/1762423
SSH to VM failed by Permission denied (publickey) https://bugs.launchpad.net/starlingx/+bug/1824174
-----------------------------------------------------------------------------
For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc...
Regards! Maria G
participants (1)
-
Perez Ibarra, Maria G