[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 7/30/19
Perez Ibarra, Maria G
maria.g.perez.ibarra at intel.com
Tue Jul 30 23:18:36 UTC 2019
StarlingX 2.0 Release Status:
ISO: BUILD_ID=" 20190724T013000Z" from (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190724T013000Z/outputs/iso/>)
----------------------------------------------------------------------
MANUAL EXECUTION
----------------------------------------------------------------------
Overall Results:
Total = 492
Pass = 371
Fail = 20
Blocked = 30
Not Run = 39
Obsolete = 26
Deferred = 6
Total executed = 421
Pass Rate = 94.88%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Regression - AIO-SX 26 PASS | 1 Obsolete
Regression - Backup & Restore 6 Deferrer
Regression - Distributed Cloud
Regression - Gnoochi 15 PASS
Regression - FM 3 PASS
Regression - HA 11 PASS | 1 FAIL
Regression - Heat 12 PASS | 1 OBSOLETE
Regression - Horizon 4 PASS
Regression - Install and Config 5 PASS | 1 Fail
Regression - Maintenance 8 PASS | 1 FAIL
Regression - Networking 111 PASS | 2 FAIL | 11 BLOCKED | 19 OBSOLETE
Regression - Nova 17 PASS | 7 FAIL
Regression - Security 34 PASS | 1 FAIL | 6 BLOCKED | 1 OBSOLETE
Regression - Storage 23 PASS |1 BLOCKED| 3 OBSOLETE
Regression - Inventory 29 PASS | 1 FAIL
System Test 20 PASS | 1 FAIL | 12 BLOCKED | 1 OBSOLETE
Regression - new features 54 PASS | 5 FAIL
---------------------------------------------------------------------------
AUTOMATED EXECUTION - INTEL
---------------------------------------------------------------------------
Overall Results:
Total = 235
Pass = 156
Fail = 66
Not Run = 13
Total executed = 222
Pass Rate = 70.27%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Fault-Management 15 PASS
Gnocchi 12 PASS
HEAT 6 PASS
High-Availability 6 PASS | 4 FAIL
Horizon 2 PASS
Insallation-And-Config 6 PASS | 1 FAIL
Maintenance 19 PASS | 7 FAIL
Networking 35 PASS | 16 FAIL
Nova 8 PASS | 11 FAIL
Security 15 PASS | 8 FAIL
Storage 1 PASS | 13 FAIL
SYSINVENTORY 28 PASS | 2 FAIL
System 3 PASS |4 FAIL
----------------------------------------------------------------------
AUTOMATED EXECUTION - Wind River
----------------------------------------------------------------------
"Pending results"
-------------------------------------------------
Bugs:
user does not login within configured time(60s) login is aborted https://bugs.launchpad.net/starlingx/+bug/1833469
After pull data cable on the compute, no alarm has triggered https://bugs.launchpad.net/starlingx/+bug/1834512
Containers: lock_host failed on a host with config_drive VM https://bugs.launchpad.net/starlingx/+bug/1821026
200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot https://bugs.launchpad.net/starlingx/+bug/1832047
3 instances launched in soft anti-affinity server group but unexpectedly ignored the 3rd host https://bugs.launchpad.net/starlingx/+bug/1834255
stx-openstack apply takes longer time when lock and unlock on standby controller https://bugs.launchpad.net/starlingx/+bug/1834083
Port list was not showing for some computes during install https://bugs.launchpad.net/starlingx/+bug/1834245
neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute https://bugs.launchpad.net/starlingx/+bug/1835807
When creating instance with pci-passthrough port getting error https://bugs.launchpad.net/starlingx/+bug/1836682
unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633
VM fail to live migrate after evacuation https://bugs.launchpad.net/starlingx/+bug/1836402
application apply fails after compute lock and unlock https://bugs.launchpad.net/starlingx/+bug/1836609
CirrOS VM login takes too much time, and throw different log errors https://bugs.launchpad.net/starlingx/+bug/1835575
Live Migration Error: Failed to live migrate instance to host "AUTO_SCHEDULE". https://bugs.launchpad.net/starlingx/+bug/1837256
stx-openstack in apply-failed after lock/unlock standby controller https://bugs.launchpad.net/starlingx/+bug/1837581
403 error in horizon log when try to update the flavor metadata (and admin user is logged out) https://bugs.launchpad.net/starlingx/+bug/1821213
Create Volume dialog opens (from image panel in Horizon) but getting error default volume type can not be found https://bugs.launchpad.net/starlingx/+bug/1826259
instance creating via horizon failed https://bugs.launchpad.net/starlingx/+bug/1829925
Containers: openstack pods failed after force rebooting active controller https://bugs.launchpad.net/starlingx/+bug/1816842
After active controller reboot, VM boot up failed with error "Failed to allocate the network(s), not rescheduling" https://bugs.launchpad.net/starlingx/+bug/1836928
nova instance remnant left behind after cold migration completes https://bugs.launchpad.net/starlingx/+bug/1824858
disk_available_least value updates when instance moved but not to the value expected https://bugs.launchpad.net/nova/+bug/1834527
Containers: vm unreachable for minutes after live migration or vm reboot https://bugs.launchpad.net/starlingx/+bug/1818118
100.114 NTP alarm not cleared after swact https://bugs.launchpad.net/starlingx/+bug/1834071
unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633
after changing a setting of panko stx-openstack failed to reach 'applied' status after 1800 seconds https://bugs.launchpad.net/starlingx/+bug/1828056
AIO-DX Application apply aborted Unexpected process termination while application-apply was in progress https://bugs.launchpad.net/starlingx/+bug/1838101
Uncontrolled swact on standard system is slow https://bugs.launchpad.net/starlingx/+bug/1838411
tenant-mgmt-net not reachable from external network https://bugs.launchpad.net/starlingx/+bug/1836252
total bugs: 29
-----------------------------------------------------------------------------
For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit?pli=1#gid=322455033
Regards!
Maria G
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190730/0fd80ffb/attachment-0001.html>
More information about the Starlingx-discuss
mailing list