[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 7/23/19

[Perez Ibarra, Maria G]

StarlingX 2.0 Release Status:


ISO: BUILD_ID=" 20190718T013000Z" from (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190718T013000Z/outputs/iso/>)

----------------------------------------------------------------------

Overall Results:



Total = 493

Pass = 287

Fail = 11

Blocked = 37

Not Run = 137

Obsolete = 21

Total executed = 335



Pass Rate = 96.30%



Formula used : Pass Rate = pass * 100 / (pass + fail)



----------------------------------------------------------------------

Results per Domain:



Regression - AIO-SX                          25 PASS | 1 Obsolete

Regression - Backup & Restore

Regression - Distributed Cloud

Regression - Gnoochi                        15 PASS

Regression - FM                                   3 PASS

Regression - HA                                   9 PASS  | 1 FAIL

Regression - Heat                             12 PASS | 1 OBSOLETE

Regression - Horizon                         4 PASS

Regression - Install and Config        5 PASS

Regression - Maintenance               7 PASS | 1 FAIL

Regression - Networking                97 PASS | 4 FAIL | 19 BLOCKED | 15 OBSOLETE

Regression - Nova                           10 PASS | 2 FAIL

Regression - Security                      34 PASS | 1 FAIL | 6 BLOCKED | 1 OBSOLETE

Regression - Storage                        8 PASS | 2 OBSOLETE

Regression - Inventory                  29 PASS | 1 FAIL

System Test                                     20 PASS | 1 FAIL | 12 BLOCKED | 1 OBSOLETE

Regression - new features             9 PASS

---------------------------------------------------------------------------

Bugs:
Controller can't unlock after lock on AIO-SX               https://bugs.launchpad.net/starlingx/+bug/1833472
user does not login within configured time(60s) login is aborted               https://bugs.launchpad.net/starlingx/+bug/1833469
After pull data cable on the compute, no alarm has triggered               https://bugs.launchpad.net/starlingx/+bug/1834512
System account doesn't block after invalid login attempts                https://bugs.launchpad.net/starlingx/+bug/1814345
Containers: lock_host failed on a host with config_drive VM               https://bugs.launchpad.net/starlingx/+bug/1821026
200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot        https://bugs.launchpad.net/starlingx/+bug/1832047
virsh only listing one volume, even though there was an additional volume attached after instantiation                      https://bugs.launchpad.net/starlingx/+bug/1834194
3 instances launched in soft anti-affinity server group but unexpectedly ignored the 3rd host               https://bugs.launchpad.net/starlingx/+bug/1834255
stx-openstack apply takes longer time when lock and unlock on standby controller                https://bugs.launchpad.net/starlingx/+bug/1834083
Port list was not showing for some computes during install               https://bugs.launchpad.net/starlingx/+bug/1834245
Instance created with a flat network spawns in error state               https://bugs.launchpad.net/starlingx/+bug/1835965
neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute                https://bugs.launchpad.net/starlingx/+bug/1835807
When creating instance with pci-passthrough port getting error               https://bugs.launchpad.net/starlingx/+bug/1836682
unexpected output when wipe unassigned disk               https://bugs.launchpad.net/starlingx/+bug/1836633
VM fail to live migrate after evacuation   https://bugs.launchpad.net/starlingx/+bug/1836402
application apply fails after compute lock and unlock               https://bugs.launchpad.net/starlingx/+bug/1836609
CirrOS VM login takes too much time, and throw different log errors               https://bugs.launchpad.net/starlingx/+bug/1835575
Live Migration Error: Failed to live migrate instance to host "AUTO_SCHEDULE".               https://bugs.launchpad.net/starlingx/+bug/1837256
Storage group type conversion getting failed               https://bugs.launchpad.net/starlingx/+bug/1837464
stx-openstack in apply-failed after lock/unlock standby controller               https://bugs.launchpad.net/starlingx/+bug/1837581



Total Bugs: 20



-----------------------------------------------------------------------------



For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit?pli=1#gid=322455033


Regards!
Maria G


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190723/62c60de1/attachment-0001.html>