[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 7/09/19

[Perez Ibarra, Maria G]

StarlingX 2.0 Release Status:



ISO: BUILD_ID=" 20190705T013000Z" from (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190705T013000Z/outputs/iso/>)

----------------------------------------------------------------------

Overall Results:



Total = 422

Pass = 223

Fail = 14

Blocked = 36

Not Run = 149

Total executed = 273



Pass Rate = 94.09%



Formula used : Pass Rate = pass * 100 / (pass + fail)



----------------------------------------------------------------------

Results per Domain:



Regression - AIO-SX                          23 PASS | 1 FAIL | 2 BLOCKED

Regression - Backup & Restore

Regression - Distributed Cloud

Regression - Gnoochi                       15 PASS

Regression - FM

Regression - HA 2

Regression - Heat                              12 PASS | 1 BLOCKED

Regression - Horizon                        4 PASS

Regression - Install and Config       2 PASS

Regression - Maintenance               5 PASS | 1 FAIL

Regression - Networking               84 PASS | 8 FAIL | 21 BLOCKED

Regression - Nova                             2 PASS

Regression - Security                      32 PASS | 2 FAIL | 4 BLOCKED

Regression - Storage

Regression - Inventory                  29 PASS | 1 FAIL

System Test                                     12 PASS | 1 FAIL | 8 BLOCKED

---------------------------------------------------------------------------

Bugs:

Controller can't unlock after lock on AIO-SX               https://bugs.launchpad.net/starlingx/+bug/1833472

user does not login within configured time(60s) login is aborted               https://bugs.launchpad.net/starlingx/+bug/1833469

After pull data cable on the compute, no alarm has triggered               https://bugs.launchpad.net/starlingx/+bug/1834512

Cannot create instances with SRIOV port                https://bugs.launchpad.net/starlingx/+bug/1835318

Instance cannot create with network driver e1000 and rtl8139               https://bugs.launchpad.net/starlingx/+bug/1835300

Containers: lock_host failed on a host with config_drive VM               https://bugs.launchpad.net/starlingx/+bug/1821026

200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot        https://bugs.launchpad.net/starlingx/+bug/1832047

virsh only listing one volume, even though there was an additional volume attached after instantiation       https://bugs.launchpad.net/starlingx/+bug/1834194

3 instances launched in soft anti-affinity server group but unexpectedly ignored the 3rd host               https://bugs.launchpad.net/starlingx/+bug/1834255

Device UUID is missing when boot up VM with block device               https://bugs.launchpad.net/starlingx/+bug/1835282

stx-openstack apply takes longer time when lock and unlock on standby controller                https://bugs.launchpad.net/starlingx/+bug/1834083

Port list was not showing for some computes during install               https://bugs.launchpad.net/starlingx/+bug/1834245

Reaching VM limit creation (10) virsh doesn't list all running instances               https://bugs.launchpad.net/starlingx/+bug/1835853

ceph-mgr restful plugin error preventing platform-integ-apps from auto applying               https://bugs.launchpad.net/starlingx/+bug/1835938

Instance created with a flat network spawns in error state               https://bugs.launchpad.net/starlingx/+bug/1835965

neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute                https://bugs.launchpad.net/starlingx/+bug/1835807



Total Bugs: 16



-----------------------------------------------------------------------------



For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit#gid=838066175


Regards!
Maria G


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190709/42074a38/attachment.html>