StarlingX 2.0 Release Status:

 

ISO: BUILD_ID=" 20190718T013000Z" from (link)

----------------------------------------------------------------------

MANUAL EXECUTION

----------------------------------------------------------------------

Overall Results:

Total = 493

Pass = 323

Fail = 15

Blocked = 37

Not Run = 97

Obsolete = 37

Total executed = 375

                             

Pass Rate = 95.56%

 

Formula used : Pass Rate = pass * 100 / (pass + fail)

 

 

Results per Domain:

Regression - AIO-SX                          25 PASS | 1 Obsolete

Regression - Backup & Restore                                 

Regression - Distributed Cloud                                  

Regression - Gnoochi                        15 PASS                            

Regression - FM                                   3 PASS

Regression - HA                                  11 PASS  | 1 FAIL                           

Regression - Heat                             12 PASS | 1 OBSOLETE 

Regression - Horizon                         4 PASS                              

Regression - Install and Config        5 PASS               

Regression - Maintenance               8 PASS | 1 FAIL

Regression - Networking                106 PASS | 3 FAIL | 19 BLOCKED | 15 OBSOLETE 

Regression - Nova                           12 PASS | 3 FAIL             

Regression - Security                      34 PASS | 1 FAIL | 6 BLOCKED | 1 OBSOLETE 

Regression - Storage                      15 PASS |1 FAIL| 2 OBSOLETE        

Regression - Inventory                  29 PASS | 1 FAIL 

System Test                                     20 PASS | 1 FAIL | 12 BLOCKED | 1 OBSOLETE 

Regression - new features           24 PASS | 3 FAIL

 

--------------------------------------------------------------------------- 

AUTOMATED EXECUTION - INTEL

--------------------------------------------------------------------------- 

Overall Results:

Total = 235

Pass = 139

Fail = 75

Not Run = 21

Total executed = 214

                             

Pass Rate = 64.95%

 

Formula used : Pass Rate = pass * 100 / (pass + fail)

 

Results per Domain:

Fault-Management          14 PASS | 1 FAIL

Gnocchi                              12 PASS

HEAT                                   6   PASS

High-Availability                6 PASS | 4   FAIL

Horizon                              2 PASS  

Insallation-And-Config    2 PASS | 1 FAIL

Maintenance                     19 PASS | 7 FAIL

Networking                        33 PASS | 17 FAIL

Nova                                   7   PASS | 12 FAIL

Security                               12 PASS | 11 FAIL

Storage                               1   PASS | 13 FAIL

SYSINVENTORY                 23 PASS | 5 FAIL

System                                  2 PASS |4  FAIL

 

----------------------------------------------------------------------

AUTOMATED EXECUTION – Wind River  

----------------------------------------------------------------------

Overall Results:

Pass = 609

Fail = 139

Total executed = 748

                             

Pass Rate = 81.4%

 

Formula used : Pass Rate = pass * 100 / (pass + fail)

 

Results per Domain:

Horizon 46           4      PASS

MTC General      33  PASS | 31 FAIL

Networking         22  PASS | 11 FAIL

Nova                    184 PASS | 62 FAIL

REST API              220 PASS |  4  FAIL

Security                28   PASS | 14 FAIL   

Storage                59   PASS | 10 FAIL

Sysinv                   17   PASS | 3  FAIL

 

 

-------------------------------------------------

Bugs:

Controller can't unlock after lock on AIO-SX               https://bugs.launchpad.net/starlingx/+bug/1833472

user does not login within configured time(60s) login is aborted               https://bugs.launchpad.net/starlingx/+bug/1833469

After pull data cable on the compute, no alarm has triggered               https://bugs.launchpad.net/starlingx/+bug/1834512

System account doesn't block after invalid login attempts                https://bugs.launchpad.net/starlingx/+bug/1814345

Containers: lock_host failed on a host with config_drive VM               https://bugs.launchpad.net/starlingx/+bug/1821026

200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot        https://bugs.launchpad.net/starlingx/+bug/1832047

virsh only listing one volume, even though there was an additional volume attached after instantiation                      https://bugs.launchpad.net/starlingx/+bug/1834194

3 instances launched in soft anti-affinity server group but unexpectedly ignored the 3rd host                                             https://bugs.launchpad.net/starlingx/+bug/1834255

stx-openstack apply takes longer time when lock and unlock on standby controller                https://bugs.launchpad.net/starlingx/+bug/1834083

Port list was not showing for some computes during install               https://bugs.launchpad.net/starlingx/+bug/1834245

neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute                https://bugs.launchpad.net/starlingx/+bug/1835807

When creating instance with pci-passthrough port getting error               https://bugs.launchpad.net/starlingx/+bug/1836682

unexpected output when wipe unassigned disk               https://bugs.launchpad.net/starlingx/+bug/1836633

VM fail to live migrate after evacuation   https://bugs.launchpad.net/starlingx/+bug/1836402

application apply fails after compute lock and unlock               https://bugs.launchpad.net/starlingx/+bug/1836609

CirrOS VM login takes too much time, and throw different log errors               https://bugs.launchpad.net/starlingx/+bug/1835575

Live Migration Error: Failed to live migrate instance to host "AUTO_SCHEDULE".               https://bugs.launchpad.net/starlingx/+bug/1837256

stx-openstack in apply-failed after lock/unlock standby controller                https://bugs.launchpad.net/starlingx/+bug/1837581

403 error in horizon log when try to update the flavor metadata (and admin user is logged out)                https://bugs.launchpad.net/starlingx/+bug/1821213

Create Volume dialog opens (from image panel in Horizon) but getting error default volume type can not be found              https://bugs.launchpad.net/starlingx/+bug/1826259

instance creating via horizon failed            https://bugs.launchpad.net/starlingx/+bug/1829925

Containers: openstack pods failed after force rebooting active controller               https://bugs.launchpad.net/starlingx/+bug/1816842

After active controller reboot, VM boot up failed with error "Failed to allocate the network(s), not rescheduling"             https://bugs.launchpad.net/starlingx/+bug/1836928

nova instance remnant left behind after cold migration completes                https://bugs.launchpad.net/starlingx/+bug/1824858

disk_available_least value updates when instance moved but not to the value expected               https://bugs.launchpad.net/nova/+bug/1834527

Containers: vm unreachable for minutes after live migration or vm reboot               https://bugs.launchpad.net/starlingx/+bug/1818118

100.114 NTP alarm not cleared after swact               https://bugs.launchpad.net/starlingx/+bug/1834071

unexpected output when wipe unassigned disk               https://bugs.launchpad.net/starlingx/+bug/1836633

after changing a setting of panko stx-openstack failed to reach 'applied' status after 1800 seconds https://bugs.launchpad.net/starlingx/+bug/1828056

 

Total Bugs: 28

 

-----------------------------------------------------------------------------

 

For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit?pli=1#gid=322455033

 

 

Regards!

Maria G