[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 8/08/19

Perez Ibarra, Maria G maria.g.perez.ibarra at intel.com
Thu Aug 8 22:37:31 UTC 2019


StarlingX 2.0 Release Status:


ISO: BUILD_ID="20190802T013000Z" from (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190802T013000Z/outputs/iso/bootimage.iso>)

----------------------------------------------------------------------

MANUAL EXECUTION

----------------------------------------------------------------------

Overall Results:

Total = 493

Pass = 410

Fail = 25

Blocked = 14

Not Run = 0

Obsolete = 26

Deferred = 18

Total executed = 449



Pass Rate = 94.25%



Formula used : Pass Rate = pass * 100 / (pass + fail)





Results per Domain:

Regression - AIO-SX                          25 PASS | 1 Obsolete

Regression - Backup & Restore         6 Deferrer

Regression - Distributed Cloud

Regression - Gnoochi                        15 PASS

Regression - FM                                   3 PASS

Regression - HA                                  11 PASS  | 1 FAIL

Regression - Heat                             12 PASS | 1 OBSOLETE

Regression - Horizon                         4 PASS

Regression - Install and Config        7 PASS | 1 Fail

Regression - Maintenance               8 PASS | 1 FAIL

Regression - Networking                121 PASS | 1 FAIL | 3 BLOCKED | 19 OBSOLETE

Regression - Nova                           24 PASS | 13 FAIL | 3 OBSOLETE

Regression - Security                      34 PASS | 1 FAIL | 2 BLOCKED | 1 OBSOLETE | 4 Deferrer

Regression - Storage                      23 PASS |2 BLOCKED| 2 Deferrer

Regression - Inventory                  30 PASS

System Test                                     20 PASS | 2 FAIL | 7 BLOCKED | 1 OBSOLETE  | 6 Deferrer

Regression - new features           73 PASS | 5 FAIL



---------------------------------------------------------------------------

AUTOMATED EXECUTION - INTEL

---------------------------------------------------------------------------

Overall Results:

Pass = 197

Fail = 38

Total executed = 235



Pass Rate = 83.82%



Formula used : Pass Rate = pass * 100 / (pass + fail)



Results per Domain:

Fault-Management          15 PASS

Gnocchi                              12 PASS

HEAT                                   6   PASS

High-Availability                9 PASS | 2   FAIL

Horizon                              2 PASS

Insallation-And-Config    8 PASS

Maintenance                     26 PASS | 3 FAIL

Networking                        45 PASS | 7 FAIL

Nova                                   17   PASS | 2 FAIL

Security                               18 PASS | 5 FAIL

Storage                               5   PASS | 11 FAIL

SYSINVENTORY                 26 PASS | 5 FAIL

System                                  8 PASS |3  FAIL



----------------------------------------------------------------------

AUTOMATED EXECUTION - Wind River

----------------------------------------------------------------------

Overall Results:

Pass = 644

Fail = 123

Total executed = 767



Pass Rate = 84.0%



Formula used : Pass Rate = pass * 100 / (pass + fail)



Results per Domain:
Horizon                57 PASS | 5 FAIL
MTC General      30 PASS | 37 FAIL
MTC Process Monitoring
Networking         29 PASS | 9 FAIL
Nova                    193 PASS | 54 FAIL
REST API              222 PASS | 4 FAIL
Security                34 PASS | 4 FAIL
Storage                63 PASS | 6 FAIL
Sysinv                   16 PASS | 4 FAIL
Backup/Restore



----------------------------------------------------------------------

user does not login within configured time(60s) login is aborted               https://bugs.launchpad.net/starlingx/+bug/1833469

After pull data cable on the compute, no alarm has triggered               https://bugs.launchpad.net/starlingx/+bug/1834512

Containers: lock_host failed on a host with config_drive VM               https://bugs.launchpad.net/starlingx/+bug/1821026

200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot        https://bugs.launchpad.net/starlingx/+bug/1832047

stx-openstack apply takes longer time when lock and unlock on standby controller                https://bugs.launchpad.net/starlingx/+bug/1834083

Port list was not showing for some computes during install               https://bugs.launchpad.net/starlingx/+bug/1834245

neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute                https://bugs.launchpad.net/starlingx/+bug/1835807

When creating instance with pci-passthrough port getting error               https://bugs.launchpad.net/starlingx/+bug/1836682

unexpected output when wipe unassigned disk               https://bugs.launchpad.net/starlingx/+bug/1836633

application apply fails after compute lock and unlock               https://bugs.launchpad.net/starlingx/+bug/1836609

403 error in horizon log when try to update the flavor metadata (and admin user is logged out)               https://bugs.launchpad.net/starlingx/+bug/1821213

Create Volume dialog opens (from image panel in Horizon) but getting error default volume type cannot be found              https://bugs.launchpad.net/starlingx/+bug/1826259

instance creating via horizon failed            https://bugs.launchpad.net/starlingx/+bug/1829925

Containers: openstack pods failed after force rebooting active controller               https://bugs.launchpad.net/starlingx/+bug/1816842

After active controller reboot, VM boot up failed with error "Failed to allocate the network(s), not rescheduling"             https://bugs.launchpad.net/starlingx/+bug/1836928

nova instance remnant left behind after cold migration completes                https://bugs.launchpad.net/starlingx/+bug/1824858

disk_available_least value updates when instance moved but not to the value expected               https://bugs.launchpad.net/nova/+bug/1834527

Containers: vm unreachable for minutes after live migration or vm reboot                https://bugs.launchpad.net/starlingx/+bug/1818118

100.114 NTP alarm not cleared after swact               https://bugs.launchpad.net/starlingx/+bug/1834071

unexpected output when wipe unassigned disk               https://bugs.launchpad.net/starlingx/+bug/1836633

AIO-DX Application apply aborted Unexpected process termination while application-apply was in progress          https://bugs.launchpad.net/starlingx/+bug/1838101

Uncontrolled swact on standard system is slow               https://bugs.launchpad.net/starlingx/+bug/1838411

tenant-mgmt-net not reachable from external network               https://bugs.launchpad.net/starlingx/+bug/1836252

VM filesystem is not RW when attached the 2nd volume               https://bugs.launchpad.net/starlingx/+bug/1838546

dedicated instance on low latency worker node not appearing in C1 state               https://bugs.launchpad.net/starlingx/+bug/1838524

Intermittently the openstack server show indicates that the server does not exist (in live migration tests)                https://bugs.launchpad.net/starlingx/+bug/1838676

Resize to swapless flavor still looking for swap               https://bugs.launchpad.net/nova/+bug/1762423

SSH to VM failed by Permission denied (publickey)               https://bugs.launchpad.net/starlingx/+bug/1824174



vSwitch 1G Hugepage available size cannot be changed               https://bugs.launchpad.net/starlingx/+bug/1834530

Validate re-purposing worker is getting degraded state               https://bugs.launchpad.net/starlingx/+bug/1839018

hypervisor stays down after force lock and unlock due to pci-irq-affinity-agent process failure               https://bugs.launchpad.net/starlingx/+bug/1839160

Image conversion fails with large qcow2 guest image due to insufficient filesystem size               https://bugs.launchpad.net/starlingx/+bug/1819688

SSH to secure boot VM fails after evacuation               https://bugs.launchpad.net/starlingx/+bug/1839320

platform keystone account lockout feature is not enabled               https://bugs.launchpad.net/starlingx/+bug/1838100

stx-openstack application-applying stuck at osh-openstack-placement               https://bugs.launchpad.net/starlingx/+bug/1837769

after changing a setting of panko stx-openstack failed to reach 'applied' status after 1800 seconds https://bugs.launchpad.net/starlingx/+bug/1828056

-----------------------------------------------------------------------------



For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit?pli=1#gid=322455033


Regards!
Maria G


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190808/8ef10d03/attachment-0001.html>


More information about the Starlingx-discuss mailing list