[Starlingx-discuss] [ Regression testing - stx2.0 ] Report for 8/13/19
Perez Ibarra, Maria G
maria.g.perez.ibarra at intel.com
Tue Aug 13 22:54:09 UTC 2019
StarlingX 2.0 Release Status:
ISO: BUILD_ID=" 20190809T053000Z" from (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190809T053000Z/outputs/iso/>)
----------------------------------------------------------------------
MANUAL EXECUTION
----------------------------------------------------------------------
Overall Results:
Total = 493
Pass = 412
Fail = 25
Blocked = 12
Not Run = 0
Obsolete = 26
Deferred = 18
Total executed = 449
Pass Rate = 94.27%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Regression - AIO-SX 25 PASS | 1 Obsolete
Regression - Backup & Restore 6 Deferrer
Regression - Distributed Cloud
Regression - Gnoochi 15 PASS
Regression - FM 3 PASS
Regression - HA 11 PASS | 1 FAIL
Regression - Heat 12 PASS | 1 OBSOLETE
Regression - Horizon 4 PASS
Regression - Install and Config 7 PASS | 1 Fail
Regression - Maintenance 8 PASS | 1 FAIL
Regression - Networking 122 PASS | 1 FAIL | 2 BLOCKED | 19 OBSOLETE
Regression - Nova 24 PASS | 13 FAIL | 3 OBSOLETE
Regression - Security 34 PASS | 1 FAIL | 2 BLOCKED | 1 OBSOLETE | 4 Deferrer
Regression - Storage 24 PASS |1 BLOCKED| 2 Deferrer
Regression - Inventory 30 PASS
System Test 20 PASS | 2 FAIL | 7 BLOCKED | 1 OBSOLETE | 6 Deferrer
Regression - new features 73 PASS | 5 FAIL
---------------------------------------------------------------------------
AUTOMATED EXECUTION - INTEL
---------------------------------------------------------------------------
Overall Results:
Pass = 203
Fail = 32
Total executed = 235
Pass Rate = 86.38%
Formula used : Pass Rate = pass * 100 / (pass + fail)
Results per Domain:
Fault-Management 15 PASS
Gnocchi 12 PASS
HEAT 6 PASS
High-Availability 9 PASS | 2 FAIL
Horizon 2 PASS
Insallation-And-Config 8 PASS
Maintenance 27 PASS | 2 FAIL
Networking 45 PASS | 7 FAIL
Nova 17 PASS | 2 FAIL
Security 19 PASS | 4 FAIL
Storage 8 PASS | 8 FAIL
SYSINVENTORY 27 PASS | 4 FAIL
System 8 PASS |3 FAIL
----------------------------------------------------------------------
AUTOMATED EXECUTION - Wind River
----------------------------------------------------------------------
"Pending Results"
----------------------------------------------------------------------
user does not login within configured time(60s) login is aborted https://bugs.launchpad.net/starlingx/+bug/1833469
After pull data cable on the compute, no alarm has triggered https://bugs.launchpad.net/starlingx/+bug/1834512
Containers: lock_host failed on a host with config_drive VM https://bugs.launchpad.net/starlingx/+bug/1821026
200.006 alarm "controller-0 is degraded due to the failure of its 'pci-irq-affinity-agent' process" after reboot https://bugs.launchpad.net/starlingx/+bug/1832047
stx-openstack apply takes longer time when lock and unlock on standby controller https://bugs.launchpad.net/starlingx/+bug/1834083
Port list was not showing for some computes during install https://bugs.launchpad.net/starlingx/+bug/1834245
neutron-l3-agent and neutron-dhcp-agent never recovered after force reboot on compute https://bugs.launchpad.net/starlingx/+bug/1835807
When creating instance with pci-passthrough port getting error https://bugs.launchpad.net/starlingx/+bug/1836682
unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633
application apply fails after compute lock and unlock https://bugs.launchpad.net/starlingx/+bug/1836609
403 error in horizon log when try to update the flavor metadata (and admin user is logged out) https://bugs.launchpad.net/starlingx/+bug/1821213
instance creating via horizon failed https://bugs.launchpad.net/starlingx/+bug/1829925
After active controller reboot, VM boot up failed with error "Failed to allocate the network(s), not rescheduling" https://bugs.launchpad.net/starlingx/+bug/1836928
nova instance remnant left behind after cold migration completes https://bugs.launchpad.net/starlingx/+bug/1824858
disk_available_least value updates when instance moved but not to the value expected https://bugs.launchpad.net/nova/+bug/1834527
Containers: vm unreachable for minutes after live migration or vm reboot https://bugs.launchpad.net/starlingx/+bug/1818118
100.114 NTP alarm not cleared after swact https://bugs.launchpad.net/starlingx/+bug/1834071
unexpected output when wipe unassigned disk https://bugs.launchpad.net/starlingx/+bug/1836633
AIO-DX Application apply aborted Unexpected process termination while application-apply was in progress https://bugs.launchpad.net/starlingx/+bug/1838101
Uncontrolled swact on standard system is slow https://bugs.launchpad.net/starlingx/+bug/1838411
tenant-mgmt-net not reachable from external network https://bugs.launchpad.net/starlingx/+bug/1836252
VM filesystem is not RW when attached the 2nd volume https://bugs.launchpad.net/starlingx/+bug/1838546
dedicated instance on low latency worker node not appearing in C1 state https://bugs.launchpad.net/starlingx/+bug/1838524
Intermittently the openstack server show indicates that the server does not exist (in live migration tests) https://bugs.launchpad.net/starlingx/+bug/1838676
Resize to swapless flavor still looking for swap https://bugs.launchpad.net/nova/+bug/1762423
SSH to VM failed by Permission denied (publickey) https://bugs.launchpad.net/starlingx/+bug/1824174
vSwitch 1G Hugepage available size cannot be changed https://bugs.launchpad.net/starlingx/+bug/1834530
hypervisor stays down after force lock and unlock due to pci-irq-affinity-agent process failure https://bugs.launchpad.net/starlingx/+bug/1839160
Image conversion fails with large qcow2 guest image due to insufficient filesystem size https://bugs.launchpad.net/starlingx/+bug/1819688
SSH to secure boot VM fails after evacuation https://bugs.launchpad.net/starlingx/+bug/1839320
platform keystone account lockout feature is not enabled https://bugs.launchpad.net/starlingx/+bug/1838100
stx-openstack application-applying stuck at osh-openstack-placement https://bugs.launchpad.net/starlingx/+bug/1837769
after changing a setting of panko stx-openstack failed to reach 'applied' status after 1800 seconds https://bugs.launchpad.net/starlingx/+bug/1828056
-----------------------------------------------------------------------------
For more detail of the tests: https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit?pli=1#gid=322455033
Regards!
Maria G
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190813/5dca84fe/attachment-0001.html>
More information about the Starlingx-discuss
mailing list