Hi Carlos,
Has VM connectivity test been added to regular sanity test, as is requested in attached email?
Besides the number of PASS/FAIL test cases, how can we know/check which test cases are actually PASS/FAIL?
Thanks,
Forrest
Status of the Sanity Test for last CENGN ISO:
bootimage.iso from 2019-Mar-25
(link)
Status:
YELLOW
===========================================
Sanity Test is executed in a
Containers – Bare Metal Environment
AIO -
Simplex
Setup Manual [PASS]
Provisioning 01 TCs [FAIL]
Sanity OpenStack
49 TCs [FAIL]
Sanity Platform 07 TCs [FAIL]
TOTAL: [
57 TCs FAIL ]
AIO -
Duplex
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [
58 TCs PASS
]
Standard - Local Storage (2+2)
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack
52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [
58 TCs PASS ]
Standard
- Dedicated Storage (2+2+2)
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack
16 TCs [PASS] |
36 TCs [FAIL]
Sanity Platform 05 TCs [PASS]
TOTAL: [
22 TCs PASS
| 36 TCs FAIL ]
===========================================
Sanity Test is executed in a
Containers - Virtual Environment
AIO -
Simplex
Setup 04 TCs [PASS]
Provisioning 01 TCs [FAIL]
Sanity OpenStack
49 TCs [FAIL]
Sanity Platform 07 TCs [FAIL]
TOTAL: [ 04 TCs PASS |
57 TCs FAIL ]
AIO - Duplex
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [ 62 TCs PASS
]
Standard – Local Storage
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [ 62 TCs PASS
]
Standard – Dedicated Storage
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [ 62 TCs PASS
]
------------------------------------------------------------------
Simplex - application-apply fails at 95% - ceilometer pod
Launchpad opened:
https://bugs.launchpad.net/starlingx/+bug/1820928
Could not create VMs on Standard Dedicated Storage, in bare metal environment
Launchpad opened:
https://bugs.launchpad.net/starlingx/+bug/1821841
------------------------------------------------------------------
This is the list of test cases executed:
https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests
Regards.
Juan Carlos Alonso