Hi Forrest,
From next Sanity Test report (tomorrow) will has the tests to ping between VMs.
At the end of the report you can find a link to the detailed list of test cases.
Regards.
Juan Carlos Alonso
Hi Carlos,
Has VM connectivity test been added to regular sanity test, as is requested in attached email?
Besides the number of PASS/FAIL test cases, how can we know/check which test cases are actually PASS/FAIL?
Thanks,
Forrest
From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com]
Sent: Wednesday, March 27, 2019 11:13 AM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190325
Status of the Sanity Test for last CENGN ISO:
bootimage.iso from 2019-Mar-25
(link)
Status:
YELLOW
===========================================
Sanity Test is executed in a
Containers – Bare Metal Environment
AIO -
Simplex
Setup Manual [PASS]
Provisioning 01 TCs [FAIL]
Sanity OpenStack
49 TCs [FAIL]
Sanity Platform 07 TCs [FAIL]
TOTAL: [
57 TCs FAIL ]
AIO -
Duplex
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [
58 TCs PASS
]
Standard - Local Storage (2+2)
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack
52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [
58 TCs PASS ]
Standard
- Dedicated Storage (2+2+2)
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack
16 TCs [PASS] |
36 TCs [FAIL]
Sanity Platform 05 TCs [PASS]
TOTAL: [
22 TCs PASS
| 36 TCs FAIL ]
===========================================
Sanity Test is executed in a
Containers - Virtual Environment
AIO -
Simplex
Setup 04 TCs [PASS]
Provisioning 01 TCs [FAIL]
Sanity OpenStack
49 TCs [FAIL]
Sanity Platform 07 TCs [FAIL]
TOTAL: [ 04 TCs PASS |
57 TCs FAIL ]
AIO - Duplex
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [ 62 TCs PASS
]
Standard – Local Storage
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [ 62 TCs PASS
]
Standard – Dedicated Storage
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52 TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL: [ 62 TCs PASS
]
------------------------------------------------------------------
Simplex - application-apply fails at 95% - ceilometer pod
Launchpad opened:
https://bugs.launchpad.net/starlingx/+bug/1820928
Could not create VMs on Standard Dedicated Storage, in bare metal environment
Launchpad opened:
https://bugs.launchpad.net/starlingx/+bug/1821841
------------------------------------------------------------------
This is the list of test cases executed:
https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests
Regards.
Juan Carlos Alonso