Yes, I agree it's an excellent idea
+1, that’s a good idea.
From: Xie, Cindy <cindy.xie@intel.com>
Sent: Tuesday, April 30, 2019 10:08 PM
To: Perez Ibarra, Maria G <maria.g.perez.ibarra@intel.com>;
starlingx-discuss@lists.starlingx.io
Subject: Re: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430
Ada/Maria,
I have a suggestion to the sanity test report, by looking at the cases you marked as “FAIL”, actually there are quite some cases are actually “Blocked” due to the failure cases. For example:
Standard – Local Storage
Setup 04 TCs [PASS]
Provisioning 01 TCs [FAIL]
Sanity OpenStack 49 TCs [FAIL]
Sanity Platform 07 TCs [FAIL]
TOTAL: [ 61 TCs PASS ]
[Fail : 57 TCs]
Due to the fact that you’re not able to provision Standard BM, they (49+7) cases were blocked. Normally I will mark those as “Blocked” instead of “Fail”.
Comments?
Thx. - cindy
From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra@intel.com]
Sent: Wednesday, May 1, 2019 7:26 AM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430
Status of the Sanity Test for last CENGN ISO:
bootimage.iso from 2019-APRIL-30
(link)
Status:
RED
===========================================
Sanity Test is executed in a
Containers – Bare Metal Environment
AIO -
Simplex
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack
49 TCs [FAIL]
| 03 TCs FAIL
Sanity Platform 07 TCs [PASS]
TOTAL:
57 TCS
[Fail : 3 TCs]
AIO –
Duplex
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52
TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL:
57 TCS
PASS
Standard - Local Storage (2+2)
Setup Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack
49 TCs [PASS]
Sanity Platform 07 TCs [PASS]
TOTAL:
57 TCS
PASS
Standard
- Dedicated Storage (2+2+2)
Setup
Manual [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 52
TCs [PASS]
Sanity Platform 05 TCs [PASS]
TOTAL:
57 TCS PASS
Sanity Test is executed in a
Containers - Virtual Environment
AIO -
Simplex
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 49 TCs [PASS] |
3 TCs FAIL
Sanity Platform 07 TCs [PASS]
TOTAL: [ 61 TCs ]
[Fail : 3 TCs]
AIO -
Duplex
Setup 04 TCs [PASS]
Provisioning 01 TCs [PASS]
Sanity OpenStack 49 TCs [PASS]
Sanity Platform 07 TCs [PASS]
TOTAL: [ 61 TCs PASS ]
Standard – Local Storage
Setup 04 TCs [PASS]
Provisioning 01 TCs [FAIL]
Sanity OpenStack 49 TCs [FAIL]
Sanity Platform 07 TCs [FAIL]
TOTAL: [ 61 TCs PASS ]
[Fail : 57 TCs]
----------------------------------------------------------
-
VM resize failed by "No valid host was found"
https://bugs.launchpad.net/starlingx/+bug/1824412
-
Failing application-apply due error on osh-openstack-openvswitch
https://bugs.launchpad.net/starlingx/+bug/1826445
For more detail of the tests:
https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack
Regards
Maria G.