Ada/Maria,

I have a suggestion to the sanity test report, by looking at the cases you marked as “FAIL”, actually there are quite some cases are actually “Blocked” due to the failure cases. For example:

Standard – Local Storage

Setup             04 TCs [PASS] 

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

Due to the fact that you’re not able to provision Standard BM, they (49+7) cases were blocked. Normally I will mark those as “Blocked” instead of “Fail”.

Comments?

Thx. - cindy

From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra@intel.com]
Sent: Wednesday, May 1, 2019 7:26 AM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430

Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-APRIL-30 (link)

Status: RED

===========================================

Sanity Test is executed in a Containers – Bare Metal Environment

AIO - Simplex

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [FAIL] | 03 TCs FAIL

Sanity Platform   07 TCs [PASS] 

TOTAL: 57 TCS [Fail : 3 TCs]

AIO – Duplex

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

TOTAL: 57 TCS PASS

Standard - Local Storage (2+2)

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]

TOTAL: 57 TCS PASS

Standard - Dedicated Storage (2+2+2)

Setup            Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

TOTAL: 57 TCS PASS

Sanity Test is executed in a Containers - Virtual Environment

AIO - Simplex

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS] | 3 TCs FAIL

Sanity Platform   07 TCs [PASS]

TOTAL: [ 61 TCs ] [Fail : 3 TCs]

AIO - Duplex

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]

TOTAL: [ 61 TCs PASS ]

Standard – Local Storage

Setup             04 TCs [PASS] 

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

----------------------------------------------------------

- VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

- Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

For more detail of the tests: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack

Regards

Maria G.