Ada/Maria,

I have a suggestion to the sanity test report, by looking at the cases you marked as “FAIL”, actually there are quite some cases are actually “Blocked” due to the failure cases. For example:

 

Standard – Local Storage

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

 

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

 

 

Due to the fact that you’re not able to provision Standard BM, they (49+7) cases were blocked. Normally I will mark those as “Blocked” instead of “Fail”.

 

Comments?

Thx. - cindy

 

 

From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra@intel.com]
Sent: Wednesday, May 1, 2019 7:26 AM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430

 

Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-APRIL-30 (link)

 

Status: RED

 

===========================================

 

Sanity Test is executed in a Containers – Bare Metal Environment

 

AIO - Simplex

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [FAIL] | 03 TCs FAIL  

Sanity Platform   07 TCs [PASS

 

TOTAL: 57 TCS [Fail : 3 TCs]

 

AIO – Duplex

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: 57 TCS PASS

 

Standard - Local Storage (2+2)

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]

 

TOTAL: 57 TCS PASS

 

Standard - Dedicated Storage (2+2+2)

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: 57 TCS PASS

 

 

 

Sanity Test is executed in a Containers - Virtual Environment

 

AIO - Simplex

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS] | 3 TCs FAIL

Sanity Platform   07 TCs [PASS]

 

TOTAL: [ 61 TCs ] [Fail : 3 TCs]

 

 

AIO - Duplex

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]

 

TOTAL: [ 61 TCs PASS ]

 

 

Standard – Local Storage

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

 

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

 

----------------------------------------------------------

 

-          VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

-          Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

 

For more detail of the tests: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack

 

 

Regards

Maria G.