Hello Frank,

 

I also see the improvement in these results more as yellow, however I had the instruction to classify the results as RED whenever a provisioning failed on any configuration, treating it as a critical issue. This could be a good opportunity to define the results classification within the test teams.

 

 

Regards

Maria G.

 

 

From: Miller, Frank [mailto:Frank.Miller@windriver.com]
Sent: Monday, April 29, 2019 11:17 PM
To: Perez Ibarra, Maria G <maria.g.perez.ibarra@intel.com>; starlingx-discuss@lists.starlingx.io
Subject: RE: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190428

 

Maria – the sanities are much improved and I don’t think they should be labelled RED.  Looks more like YELLOW to me.

 

There are 2 issues reported in this sanity.  Can we get updates on the status of the 2 issues from the LP primes:

·        Cindy for: VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

·        Mingyuan for: Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

 

Let us know if you require assistance to triage/debug.

 

Frank

 

From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra@intel.com]
Sent: Monday, April 29, 2019 10:25 PM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190428

 

Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-APRIL-28 (link)

 

Status: RED

 

===========================================

 

Sanity Test is executed in a Containers – Bare Metal Environment

 

AIO - Simplex

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [FAIL] | 03 TCs FAIL  

Sanity Platform   07 TCs [PASS

 

TOTAL: 57 TCS [Fail : 3 TCs]

 

AIO – Duplex

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: 57 TCS PASS

 

Standard - Local Storage (2+2)

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]

 

TOTAL: 57 TCS PASS

 

Standard - Dedicated Storage (2+2+2)

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: 57 TCS PASS

 

 

 

Sanity Test is executed in a Containers - Virtual Environment

 

AIO - Simplex

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS] | 3 TCs FAIL

Sanity Platform   07 TCs [PASS]

 

TOTAL: [ 61 TCs ] [Fail : 3 TCs]

 

 

AIO - Duplex

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]

 

TOTAL: [ 61 TCs PASS ]

 

 

Standard – Local Storage

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

 

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

 

----------------------------------------------------------

 

-        VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

-        Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

 

For more detail of the tests: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack

 

 

Regards

Maria G.