[Starlingx-discuss] [Containers] Sanity Test - ISO 20190428

[Perez Ibarra, Maria G]

Hello Frank,

I also see the improvement in these results more as yellow, however I had the instruction to classify the results as RED whenever a provisioning failed on any configuration, treating it as a critical issue. This could be a good opportunity to define the results classification within the test teams.


Regards
Maria G.


From: Miller, Frank [mailto:Frank.Miller at windriver.com]
Sent: Monday, April 29, 2019 11:17 PM
To: Perez Ibarra, Maria G <maria.g.perez.ibarra at intel.com>; starlingx-discuss at lists.starlingx.io
Subject: RE: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190428

Maria - the sanities are much improved and I don't think they should be labelled RED.  Looks more like YELLOW to me.

There are 2 issues reported in this sanity.  Can we get updates on the status of the 2 issues from the LP primes:

*        Cindy for: VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

*        Mingyuan for: Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

Let us know if you require assistance to triage/debug.

Frank

From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra at intel.com]
Sent: Monday, April 29, 2019 10:25 PM
To: starlingx-discuss at lists.starlingx.io<mailto:starlingx-discuss at lists.starlingx.io>
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190428


Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-APRIL-28 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190428T233000Z/>)


Status: RED



===========================================



Sanity Test is executed in a Containers - Bare Metal Environment



AIO - Simplex



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [FAIL] | 03 TCs FAIL

Sanity Platform   07 TCs [PASS]



TOTAL: 57 TCS [Fail : 3 TCs]


AIO - Duplex



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]



TOTAL: 57 TCS PASS



Standard - Local Storage (2+2)



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]



TOTAL: 57 TCS PASS



Standard - Dedicated Storage (2+2+2)



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]



TOTAL: 57 TCS PASS





Sanity Test is executed in a Containers - Virtual Environment



AIO - Simplex


Setup             04 TCs [PASS]
Provisioning      01 TCs [PASS]
Sanity OpenStack  49 TCs [PASS] | 3 TCs FAIL
Sanity Platform   07 TCs [PASS]

TOTAL: [ 61 TCs ] [Fail : 3 TCs]



AIO - Duplex


Setup             04 TCs [PASS]
Provisioning      01 TCs [PASS]
Sanity OpenStack  49 TCs [PASS]
Sanity Platform   07 TCs [PASS]

TOTAL: [ 61 TCs PASS ]


Standard - Local Storage

Setup             04 TCs [PASS]
Provisioning      01 TCs [FAIL]
Sanity OpenStack  49 TCs [FAIL]
Sanity Platform   07 TCs [FAIL]

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

----------------------------------------------------------


-        VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

-        Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

For more detail of the tests: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack


Regards
Maria G.



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190430/4aea4dc7/attachment-0001.html>