[Starlingx-discuss] [Containers] Sanity Test - ISO 20190430

[Zvonar, Bill]

+1, that's a good idea.

From: Xie, Cindy <cindy.xie at intel.com>
Sent: Tuesday, April 30, 2019 10:08 PM
To: Perez Ibarra, Maria G <maria.g.perez.ibarra at intel.com>; starlingx-discuss at lists.starlingx.io
Subject: Re: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430

Ada/Maria,
I have a suggestion to the sanity test report, by looking at the cases you marked as "FAIL", actually there are quite some cases are actually "Blocked" due to the failure cases. For example:

Standard - Local Storage

Setup             04 TCs [PASS]
Provisioning      01 TCs [FAIL]
Sanity OpenStack  49 TCs [FAIL]
Sanity Platform   07 TCs [FAIL]

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]


Due to the fact that you're not able to provision Standard BM, they (49+7) cases were blocked. Normally I will mark those as "Blocked" instead of "Fail".

Comments?
Thx. - cindy


From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra at intel.com]
Sent: Wednesday, May 1, 2019 7:26 AM
To: starlingx-discuss at lists.starlingx.io<mailto:starlingx-discuss at lists.starlingx.io>
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430


Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-APRIL-30 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190429T233000Z/>)


Status: RED



===========================================



Sanity Test is executed in a Containers - Bare Metal Environment



AIO - Simplex



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [FAIL] | 03 TCs FAIL

Sanity Platform   07 TCs [PASS]



TOTAL: 57 TCS [Fail : 3 TCs]


AIO - Duplex



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]



TOTAL: 57 TCS PASS



Standard - Local Storage (2+2)



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  49 TCs [PASS]

Sanity Platform   07 TCs [PASS]



TOTAL: 57 TCS PASS



Standard - Dedicated Storage (2+2+2)



Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]



TOTAL: 57 TCS PASS





Sanity Test is executed in a Containers - Virtual Environment



AIO - Simplex


Setup             04 TCs [PASS]
Provisioning      01 TCs [PASS]
Sanity OpenStack  49 TCs [PASS] | 3 TCs FAIL
Sanity Platform   07 TCs [PASS]

TOTAL: [ 61 TCs ] [Fail : 3 TCs]



AIO - Duplex


Setup             04 TCs [PASS]
Provisioning      01 TCs [PASS]
Sanity OpenStack  49 TCs [PASS]
Sanity Platform   07 TCs [PASS]

TOTAL: [ 61 TCs PASS ]


Standard - Local Storage

Setup             04 TCs [PASS]
Provisioning      01 TCs [FAIL]
Sanity OpenStack  49 TCs [FAIL]
Sanity Platform   07 TCs [FAIL]

TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs]

----------------------------------------------------------


-          VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412

-          Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445

For more detail of the tests: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack


Regards
Maria G.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190501/f2e708fb/attachment-0001.html>