[Starlingx-discuss] [Containers] Sanity Test - ISO 20190311

Alonso, Juan Carlos juan.carlos.alonso at intel.com
Tue Mar 12 02:31:14 UTC 2019


Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-Mar-11 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_build/outputs/iso/bootimage.iso>)



Status: YELLOW



===========================================



Sanity Test is executed in a Containers - Bare Metal Environment



Simplex



Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]



TOTAL: [58 TCs PASS | 01 TCs FAIL ]



Duplex



Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   03 TCs [FAIL]



TOTAL: [53 TCs PASS | 04 TCs FAIL ]



Standard Local Storage (2+2)



Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  16 TCs [PASS] | 33 TCS [FAIL]

Sanity Platform   03 TCs [PASS]



TOTAL: [ 20 TCs PASS | 34 TCs FAIL ]



Standard External Storage (2+2+2)



Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   03 TCs [PASS]



TOTAL: [ 56 TCs PASS | 01 TCs FAIL ]



===========================================



Sanity Test is executed in a Containers - Virtual Environment



Simplex



Setup             04 TCs [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]



TOTAL: [ 61 TCs PASS | 01 TCs FAIL ]


Duplex

Setup             04 TCs [PASS]
Provisioning      01 TCs [FAIL]
Sanity OpenStack  29 TCs [PASS] | 23 TCS [FAIL]
Sanity Platform   03 TCs [FAIL]

TOTAL: [ 37 TCs PASS | 23 TCs FAIL ]





------------------------------------------------------------------

openstack network segment range create FAILED

Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1819541



Duplex virtual, Duplex Bare Metal,  Standard Local Storage Bare Metal and Standard External Storage configurations suddenly swacted during Sanity Test and cause a lot of test cases fail, debugging in progress to know if it is a real issue or not.

Also will check in next release if behavior is still present.

------------------------------------------------------------------



This is the list of test cases executed: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests



Regards.

Juan Carlos Alonso



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190312/72bd215c/attachment-0001.html>


More information about the Starlingx-discuss mailing list