[Starlingx-discuss] [Containers] Sanity Test - ISO 20190311

Tue Mar 12 02:31:14 UTC 2019

Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-Mar-11 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/latest_build/outputs/iso/bootimage.iso>)

Status: YELLOW

===========================================

Sanity Test is executed in a Containers - Bare Metal Environment

Simplex

Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

TOTAL: [58 TCs PASS | 01 TCs FAIL ]

Duplex

Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   03 TCs [FAIL]

TOTAL: [53 TCs PASS | 04 TCs FAIL ]

Standard Local Storage (2+2)

Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  16 TCs [PASS] | 33 TCS [FAIL]

Sanity Platform   03 TCs [PASS]

TOTAL: [ 20 TCs PASS | 34 TCs FAIL ]

Standard External Storage (2+2+2)

Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   03 TCs [PASS]

TOTAL: [ 56 TCs PASS | 01 TCs FAIL ]

===========================================

Sanity Test is executed in a Containers - Virtual Environment

Simplex

Setup             04 TCs [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

TOTAL: [ 61 TCs PASS | 01 TCs FAIL ]

Duplex

Setup             04 TCs [PASS]
Provisioning      01 TCs [FAIL]
Sanity OpenStack  29 TCs [PASS] | 23 TCS [FAIL]
Sanity Platform   03 TCs [FAIL]

TOTAL: [ 37 TCs PASS | 23 TCs FAIL ]

------------------------------------------------------------------

openstack network segment range create FAILED

Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1819541

Duplex virtual, Duplex Bare Metal,  Standard Local Storage Bare Metal and Standard External Storage configurations suddenly swacted during Sanity Test and cause a lot of test cases fail, debugging in progress to know if it is a real issue or not.

Also will check in next release if behavior is still present.

------------------------------------------------------------------

This is the list of test cases executed: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests

Regards.

Juan Carlos Alonso

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20190312/72bd215c/attachment-0001.html>