+1, that's a good idea. From: Xie, Cindy <cindy.xie@intel.com> Sent: Tuesday, April 30, 2019 10:08 PM To: Perez Ibarra, Maria G <maria.g.perez.ibarra@intel.com>; starlingx-discuss@lists.starlingx.io Subject: Re: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430 Ada/Maria, I have a suggestion to the sanity test report, by looking at the cases you marked as "FAIL", actually there are quite some cases are actually "Blocked" due to the failure cases. For example: Standard - Local Storage Setup 04 TCs [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs] Due to the fact that you're not able to provision Standard BM, they (49+7) cases were blocked. Normally I will mark those as "Blocked" instead of "Fail". Comments? Thx. - cindy From: Perez Ibarra, Maria G [mailto:maria.g.perez.ibarra@intel.com] Sent: Wednesday, May 1, 2019 7:26 AM To: starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190430 Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-APRIL-30 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190429T233000Z/>) Status: RED =========================================== Sanity Test is executed in a Containers - Bare Metal Environment AIO - Simplex Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [FAIL] | 03 TCs FAIL Sanity Platform 07 TCs [PASS] TOTAL: 57 TCS [Fail : 3 TCs] AIO - Duplex Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: 57 TCS PASS Standard - Local Storage (2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: 57 TCS PASS Standard - Dedicated Storage (2+2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: 57 TCS PASS Sanity Test is executed in a Containers - Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] | 3 TCs FAIL Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs ] [Fail : 3 TCs] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 49 TCs [PASS] Sanity Platform 07 TCs [PASS] TOTAL: [ 61 TCs PASS ] Standard - Local Storage Setup 04 TCs [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 61 TCs PASS ] [Fail : 57 TCs] ---------------------------------------------------------- - VM resize failed by "No valid host was found" https://bugs.launchpad.net/starlingx/+bug/1824412 - Failing application-apply due error on osh-openstack-openvswitch https://bugs.launchpad.net/starlingx/+bug/1826445 For more detail of the tests: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests#Sanity-OpenStack Regards Maria G.