[Starlingx-discuss] [Containers] Sanity Test - ISO 20190325
Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-Mar-25 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190325T233000Z/outputs/iso/>) Status: YELLOW =========================================== Sanity Test is executed in a Containers - Bare Metal Environment AIO - Simplex Setup Manual [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 57 TCs FAIL ] AIO - Duplex Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 58 TCs PASS ] Standard - Local Storage (2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 58 TCs PASS ] Standard - Dedicated Storage (2+2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 16 TCs [PASS] | 36 TCs [FAIL] Sanity Platform 05 TCs [PASS] TOTAL: [ 22 TCs PASS | 36 TCs FAIL ] =========================================== Sanity Test is executed in a Containers - Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 04 TCs PASS | 57 TCs FAIL ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] Standard - Local Storage Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] Standard - Dedicated Storage Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] ------------------------------------------------------------------ Simplex - application-apply fails at 95% - ceilometer pod Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1820928 Could not create VMs on Standard Dedicated Storage, in bare metal environment Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1821841 ------------------------------------------------------------------ This is the list of test cases executed: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests Regards. Juan Carlos Alonso
Hi Carlos, Has VM connectivity test been added to regular sanity test, as is requested in attached email? Besides the number of PASS/FAIL test cases, how can we know/check which test cases are actually PASS/FAIL? Thanks, Forrest From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com] Sent: Wednesday, March 27, 2019 11:13 AM To: starlingx-discuss@lists.starlingx.io Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190325 Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-Mar-25 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190325T233000Z/outputs/iso/>) Status: YELLOW =========================================== Sanity Test is executed in a Containers - Bare Metal Environment AIO - Simplex Setup Manual [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 57 TCs FAIL ] AIO - Duplex Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 58 TCs PASS ] Standard - Local Storage (2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 58 TCs PASS ] Standard - Dedicated Storage (2+2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 16 TCs [PASS] | 36 TCs [FAIL] Sanity Platform 05 TCs [PASS] TOTAL: [ 22 TCs PASS | 36 TCs FAIL ] =========================================== Sanity Test is executed in a Containers - Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 04 TCs PASS | 57 TCs FAIL ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] Standard - Local Storage Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] Standard - Dedicated Storage Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] ------------------------------------------------------------------ Simplex - application-apply fails at 95% - ceilometer pod Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1820928 Could not create VMs on Standard Dedicated Storage, in bare metal environment Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1821841 ------------------------------------------------------------------ This is the list of test cases executed: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests Regards. Juan Carlos Alonso
Hi Forrest,
From next Sanity Test report (tomorrow) will has the tests to ping between VMs. At the end of the report you can find a link to the detailed list of test cases.
Regards. Juan Carlos Alonso From: Zhao, Forrest Sent: Tuesday, March 26, 2019 9:22 PM To: Alonso, Juan Carlos <juan.carlos.alonso@intel.com> Cc: starlingx-discuss@lists.starlingx.io Subject: RE: [Containers] Sanity Test - ISO 20190325 Hi Carlos, Has VM connectivity test been added to regular sanity test, as is requested in attached email? Besides the number of PASS/FAIL test cases, how can we know/check which test cases are actually PASS/FAIL? Thanks, Forrest From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com] Sent: Wednesday, March 27, 2019 11:13 AM To: starlingx-discuss@lists.starlingx.io<mailto:starlingx-discuss@lists.starlingx.io> Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190325 Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-Mar-25 (link<http://mirror.starlingx.cengn.ca/mirror/starlingx/master/centos/20190325T233000Z/outputs/iso/>) Status: YELLOW =========================================== Sanity Test is executed in a Containers - Bare Metal Environment AIO - Simplex Setup Manual [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 57 TCs FAIL ] AIO - Duplex Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 58 TCs PASS ] Standard - Local Storage (2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 58 TCs PASS ] Standard - Dedicated Storage (2+2+2) Setup Manual [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 16 TCs [PASS] | 36 TCs [FAIL] Sanity Platform 05 TCs [PASS] TOTAL: [ 22 TCs PASS | 36 TCs FAIL ] =========================================== Sanity Test is executed in a Containers - Virtual Environment AIO - Simplex Setup 04 TCs [PASS] Provisioning 01 TCs [FAIL] Sanity OpenStack 49 TCs [FAIL] Sanity Platform 07 TCs [FAIL] TOTAL: [ 04 TCs PASS | 57 TCs FAIL ] AIO - Duplex Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] Standard - Local Storage Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] Standard - Dedicated Storage Setup 04 TCs [PASS] Provisioning 01 TCs [PASS] Sanity OpenStack 52 TCs [PASS] Sanity Platform 05 TCs [PASS] TOTAL: [ 62 TCs PASS ] ------------------------------------------------------------------ Simplex - application-apply fails at 95% - ceilometer pod Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1820928 Could not create VMs on Standard Dedicated Storage, in bare metal environment Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1821841 ------------------------------------------------------------------ This is the list of test cases executed: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests Regards. Juan Carlos Alonso
participants (2)
-
Alonso, Juan Carlos
-
Zhao, Forrest