Hi Forrest,

 

From next Sanity Test report (tomorrow) will has the tests to ping between VMs.

At the end of the report you can find a link to the detailed list of test cases.

 

Regards.

Juan Carlos Alonso

 

From: Zhao, Forrest
Sent: Tuesday, March 26, 2019 9:22 PM
To: Alonso, Juan Carlos <juan.carlos.alonso@intel.com>
Cc: starlingx-discuss@lists.starlingx.io
Subject: RE: [Containers] Sanity Test - ISO 20190325

 

Hi Carlos,

 

Has VM connectivity test been added to regular sanity test, as is requested in attached email?

 

Besides the number of PASS/FAIL test cases, how can we know/check which test cases are actually PASS/FAIL?

 

Thanks,

Forrest

 

From: Alonso, Juan Carlos [mailto:juan.carlos.alonso@intel.com]
Sent: Wednesday, March 27, 2019 11:13 AM
To: starlingx-discuss@lists.starlingx.io
Subject: [Starlingx-discuss] [Containers] Sanity Test - ISO 20190325

 

Status of the Sanity Test for last CENGN ISO: bootimage.iso from 2019-Mar-25 (link)

 

Status: YELLOW

 

===========================================

 

Sanity Test is executed in a Containers – Bare Metal Environment

 

AIO - Simplex

 

Setup             Manual [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

 

TOTAL: [ 57 TCs FAIL ]

 

AIO - Duplex

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: [ 58 TCs PASS ]

 

Standard - Local Storage (2+2)

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: [ 58 TCs PASS ]

 

Standard - Dedicated Storage (2+2+2)

 

Setup             Manual [PASS]

Provisioning      01 TCs [PASS]

Sanity OpenStack  16 TCs [PASS] | 36 TCs [FAIL]

Sanity Platform   05 TCs [PASS]

 

TOTAL: [ 22 TCs PASS | 36 TCs FAIL ]

 

===========================================

 

Sanity Test is executed in a Containers - Virtual Environment

 

AIO - Simplex

 

Setup             04 TCs [PASS]

Provisioning      01 TCs [FAIL]

Sanity OpenStack  49 TCs [FAIL]

Sanity Platform   07 TCs [FAIL]

 

TOTAL: [ 04 TCs PASS | 57 TCs FAIL ]

 

AIO - Duplex

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: [ 62 TCs PASS ]

 

Standard – Local Storage

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: [ 62 TCs PASS ]

 

Standard – Dedicated Storage

 

Setup             04 TCs [PASS] 

Provisioning      01 TCs [PASS]

Sanity OpenStack  52 TCs [PASS]

Sanity Platform   05 TCs [PASS]

 

TOTAL: [ 62 TCs PASS ]

 

------------------------------------------------------------------

 

Simplex - application-apply fails at 95% - ceilometer pod

Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1820928

 

Could not create VMs on Standard Dedicated Storage, in bare metal environment

Launchpad opened: https://bugs.launchpad.net/starlingx/+bug/1821841

 

------------------------------------------------------------------

 

This is the list of test cases executed: https://wiki.openstack.org/wiki/StarlingX/Test/SanityTests

 

Regards.

Juan Carlos Alonso