[Starlingx-discuss] [ Test ] meeting notes - 05/19/2020

[Liu, Yang (YOW)]

Agenda for 05/19/2020

Attendees: Yang, Nicolae, Ruediger, GeorgeC, Bruce, Mihail, ChrisW

·         Sanity Status:

  *   Last Saturday's (5/16) sanity passed. No new builds since 5/17.
·         stx4.0 testing:

  *   Feature testing:
§  https://docs.google.com/spreadsheets/d/1C9n4aRQT7xMyTDCT5sfuZGNI9ermAX5BYRypzcCpQ6U/edit#gid=0
§  Centos8:
·         TPM tested - https, ssl
·         Test in progress using Mellonox CX5
§  Ceph - Rook
·         In progress. Some are blocked. Nic's team to update feature spreadsheet for block reason and follow up with designer prime.
§  Upversion Openstack services used by flock components on host:
·         Test completed with robot sanity and regression on eng load. Nic to update feature spreadsheet.
§  Upgrade Containerized OpenStack to Ussuri (and OpenStack helm rebase)
·         Got eng load, working with ZiPeng - encountered issues, such as missing images, stx-openstack does not apply - blocked at the moment.
·         Tested on a eng load, executed robot and design sanity with all configs. Nic to update feature spreadsheet.
§  Windows Active directory completed
§  Red fish virual media support - testing  completed
§  Kubernetes Upgrade Support in progress
·         Completed - feature spreadsheet updated.
§  Kata Containers - started, not a focus at the moment.
·         Documentation provided by desiner was tested
·         Regression and performance testing in progress - ETA 5/29.
§  TSN - not started
§  B&R with etcd database
·         Feature testing completed, spreadsheet updated

  *   Regression testing:
§  Regression started on 5/18
§  Automated robot regression ran and it was noticed that test teardown is not working properly
·         Long term is to convert to pytest test cases
·         Not feasible to fix the robot automated tests for 4.0, plan is to make use of them as semi-automated test cases, and do teardown manually
·         Risk: can potentially impact the regression schedule. Nic to assess the risk.
§  Automated pytest neutron test cases ran on 5/18, results to be analyzed.
·         Open topic

  *   Test automation
§  Need automated installation script - on hold until after stx4.0 (teams are loaded with stx4.0 feature and regression testing)
·         Robot framwork installation scripts are used in daily sanity with basic setup and provisioning - needs libvert and qemu installed
o    https://opendev.org/starlingx/test/src/branch/master/automated-robot-suite
o    Nic: Look into adding to Docs/Wiki.
§  Suggest to prioritize the features without hardware dependency
·         Yang to add column to existing feature spreadsheet to identify automation candidates

  *   Test in the open
§  No obvious progress.
§  Probably need to check with Infra and Zoom.
·         Yang to meet with Bill to discuss.

  *   Zuul failed - issue resolved now
§  GeorgeP's fix is merged
§  Mihail's commit is also merged with above fix.

  *   Zoom meeting schedule doesn't seem to be right on the wiki
§  Yang has updated the test meeting times on wiki

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.starlingx.io/pipermail/starlingx-discuss/attachments/20200519/789f296b/attachment-0001.html>