[Starlingx-discuss] [ Test ] Meeting notes - 06/24/2019

[Cabrales, Ada]

Agenda for 06/24
Attendees: Elio, Richo, Al, Critopher, JC, Maria P, Numan, Yang, Bruce
    
    1. Regression testing status - Elio, Numan
    Tracker - https://docs.google.com/spreadsheets/d/1MoBroFimeQjsJvCC_N_DSLYMQsNZVMzTwAVc5tPy_t0/edit#gid=322455033
    MS-3 declared on 06/22
ISO for regression testing is from 06/21
Intel - 110 tests executed manually (began last week), 7 failures. 
Automated regression to begin today. Plan is to execute one domain per day, in 4 configs. Running on virtual, due to tests cases were created in this env and we are having problems running them on bare metal. 
Wind River - automated regression ran this weekend - results to be updated, launchpads in progress. Some failures in nova for live migration.

Reports to be sent Tuesday and Thursday. 
Maria P to send the first report today.

Goal is to finish by last week of July.
Update the title (in the tracker) and status of the bugs found.
Ask Ghada for creating a tag for bugs found during regression - stx.regression - Numan

    2. Sanity status
    Two greens in a row. Today's looks good so far.
The deployment times continue to increase
    Numan to send info about their setup and deployment times.
         Cristopher to collect the info from proxy config.
Unlocking master controller is taking more and more time. Track this time. 
    
    3. Testing framework - 
    Erich finished the review
    Elio and JC - please review the code.
    wrsroot patch is going to be submitted this week. 
    For history - it doesn't make test to include it on this commit.
    
    The testing framework is a parallel project, it doesn't have impact on the final stx product.
    
    Saul - is there a deployment capability included into the testing framework, or covers the testing only?
    Yang - is for running the tests in an already configured system.

    How to address issues found in the framework (launchpads?)
  Launchpads will be the way of reporting, however, we have to make sure of not affecting stx statistics. 
Proposal is to a  use prefix [stx-test] into the title and also, use a tag. 
For new features/tests, use storyboard, as the project does.
Ada to begin a mail thread for notifying this.

Yang - on vacations starting this Friday.

    4.  Feature testing status - Total/pass/fail/block
Containers 
Ada - 75/40/1/2
Ask to be updated offline.
Numan - 82/58/3/0
No update. 

OpenStack patch elimination
Ada - 50/21/0/6
Testing has been resumed. Latests ISO includes features that were blocking execution. 
Numan - 8/4/4/0
Retesting launchpads. 

Centos 7.6 - QAT - 12/9/0/0
10 executed - 1 pending (requires image with QAT driver). 
REST API pending - help required to define the steps. Numan to check with Cris.

Containerized OVS - 15/8/0/0
In progress - results to be updated soon. 50% already done.
No problems identified so far. 

Ceph upgrade - 26/15/0/7
6 blocked, 3 for retesting, 1 deferred - storyboard to be created.
i/o test to be run soon. 

   5. Opens
   Numan - some Intel people is going to WR for training. - This will be on late August. Request is in approval loop.