[Starlingx-discuss] [ Test ] meeting notes for 10/22

[Cabrales, Ada]

Agenda for 10/22
Attendees: Elio, Al, Cristopher, Fernando, JC, Jose, JP, Maria P, Ada, Richo, Yang
    
1. Sanity status
   Intel
      Build system broken since Friday. It was restored yesterday, but https://review.opendev.org/#/c/689438/ - broke standard and external storage.  

    WindRiver
      Same as Intel.
      https://bugs.launchpad.net/starlingx/+bug/1848721 - Another issue with platform-integ-app failing. 

   Unified sanity
      On track for 10/28?
      Cristopher to work on the setup for splitting the run in bare metal environment. 

         Yang to send an email for final sync - Ada to involve the required people to the thread.

2. stx.3.0 testing updates
   Feature testing
      Tracker - https://docs.google.com/spreadsheets/d/1n9P7as4iqO55DytIRuIGdyc7x0n2WM_q-cMfHcItJlY/edit?usp=sharing
      Distributed cloud - Yang
         52% of progress - checking on the failure, not knowing if it's a procedure or a real issue.

      Backup and restore - Yang
         63% progress, 2 failures with launchpads associated.

      Fault Containerization - Fer
         https://bugs.launchpad.net/starlingx/+bug/1848094 - asking Ghada what else is missing in the launchpad.
         Add a test for checking the FM container end point has switch to https. - Pending

      Upversion to train - JC
         EB delivered last week. It works ok in virt environment, but fails in Bare metal (related to nova)
         a new EB is being generated. 
         12 tests done: network and glance.

   GPU for K8 - Richo
      Basic tests done. One test for using the feature will be done as second priority if time allows it. 
      Tested on standard.

   QAT for K8 - Richo
      Basic test done. Using exercising the feature will be done if we have time available.
      Executed in a EB.

   Redfish - Cristopher
      New tests cases to be created for provisioning (bulk installs). - status?
      Let's work on setup an IPv6 lab for running test on this infra. - JC to send a reminder for getting the info/steps requested.
      82% of progress. Due date will be EOW.

   Infra & Cluster monitoring - Yang
      Tests defined are done. Will review for making sure on the coverage.

   Regression testing:
      Tracker - https://docs.google.com/spreadsheets/d/1X085xI96M6PIeum87w6IEF11G-TG-W1OeGuAJWnrAWI/edit?usp=sharing
      Please make sure to use the tag stx.regression for all the launchpads created coming out from these tests.

      Automated robot - ~95% done, please update the report.
         For gnocchi - yes, it's disabled by default.
         Will double check failures to make sure they are real.

      Automated pytest - will collect the data. Some has been run.

      Manual - 46% of progress. 

      A launchpad created - SSH / SCP to VM failed using NAMESPACE while IP is assigned by Horizon 
         https://bugs.launchpad.net/starlingx/+bug/1835807
         https://bugs.launchpad.net/starlingx/+bug/1836252

3. Opens
   Elio - We are in the 3rd week of regression, 4 weeks left.

--
Ada