Following are the notes from Test Breakout Session in Phoenix, AZ. Date: Jan 16, 2019 Participants: Numan, Ada, Victor, Frank * Test Repository o Test Repository will be setup before 2019.05 release. There will be all the content in the repository but it may not be all automated. o Jose from Ada's team will be the lead in setting up the repository. o There will be at least 2 cores for each sub-repo. o Same person can be nominated as Cores for more than one sub-repo. o List of cores will be provided by Jan 31, 2019 o Structure of Test Repository was discussed in length and Test repository will be setup according to the discussed structure. * Test Dashboard o Christopher from Ada's team is working on setting up test dashboard. o First step is to estimate the space required to host test dashboard. o Once the estimated space requirement is available, we will be requesting CENGN to host this dashboard. o Christopher will be maintaining the dashboard. o Linking the dashboard with automation FW to upload test results will be the responsibility of team using the automation FW. * Publically Available Test Environment o Dean indicated that there is publically accessible environment available for other projects by Intel. The proposal is to add required number of servers in the existing pool so that new permissions are not needed to access these servers. o Ada is going to follow up with Dean and Bruce about it. o There will be 4 configurations provided for public access (AIO-Simplex, AIO-Duplex, Multi-Node, Multi-Node with Dedicated Storage). o Setting up a scheduler and how the permissions will be granted is not decided at this point. It will be decided once the servers are available. * Sanity o Sanity test cases will change due to patch elimination and containerization. o Numan will provide the procedure for sanity test cases to community. o Ada's team is going to automate these test cases and provide the automated tests to community. * Regression (Manual / Automated) o Some features will not be available after Patch Elimination. o Test Case procedures will change for some features that are available in Stein Release. o Numan and Ada's team will collaborate to go through these test case suites and find out which test cases are obsolete and which test cases need changing. o These changes will be shared with community and the test cases will be uploaded to Test Repository. * Virtual Environment Installer o Numan and Ada's team will work together to create a Virtual Environment Installer for community. * Updating Test Wiki o Test Wiki needs updating o As the test cases are changing due to Patch Elimination and Containerization, Test Wiki needs updating. o Numan and Ada will work together to update the Wiki. o Wiki will be updated with information about Automation FrameWork. o Once Test Repository is available, a new section will be added to Test Wiki regarding Test Repository. o After creation of Test Dashboard, information regarding Test Dashboard will be added to test wiki. * Performance Testing o Victor will be leading the Performance testing. o What needs to be collected and different categories of performance testing suitable for STX were discussed in length at this meeting. o Victor will send his proposal regarding what he is planning to collect, performance test cases, which tools will be used and how the data will be used to the community for feedback. Numan.