Hi Newman

 

Some comments inline

 

Regards,

José

 

From: Waheed, Numan [mailto:Numan.Waheed@windriver.com]
Sent: Friday, January 25, 2019 3:18 PM
To: starlingx-discuss@lists.starlingx.io; Cabrales, Ada <ada.cabrales@intel.com>
Subject: [Starlingx-discuss] [Test] Proposal for Test Repository

 

Hi Ada and Christopher,

 

After investigating existing openstack test projects, I think we should have:

* separate repo for test cases that are independent from each other. Since they require different instructions for almost everything (install, usage, rules, etc.)

* one repo for one auto project. Subrepos are not recommended due to complicity involved in updating common libraries(keywords, fixtures, etc.) and their usages(test cases).

 

I think having 3 different repositories can become hard to maintain, also could be confusing for people who is contributing to the project.

 

Maybe we can consolidate all in one repo divided by directories , below an example:

-> stx-test

     - manual-tests

     - automated-tests

         - robot-suite

           - pytets-suite

 

Thus I suggest 3 different repositories:

- repo for manual test cases

- Is this section going to have actual scripts or just Test Specifications (preconditions, steps and expected result) in a plain text?

- repo for robot test cases

- repo for pytest test cases

 

 

Inside automated test repository, I would suggest the following structure:

 

README.rst

LICENSE

setup.py

tox.ini                        # pep8, py27, etc

requirements.txt               # project package requirements

consts/…                      # directory for various constants modules

keywords/…                     # directory for helper modules

testfixtures/                  # directory for commonly used test fixtures modules

testcases/cli/mtc/…            # directory for mtc test cases that is mainly using cli

testcases/cli/heat/…  

testcases/cli/nova/…

testcases/cli/networking/…

testcases/cli/security/…

testcases/cli/storage/…

testcases/cli/sysinv/…

testcases/rest/…               # directory for restAPI test cases

testcases/horizon/…            # directory for horizon test cases

testcases/system_test/…        # directory for complex system test scenarios

 

Agree with this structure inside of the automated test suites.

 

Thanks,

 

Numan