[Starlingx-discuss] [ Test ] stx.2018.10 test plan

[Waheed, Numan]

Hi Ada,

Thanks for sharing the test plan. Here are my comments:

TC 14 - There is only one controller in Simplex. It cannot be swacted. I think the test cases is actually meant for Duplex system.
TC 63 - will cover TC 58 and TC 59
TC 87 - I am assuming you have crypto device configured in your system
TC 97, 98 - I am assuming you will test it on Direct Connect Duplex system
TC 206, 207, 209, 209 - I am assuming you have BMC setup in your lab
TC 231 to 236 - Suggest to pick fewer Time zone test cases to save time for other tests

Suggestions:
- I would suggest adding more success path scenarios instead of failure scenarios
- I would suggest adding test cases for VM operations using different type of VMs
- Please consider adding some CEPH related test cases
- Backup and Restore for different type of configs
- Heat test cases

Regards,

Numan.

-----Original Message-----
From: Cabrales, Ada [mailto:ada.cabrales at intel.com] 
Sent: September-21-18 7:54 PM
To: starlingx-discuss at lists.starlingx.io
Subject: [Starlingx-discuss] [ Test ] stx.2018.10 test plan

Hello,

  I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services.  As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of  automated tests along time. 

   We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.

    Please take a look at it and let us know what else must be included. 

Thanks
Ada 

[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan


_______________________________________________
Starlingx-discuss mailing list
Starlingx-discuss at lists.starlingx.io
http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss