[Starlingx-discuss] [ Test ] stx.2018.10 test plan

[Cabrales, Ada]

Thanks for taking the time for reviewing it, Numan!

I'm still adding some test cases. I'll check your suggestions and adjust.

Ada
> -----Original Message-----
> From: Waheed, Numan [mailto:Numan.Waheed at windriver.com]
> Sent: Tuesday, September 25, 2018 4:03 PM
> To: Cabrales, Ada <ada.cabrales at intel.com>; starlingx-
> discuss at lists.starlingx.io
> Subject: RE: [ Test ] stx.2018.10 test plan
> 
> Hi Ada,
> 
> Thanks for sharing the test plan. Here are my comments:
> 
> TC 14 - There is only one controller in Simplex. It cannot be swacted. I think
> the test cases is actually meant for Duplex system.
> TC 63 - will cover TC 58 and TC 59
> TC 87 - I am assuming you have crypto device configured in your system TC
> 97, 98 - I am assuming you will test it on Direct Connect Duplex system TC
> 206, 207, 209, 209 - I am assuming you have BMC setup in your lab TC 231 to
> 236 - Suggest to pick fewer Time zone test cases to save time for other tests
> 
> Suggestions:
> - I would suggest adding more success path scenarios instead of failure
> scenarios
> - I would suggest adding test cases for VM operations using different type of
> VMs
> - Please consider adding some CEPH related test cases
> - Backup and Restore for different type of configs
> - Heat test cases
> 
> Regards,
> 
> Numan.
> 
> -----Original Message-----
> From: Cabrales, Ada [mailto:ada.cabrales at intel.com]
> Sent: September-21-18 7:54 PM
> To: starlingx-discuss at lists.starlingx.io
> Subject: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
> 
> Hello,
> 
>   I'm posting the test plan proposed for the October Release in the wiki [0].
> We have 238 tests so far, mostly focus on the stx services.  As we mentioned
> before, the tests will be run manually by our team for this release. The
> expectation is to increase the number of  automated tests along time.
> 
>    We are considering to cover the four configurations (Simplex, Duplex,
> Multinode local storage, Multinode external storage) both on bare metal and
> virtual. However, we are experiencing setup problems with multinode bare
> metal and simplex. We are digging into it. We'll have more information next
> week.
> 
>     Please take a look at it and let us know what else must be included.
> 
> Thanks
> Ada
> 
> [0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
> 
> 
> _______________________________________________
> Starlingx-discuss mailing list
> Starlingx-discuss at lists.starlingx.io
> http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss