[Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hello,
I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services. As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of automated tests along time.
We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.
Please take a look at it and let us know what else must be included.
Thanks Ada
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
Hi Ada,
Thanks for sharing the test plan. Here are my comments:
TC 14 - There is only one controller in Simplex. It cannot be swacted. I think the test cases is actually meant for Duplex system. TC 63 - will cover TC 58 and TC 59 TC 87 - I am assuming you have crypto device configured in your system TC 97, 98 - I am assuming you will test it on Direct Connect Duplex system TC 206, 207, 209, 209 - I am assuming you have BMC setup in your lab TC 231 to 236 - Suggest to pick fewer Time zone test cases to save time for other tests
Suggestions: - I would suggest adding more success path scenarios instead of failure scenarios - I would suggest adding test cases for VM operations using different type of VMs - Please consider adding some CEPH related test cases - Backup and Restore for different type of configs - Heat test cases
Regards,
Numan.
-----Original Message----- From: Cabrales, Ada [mailto:ada.cabrales@intel.com] Sent: September-21-18 7:54 PM To: starlingx-discuss@lists.starlingx.io Subject: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hello,
I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services. As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of automated tests along time.
We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.
Please take a look at it and let us know what else must be included.
Thanks Ada
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Thanks for taking the time for reviewing it, Numan!
I'm still adding some test cases. I'll check your suggestions and adjust.
Ada
-----Original Message----- From: Waheed, Numan [mailto:Numan.Waheed@windriver.com] Sent: Tuesday, September 25, 2018 4:03 PM To: Cabrales, Ada ada.cabrales@intel.com; starlingx- discuss@lists.starlingx.io Subject: RE: [ Test ] stx.2018.10 test plan
Hi Ada,
Thanks for sharing the test plan. Here are my comments:
TC 14 - There is only one controller in Simplex. It cannot be swacted. I think the test cases is actually meant for Duplex system. TC 63 - will cover TC 58 and TC 59 TC 87 - I am assuming you have crypto device configured in your system TC 97, 98 - I am assuming you will test it on Direct Connect Duplex system TC 206, 207, 209, 209 - I am assuming you have BMC setup in your lab TC 231 to 236 - Suggest to pick fewer Time zone test cases to save time for other tests
Suggestions:
- I would suggest adding more success path scenarios instead of failure
scenarios
- I would suggest adding test cases for VM operations using different type of
VMs
- Please consider adding some CEPH related test cases
- Backup and Restore for different type of configs
- Heat test cases
Regards,
Numan.
-----Original Message----- From: Cabrales, Ada [mailto:ada.cabrales@intel.com] Sent: September-21-18 7:54 PM To: starlingx-discuss@lists.starlingx.io Subject: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hello,
I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services. As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of automated tests along time.
We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.
Please take a look at it and let us know what else must be included.
Thanks Ada
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi, Ada, where can we find the detail test steps for each test case?
-----邮件原件----- 发件人: Cabrales, Ada ada.cabrales@intel.com 发送时间: 2018年9月22日 7:54 收件人: starlingx-discuss@lists.starlingx.io 主题: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hello,
I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services. As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of automated tests along time.
We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.
Please take a look at it and let us know what else must be included.
Thanks Ada
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
_______________________________________________ Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Hi Kai
I'm still finishing with the details. I will upload the document early next week.
Regards Ada
-----Original Message----- From: kai [mailto:li.kai@99cloud.net] Sent: Thursday, September 27, 2018 9:43 PM To: Cabrales, Ada ada.cabrales@intel.com; starlingx- discuss@lists.starlingx.io Cc: Hu, Wei W wei.w.hu@intel.com; Sun, Xianghui xianghui.sun@intel.com; wuyx36@chinaunicom.cn; Xie, Cindy cindy.xie@intel.com; Wang, Shane shane.wang@intel.com; Ding, Jian- feng jian-feng.ding@intel.com; Zeng, Hongli hongli.zeng@intel.com; Jin, Yuntong yuntong.jin@intel.com; 'lvhz7' lvhz7@chinaunicom.cn; Zhao, Forrest forrest.zhao@intel.com; 'yanky5' yanky5@chinaunicom.cn; '陈丹' chendan49@chinaunicom.cn; '王友祥' wangyx313@chinaunicom.cn; huang.shuquan@99cloud.net; Liang, Maggie maggie.liang@intel.com; 'jeffrey.zhang' jeffrey.zhang@99cloud.net; '龚永生' gong.yongsheng@99cloud.net; 'jing.liuqing' jing.liuqing@99cloud.net; '99cloud' zhang.jinnan@99cloud.net Subject: 答复: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hi, Ada, where can we find the detail test steps for each test case?
-----邮件原件----- 发件人: Cabrales, Ada ada.cabrales@intel.com 发送时间: 2018年9月22日 7:54 收件人: starlingx-discuss@lists.starlingx.io 主题: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hello,
I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services. As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of automated tests along time.
We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.
Please take a look at it and let us know what else must be included.
Thanks Ada
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
Going back to this topic, the steps for the tests are published here [0]
Just consider some steps (or commands) might not be 100% accurate. We are still working on adjusting them. However, you can have a good idea about what the test is about.
Let me know if you have questions.
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan_Instructions
Ada
-----Original Message----- From: kai [mailto:li.kai@99cloud.net] Sent: Thursday, September 27, 2018 9:43 PM To: Cabrales, Ada ada.cabrales@intel.com; starlingx- discuss@lists.starlingx.io Cc: Hu, Wei W wei.w.hu@intel.com; Sun, Xianghui xianghui.sun@intel.com; wuyx36@chinaunicom.cn; Xie, Cindy cindy.xie@intel.com; Wang, Shane shane.wang@intel.com; Ding, Jian- feng jian-feng.ding@intel.com; Zeng, Hongli hongli.zeng@intel.com; Jin, Yuntong yuntong.jin@intel.com; 'lvhz7' lvhz7@chinaunicom.cn; Zhao, Forrest forrest.zhao@intel.com; 'yanky5' yanky5@chinaunicom.cn; '陈 丹' chendan49@chinaunicom.cn; '王友祥' wangyx313@chinaunicom.cn; huang.shuquan@99cloud.net; Liang, Maggie maggie.liang@intel.com; 'jeffrey.zhang' jeffrey.zhang@99cloud.net; '龚永生' gong.yongsheng@99cloud.net; 'jing.liuqing' jing.liuqing@99cloud.net; '99cloud' zhang.jinnan@99cloud.net Subject: 答复: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hi, Ada, where can we find the detail test steps for each test case?
-----邮件原件----- 发件人: Cabrales, Ada ada.cabrales@intel.com 发送时间: 2018年9月22日 7:54 收件人: starlingx-discuss@lists.starlingx.io 主题: [Starlingx-discuss] [ Test ] stx.2018.10 test plan
Hello,
I'm posting the test plan proposed for the October Release in the wiki [0]. We have 238 tests so far, mostly focus on the stx services. As we mentioned before, the tests will be run manually by our team for this release. The expectation is to increase the number of automated tests along time.
We are considering to cover the four configurations (Simplex, Duplex, Multinode local storage, Multinode external storage) both on bare metal and virtual. However, we are experiencing setup problems with multinode bare metal and simplex. We are digging into it. We'll have more information next week.
Please take a look at it and let us know what else must be included.
Thanks Ada
[0] https://wiki.openstack.org/wiki/StarlingX/stx.2018.10_Testplan
Starlingx-discuss mailing list Starlingx-discuss@lists.starlingx.io http://lists.starlingx.io/cgi-bin/mailman/listinfo/starlingx-discuss
participants (3)
-
Cabrales, Ada
-
kai
-
Waheed, Numan