- Pre-requisites Linux server with enough Cores (+8) Python 2.7 and pip installed Titanium server with external IP addresses in order to access APIs - Tempest installation To access Titiannium System instances, a test VM setup on a server which could reach Titiannium System Setup is done following the instructions here: https://github.com/openstack/refstack-client/blob/master/README.rst Run setup_env: cd "refstack installation directory" ./setup_env setup the tempest config and user accounts files at the location which could access by test VM - Titanium configuration changes Prior to run tempest, ensure that lab_setup.sh has been ran on your Titanium server. If you plan to run Swift and Cinder test suites, please book a Storage lab with Storage nodes online. You will need to run these commands to create new Tenants and modify their quota: Tenants 3 to 6: source /etc/nova/openrc for i in {3..6};do openstack project create --domain default --description tenant$i tenant$i;openstack user create --password Test1234@ --domain default --project tenant$i --project-domain default tenant$i;openstack role add --project tenant$i --project-domain default --user tenant$i --user-domain default _member_;openstack role add --project tenant$i --project-domain default --user admin --user-domain default admin;nova quota-update --instances 16 --cores 40 tenant$i;cinder quota-update --volumes 22 --snapshots 12 tenant$i;neutron quota-update --port 500 --floatingip 50 --subnet 100 --network 100 --tenant-id tenant$i;done Additional config for Swift object-storage tests: add SwiftOperator role for i in {3..6}; do openstack role add --project tenant$i --project-domain default --user tenant$i --user-domain default SwiftOperator; done Changing Admin Quota: admin_id=$(openstack project list | grep -w admin | awk '{print $2}') nova quota-update --instances 10 --cores 20 ${admin_id} neutron quota-update --port 20 --floatingip 10 --subnet 40 --network 13 --tenant-id ${admin_id} Then, ensure that you have at least 2 Nova VM flavours defined: nova flavor-list nova flavor-create testflavor1 auto 1024 2 2 nova flavor-key testflavor1 set hw:cpu_policy=dedicated nova flavor-key testflavor1 set hw:mem_page_size=2048 nova flavor-create testflavor2 auto 1024 2 2 nova flavor-key testflavor2 set hw:cpu_policy=dedicated nova flavor-key testflavor2 set hw:mem_page_size=2048 Finally, you need to have at least 2 VM images defined: glance image-list +------------------+------------------+ | ID | Name | +------------------+------------------+ | a4671145-17aa-446a-9fa6-4ed903fe0608 | tis-centos-guest | +------------------+------------------+ Suggest to create a second tis-centos-guest, starting from .img file: glance image-create --name tis-centos2 --visibility public --container-format bare --disk-format qcow2 --file /home/wrsroot/images/tis-centos-guest.img Finally, ensure that "admin" account password matches the default one setup by lab_setup.sh - Tempest configuration files Default config file location: refstack-client/etc/tempest.conf You will need to change following variables in that file: ran "glance image-list", and extract 2 Image IDs you want to use for tests. Assign them to these 2 variables: image_ref image_ref_alt ran "nova flavor-list", and extract 2 flavors IDs you want to use for tests. Assign them to these 2 variables: flavor_ref flavor_ref_alt Determine Floating IP of your Titanium System under Test,and assign it to these 2 variables: (look for openstack endpoint list | grep 5000 | grep public) uri = http://128.224.150.89:5000/v2.0 uri_v3 = http://128.224.150.89:5000/v3 The public_network_id specified in the config file is the id of external-net0 Note: if your system is "HTTPS", please change the http prefix. - How to run test suite Prior to run 1st time, please delete source code of Keystone V2 file if the files are generated: rm -fR ~/refstack-client/.tempest/tempest/api/identity/v2 rm -fR ~/refstack-client/.tempest/tempest/api/identity/admin/v2 Then, run full Tempest suite. Depending on how many Cores you have on test server, it will takes between 1-2 hours execution time: cd ./refstack-client script ~/report.txt source .venv/bin/activate refstack-client test -c "tempest configuration file" -v Wait for test execution... CTRL-D to close script Full test output is located @: ~/refstack-client/.tempest/.testrepository