Release Notes

0.4.1

Create new cli test in Sahara Tempest plugin for node group templates

Clean resources created in CLI tests

Create new cli tests in Sahara Tempest plugin for job types

Long overdue general updates of the test templates

New Features

• Now we can filter node group template with column flag by plugin and check if it was filtered successfully

• Now we can filter job types with column flag and also save config file of any job type to the specified file.

Bug Fixes

• Fix bug in which after running CLI tests, projects and networks created for these tests were not deleted at the end of the run.

• The default templates used by tests have been updated; added (MapR, Ambari and Storm, and some versions of CDH), or removed (obsolete versions of Vanilla and CDH).

Other Notes

• The dependency on tempest.scenario.manager.py has been removed. There are still dependencies on internal Tempest interfaces but they are more difficult to replace due to lack of tempest.lib alternatives, and scenario.manager.py is undergoing an heavy refactoring.

0.4.0

Fixes and addition for the API and CLI tests.

Support for CDH 5.9 in scenario tests.

Less parameters required for scenario tests.

Ocata test templates are now available, while Liberty test templates have been removed.

New Features

• The Tempest-based tests have received an increase of the coverage for both API and CLI tests (job, plugins, templates; negative testing).

• CDH 5.9 can be tested thanks to the addition of the specific templates.

• Few parameters are not required anymore by the templates in scenario tests; a default value is provided (name of templates, etc).

• The flavors used in templates are now parameters too.

• If a flavor name is provided in addition to its specification and a flavor with that name exists, it is used and not created again.

• The dependencies on non-public Tempest interfaces have been removed.

• A folder with test templates with Ocata has been created and initialized starting from the templates in the main directory, following the status of the jobs tested on the Sahara CI.

• Capture and report the timestamp in scenario tests when an event starts and when an exception is triggered.

Upgrade Notes

• the name of the variables/parameters used for the name of the images in the scenario tests have been changes to follow a more consistent pattern.

Deprecation Notes

• The Liberty-specific job templates have been removed. This means that starting from this release Liberty is not supported (it has been EOL for a while).

• The MapR 5.0.0 test template have been removed from the master branch as well.

Critical Issues

• The Tempest plugin was fixed after the removal of the data_processing plugin from the tempest repository. Most of the work was in place, only a small change was missing.

Bug Fixes

• The artifacts created during the execution of CLI tests are properly cleaned at the end of the tests.

Other Notes

• The documentation was improved (scenario tests) and extended (Tempest plugin).

0.3.0

Added ability to use clouds.yaml with scenario tests

Client tests have been imported from the Sahara repository.

Migrate sahara cli tests from saharaclient to sahara-tests

Yaml-files for deprecated plugins was removed

Tests no longer depend on fake plugin to run

Sahara Tests plugin now uses tempest stable interface

New Features

• User can now use clouds.yaml in the format defined by os-client-config to specify the auth values wanted on a scenario test.

• The tests for the official Python clients have been moved here from the Sahara repository. They are based on the Tempest libraries even they do not follow the Tempest guidelines (as they need to test the Python clients, they do not use the native Tempest clients).

Upgrade Notes

• Migration from novaclient.v2.images to glanceclient

Bug Fixes

• Removed yaml-files for Kilo release

• Removed unused yaml-files for master branch

Other Notes

• Adapt Sahara Tests code to stop relying only on the fake plugin and use the default plugin available. However, it’s worth noting that - if available - the fake plugin will be used.

• Sahara Tests plugin is adapted to use in-tree client, which was migrated from Tempest code. Also, there’s a new stable interface for Service Clients in Tempest, so this change adapts the code to use it.

0.2.0

Discovery of data sources with relative paths is now fixed.

Fix default resource discovery from the installed package.

Migrate auth system from keystoneclient to keystoneauth

Removed the need of a .testr.conf file when calling the test runner.

Bug Fixes

• Datasources with relative paths are now properly found from the default resources.

• The default set of resources (test templates for each plugin, etc) can now be properly discovered when the package is installed.

• A .testr.conf file was previously required in the runner execution directory, now this is handled internally.

Other Notes

• The default timeout for cluster polling was raised from 1800 to 3600 seconds.

0.1.0

New Features

• Sahara API tests have been imported from Tempest and made available using the Tempest Plugin Interface.

Other Notes

• OpenStack reno integration was added for managing release notes