TestPreparation
Automation
The keys to Continuous Testing
TestPreparation
Automation
The keys to Continuous Testing
Want to know more about Test Preparation Automation? Speak to our experts >
Overview / Challenge
Test Automation tends to focus primarily on execution and is usually reserved for regression purposes. Whereas Test Preparation activities remain highly manual, slow and laborious. It won’t surprise you to know that the effort and time ratio of test preparation to test execution is a minimum of 6 to 1 and where execution is automated the differential is much higher.
If we are serious about meaningful testing ‘in-sprint’, increasing overall development velocity and achieving Continuous Testing to align with Continuous Delivery, this model is not sustainable.
Solution
To achieve Continuous Testing we must automate Test Preparation activities as well as Test Execution activities, so that Test Coverage can be calculated automatically, Test Data can be Requested and Provisioned automatically, Expected Results can be calculated, Data can be Matched to Tests, Executable Tests can be generated on demand, and data can be fed to test execution tools on demand at run time – all automatically.
Benefits
Orson’s ability to dramatically reduce the test preparation effort and maintenance overhead for the Testing lifecycle has the following benefits:
- Testing fits in-Sprint
- Testing can be truly Continuous
- Substantial reduction in time & effort to prepare and execute testing
- More testing can be undertaken because it takes less time overall
Test Activity | Current Approach | Orson Approach | Effort to Create | Effort to Update |
Derive Test Coverage | Manual -1 by 1 | Automated – in bulk | 5 to 1 | 20 to 1 |
Identify Data Requirements | Manual -1 by 1 | Included in Coverage | 20 to 1 | 100 to 1 |
Request Data | Manual -1 by 1 | Automated – in bulk | 100 to 1 | 100 to 1 |
Match Data to Tests | Manual -1 by 1 | Automated – in bulk | 20 to 1 | 100 to 1 |
Apply Expected Results to Tests | Manual -1 by 1 | Automated – in bulk | 20 to 1 | 100 to 1 |
Create Tests | Manual -1 by 1 | Automated – in bulk | 100 to 1 | 100 to 1 |
Calculate Complex Results | Manual -1 by 1 | Automated – in bulk | 2 to 1 | 5 to 1 |
Test Activity | Current Approach | Orson Approach | Effort to Create | Effort to Update |
---|---|---|---|---|
Derive Test Coverage | Manual -1 by 1 | Automated – in bulk | 5 to 1 | 20 to 1 |
Identify Data Requirements | Manual -1 by 1 | Included in Coverage | 20 to 1 | 100 to 1 |
Request Data | Manual -1 by 1 | Automated – in bulk | 100 to 1 | 100 to 1 |
Match Data to Tests | Manual -1 by 1 | Automated – in bulk | 20 to 1 | 100 to 1 |
Apply Expected Results to Tests | Manual -1 by 1 | Automated – in bulk | 20 to 1 | 100 to 1 |
Create Tests | Manual -1 by 1 | Automated – in bulk | 100 to 1 | 100 to 1 |
Calculate Complex Results | Manual -1 by 1 | Automated – in bulk | 2 to 1 | 5 to 1 |