Test Automation is a strategic decision influenced by myths and facts. However, firms need to understand any test automation is an investment, which has its assumptions and a strategy, stressing the need to measure the ROI. But what are the factors that influence ROI? Are there any assumptions? Is there a formula to devise? Are there any tools like Test Automation ROI Calculator? Is there a range that dictates my test automation suite is healthy once ROI is calculated? To these questions and more @CloudQa is here to help you.
Most of the ROI calculator available online uses a simple formula = hours saved via automation multiplied by an hourly rate.
But we haven’t included the expense to purchase automation tools, learn scripting language, or hire new resources, software, environments, etc.? Hence the above formula does not provide you with accurate results. So, let's list down all the factors that could affect an ROI of test automation suite.
Some of the factors that influence the ROI of test automation are –
Once we have these vital stats, ROI calculation would be easy. Let’s pick an example, based on a testing project here are some numbers –
|Number of builds every week||1|
|Number of test cases per build||250|
|Cost of Automation tool [1-50 users] [One year validity]||$10,000|
|Manual Tester hourly service rate||80$|
|Automation tester hourly service rate||100$|
|Manual Effort per week||8 hrs|
|Other hardware Cost [Machine/Mouse/etc]||$500|
|Time to automate one test case||1.5 hrs|
|Miscellaneous Activity [Starting the script, maintenance, etc.]/per week||10 hrs|
|Test Case documentation [single test case]||45 minutes|
|Time to manually execute one test case||15 minutes|
|Costing in training||$15,000|
Considering a release every three months i.e. four test cycles.
|1st Year[3 months /1st cycle]|
|Cost of designing||450000||180000|
|Cost of test execution||0||60000|
|1st Year[9 months /2nd/3rd/4thst cycle]|
|Cost of designing||0||0|
|Cost of test execution||0||180000|
Please note that the figures above are just for illustration and may vary with each product, geography, and tool.
ROI is not only about a long term investment reaping benefits, but it also assures quality and that should be the primary goal of any firm with ROI or without it.