Test automation management tools are specific tools that provide a
collaborative
Collaboration (from Latin ''com-'' "with" + ''laborare'' "to labor", "to work") is the process of two or more people, entities or organizations working together to complete a task or achieve a goal. Collaboration is similar to cooperation. Mo ...
environment that is intended to make
test automation efficient, traceable and clear for stakeholders. Test automation is becoming a cross-discipline (i.e. a mix of both testing and development practices.)
Motivation
Test automation systems usually lack reporting, analysis and meaningful information about project status. Test management systems target manual effort and do not give all the required information.
Test automation management systems leverage automation effort towards efficient and continuous processes of delivering test execution and new working tests by:
* Making transparent, meaningful and traceable reporting for all project stakeholders.
* Easing test debugging through test results analysis workflow.
* Providing valuable metrics and key performance indicators – both technical and business-wise (trend analysis, benchmarking, gap analysis,
root cause analysis
In science and engineering, root cause analysis (RCA) is a method of problem solving used for identifying the root causes of faults or problems. It is widely used in IT operations, manufacturing, telecommunications, industrial process control, ...
and risk point analysis).
* Grid benchmarking and comparison of test execution days reduces analysis and review effort.
* Clean traceability with other testing artifacts (test cases, data, issues, etc.).
* Organizing historical data.
* Post-project analysis and automation performance assessment. (Progress of test coverage shows the group performance.)
Compliance with Agile
Test automation management tools fit
Agile
Agile may refer to:
* Agile, an entity that possesses agility
Project management
* Agile software development, a development method
* Agile construction, iterative and incremental construction method
* Agile learning, the application of incremen ...
Systems Development Life Cycle methodologies. In most cases, test automation covers continuous changes in order to minimize manual regression testing. Changes are usually noted by monitoring test log diffs. For example, differences in the number of failures signal probable changes either in AUT or in test code (broken test code base, instabilities) or in both. Quick notice of changes and unified workflow of results analysis reduces testing costs and increases project quality.
TDD
Test-driven development
Test-driven development (TDD) is a software development process relying on software requirements being converted to test cases before software is fully developed, and tracking all software development by repeatedly testing the software against a ...
utilizes test automation as the primary driver to rapid and high-quality software production. Concepts of green line and thoughtful design are supported with tests before actual coding, assuming there are special tools to track and analyze within TDD process.
Continuous Integration
Another test automation practice
is
continuous integration, which explicitly supposes automated test suites as a final stage upon building, deployment and distributing new versions of software. Based on acceptance of test results, a build is declared either as qualified for further testing or rejected.
Dashboards provide relevant information on all stages of software development including test results. However, dashboards do not support comprehensive operations and views for an automation engineer. This is another reason for dedicated management tools that can supply high-level data to other project management tools such as
test management
Test management most commonly refers to the activity of managing a testing process. A test management tool is software used to manage tests
Test(s), testing, or TEST may refer to:
* Test (assessment), an educational assessment intended to meas ...
,
issue management
Issue or issues may refer to:
Publishing
* ''Issue'' (company), a mobile publishing company
* ''Issue'' (magazine), a monthly Korean comics anthology magazine
* Issue (postal service), a stamp or a series of stamps released to the public
* ''I ...
and
change management
Change management (sometimes abbreviated as CM) is a collective term for all approaches to prepare, support, and help individuals, teams, and organizations in making organizational change. It includes methods that redirect or redefine the use o ...
.
References
{{DEFAULTSORT:Test Automation Management Tools
Automation software
Software testing tools
Collaborative software