Operational acceptance testing (OAT) is used to conduct operational readiness (pre-release) of a product, service, or system as part of a
quality management system
A quality management system (QMS) is a collection of business processes focused on consistently meeting customer requirements and enhancing their satisfaction. It is aligned with an organization's purpose and strategic direction (ISO 9001:2015). I ...
. OAT is a common type of non-functional
software testing, used mainly in
software development
Software development is the process of conceiving, specifying, designing, programming, documenting, testing, and bug fixing involved in creating and maintaining applications, frameworks, or other software components. Software development invol ...
and
software maintenance
Software maintenance in software engineering is the modification of a software product after delivery to correct faults, to improve performance or other attributes.
A common perception of maintenance is that it merely involves fixing defects. H ...
projects. This type of testing focuses on the operational readiness of the system to be supported, and/or to become part of the production environment. Hence, it is also known as operational readiness testing (ORT) or operations readiness and assurance testing (OR&A).
Functional testing within OAT is limited to those tests which are required to verify the ''non-functional'' aspects of the system.
According to the International Software Testing Qualifications Board (ISTQB), OAT may include checking the
backup
In information technology, a backup, or data backup is a copy of computer data taken and stored elsewhere so that it may be used to restore the original after a data loss event. The verb form, referring to the process of doing so, is "back up", w ...
/restore facilities, IT
disaster recovery
Disaster recovery is the process of maintaining or reestablishing vital infrastructure and systems following a natural or human-induced disaster, such as a storm or battle.It employs policies, tools, and procedures. Disaster recovery focuses on t ...
procedures, maintenance tasks and periodic check of security vulnerabilities., and whitepapers on ISO 29119 and Operational Acceptance by Anthony Woods,
and ISO 25000 and Operational Acceptance Testing by Dirk Dach et al., OAT generally includes:
[White Paper: Operational Acceptance Testing, Business Continuity Assurance. December 2012 Dirk Dach, Dr Kai-Uwe Gawlik, Mark Mevert]
* Component Testing
* Failover (Within the same data centre)
:* Component fail-over
:* Network fail-over
* Functional Stability
:* Accessibility
:* Conversion
:* Stability
:* Usability
* IT Service Management (Supportability)
* Monitoring and Alerts (to ensure proper alerts are configured in the system if something goes wrong)
* Portability
:* Compatibility
:* Interoperability
:* Installation and Backout
:* Localization
* Recovery (across data centres)
:* Application/system recovery
:* Data recovery
* Reliability
:* Backup and Restoration (Recovery)
:* Disaster Recovery
:* Maintainability
:* Performance, Stress and Volume,
:* Procedures (Operability) and Supporting Documentation (Supportability)
:* Security and Penetration
During OAT changes may be made to environmental parameters which the application uses to run smoothly. For example, with
Microsoft Windows
Windows is a group of several proprietary graphical operating system families developed and marketed by Microsoft. Each family caters to a certain sector of the computing industry. For example, Windows NT for consumers, Windows Server for serv ...
applications with a mixed or hybrid architecture, this may include:
Windows services,
configuration files,
web services,
XML files,
COM+
Com or COM may refer to:
Computing
* COM (hardware interface), a serial port interface on IBM PC-compatible computers
* COM file, or .com file, short for "command", a file extension for an executable file in MS-DOS
* .com, an Internet top-level d ...
components, web services,
IIS, stored procedures in databases, etc. Typically OAT should occur after each main phase of the development life cycle: design, build, and
functional testing. In sequential projects it is often viewed as a ''final'' verification before a system is released; where in agile and iterative projects, a more frequent execution of OAT occurs providing stakeholders with assurance of continued stability of the system and its operating environment.
An approach used in OAT may follow these steps:
* Design the system,
* Assess the design,
* Build the system,
* Confirm if built to design,
* Evaluate the system addresses business functional requirements,
* Assess the system for compliance with non-functional requirements,
* Deploy the system,
* Assess operability and supportability of the system.
For running the OAT
test cases, the tester normally has exclusive access to the system or environment. This means that a single tester would be executing the test cases at a single point of time. For OAT the exact Operational Readiness quality gates are defined: both entry and exit gates. The primary emphasis of OAT should be on the operational stability, portability and reliability of the system.
References
{{reflist
Software testing