Software verification is a discipline of
software engineering
Software engineering is a branch of both computer science and engineering focused on designing, developing, testing, and maintaining Application software, software applications. It involves applying engineering design process, engineering principl ...
,
programming languages
A programming language is a system of notation for writing computer programs.
Programming languages are described in terms of their syntax (form) and semantics (meaning), usually defined by a formal language. Languages usually provide features ...
, and
theory of computation
In theoretical computer science and mathematics, the theory of computation is the branch that deals with what problems can be solved on a model of computation, using an algorithm, how efficiently they can be solved or to what degree (e.g., app ...
whose goal is to assure that software satisfies the expected requirements.
Broad scope and classification
A broad definition of verification makes it related to
software testing
Software testing is the act of checking whether software satisfies expectations.
Software testing can provide objective, independent information about the Quality (business), quality of software and the risk of its failure to a User (computin ...
. In that case, there are two fundamental approaches to verification:
* ''Dynamic verification'', also known as
experimentation
An experiment is a procedure carried out to support or refute a hypothesis, or determine the efficacy or likelihood of something previously untried. Experiments provide insight into cause-and-effect by demonstrating what outcome occurs whe ...
,
dynamic testing or, simply testing. - This is good for finding faults (
software bugs
A software bug is a design defect ( bug) in computer software. A computer program with many or serious bugs may be described as ''buggy''.
The effects of a software bug range from minor (such as a misspelled word in the user interface) to sev ...
).
* ''Static verification'', also known as
analysis
Analysis (: analyses) is the process of breaking a complex topic or substance into smaller parts in order to gain a better understanding of it. The technique has been applied in the study of mathematics and logic since before Aristotle (38 ...
or,
static testing
In computer science, static program analysis (also known as static analysis or static simulation) is the program analysis, analysis of computer programs performed without executing them, in contrast with dynamic program analysis, which is performe ...
- This is useful for proving the
correctness of a program. Although it may result in false positives when there are one or more conflicts between the process a software really does and what the static verification assumes it does.
Under the
ACM Computing Classification System
The ACM Computing Classification System (CCS) is a subject classification system for computing devised by the Association for Computing Machinery (ACM). The system is comparable to the Mathematics Subject Classification (MSC) in scope, aims, and st ...
, software verification topics appear under "Software and its engineering", within "Software creation", whereas
Program verification
In the context of hardware and software systems, formal verification is the act of proving or disproving the correctness of a system with respect to a certain formal specification or property, using formal methods of mathematics.
Formal ver ...
also appears under
Theory of computation
In theoretical computer science and mathematics, the theory of computation is the branch that deals with what problems can be solved on a model of computation, using an algorithm, how efficiently they can be solved or to what degree (e.g., app ...
under Semantics and reasoning, Program reasoning.
Dynamic verification (Test, experimentation)
Dynamic verification is performed during the execution of software, and dynamically checks its behavior; it is commonly known as the
Test
Test(s), testing, or TEST may refer to:
* Test (assessment), an educational assessment intended to measure the respondents' knowledge or other abilities
Arts and entertainment
* ''Test'' (2013 film), an American film
* ''Test'' (2014 film) ...
phase.
Verification is a Review Process.
Depending on the scope of tests, we can categorize them in three families:
* ''Test in the small'': a test that checks a single function or class (
Unit test
Unit testing, component or module testing, is a form of software testing by which isolated source code is tested to validate expected behavior.
Unit testing describes tests that are run at the unit-level to contrast testing at the integration ...
)
* ''Test in the large'': a test that checks a group of classes, such as
** Module test (a single module)
**
Integration test
Integration testing is a form of software testing in which multiple software components, modules, or services are tested together to verify they work as expected when combined. The focus is on testing the interactions and data exchange between i ...
(more than one module)
** System test (the entire system)
* ''Acceptance test'': a formal test defined to check acceptance criteria for a software
** Functional test
** Non functional test (performance,
stress test)
The aim of software dynamic verification is to find the errors introduced by an activity (for example, having a medical software to analyze bio-chemical data); or by the repetitive performance of one or more activities (such as a stress test for a web server, i.e. check if the current product of the activity is as correct as it was at the beginning of the activity).
Static verification (Analysis)
Static verification is the process of checking that software meets requirements by inspecting the code before it runs. For example:
* ''
Code conventions
Coding conventions are a set of guidelines for a specific programming language that recommend programming style, practices, and methods for each aspect of a program written in that language. These conventions usually cover file organization, in ...
verification''
* ''Bad practices (
anti-pattern
An anti-pattern in software engineering, project management, and business processes is a common response to a recurring problem that is usually ineffective and risks being highly counterproductive. The term, coined in 1995 by computer programmer An ...
) detection''
*
Software metric
In software engineering and development, a software metric is a standard of measure of a degree to which a software system or process possesses some property. Even if a metric is not a measurement (metrics are functions, while measurements are t ...
s calculation
*
Formal verification
In the context of hardware and software systems, formal verification is the act of proving or disproving the correctness of a system with respect to a certain formal specification or property, using formal methods of mathematics.
Formal ver ...
Verification by Analysis - The analysis verification method applies to verification by investigation, mathematical calculations, logical evaluation, and calculations using classical textbook methods or accepted general use computer methods. Analysis includes sampling and correlating measured data and observed test results with calculated expected values to establish conformance with requirements.
Narrow scope
When it is defined more strictly, verification is equivalent only to static testing and it is intended to be applied to artifacts. And, validation (of the whole software product) would be equivalent to dynamic testing and intended to be applied to the running software product (not its artifacts, except requirements). Notice that requirements validation can be performed statically and dynamically (See
artifact validation).
Comparison with validation
Software verification is often confused with software validation. The difference between
''verification'' and ''validation'':
* Software ''verification'' asks the question, "Are we building the product right?"; that is, does the software conform to its specifications? (As a house conforms to its blueprints.)
* Software ''validation'' asks the question, "Are we building the right product?"; that is, does the software do what the user really requires? (As a house conforms to what the owner needs and wants.)
See also
*
Verification and validation (software)
In software project management, software testing, and software engineering, verification and validation is the process of checking that a software engineer system meets specifications and requirements so that it fulfills its intended purpose. It ...
*
Runtime verification Runtime verification is a computing system analysis and execution approach based on extracting information from a running system and using it to detect and possibly react to observed behaviors satisfying or violating certain properties. Some very p ...
*
Hardware verification
Electronic design automation (EDA), also referred to as electronic computer-aided design (ECAD), is a category of software tools for designing Electronics, electronic systems such as integrated circuits and printed circuit boards. The tools wo ...
*
Formal verification
In the context of hardware and software systems, formal verification is the act of proving or disproving the correctness of a system with respect to a certain formal specification or property, using formal methods of mathematics.
Formal ver ...
References
*
IEEE
The Institute of Electrical and Electronics Engineers (IEEE) is an American 501(c)(3) organization, 501(c)(3) public charity professional organization for electrical engineering, electronics engineering, and other related disciplines.
The IEEE ...
: ''SWEBOK: Guide to the Software Engineering Body of Knowledge''
*
Carlo Ghezzi
Carlo Ghezzi is an emeritus professor and former chair of software engineering at the Politecnico di Milano, Italy, and an adjunct professor at the Università della Svizzera italiana (USI), Switzerland. At the Politecnico, he has been the Rector ...
,
Mehdi Jazayeri Mehdi Jazayeri is the founding dean of the faculty of informatics of the Università della Svizzera italiana (University of Lugano) in Lugano, Switzerland, and author of several textbooks on computer software. He was awarded the Influential Educat ...
,
Dino Mandrioli Dino may refer to:
Prefix
* dino-, a common prefix in taxonomy, meaning "terrible", "formidable"
**Dinosaur
** Dinosaurus
People
* Dino (given name), a masculine given name and a nickname
* Dino (surname), a surname found in Albania and Turkey
...
: ''Fundamentals of Software Engineering'', Prentice Hall, {{ISBN, 0-13-099183-X
*
Alan L. Breitler: ''A Verification Procedure for Software Derived from Artificial Neural Networks'', Journal of the International Test and Evaluation Association, Jan 2004, Vol 25, No 4.
* Vijay D'Silva,
Daniel Kroening, Georg Weissenbacher
A Survey of Automated Techniques for Formal Software Verification IEEE Trans. on CAD of Integrated Circuits and Systems 27(7): 1165-1178 (2008)
Software testing