Proportional reduction in loss (PRL) is a general framework for developing and evaluating measures of the
reliability
Reliability, reliable, or unreliable may refer to:
Science, technology, and mathematics Computing
* Data reliability (disambiguation), a property of some disk arrays in computer storage
* High availability
* Reliability (computer networking), a ...
of particular ways of making observations which are possibly subject to errors of all types. Such measures quantify how much having the observations available has reduced the loss (cost) of the uncertainty about the intended quantity compared with not having those observations.
Proportional reduction in error is a more restrictive framework widely used in statistics, in which the general loss function is replaced by a more direct measure of error such as the mean square error. Examples are the
coefficient of determination and
Goodman and Kruskal's lambda
In probability theory and statistics, Goodman & Kruskal's lambda (\lambda) is a measure of proportional reduction in error in cross tabulation analysis. For any sample with a nominal independent variable and dependent variable (or ones that can be ...
.
The concept of proportional reduction in loss was proposed by
Bruce Cooil and Roland T. Rust in their 1994 paper ''Reliability and Expected Loss: A Unifying Principle''. Many commonly used reliability measures for quantitative data (such as continuous data in an experimental design) are PRL measures, including
Cronbach's alpha
Cronbach's alpha (Cronbach's \alpha), also known as tau-equivalent reliability (\rho_T) or coefficient alpha (coefficient \alpha), is a reliability coefficient that provides a method of measuring internal consistency of tests and measures. Nume ...
and measures proposed by
Ben J. Winer in 1971. It also provides a general way of developing measures for the reliability of qualitative data. For example, this framework provides several possible measures that are applicable when a researcher wants to assess the consensus between judges who are asked to code a number of items into mutually exclusive qualitative categories. Measures of this latter type have been proposed by several researchers, including Perrault and Leigh in 1989.
References
Further reading
*
*
* {{Cite journal , last1=Rust , first1=Roland T. , last2=Cooil , first2=Bruce , date=February 1994 , title=Reliability Measures for Qualitative Data: Theory and Implications , url=http://journals.sagepub.com/doi/10.1177/002224379403100101 , journal=Journal of Marketing Research , language=en , volume=31 , issue=1 , pages=1–14 , doi=10.1177/002224379403100101 , s2cid=149884833 , issn=0022-2437
Comparison of assessments
Missing data