|
Reproducibility Project
The Reproducibility Project: Psychology was a Crowdsourced psychological science, crowdsourced collaboration of 270 contributing authors to repeat 100 published experimental and correlational psychological studies. This project was led by the Center for Open Science and its co-founder, Brian Nosek, who started the project in November 2011. The results of this collaboration were published in August 2015. Reproducibility is the ability to produce the same findings, using the same methodologies as the original work, but on a different dataset (for instance, collected from a different set of participants). The project has illustrated the growing problem of failed reproducibility in social science. This project has started a movement that has spread through the science world with the expanded testing of the reproducibility of published works. Results Brian Nosek of University of Virginia and colleagues sought out to replicate 100 different studies that all were published in 2008. The pr ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Crowdsourced Psychological Science
Crowdsourced science (not to be confused with citizen science, a subtype of crowdsourced science) refers to collaborative contributions of a large group of people to the different steps of the Scientific research, research process in science. In psychology, the nature and scope of the collaborations can vary in their application and in the benefits it offers. What is crowdsourcing? A complement to the traditional way of doing science Crowdsourcing is a collaborative sourcing model in which a large and diverse number of people or organizations can contribute to a common goal or project. First examples of crowdsourcing science can be found during the 19th century. A Yale University professor launched a call for open participation of citizens to maximize the number and diversity of observations he could get on the Leonids#1800s, Leonids of 1833 meteor storm phenomenon. Crowdsourced science has been set aside for a long time and has only recently gained popularity in science. Actually, ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Effect Sizes
In statistics, an effect size is a value measuring the strength of the relationship between two variables in a population, or a sample-based estimate of that quantity. It can refer to the value of a statistic calculated from a sample of data, the value of a parameter for a hypothetical population, or to the equation that operationalizes how statistics or parameters lead to the effect size value. Examples of effect sizes include the correlation between two variables, the regression coefficient in a regression, the mean difference, or the risk of a particular event (such as a heart attack) happening. Effect sizes complement statistical hypothesis testing, and play an important role in power analyses, sample size planning, and in meta-analyses. The cluster of data-analysis methods concerning effect sizes is referred to as estimation statistics. Effect size is an essential component when evaluating the strength of a statistical claim, and it is the first item (magnitude) in the MAGI ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Validity (statistics)
Validity is the main extent to which a concept, conclusion or measurement is well-founded and likely corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool (for example, a test in education) is the degree to which the tool measures what it claims to measure. Validity is based on the strength of a collection of different types of evidence (e.g. face validity, construct validity, etc.) described in greater detail below. In psychometrics, validity has a particular application known as test validity: "the degree to which evidence and theory support the interpretations of test scores" ("as entailed by proposed uses of tests"). It is generally accepted that the concept of scientific validity addresses the nature of reality in terms of statistical measures and as such is an epistemological and philosophical issue as well as a question of measurement. The use of the term in logic is narrower, relati ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Scientific Method
The scientific method is an empirical method for acquiring knowledge that has characterized the development of science since at least the 17th century (with notable practitioners in previous centuries; see the article history of scientific method for additional detail.) It involves careful observation, applying rigorous skepticism about what is observed, given that cognitive assumptions can distort how one interprets the observation. It involves formulating hypotheses, via induction, based on such observations; the testability of hypotheses, experimental and the measurement-based statistical testing of deductions drawn from the hypotheses; and refinement (or elimination) of the hypotheses based on the experimental findings. These are ''principles'' of the scientific method, as distinguished from a definitive series of steps applicable to all scientific enterprises. Although procedures vary from one field of inquiry to another, the underlying process is frequently the sa ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Replication Crisis
The replication crisis (also called the replicability crisis and the reproducibility crisis) is an ongoing methodological crisis in which the results of many scientific studies are difficult or impossible to reproduce. Because the reproducibility of empirical results is an essential part of the scientific method, such failures undermine the credibility of theories building on them and potentially call into question substantial parts of scientific knowledge. The replication crisis is frequently discussed in relation to psychology and medicine, where considerable efforts have been undertaken to reinvestigate classic results, to determine both their reliability and, if found unreliable, the reasons for the failure. Data strongly indicate that other natural, and social sciences are affected as well. The phrase ''replication crisis'' was coined in the early 2010s as part of a growing awareness of the problem. Considerations of causes and remedies have given rise to a new scientific ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Publication Bias
In published academic research, publication bias occurs when the outcome of an experiment or research study biases the decision to publish or otherwise distribute it. Publishing only results that show a significant finding disturbs the balance of findings in favor of positive results. The study of publication bias is an important topic in metascience. Despite similar quality of execution and design, papers with statistically significant results are three times more likely to be published than those with null results. This unduly motivates researchers to manipulate their practices to ensure statistically significant results, such as by data dredging. Many factors contribute to publication bias. For instance, once a scientific finding is well established, it may become newsworthy to publish reliable papers that fail to reject the null hypothesis. Most commonly, investigators simply decline to submit results, leading to non-response bias. Investigators may also assume they made a ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Proteus Phenomenon
The Proteus phenomenon is the tendency in science for early replications of a work to contradict the original findings, a consequence of publication bias. It is akin to the winner's curse. The term was coined by John Ioannidis and Thomas A. Trikalinos in 2005 named after the Greek god Proteus who could rapidly change his appearance. A 2013 paper argued that the phenomenon might be "desirable or even optimal" from a scientific standpoint. See also * Reproducibility * Reproducibility Project * Metascience Metascience (also known as meta-research) is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "''research on research''" ... References Criticism of academia Academic publishing {{science-stub ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Metascience
Metascience (also known as meta-research) is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "''research on research''" and "''the science of science''", as it uses research methods to study how research is done and find where improvements can be made. Metascience concerns itself with all fields of research and has been described as "a bird's eye view of science". In the words of John Ioannidis, "Science is the best thing that has happened to human beings ... but we can do it better." In 1966, an early meta-research paper examined the statistical methods of 295 papers published in ten high-profile medical journals. It found that "in almost 73% of the reports read ... conclusions were drawn when the justification for these conclusions was invalid." Meta-research in the following decades found many methodological flaws, inefficiencies, and poor practices in r ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Meta-analysis
A meta-analysis is a statistical analysis that combines the results of multiple scientific studies. Meta-analyses can be performed when there are multiple scientific studies addressing the same question, with each individual study reporting measurements that are expected to have some degree of error. The aim then is to use approaches from statistics to derive a pooled estimate closest to the unknown common truth based on how this error is perceived. Meta-analytic results are considered the most trustworthy source of evidence by the evidence-based medicine literature.Herrera Ortiz AF., Cadavid Camacho E, Cubillos Rojas J, Cadavid Camacho T, Zoe Guevara S, Tatiana Rincón Cuenca N, Vásquez Perdomo A, Del Castillo Herazo V, & Giraldo Malo R. A Practical Guide to Perform a Systematic Literature Review and Meta-analysis. Principles and Practice of Clinical Research. 2022;7(4):47–57. https://doi.org/10.21801/ppcrj.2021.74.6 Not only can meta-analyses provide an estimate of the un ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
John Ioannidis
John P. A. Ioannidis (; el, Ιωάννης Ιωαννίδης, ; born August 21, 1965) is a Greek-American physician-scientist, writer and Stanford University professor who has made contributions to evidence-based medicine, epidemiology, and clinical research. Ioannidis studies scientific research itself, meta-research primarily in clinical medicine and the social sciences. He has served on the editorial board of over twenty scientific journals. Ioannidis's 2005 essay "Why Most Published Research Findings Are False" was the most-accessed article in the history of Public Library of Science (PLOS) as of 2020, with more than three million views. Ioannidis has been a prominent opponent of masks and lockdowns during the COVID-19 pandemic. Early life and education Born in New York City in 1965, Ioannidis was raised in Athens, Greece. He was valedictorian of his class at Athens College, graduating in 1984, and won a number of awards, including the National Award of the Greek Mathema ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Invalid Science
Invalid science consists of scientific claims based on experiments that cannot be reproduced or that are contradicted by experiments that can be reproduced. Recent analyses indicate that the proportion of retracted claims in the scientific literature is steadily increasing. The number of retractions has grown tenfold over the past decade, but they still make up approximately 0.2% of the 1.4m papers published annually in scholarly journals. The U.S. Office of Research Integrity (ORI), investigates scientific misconduct. Incidence Science magazine ranked first for the number of articles retracted at 70, just edging out PNAS, which retracted 69. Thirty-two of Science's retractions were due to fraud or suspected fraud, and 37 to error. A subsequent "retraction index" indicated that journals with relatively high impact factors, such as Science, Nature and Cell, had a higher rate of retractions. Under 0.1% of papers in PubMed had were retracted of more than 25 million papers going b ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Medicine
Medicine is the science and practice of caring for a patient, managing the diagnosis, prognosis, prevention, treatment, palliation of their injury or disease, and promoting their health. Medicine encompasses a variety of health care practices evolved to maintain and restore health by the prevention and treatment of illness. Contemporary medicine applies biomedical sciences, biomedical research, genetics, and medical technology to diagnose, treat, and prevent injury and disease, typically through pharmaceuticals or surgery, but also through therapies as diverse as psychotherapy, external splints and traction, medical devices, biologics, and ionizing radiation, amongst others. Medicine has been practiced since prehistoric times, and for most of this time it was an art (an area of skill and knowledge), frequently having connections to the religious and philosophical beliefs of local culture. For example, a medicine man would apply herbs and say prayers for healing, o ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
