AllTrials (sometimes called All Trials or AllTrials.net) is a project advocating that
clinical research
Clinical research is a branch of healthcare science that determines the safety and effectiveness ( efficacy) of medications, devices, diagnostic products and treatment regimens intended for human use. These may be used for prevention, treatm ...
adopt the principles of
open research
Open research is research that is openly accessible and modifiable by others. The central theme of open research is to make clear accounts of research methods freely available via the internet, along with any data or results extracted or derived ...
. The project summarizes itself as "All trials registered, all results reported": that is, all
clinical trials should be listed in a
clinical trials registry
Preregistration is the practice of registering the hypotheses, methods, and/or analyses of a scientific study before it is conducted. This can include analyzing primary data or secondary data. Clinical trial registration is similar, although it may ...
, and their results should always be shared as
open data
Open data is data that is openly accessible, exploitable, editable and shared by anyone for any purpose. Open data is licensed under an open license.
The goals of the open data movement are similar to those of other "open(-source)" movement ...
.
At the center of the organisation is a petition signed by over 85,000 individuals and
599 organisations (as of August 2015):
Ben Goldacre
Ben Michael Goldacre (born 20 May 1974) is a British physician, academic and science writer. He is the first Bennett Professor of Evidence-Based Medicine and director of the Bennett Institute for Applied Data Science at the University of Oxford ...
, author of ''
Bad Science'' and ''
Bad Pharma'', is a founder of the campaign and its most public spokesperson. In 2016 he participated in the launch of the OpenTrials database.
AllTrials is an international initiative of
Bad Science, ''
BMJ'',
Centre for Evidence-based Medicine
The Centre for Evidence-Based Medicine (CEBM), based in the Nuffield Department of Primary Care Health Sciences at the University of Oxford, is an academic-led centre dedicated to the practice, teaching, and dissemination of high quality evidenc ...
,
Cochrane Collaboration
Cochrane (previously known as the Cochrane Collaboration) is a British international charitable organisation formed to organise medical research findings to facilitate evidence-based choices about health interventions involving health profess ...
, James Lind Initiative, ''
PLOS
PLOS (for Public Library of Science; PLoS until 2012 ) is a nonprofit publisher of open-access journals in science, technology, and medicine and other scientific literature, under an open-content license. It was founded in 2000 and laun ...
'' and
Sense about Science and is being led in the US by Sense about Science USA, Dartmouth's
Geisel School of Medicine
The Geisel School of Medicine at Dartmouth is the graduate medical school of Dartmouth College in Hanover, New Hampshire. The fourth oldest medical school in the United States, it was founded in 1797 by New England physician Nathan Smith. It is o ...
and the Dartmouth Institute for Health Policy & Clinical Practice.
Issues addressed
The project is a reaction to under-reporting of research.
A substantial proportion (estimates range from one-third to one-half) of medical research goes unpublished.
[
*] It has also been shown that negative findings are
less likely to be published than positive ones, even in the absence of conflicts of interest.
Much medical research is done by the pharmaceutical industry, which have a
conflict of interest reporting results which may hurt sales of their products.
There is a measurable
funding bias
Funding bias, also known as sponsorship bias, funding outcome bias, funding publication bias, and funding effect, refers to the tendency of a scientific study to support the interests of the study's financial sponsor. This phenomenon is recognized ...
in reporting; studies have shown that published drug studies funded by pharmaceutical companies are much more likely to support the use of the tested drug than studies with other funding. Industry-funded trials are also less likely to be published.
If the statistical methods used to analyse the trial are not chosen before the study it started, there is a danger that researchers will intentionally or unintentionally pick the method that gives the results they expect, or which gives the most significant results. This makes the analysis statistically invalid.
Not publishing trials which fail to find a clear effect exposes trial volunteers to pointless risk and wastes research effort (as the same trial is repeated over and over). It also biases the medical literature, making it report effects where none exist (since, given enough trials, eventually one will find a difference by pure chance).
Pre-trial registration makes non-publication and changes in analysis methods obvious to medical reviewers. It also enables authors of meta-studies to track down and analyse missing data. Finally, it lets doctors and patients know when a trial is looking for volunteers.[
There are other sources of bias, such as the conditions sometimes attached to funding by funding agencies with a financial interest in the trial's outcome. Medical researchers may be asked to agree to allow the funding agency to censor results. Some funding agencies may also refuse to give the medical researcher access to the raw data, giving them only the finished analysis, or even a draft paper, and asking them to put their name to it. This is not acceptable academic practice, and some academic journals require that authors sign a statement that they have not entered into such agreements.][
]Ben Goldacre
Ben Michael Goldacre (born 20 May 1974) is a British physician, academic and science writer. He is the first Bennett Professor of Evidence-Based Medicine and director of the Bennett Institute for Applied Data Science at the University of Oxford ...
, a physician and spokesperson for the campaign, would like to address the systematic flaws in clinical research which cause data to be lost after it is gathered.
Coverage
The campaign has been widely covered, and supported, in the academic press. The British Medical Journal and PLOS
PLOS (for Public Library of Science; PLoS until 2012 ) is a nonprofit publisher of open-access journals in science, technology, and medicine and other scientific literature, under an open-content license. It was founded in 2000 and laun ...
are founding members. ''Nature
Nature, in the broadest sense, is the physical world or universe. "Nature" can refer to the phenomena of the physical world, and also to life in general. The study of nature is a large, if not the only, part of science. Although humans are ...
'' and The Lancet
''The Lancet'' is a weekly peer-reviewed general medical journal and one of the oldest of its kind. It is also the world's highest-impact academic journal. It was founded in England in 1823.
The journal publishes original research articles, ...
both published supportive articles in January 2014.
There has also been mainstream media coverage.
Controversy
There has been criticism from the Pharmaceutical Research and Manufacturers of America
Pharmaceutical Research and Manufacturers of America (PhRMA, pronounced ), formerly known as the Pharmaceutical Manufacturers Association, is a trade group representing companies in the pharmaceutical industry in the United States. Founded in 195 ...
(PhRMA), with senior vice-president Matt Bennett saying that trial data disclosure measures which AllTrials has recommended to the European Medicines Agency "could risk patient privacy, lead to fewer clinical trials, and result in fewer new medicines to meet patient needs and improve health.".
AllTrials have published a detailed statement of exactly what they want to see published, which states "The AllTrials campaign is not calling for individual patient data to be made publicly available".
A 2012 editorial published by senior regulators from the European Medicines agency[ largely agreed with AllTrials, saying "We consider it neither desirable nor realistic to maintain the status quo of limited availability of regulatory trials data". They were also of the opinion that adequate standards for protection of personal data could be written. However, they warned that third party reanalysis was neither a guarantee of quality nor of lack of conflict of interest, which, in the worst case, could lead to negative public health consequences.
They suggested that reanalyses should therefore be subject to the same regulations as sponsor analyses, such as registering analysis plans. They argued against completely unrestricted access to data, but in favor of broader access.] AllTrials is not calling for completely unrestricted access to raw data,[ so the scope of disagreements is limited to what restrictions should be in place.
]
Supporters
The campaign is an initiative of Sense about Science, Centre for Evidence Based Medicine, The Dartmouth Institute for Health Policy and Clinical Practice
The Dartmouth Institute for Health Policy and Clinical Practice (TDI) is an organization within Dartmouth College "dedicated to improving healthcare through education, research, policy reform, leadership improvement, and communication with patient ...
, James Lind Alliance, Cochrane Collaboration
Cochrane (previously known as the Cochrane Collaboration) is a British international charitable organisation formed to organise medical research findings to facilitate evidence-based choices about health interventions involving health profess ...
, BMJ Group, PLOS
PLOS (for Public Library of Science; PLoS until 2012 ) is a nonprofit publisher of open-access journals in science, technology, and medicine and other scientific literature, under an open-content license. It was founded in 2000 and laun ...
, and Bad Science. The petition statement of AllTrials has been signed by organizations including Wellcome Trust
The Wellcome Trust is a charitable foundation focused on health research based in London, in the United Kingdom. It was established in 1936 with legacies from the pharmaceutical magnate Henry Wellcome (founder of one of the predecessors of Glaxo ...
, British Library
The British Library is the national library of the United Kingdom and is one of the largest libraries in the world. It is estimated to contain between 170 and 200 million items from many countries. As a legal deposit library, the British ...
, Medical Research Council (UK), British Heart Foundation
The British Heart Foundation (BHF) is a cardiovascular research charity in the United Kingdom. It funds medical research related to heart and circulatory diseases and their risk factors, and runs influencing work aimed at shaping public policy ...
, Institute for Quality and Efficiency in Health Care
The Institute for Quality and Efficiency in Healthcare (IQWiG) (german: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen) is a German agency responsible for assessing the quality and efficiency of medical treatments, including dr ...
, National Institute for Health and Care Excellence
The National Institute for Health and Care Excellence (NICE) is an executive non-departmental public body of the Department of Health and Social Care in England that publishes guidelines in four areas:
* the use of health technologies withi ...
, BioMed Central
BioMed Central (BMC) is a United Kingdom-based, for-profit scientific open access publisher that produces over 250 scientific journals. All its journals are published online only. BioMed Central describes itself as the first and largest open ...
, National Physicians Alliance
The National Physicians Alliance (NPA) was a 501(c)(3) national, multi-specialty medical organization founded in 2005. The organization's mission statement was: "The National Physicians Alliance creates research and education programs that promote ...
, Royal Society of Medicine
The Royal Society of Medicine (RSM) is a medical society in the United Kingdom, headquartered in London.
History
The Society was established in 1805 as Medical and Chirurgical Society of London, meeting in two rooms in barristers’ chamber ...
, Health Research Authority
The Health Research Authority (HRA) is an arm’s length body of the Department of Health and Social Care (DHSC) in England. The HRA exists to provide a unified national system for the governance of health research. The current chair of the HRA is ...
, American Medical Student Association
The American Medical Student Association (AMSA), founded in 1950 and based in Washington, D.C., is an independent association of physicians-in-training in the United States. AMSA is a student-governed national organization.They have a membership ...
, GlaxoSmithKline, and others.
As of May 2017, The AllTrials petition has been signed by 90,282 people and 721 organisations. In October 2016, AllTrials published a road map detailing steps that various types of organisations can take to get more trials registered and more results reported.
85 investors with >€3.5 trillion (£2.45trn; $3.83trn) of investments have supported AllTrials (as of July 2015), with Peter van der Werf of RobecoSAM saying: "We deem this to be a financially material factor and encourage all companies to gain credibility regarding their approach to clinical trial transparency by signing up to the AllTrials principles.". The Laura and John Arnold Foundation provided early and ongoing financial support.
The original policy of the Coalition for Epidemic Preparedness Innovations
The Coalition for Epidemic Preparedness Innovations (CEPI) is a foundation that takes donations from public, private, philanthropic, and civil society organisations, to finance independent research projects to develop vaccines against emerging ...
required that funded parties pre-register any trials in a clinical trials registry
Preregistration is the practice of registering the hypotheses, methods, and/or analyses of a scientific study before it is conducted. This can include analyzing primary data or secondary data. Clinical trial registration is similar, although it may ...
, publish results within a year of study completion (except with compelling reason and permission of CEPI), publish results in open-access
Open access (OA) is a set of principles and a range of practices through which research outputs are distributed online, free of access charges or other barriers. With open access strictly defined (according to the 2001 definition), or libre op ...
articles, and have mechanisms for securely sharing underlying data and results, including negative results, in a way that preserves trial volunteer privacy. In May 2018 the CEPI proposed changing the policy to remove these provisions. The policy was changed by the CEPI in December 2018.
Opponents
The and Pharmaceutical Research and Manufacturers of America
Pharmaceutical Research and Manufacturers of America (PhRMA, pronounced ), formerly known as the Pharmaceutical Manufacturers Association, is a trade group representing companies in the pharmaceutical industry in the United States. Founded in 195 ...
have expressed interest in lobbying against the campaign. Campaign supporters criticized Hoffmann-La Roche's plans to be more open but not to the extent requested by AllTrials.
See also
* Clinical data repository
*Conflicts of interest in academic publishing
Conflicts of interest (COIs) often arise in academic publishing. Such conflicts may cause wrongdoing and make it more likely. Ethical standards in academic publishing exist to avoid and deal with conflicts of interest, and the field continues to ...
*Monitoring in clinical trials
Clinical monitoring is the oversight and administrative efforts that monitor a participant's health and efficacy of the treatment during a clinical trial. Both independent and government-run grant-funding agencies, such as the National Institutes ...
*Metascience
Metascience (also known as meta-research) is the use of scientific methodology to study science itself. Metascience seeks to increase the quality of scientific research while reducing inefficiency. It is also known as "''research on research''" ...
*Privacy for research participants Privacy for research participants is a concept in research ethics which states that a person in human subject research has a right to privacy when participating in research. Some typical scenarios this would apply to include, or example, a surveyo ...
* Evidence-based medicine
* Clinical trials publication
* Censoring (clinical trials)
References
External links
*
Where's the rest of the data iceberg?
a video presentation by Ben Goldacre at TEDMED
{{conflict of interest
Clinical research
Human subject research
Open science
Open data
Research projects
Medical ethics
Health campaigns
Petitions
Medical activism
Science advocacy organizations
Science activism
Scientific skepticism
Metascience