IDEAL (Idea, Development, Exploration, Assessment, Long-term study) is a framework for describing the stages of innovation in
surgery and other interventional procedures. The purpose of IDEAL is to improve the quality of research in surgery by emphasizing appropriate methods, transparency of data and rigorous reporting of outcomes.
To achieve this, the IDEAL framework provides a set of recommendations for improving the evidence base from research at each stage of innovation, as outlined in the seminal
paper
Paper is a thin sheet material produced by mechanically or chemically processing cellulose fibres derived from wood, Textile, rags, poaceae, grasses or other vegetable sources in water, draining the water through fine mesh leaving the fibre e ...
published in ''
The Lancet
''The Lancet'' is a weekly peer-reviewed general medical journal and one of the oldest of its kind. It is also the world's highest-impact academic journal. It was founded in England in 1823.
The journal publishes original research articles, ...
'' in 2009. The recommendations emphasize evaluating new procedures prospectively, entering patients and studies into registries and databases to capture all incidences of a procedure, and reporting outcomes by established protocols. It is the first and only such framework for
evidence-based practice
Evidence-based practice (EBP) is the idea that occupational practices ought to be based on scientific evidence. While seemingly obviously desirable, the proposal has been controversial, with some arguing that results may not specialize to indivi ...
that was established specifically for surgery and interventional procedures.
Background
The IDEAL framework was the result of an expert
consensus developed from a series of meetings held at
Balliol College, Oxford
Balliol College () is one of the constituent colleges of the University of Oxford in England. One of Oxford's oldest colleges, it was founded around 1263 by John I de Balliol, a landowner from Barnard Castle in County Durham, who provided the ...
, from 2007 to 2009. This group was known as the Balliol Collaboration. The purpose of the meetings was to address the challenges unique to establishing the optimal evidence base in surgery, including practical, methodological, and ethical challenges. Attendees to the meeting (the “IDEAL collaboration”) included experts in evidence-based medicine, including
Cochrane Collaboration
Cochrane (previously known as the Cochrane Collaboration) is a British international charitable organisation formed to organise medical research findings to facilitate evidence-based choices about health interventions involving health profes ...
founder
Iain Chalmers
Sir Iain Geoffrey Chalmers (born 3 June 1943) is a British health services researcher, one of the founders of the Cochrane Collaboration,[Muir Gray
Sir John Armstrong Muir Gray is a British physician, who has held senior positions in screening, public health, information management. and value in healthcare. He is currently the Chief Knowledge Officer for EXi, a digital health therapeut ...](_blank)
, statistician and founder of the Centre for Statistics in Medicine in Oxford
Doug Altman
Douglas Graham Altman FMedSci (12 July 1948 – 3 June 2018) was an English statistician best known for his work on improving the reliability and reporting of medical research and for highly cited papers on statistical methodology. He was profes ...
, clinician-researchers,
methodologists, and manufacturers of medical devices.
Framework and recommendations
The five stages of IDEAL, and the recommendations for each stage, are as follows:
Stage 1: Idea
* All new procedures should be reported automatically
* An online registry should be established for reporting of procedures
* Reports should include adverse events
Stage 2a: Development
* Protocols for prospective development studies should be established
* Protocols should include details about patient selection, operative methods and predefined outcomes
* A registry for these protocols should be established
* The publication of retrospective case series should be avoided
* If retrospective case series are to be published, they should include all consecutive patients and adhere to a reporting template such as
STROBE
A strobe light or stroboscopic lamp, commonly called a strobe, is a device used to produce regular flashes of light. It is one of a number of devices that can be used as a stroboscope. The word originated from the Ancient Greek ('), meaning ...
Stage 2b: Exploration
* A prospective research database should be established
* Validated methods for evaluating learning curves, such as
CUSUM
In statistical quality control, the CUsUM (or cumulative sum control chart) is a sequential analysis technique developed by E. S. Page of the University of Cambridge. It is typically used for monitoring change detection.
CUSUM was announced in Bi ...
, should be used
* Reporting should be more disease-based than procedure-based
* Outcome measures should be predefined and include technical, clinical, and patient-reported outcomes
Stage 3: Assessment
* Study design should be a
randomized controlled trial
A randomized controlled trial (or randomized control trial; RCT) is a form of scientific experiment used to control factors not under direct experimental control. Examples of RCTs are clinical trials that compare the effects of drugs, surgical ...
, or acceptable alternatives
Stage 4: Long-term study
* Reporting should include only key outcomes and relevant information
* When comparing outcomes among different surgeons or interventionalists and institutions, results should be adjusted for the
comorbidities
In medicine, comorbidity - from Latin morbus ("sickness"), co ("together"), -ity (as if - several sicknesses together) - is the presence of one or more additional conditions often co-occurring (that is, concomitant or concurrent) with a primary ...
of the patient and the learning curve of the surgeon or interventionalist
Proposals
In the original publication in ''The Lancet'', the authors outline a number of proposals for key stakeholders in the generation of surgical evidence. These include journal editors, funders of services and research, regulators, and professional societies.
IDEAL collaboration
The original IDEAL collaboration consists of attendees to the Balliol meetings. Subsequent members include other stakeholders in evidence-based surgery and interventional procedures. The IDEAL collaboration is led by Oxford surgeon-researcher Peter McCulloch.
Role in device regulation
While the initial Balliol meetings were intended to address innovations in surgery and interventional procedures, it soon became clear that there were also deficits in the evaluation of medical devices and implants used in such procedures. In December 2011, the Center for Devices and Radiological Health of the
United States Food and Drug Administration
The United States Food and Drug Administration (FDA or US FDA) is a federal agency of the Department of Health and Human Services. The FDA is responsible for protecting and promoting public health through the control and supervision of food s ...
held a public workshop on using the IDEAL framework to help develop high-quality evidence for devices and implants. In September 2012, the FDA published its strategy for improved postmarket surveillance based in part on the discussions from the IDEAL meeting, including the promotion of registries for devices, better assessment of evidence already published, and improved reporting of adverse events.
IDEAL collaborators have written several editorials and commentaries in journals such as the ''
British Medical Journal
''The BMJ'' is a weekly peer-reviewed medical trade journal, published by the trade union the British Medical Association (BMA). ''The BMJ'' has editorial freedom from the BMA. It is one of the world's oldest general medical journals. Origin ...
'' and ''The Lancet'' concerning the regulation of devices.
[McCulloch P. "Wanted: an appropriate evaluation template." BMJ. 2011 Jun 7;342:d3540. doi: 10.1136/bmj.d3540.]
External links
The IDEAL Collaboration��The IDEAL Collaboration website, including key publications, background materials, blog and discussion forum
References
{{Reflist
Surgery
Clinical research
Evidence-based medicine