Log in | Register

Registration and design alterations of clinical trials in critical care: a cross-sectional observational study

Vijay Anand| Damon C. Scales| Christopher S. Parshuram| Brian P. Kavanagh
Original
Volume 40, Issue 5 / May , 2014

Pages 700 - 722

Abstract

Purpose

In 2005 the International Committee of Medical Journal Editors issued a requirement that all randomized controlled trials (RCTs) be registered primarily to prevent selective reporting (publication bias). However, registries allow for alterations in study protocol. Changes occurring before (or after) study completion could invalidate the original study intent, leading to publication of misleading conclusions. In RCTs involving critically ill patients, these concerns may be particularly acute because mortality is high and conditions investigated are usually syndromes rather than specific diseases. This study was conducted to estimate the registration rate of RCTs in critical care; and, among registered RCTs, to determine timing of registration and whether sample size or primary outcome were altered.

Methods

We searched the MEDLINE database for RCTs that began after or continued through July 2005. We determined whether each trial had been registered and, for registered trials, compared registry data to data in the published manuscript.

Results

Approximately two-thirds (66 %) of trials were registered. Of these, 66 % of registrations occurred after enrolment had commenced. Overall, 6 % (5/90) of trials appropriately registered a sample size which was unchanged from the interval between registration and publication, and only 12 % (11/90) reported primary outcomes that were both appropriately registered and unchanged.

Conclusions

Non-registration, or registration after trial initiation, are common in RCTs of critically ill patients. Among registered trials important protocol changes are often made between trial commencement and publication. This study identifies and quantifies the extent of this serious—but correctable—problem for RCTs in critically ill patients.

Keywords

References

  1. Sacks H, Chalmers T, Smith H Jr (1982) Randomized versus historical controls for clinical trials. Am J Med 72:233–240
    • View reference on PubMed
    • View reference on publisher's website
  2. Sozu T, Sugimoto T, Hamasaki T (2010) Sample size determination in clinical trials with multiple co-primary binary endpoints. Stat Med 29(21):2169–2179
    • View reference on PubMed
    • View reference on publisher's website
  3. De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R et al (2004) Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med 351(12):1250–1251
    • View reference on PubMed
    • View reference on publisher's website
  4. Abraham E (2005) The AJRCCM in 2005. Am J Respir Crit Care Med 171(1):1–2
    • View reference on publisher's website
  5. Kirillova O (2012) Results and outcome reporting in ClinicalTrials.gov, what makes it happen? PLoS One 7(6):e37847
    • View reference on PubMed
    • View reference on publisher's website
  6. Mathieu S, Moher D, Altman DG (2009) Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 302(9):977–984
    • View reference on PubMed
    • View reference on publisher's website
  7. Silverman HJ (2004) The acute respiratory distress syndrome network controversy: lessons and legacy. Curr Opin Crit Care 10:560–564
    • View reference on PubMed
    • View reference on publisher's website
  8. Silverman WA (2004) Personal reflections on lessons learned from randomized trials involving newborn infants from 1951 to 1967. Clin Trials 1:179–184
    • View reference on PubMed
    • View reference on publisher's website
  9. Flanagan BM, Philpott S, Strosberg MA (2011) Protecting participants of clinical trials conducted in the intensive care unit. J Intensive Care Med 26(4):237–249
    • View reference on PubMed
    • View reference on publisher's website
  10. Halpern SD (2002) Prospective preference assessment: a method to enhance the ethics and efficiency of randomized controlled trials. Control Clin Trials 23(3):274–288
    • View reference on PubMed
    • View reference on publisher's website
  11. Ospina-Tascón GA, Büchele GL, Vincent J-L (2008) Multicenter, randomized, controlled trials evaluating mortality in intensive care: doomed to fail? Crit Care Med 36(4):1311–1322
    • View reference on PubMed
    • View reference on publisher's website
  12. Hannink G, Gooszen HG, Rovers MM (2013) Comparison of registered and published primary outcomes in randomized clinical trials of surgical interventions. Ann Surg 257(5):818–823
    • View reference on PubMed
    • View reference on publisher's website
  13. Milette K, Roseman M, Thombs BD (2011) Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosom Res 70(3):205–217
    • View reference on PubMed
    • View reference on publisher's website
  14. Zarin DA, Tse T, Ide NC (2005) Trial registration at ClinicalTrials.gov between May and October 2005. N Engl J Med 353(26):2779–2787
    • View reference on PubMed
    • View reference on publisher's website
  15. Aberegg SK, Richards DR, O’Brien JM (2010) Delta inflation: a bias in the design of randomized controlled trials in critical care medicine. Crit Care 14(2):R77
    • View reference on PubMed
    • View reference on publisher's website
  16. Bassler D, Briel M, Montori VM, Lane M, Glasziou P, Zhou Q et al (2010) Stopping randomized trials early for benefit and estimation of treatment effects. JAMA 303(12):1180–1187
    • View reference on PubMed
    • View reference on publisher's website
  17. Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G (2008) Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol 61(3):241–246
    • View reference on PubMed
    • View reference on publisher's website
  18. Phua J, Badia JR, Adhikari NK, Friedrich JO, Fowler RA, Singh JM et al (2009) Has mortality from acute respiratory distress syndrome decreased over time? A systematic review. Am J Respir Crit Care Med 179(3):220–227
    • View reference on PubMed
    • View reference on publisher's website
  19. Iwashyna TJ (2010) Survivorship will be the defining challenge of critical care in the 21st century. Ann Intern Med 153:204–205
    • View reference on PubMed
    • View reference on publisher's website
  20. Kahn JM, Benson NM, Appleby D, Carson SS, Iwashyna TJ (2010) Long-term acute care hospital utilization after critical illness. JAMA 303(22):2253–2259
    • View reference on PubMed
    • View reference on publisher's website
  21. Iwashyna TJ, Ely EW, Smith DM, Langa KM (2010) Long-term cognitive impairment and functional disability among survivors of severe sepsis. JAMA 304(16):1787–1794
    • View reference on PubMed
    • View reference on publisher's website
  22. Herridge MS, Tansey CM, Matte A, Tomlinson G, Diaz-granados N, Cooper A et al (2011) Functional disability 5 years after acute respiratory distress syndrome. N Engl J Med 364(14):1293–1304
  23. Bienvenu OJ, Colantuoni E, Mendez-Tellez PA, Dinglas VD, Shanholtz C, Husain N et al (2012) Depressive symptoms and impaired physical function after acute lung injury: a 2-year longitudinal study. Am J Respir Crit Care Med 185(5):517–524
    • View reference on PubMed
    • View reference on publisher's website
  24. Unroe M, Kahn JM, Carson SS, Govert JA, Martinu T, Sathy SJ et al (2013) One-year trajectories of care and resource utilization for recipients of prolonged mechanical ventilation. Ann Intern Med 153(3):167–175
    • View reference on publisher's website
  25. Silverman H (2011) Protecting vulnerable research subjects in critical care trials: enhancing the informed consent process and recommendations for safeguards. Ann Intensive Care 1(1):8
    • View reference on PubMed
    • View reference on publisher's website
  26. Sekeres M, Gold JL, Chan A-W, Lexchin J, Moher D, Van Laethem MLP et al (2008) Poor reporting of scientific leadership information in clinical trial registers. PLoS One 3(2):e1610
    • View reference on PubMed
    • View reference on publisher's website

Sign In

Connect with ICM

Top 5 Articles Editors Picks Supplement