Accessibility statement

Adverse events under-reported

Posted on 18 June 2013

York research reveals incomplete reporting of adverse events for bone growth product

Adverse events linked to a product used to promote bone growth are incompletely and inadequately reported in the published literature, reveals new research from the Centre for Reviews and Dissemination (CRD) at the University of York.

Recombinant human bone morphogenetic protein-2 (rhBMP-2) is a controversial orthobiologic agent used to promote bone growth in spinal surgery. Concerns about the product stemmed from suspicions of under reporting of harms in the publications arising from industry-funded studies.

Systematic reviews provide the best means of informing health decision making, but rely on the availability and integrity of the trial data on which they are based. If unfavourable results are not placed in the public domain then the evidence base is biased, undermining systematic reviews and the decisions that depend on them.

In 2011, Yale University brokered an unprecedented agreement with the manufacturer, Medtronic, to release all its patient-level clinical trial data for unrestricted independent scrutiny and re-analysis. Yale then appointed two teams, CRD and Oregon Health & Science University, to separately conduct systematic reviews and individual participant data (IPD) meta-analyses of the company’s data.

As part of this project, the CRD research team investigated whether the published results of industry-funded trials of rhBMP-2 matched the patient-level data and whether systematic reviews based only on publically available data differed from those incorporating additional confidential data.

Published online in the BMJ, the researchers have found that the published literature only partially represents the total data known to have been collected on the effects of rhBMP-2. While this did not substantially influence effectiveness outcomes, reporting of adverse event data in trial publications was sparse and inconsistent, such that any analysis based solely on the publicly available data could not properly evaluate the safety of rhBMP-2.

Far fewer total adverse events were reported across publications than were collected in the IPD. Several journal articles reported only “serious”, “related”, or “unanticipated” adverse events, without defining these terms. Around 18.5% of adverse events recorded in the patient-level research data from randomised trials have been reported in the entire published literature; this figure was 10.5% for RCTs of rhBMP-2 in its licensed preparation (INFUSE®).

CRD Director, Professor Lesley Stewart said “Having unprecedented access to all the individual participant data enabled a robust evaluation of the benefits and harms of this product and confirmed that adverse events were only partially reported in the published literature. This underscores the importance that the full results of all trials, positive, negative or inconclusive, are made available for systematic review and decision making.”

She added “This has been a ground breaking study in which we have been delighted to partner with Yale. Medtronic also deserve credit for helping pioneer this move towards greater openness and transparency.”

Notes to editors:

  • The paper - Reporting of industry-funded study outcome data: a comparison of confidential and published data on the safety and effectiveness of rhBMP-2 for spinal fusion - is published online in the BMJ: http://www.bmj.com/content/346/bmj.f3981?ijkey=zlphVNSz8yiY7kG&keytype=ref
  • The first part of the York team’s evaluation - Safety and effectiveness of recombinant human bone morphogenetic protein-2 for spinal fusion: a meta-analysis of individual-participant data - was published in Annals of Internal Medicine on Monday 17th June.  See: http://annals.org/article.aspx?articleid=1696645
  • This study used data obtained from the Yale University Open Data Access Project (YODA) that included clinical trials of rhBMP-2 funded by Medtronic. The analysis, interpretation, and reporting of the data are the sole responsibility of the authors alone and do not necessarily represent the views of the YODA Project. For more information on YODA, visit: http://medicine.yale.edu/core/projects/yodap/index.aspx
  • The Centre for Reviews and Dissemination is part of the National Institute for Health Research and a department of the University of York. The Centre produces and disseminates systematic reviews and associated economic analyses that evaluate the effects of health and social care interventions, and the delivery and organisation of health care. 
  • Further information can be obtained from Paul Wilson, Tel: 01904 321040 or Email: paul.wilson@york.ac.uk