Differential Dropout and Bias in Randomised Controlled Trials: When it Matters and When it may Not
Melanie L Bell, senior research fellow, Michael G Kenward, professor, Diane L Fairclough, professor, Nicholas J Horton, professor
Dropout in randomised controlled trials is common and threatens the validity of results, as completers may differ from people who drop out. Differing dropout rates between treatment arms is sometimes called differential dropout or attrition. Although differential dropout can bias results, it does not always do so. Similarly, equal dropout may or may not lead to biased results. Depending on the type of missingness and the analysis used, one can get a biased estimate of the treatment effect with equal dropout rates and an unbiased estimate with unequal dropout rates. We reinforce this point with data from a randomised controlled trial in patients with renal cancer and a simulation study.
Introduction
Dropout in longitudinal randomised controlled trials is common and a potential source of bias in terms of evidence based medicine. A review of 71 randomised controlled trials in four top medical journals showed dropout rates of 20% or more in 18% of the trials.1 Similar rates were found in a review of quality of life outcomes.2 In specialist journals, the rates are likely to be higher.
When dropout rates differ between treatment arms, so that fewer patients are followed up in one arm than the other, it is sometimes called "differential dropout" or "differential attrition." Despite extensive literature on incomplete data methods for randomised controlled trials, guidance from the CONSORT reports, and the National Research Council's recent report on missing data,3 many applied researchers have misconceptions about how to handle dropout.1 2 4 Two common misunderstandings about differential dropout need to be debunked:
