The imperative for sound clinical research continues to increase in response to the demand for evidence-based, guideline-driven medicine. To increase the quality of health care and improve clinical decision-making, innumerable studies have contributed to a hierarchy of evidence for each disease state. The randomized trial often stands at the pinnacle of this hierarchy, yielding the highest level of evidence through a blinded experiment of an intervention or treatment. Preceding observational studies often generate the equipoise and hypotheses for randomized trials. In other instances, observational research can be the best vehicle for generating the evidence. The experimentation inherent in a randomized trial might be unnecessary, inappropriate, or even impossible under certain circumstances. Political, legal, and ethical barriers also can prohibit randomized trials. Increasingly, the costs of large trials are creating another barrier to generating randomized evidence, reducing incentives for funding the head-to-head trials needed to understand the real-world effectiveness of novel therapies. It is therefore important, in the context of the emerging field of comparative effectiveness research, to understand the value and appropriateness of observational research versus randomized trials in answering different clinical questions (Figure 16–1). Prior observational studies, both successes and failures, can inform future efforts in comparative effectiveness.
Strengths and weaknesses of clinical trials versus observational studies.
Hierarchies of evidence are not the same across disease states. In prevalent conditions with substantial morbidity and mortality, public and private resources are often devoted to generating high-quality evidence from randomized trials. However, even in cardiovascular disease, the leading cause of death in the United States, guideline recommendations are largely developed from lower-level sources of evidence or expert opinion (1,2).
In unstudied subgroups, observational data often serve as guidance for clinical decision-making. For example, age is a significant determinant of outcomes for patients with acute coronary syndromes (ACS), and almost 25% of percutaneous coronary interventions (PCIs) in contemporary practice are performed in patients older than 75 years (3,4). However, most clinical trials exclude such patients. From 1991 to 2000, patients older than 75 years accounted for only 9% of trial enrollment, despite accounting for 37% of all patients with myocardial infarction (MI) in the United States (5). In place of randomized clinical trials, large clinical registries have provided much of the information that informs treatment patterns for this growing subgroup of patients undergoing coronary revascularization.
The American Heart Association (AHA) 2007 scientific statement on acute coronary care in the elderly (6) relied on the National Registry of Myocardial Infarction (NRMI), the Global Registry of Acute Coronary Events (GRACE) (7), and the Can Rapid risk stratification of Unstable angina patients Suppress ADverse outcomes with Early implementation of the ACC/AHA guidelines? (CRUSADE) national quality improvement initiative (8) to determine in-hospital and long-term outcomes for elderly patients ...