"Evidence" Trail Elusive
The practice of comparative effectiveness research (CER), its promise spotlighted in recent years amid the legislative push to measure the value of medicines in the real world, has had little impact on actual healthcare decision-making to date. That was the consensus from experts speaking on the subject at the DIA 50th Annual Meeting in San Diego, though the slow go to real practice change is not due to a lack of interest or attention in CER. Today, there is more education and guidance available on the conduct of non-interventional approaches, and groups such as the Agency for Healthcare Research and Quality (AHRQ), the Patient-Centered Outcomes Research Institute (PCORI), and NIH are moving closer to an agreement on uniform research standards governing this area.
In addition, opportunities exist to use real-world evidence more widely. The European Medicines Agency (EMA) issued guidance last year on post-authorization safety studies, now requiring the collection of risk-benefit data as well. No longer is it enough to simply identify side effects in the observational setting; pharmaceutical companies must now take a more granular approach, examining different subpopulations to determine their respective risk-benefit balance.1 There is also increasing demand from FDA that drug manufacturers conduct observational studies on a new product’s effectiveness, and healthcare payers and clinicians are eager as well to view more detailed health outcomes data to inform prescribing and reimbursement decisions.
It is believed that 15% of current postmarketing commitments have non-interventional study designs, and the number of patient registry studies listed on ClinicalTrials.gov reportedly jumped from the hundreds to the thousands from 2013-2014.
“CER is going to be a fundamental game-changer in how we practice medicine, and will help us get access to the right medicines at the right time for the right patient,” Nancy Dreyer, chief of scientific affairs and senior VP at Quintiles Outcome, the CRO’s real-world and late-phase research division, told Applied Clinical Trials, leading up to a DIA session she participated in on CER and healthcare decision-making.
Dreyer noted, however, that at the moment, learning healthcare systems still lack the tools and training necessary to best interpret real-world data and help implement it into healthcare delivery. Kimberly Westrich, director of health services research at the National Pharmaceutical Council (NPC), a policy and research organization, also pointed to a lack of good studies and not enough dissemination of quality studies as factors contributing to the current gap between promise and reality for CER. Such factors are likely influencing stakeholder perceptions of CER’s role in the healthcare landscape. According to findings from a NPC survey presented by Westrich, only 6% of respondents feel there will be substantial improvement in CER’s impact on healthcare decision-making in the next year. That figure does increase to 21% when applied to the next three years and 42% to the next five years.
Another roadblock in CER adoption, according to Brian Mittman, a senior scientist with Kaiser Permanente Dept. of Research & Evaluation, Care Improvement Research Team, speaking during the session, is the physician community’s general conservative response to evidence—that while often an appropriate response to single efficacy-related studies, is not appropriate, Mittman believes, in the face of better forms of evidence such as those captured by systematic reviews and CER studies that are well-designed. Another factor influencing the implementation of CER, Mittman says, is the uneven level of support and investment site-by-site. There are cases where research teams are on-site promoting CER and evidence-based adoption, while also measuring findings and providing feedback; but such efforts are not scalable enough across a study program to achieve practice change on a large scale, Mittman notes.
There are emerging tools in the medical data space that are attracting notice from healthcare stakeholders interested in CER. For example, with the growing availability of electronic medical record (EMR) data, there are now opportunities to collect clinical detail on health outcomes, along with the traditional data mined from insurance claims (e.g., prescription use, physician/hospital visits).
The challenge, therefore, is providing payers the right evidence and the right comparators. Sponsors have attempted to placate insurers in the past through head-to-head trials, which have garnered significant notice, but have often left payers unconvinced of a drug’s ultimate effectiveness in the specific therapeutic market. That’s largely because the comparators chosen are often older drugs not covered on formularies, or a company’s new product has not been used enough in the real-world environment. Hence, any comparative data is of less importance to payers.
“If nobody is using your product, they’re very hard to study in non-interventional studies,” says Dreyer. “There’s some wonderful new drugs that looked good in the clinical setting and physicians won’t touch them. The real-life experience is very different from the clinical trial experience. So several new products never made it. They were good but you needed the real-world setting to understand the value.”
“You have to start somewhere,” Dreyer told us. “It comes down to having a good enough product that people are willing to give it a try, and then watching who uses it and how they use it, and finding similar people… It’s the concept of treatment heterogeneity. [Trials typically target] the average patient, the average treatment, the average treatment effect. But no one is average. No one gets an average treatment effect.”
2. “Grace Principles: A Validated Checklist for Evaluating the Quality of Observational Cohort Studies for Decision-Making Support,”
3. Agency for Healthcare Research and Quality, “Registries for Evaluating Patient Outcomes: A User's Guide: 3rd Edition,” 2014.
How Digital Medicine Can Pinpoint Dosing Regimens to Optimize Drug Efficacy and Safety