One way to do that is with the use of a clinical utility index (CUI), which quantifies factors like a product's efficacy, safety, cost, and contribution to quality of life—and makes trade-offs transparent to decision makers. A CUI provides a single metric for multiple dimensions of benefit and risk and captures expert opinion on the therapeutic importance of various product characteristics. It also enhances communication between discovery, development, and the commercial side.
Multiple Dimensions Getting the right information to physicians about the best clinical use of a drug becomes more challenging as the number of available therapies grows. In his article "Choosing Which Drug to Prescribe" (Medscape General Medicine, 6 August 2003), Tomas Kramer, MD pens: "Recently, a great deal has been written urging clinicians to practice 'evidence-based medicine,' in which clinical decision making is based on scientifically derived data. The problem with this, of course, is there is very little evidence upon which to practice evidence-based medicine."
Clinical utility Every medical therapy has benefits and risks. The relative importance of these characteristics depends on the disease, patient, and how the drug is used (for example, dosage or concomitant therapy). A CUI is a transparent means of weighing and quantifying a compound's trade-offs. It provides a scale to compare product profiles and measure the impact of scientific and market assumptions. It can be used at low cost (a small amount of time and effort on the part of the drug development team) and early in a clinical program (Phases I and II)."
Clinical utility is defined as the net benefit of treatment to the patient as perceived by the prescribing physician or a surrogate decision maker such as an HMO making formulary decisions. A CUI quantifies the contribution of each attribute in the product profile (label) using physician preference data, if available, or by relying on clinical advisors and other internal expertise. The latter is less expensive, and may be more appropriate early in a development program.
Product position CUI, in addition to lower cost, offers specific benefits when used in lieu of or as an early measure of physician prescribing behavior. Construction of a CUI leads the development team to identify those product attributes critical to the patient. A CUI focuses development team efforts on exploring the most valuable region of treatment—not necessarily the most efficacious—and the best market position. Further, CUI can be used to examine differences between internal team opinion and outside physician input. Multiple CUIs can explore the potential influence of non-prescriber decision makers, such as the FDA or third-party payers.
Because these models also include the uncertainty in the drugs effects, they can also be used to predict the outcomes of proposed development trials. As a development program progresses, ongoing or completed trial results provide learning and models are updated. Model output can be broken into categories that show the chance of achieving a given product profile and CUI, given what is known about the drug. The chances of different product profiles can, in turn, be linked to financial models for decision making.
Such models have been used successfully to support better choices in clinical development, as illustrated in the following case studies. Each is derived from a real project conducted for a client in the pharmaceutical industry. Indications and other information may have been blinded to protect confidentiality.
Case Study: Efficacy vs Side Effects CUIs needn't be complex to prove useful. A simple index, constructed using a penalized dose-response model, was used to explicitly value trade-offs between increased efficacy and side effects for a new chemical entity (NCE) with a novel mechanism of action. This index formed the basis for the choice of best dose, which was in turn used in simulations to optimize trial strategy for a phase II dose-ranging trial.
The compound was a psychiatric medication with a novel mechanism of action and little prior information was available to inform expectations for efficacy or side effects. Phase I safety trials and one inconclusive Phase IIa trial had been completed, leaving high uncertainty in efficacy and dose-response for the NCE.
A modeling project was undertaken to improve efficiency and informativeness of Phase II trial strategies, and to optimize the treatment regimen. First, drug and disease models were developed to quantify expectations and uncertainties about efficacy and side effects. This formed the basis for a penalized dose-response model, developed to provide a utility criterion for choosing best dose. (See "Dose Benefit Model".)
A model of various dosing strategies was developed. Simulations assessed each design's performance compared to fixed-dose dose-ranging. The criteria for trial quality were: closest estimate of best dose (Dbest) and minimum effective dose (MED), as measured using the penalized dose function (utility index). The simulations indicated an advantage to particular designs because the uncertainty in safety and efficacy was understood and a utility index provided a single, quantitative measure of that best dose.
Case Study: Identifying No-Gos Evaluating a potential next-in-class drug against successful predecessors requires close comparison of risk-benefit profiles. A CUI is ideal for the job.
A new selective estrogen receptor modulator (SERM) was in early human trials. Concern had risen over a possible side effect, endometrial hypertrophy, which could lead to cancer if unchecked. Further trials posed not only financial risk but possible health risks for hundreds of women if this side effect proved troublesome. To explore whether any dose of the new candidate could be expected to perform acceptably against the popular first-in-class drug, Evista (raloxifene), Aventis Pharmaceuticals turned to modeling and simulation.
Dose-response models for efficacy versus side effects were developed from early trials of the new SERM and prior information on related compounds. An initial version of the CUI was elicited from project team members. They identified 10 critical attributes of the product profile. For each attribute, possible attribute levels and their clinical value were defined using a preference ratio. The attributes were ranked and their importance weighted. The team reviewed the attributes to ensure that they described all important and relevant clinical issues, captured the range of outcomes for each attribute, and reflected the expected clinical value of possible outcomes.
Simulation produced a distribution of likely patient outcomes for each attribute. Each distribution was parsed into categories, each of which had a known likelihood of occurrence. Every unique combination of attribute levels yielded one possible CUI score. The probabilities of the attribute levels for a given CUI score yielded the likelihood of that score being the "true" product CUI. The combined set of possible CUI scores and their likelihoods were characterized as a probability distribution, describing the expected CUI values for the new SERM and its primary competitor.
Simulations revealed that the new SERM, as reflected in its CUI distribution, was expected to perform worse than the established competition at all doses. Sensitivity analysis made it clear that the drug could have performed well except for the key side effect; an identical drug without the risk of endometrial proliferation would surpass the competition. The upcoming trial would have been quite expensive and those funds could be used more effectively on other compounds. Consequently, it was decided to progress a more promising back-up compound that did not appear to have this liability in preclinical testing.
Quicker Wins In early drug development, a CUI makes optimal use of internal expertise and minimizes the cost of focusing development on the best product profile—not the most efficacious one. By using comparisons to current competitors and new entries under development, drugs that have no differentiation can be weeded out earlier from a crowded marketplace, providing more resources for R&D. It can substantially lower the cost of delivering a beneficial drug to the marketplace.
Additional benefit is gained by the use of modeling and simulation analyses in Phases II and III. By investing in these more intensive and adaptive early phase analyses, developers can spot poor drug candidates earlier and improve positioning of those going into Phase III. The use of a CUI can optimize the trade-offs in speed, cost, and learning during these phases, leading to quicker wins. The end result is a label that supports the best therapeutic use of a new therapy, and offers the best patient benefit. Thus, the CUI is a valuable communication, decision making and optimization tool.
Bob Korsan (email@example.com
The authors would like to acknowledge Shawne Neeper and T. J. Carrothers (both of Pharsight) for their efforts in developing this article.
How Digital Medicine Can Pinpoint Dosing Regimens to Optimize Drug Efficacy and Safety