- Open Access
The Coriell personalized medicine collaborative pharmacogenomics appraisal, evidence scoring and interpretation system
Genome Medicine volume 5, Article number: 93 (2013)
Implementation of pharmacogenomics (PGx) in clinical care can lead to improved drug efficacy and reduced adverse drug reactions. However, there has been a lag in adoption of PGx tests in clinical practice. This is due in part to a paucity of rigorous systems for translating published clinical and scientific data into standardized diagnostic tests with clear therapeutic recommendations. Here we describe the Pharmacogenomics Appraisal, Evidence Scoring and Interpretation System (PhAESIS), developed as part of the Coriell Personalized Medicine Collaborative research study, and its application to seven commonly prescribed drugs.
It has long been recognized that there is significant variability in drug response with respect to efficacy, optimal dose, and adverse drug reactions (ADRs). Pharmacogenomics (PGx), the study of the genes and genetic polymorphisms that influence variability in drug response, has the potential to both personalize and optimize drug therapy. Because of this potential for improvement in efficacy and for reduction in ADRs and their associated morbidity, mortality, and cost, there is increasing interest in integrating PGx into routine clinical care [1–9]. However, despite the many examples of causative links between genetic variations and substantial inter-individual differences in drug effects, and the fact that as many as 10% of labels for drugs approved by the Food and Drug Administration (FDA) contain PGx information , the development of validated diagnostic tests and the uptake of the PGx information by clinicians has been slow. The future success of PGx integration in personalized medicine will depend on a number of key factors, including 1) well-designed diagnostic tools that accurately identify all patients of different ancestral backgrounds who can benefit from the targeted therapies ; 2) a robust infrastructure for linking genetic test results (ideally available pre-emptively) and therapeutic recommendations to the drug-prescribing decision makers, for example, through the electronic medical record (EMR); and 3) an expansion of genomics and pharmacogenomics education programs for healthcare professionals so that they are sufficiently well-informed to use the information to manage their patients’ care.
Both the need for accurate standardized diagnostic tools and a robust infrastructure for linking genetics and therapeutic recommendations require a rigorous system for translating the published clinical and scientific data into clear drug-specific interpretations. Such a system should identify the genetic components that have sufficient data to support clinical or diagnostic utility, present evidence-based interpretations of genetic results in the context of particular drugs, provide clear recommendations for the application of specific results, and highlight areas with gaps in knowledge that need further investigation. The outcome of such a critical appraisal should guide further studies aimed both at addressing the specific gaps in knowledge about a gene’s effects on a specific drug (termed a ‘drug-gene pair’) and at validating further the predictive biomarkers, thus allowing therapeutics and diagnostics developers and regulators to make meaningful risk-benefit assessments that will pave the way to clinical adoption of the PGx guidelines . This requires a multifaceted approach that includes routine integration of PGx in the design and outcomes analysis of clinical drug trials; retrospective studies that link patient health outcomes with medical/medication histories, gleaned through self-reported or EMR data [12, 13]; and prospective, population-based, comparative effectiveness research [14, 15].
The Coriell Personalized Medicine Collaborative (CPMC) has developed a systematic process for the critical appraisal, evidence scoring, and interpretation of PGx data (the Pharmacogenomics Appraisal, Evidence Scoring and Interpretation System; PhAESIS) to evaluate and address some of the current obstacles to PGx implementation highlighted above. This process was created in support of the ongoing CPMC study, an institutional review board-approved prospective observational study designed to evaluate the utility of personalized genomic information in health management. An overview of the CPMC project  and the CPMC approach to genetic risk estimation for health conditions  has been described elsewhere. Briefly, study participants with consent provide saliva samples for genotyping. Then, using a secure web-based interface, the CPMC provides participants with educational material, collects self-reported participant data (such as medical history, medication use, family history, lifestyle factors, and optional follow-up outcome surveys), and reports personalized results for potentially actionable health conditions and genetic results related to medication response. Genetic and self-reported data are used to conduct both replication and discovery genetic analyses, and to evaluate participant use of the results over time. The CPMC utilizes two independent Advisory Groups: the Pharmacogenomics Advisory Group (PAG), which provides guidance on PGx risk reporting, and the Informed Cohort Oversight Board (ICOB), which provides guidance on reporting to study participants of their risk for common complex diseases.
In order to comprehend the current validity and utility of published PGx data, to effectively interpret this information, and to return a clinically meaningful PGx risk report for the study participants, CPMC scientists identified the need to develop a systematic process for critically evaluating and translating published drug-specific PGx data for risk reporting. The method developed is drug-centric, utilizes a multi-tier evidence-based scoring procedure to define key genetic variants influencing variation in drug response, highlights gaps in knowledge, involves guidance by an external advisory committee, and presents drug–response interpretations for use in clinical reporting of genetic results. Here, we describe the CPMC PhAESIS system, designed to guide the development of the CPMC drug PGx risk reports, and its application to individual drug-gene pairs.
The CPMC PhAESIS process broadly comprises six steps as described below (summarized in Figure 1). Curated data from steps 2 to 6 are prepared as PhAESIS summary documents for review by the CPMC Pharmacogenomics Advisory Group (PAG). If approved by the PAG, drug-specific risk reports are then developed and released to study participants.
Candidate drug selection
Candidate drugs for PGx reporting are identified and prioritized for the CPMC study based on a number of criteria: 1) inclusion in the FDA label (Table of Pharmacogenomic Biomarkers in Drug Labels) ; 2) description in scientific or clinical publications or in relevant PGx databases, such as the Pharmacogenomics Knowledgebase (PharmGKB)  and the Cytochrome P450 Drug Interaction Table at Indiana University School of Medicine ; 3) clinical significance (effect and severity) of altered drug response (for example, a genetic result associated with a life-threatening ADR or presence of a relevant ‘black box’ warning on the FDA drug label); 4) potential actionability, as defined by the ability to alter prescribing practice (dosing or alternate therapy) or clinical management such as more frequent monitoring, to potentially mitigate risk of ADRs or to maximize drug efficacy; 5) national drug usage statistics [21, 22]; and 6) CPMC cohort drug usage data (see Additional file 1: Table S1 for web-based PGx resources used for drug selection). Each of these parameters can be assessed and used to prioritize selection of a candidate drug or class of drugs for CPMC PhAESIS evaluation.
Identification of key PGx gene(s) and drug-specific key genetic variants
Once a drug is selected for evaluation, the FDA drug label, the peer-reviewed scientific and clinical literature, and public web-based databases are searched for studies that report drug-related genotype–phenotype associations (see Additional file 1: Table S1 for examples of resources). This initial search is used to identify all genes in both the pharmacokinetic (PK) and pharmacodynamic (PD) pathways that have a significant effect on response to the drug. By definition, such genes have at least one genetic variant that is significantly and consistently associated with a clinically relevant drug response outcome (altered efficacy or ADR). Literature searches using PubMed are performed using search terms that include 1) the drug of interest AND ‘genetics OR pharmacogenetics OR pharmacogenomics’; 2) the drug and the gene of interest (for example, key genes in the PK/PD pathways); and 3) individual genetic variants or haplotypes of the gene of interest or the commonly used PGx ‘star nomenclature’  for the variations in the gene. In addition, PGx-specific databases including PharmGKB , the Human Cytochrome P450 (CYP) Allele Nomenclature Committee web site , and others are reviewed for information on genetic variations and their drug–phenotype association.
Once identified, pharmacogenomic evidence for each drug-gene pair is summarized in the PhAESIS PAG submission document, including PK/PD evidence supporting an effect of the gene variant on protein function (for example, enzymatic activity and/or kinetics, plasma drug concentrations, measured difference in drug target response) and clinical outcome data supporting an association with adverse events or altered efficacy. This includes information on study design (such as, observational cohort, randomized controlled trial, or case–control design; and single study or meta-analysis), cohort size, and, for prospective studies of rare clinical outcomes, the numbers of observed events. In addition, and when available, estimates of relative effect (hazard ratios, relative risk, odds ratios) with confidence bounds are noted.
Drug- specific gene variant evidence scoring
CPMC scientists review the identified publications and assess the strength of the evidence they present according to the scale depicted in Table 1. The evidence score, assigned to each variant in a given gene, consists of 14 categories, ranging from 1 (representing the strongest evidence; presence of consistent in vivo clinical data for the drug under review) to 14 (the weakest evidence; published evidence showing a lack of effect of the variant on drug response). The scoring mechanism takes into account multiple factors, starting with the study type.
Studies are broadly categorized into study types A (greatest PGx evidence) to D (lowest PGx evidence), as follows.
Clinical outcomes studies. These studies show measurable difference in clinical endpoints such as side effects, rate of cure, morbidity, and mortality. Such studies demonstrate that the genetic variant significantly changes the medical outcome in response to the administered drug. Studies in this category can include clinical trials, cohort studies, case–control studies, case reports, and case series.
PK and PD studies. PK studies are defined as those that examine the effect of the genetic variant on the absorption, distribution, metabolism, or elimination of the drug. In these studies, the genetic variant is associated with variability in the level or concentration of the drug and its metabolites at the site of action. PD studies are defined as those that examine genetic variants in the drug targets showing a measureable difference in the biomarker’s response to the drug. Although the measured variables (biomarkers) may be considered as surrogates for a clinical response, they cannot be translated directly to clinical outcomes as the effect on clinical outcomes may be insufficiently significant to alter practice or policy. These studies include in vivo or ex vivo studies that measure PK or PD responses to a given drug, and may include clinical trials, cohort studies, case–control studies, and case reports and case series.
Molecular and cellular functional studies. These studies use in vitro functional assays to examine how the genetic variant alters the function of the enzyme or protein or the whole cell. For example, such studies might evaluate the effect of the variant on enzyme kinetics, gene activation, and expression or alteration of specific cellular properties involved in the response to a drug.
Genetic variation screening studies. These include studies in which the PGx gene variant was identified through DNA sequencing analysis or other genetic analysis, either in control or patient populations, without any additional functional or clinical studies to support a functional role for the variant.
Thus, the greatest support comes from clinical outcomes data (A), followed by PK/PD data (B), followed by in vitro molecular and/or cellular functional data (C), with the lowest evidence coming from genetic variation screening studies (D). Evidence scores (1 to 14) further differentiate between an effect of the genetic variant directly on the drug under review or indirectly on another drug (such as, another drug or probe substrate; an industry standard used to evaluate activity of specific P450 enzymes ) (Table 1). If direct evidence is available for the drug under review, this is considered a significant association with the phenotype, regardless of the level of knowledge about the function of the variant. However, if only indirect evidence is available for a given genetic variation, then the evidence is supplemented based on the variation or mutation type having specific examples assumed to show a sufficiently broad effect on the function of the protein to allow extrapolation to an effect on all drugs (such as, a null mutation that abolishes the protein function; see Table 1 for mutation types included). For example, evidence codes 1, 5, and 9 are all based on clinical outcomes data. However, code 1 is for a direct effect of the variant on the drug under review, whereas codes 5 and 9 are indirect evidence for an effect on another drug(s). The difference between codes 5 and 9 is that variants with code 5 are expected to have a universal effect on drug response based on mutation type, whereas the broader effect of those with code 9 is either unknown or unsupported based on the type or location of the mutation, or based on the observed variable or drug-specific effects. Once all the evidence for a genetic variant is gathered, a single score is assigned to each variant based on the greatest strength of evidence (that is, the lowest evidence code number).
For evidence scores 1 to 7, the drug–phenotype association should be consistent across different studies. However, given the variability in study size and quality in the published literature, evidence may be weighted in favor of larger studies and on those that do not raise concerns about study methods and design (such as use of co-medications and genotype groupings that might skew the expected outcomes). If consideration of study quality resolves apparent inconsistencies, then a score of 1 to 7 is assigned. If the data are inconclusive, the clinical relevance of the variant is unknown, and a score of 9 to 11 is returned, as appropriate.
Identification of drug-specific genetic variants of potential clinical relevance
Genetic variant evidence scores are used to partition variants based on potential clinical relevance. Gene variant evidence scores of less than 7 indicate a defined effect on drug response or clinical outcome, whereas those greater than 8 represent a lack of or insufficient evidence for an effect (Table 1). Within the former group of variants with defined effect on drug response, those with evidence code 1 include variants that have validated clinical evidence to support their effect (that is, they are considered clinically relevant); those with evidence codes 2 to 7 lack clinical outcomes data but have been found to have a measurable difference in drug response (they are potentially clinically relevant). Variants with evidence codes 8 to 14 are those that either have limited or inconsistent data for response to other drug(s) (clinical relevance unknown), or lack supportive data for response to the drug under review (clinical relevance unsupported). An evidence score of 8 or higher also highlights possible gaps in scientific or clinical data. This group is typically enriched for variants rare in Caucasian populations or those with undefined effect on the protein function.
For each gene, drug-specific gene variant summary tables are prepared, and included in the PAG submission document. These include information on the minimum set of DNA variations (such as single nucleotide polymorphisms (SNPs), insertion/deletions, or copy number variations) defining the functional gene variant (such as, haplotype or star allele). For each variation, the reference SNP ID number (rs#), the nucleotide change, mutation effect, and variant frequency in populations of Caucasian, East Asian, and African descent are recorded. In addition, for each gene variant, the effect on protein function and activity, the associated metabolic or PK/PD phenotype, and the strength of evidence score of the variant-response association, is provided. See Additional file 1: Tables S3, S6, S9, S11, S13, S15, S20, S23, and S27 for examples of the gene variant summaries in the context of different drugs.
Drug-specific genotype-phenotype interpretation
Once all of the genetic variants of potential clinical relevance (those with evidence codes of 7 or higher) have been identified, the anticipated response of the diploid individual (who possesses two copies of the gene, one inherited from each parent) with each combination of inherited variants, is defined. If published guidelines based on empirical data are available, these will be used to classify diplotypes to specific drug response groups. For example, the CYP2D6 metabolizer type or activity level for an individual is predicted based either on their highest functioning CYP2D6 allele [27, 28] or on an allele/genotype scoring approach [29–32]. If specific guidelines are not available, assignment of drug response phenotype is based on observations from published clinical outcomes data for the specific drug-gene pair. In some cases where there is a lack of published data for a specific diplotype, the predicted phenotype will be unknown. Likewise, if there are ambiguities in the published data, either due to inconsistent observations or due to consistent data with an effect in the opposite direction to that expected, an unknown clinical phenotype is assigned to the diplotype. All of these examples of data ambiguity (discordant or insufficient published data) highlight gaps in knowledge for further study.
In cases of rare observations where data exists for other alleles of similar effect, the phenotype for a given diplotype is extrapolated based on the general rules for other similar variants/genotypes. For example, CYP2C19*6 is a rare variant that results in negligible catalytic activity towards the universal CYP2C substrate tolbutamide, and is classified as a reduced activity variant similar to CYP2C19*2 and CYP2C19*3. Diplotypes carrying CYP2C19*6 are therefore assumed to have a similar response to clopidogrel as those with the CYP2C19*2 variant.
As part of the data curation process, a Punnett square is used to represent distinct diploid individuals, each assigned with a defined drug response phenotype. A ‘simple’ Punnett square is first constructed to provide the general rules used for interpretation of genotype-drug response phenotype (Figure 2). These rules are then extended to a ‘full’ Punnett square that includes all the potential diplotypes for the drug-gene pair under review. Drug response phenotypes represented in the Punnett square tables include both PK/PD and clinical response data. In cases where the data for specific diplotypes are ambiguous (discordant or insufficient published data) the phenotype assignment will be ‘unknown’ (Figure 2). In cases of genetic variation in genes that encode drug-metabolizing enzymes, the phenotype is based both on a ‘metabolizer’ type and on the drug-specific clinical outcome (as it relates to efficacy or ADR) that is associated with the particular genotype. Similarly, for a drug transporter gene, the genotype associated phenotype may be decreased, normal, or increased transport, which may be associated with reduced efficacy and/or risk of an ADR. It is also important to note that the predicted PK/PD phenotype for a specific diplotype may vary by drug. For example, for the drug-metabolizing enzyme CYP2C19, the CYP2C19*1/*17 diplotype is associated with an unknown metabolizer status (unk) with respect to proton pump inhibitors (PPIs), but an ultra-rapid metabolizer (UM) phenotype with respect to clopidogrel (see Additional file 1: Tables S4 and S7).
The CPMC PAG
The CPMC PAG, founded in 2010, is an expert advisory panel of pharmacists, geneticists, a bioethicist, pharmacologists, and clinicians with experience in PGx (see the CPMC advisory board web site  for PAG membership). The group, made up of a chair and associate members, meets at least once per year to review PhAESIS documents, and advise the CPMC scientific study team on whether and how to incorporate each drug-gene pair under consideration into the CPMC study.
PhAESIS documents, submitted to the PAG for review, comprise a detailed appraisal of the drug and drug-specific PGx, and provide a summary of curated data from steps 2 to 6 (above and in Figure 1). Each drug-specific document includes a description and mechanism of action of the drug, summary of the key publications supporting the PGx evidence, and the PhAESIS evidence scoring of key genetic variants, drug-specific genotype-phenotype correlations and predicted drug response interpretations. If for a given drug-gene pair, there are inconsistencies in the published data (for the gene or specific variants) that render the data inconclusive, the CPMC may still choose to include these in the PhAESIS report, and to seek guidance from the PAG on the validity of the data.
Functioning in a similar way to a standard study section, the PAG discusses the content of the PhAESIS document, with commentary by primary and secondary reviewers. The members discuss the material in a group setting, with the opportunity to question the CPMC scientific team. After discussion, the PAG votes on whether and how to include the drug-gene pair in the CPMC. The PAG advises the CPMC study on: 1) what PGx relevant drug-gene information is sufficiently valid and has potential clinical utility (is at a minimum potentially clinically relevant), and is therefore worthy of release to study participants as personalized PGx results; and 2) defining whether and what genetic results for a particular drug-gene pair constitute a level of drug response ‘actionability’ that may obligate a different (more urgent) communication path to participants. For example, study participants who are predicted to have diminished effectiveness of clopidogrel due to CYP2C19 poor metabolizer status would warrant a higher level of messaging via the web portal than would extensive metabolizers. This phenotype-specific messaging ensures that such participants have made an informed decision regarding whether or not to view their results. This approach is faithful to the study premise and original consent, which leaves to each study participant the decision to view, or not view, each personal genetic result.
CPMC study PGx risk reporting
Once approved by the PAG, the drug-gene specific genotype-phenotype assignments summarized in the extended Punnett square table (see Additional file 1: Tables S4 and S7) are used to develop personalized PGx risk reports for release to CPMC participants. The process for developing PGx reports falls outside the scope of the PhAESIS system described here, and will not be detailed in this paper. Briefly, the CPMC develops drug-specific genotype translation tables and information technology infrastructure for dynamically extracting personal data (genetic results for multiple variants, and relevant demographics) from the project database in order to generate personalized risk reports. PGx risk reports are delivered through the secure CPMC web portal (example reports can be viewed at the CPMC web site ) Risk reports provided to CPMC participants contain PGx genetic results, result interpretation, educational summaries, detailed information on genetic and non-genetic risk factors affecting drug response, and the range and frequency of drug response phenotypes in the population most relevant to the participant (Caucasian, African, or East Asian ancestry). Limitations, methods, and links to external resources are also provided through the web-based report. To aid participants’ understanding, the CPMC provides them with access to free counseling by board-certified genetic counselors and pharmacists.
To date the PAG has reviewed PhAESIS reports on more than 11 drugs and 18 associated PGx genes. Seven drugs/drug class and nine associated genes have been approved for PGx reporting to CPMC participants (clopidogrel and CYP2C19; warfarin and CYP2C9/VKORC1/CYP4F2; PPIs and CYP2C19; codeine and CYP2D6; thiopurines and TPMT; simvastatin and SLCO1B1; celecoxib and CYP2C9). One drug-gene pair (tamoxifen and CYP2D6) has been deferred pending more data, and three have been rejected for various reasons, including insufficient clinical data or lack of evidence for clinical utility. A summary of the PAG review outcomes is provided in Table 2. The deferral of a decision on tamoxifen and CYP2D6 is an example of how the PAG can provide expert guidance in situations where the published data are ambiguous. The large body of data evaluating the prognostic and predictive relevance of CYP2D6 gene testing to guide tamoxifen therapy for breast cancer was inconsistent, and the CPMC chose to present these to the PAG for specific guidance. After deliberation, the PAG deemed the data inconclusive, and given that data from a large clinical study was anticipated (the International Tamoxifen Pharmacogenomics Consortium (ITPC) ), the vote on this drug-gene pair was deferred pending that publication.
Drug response interpretations for the PAG-approved drug-gene pairs are summarized (Tables 3, 4, 5, 6, 7, 8, and 9). These tables include gene variants with evidence scores of 7 or higher defined during the PhAESIS evaluation of each drug-gene pair (see Additional file 1: Sections 1 to 7 for abbreviated curated data from PAG submissions, including variant summary tables, genotype-phenotype interpretation Punnett squares, and PGx evidence for each of the approved drug-gene pairs). The tables include genetic results with validated clinical evidence (Tables 3, 4, 5, 6, 7, 8, and 9), considered to be clinically relevant (those that include variants with evidence code 1) (see Additional file 1: Tables S3, S6, S9, S11, S13, S15, S20, S23, and S27). Genetic results that include variants with evidence codes 2 to 7 (potentially clinically relevant) are also included (Tables 3, 4, 5, 6, 7, 8, and 9); however, these require further validation to support their inclusion for clinical reporting. For each of the drug-specific genotype categories, both the PK/PD phenotype and the associated clinical phenotype (drug response outcome and interpretation) are provided. If specific FDA PGx guidelines are available for the drug-gene category, these are indicated along with the expected population frequencies for Caucasian, African, and East Asian ancestries.
During the PhAESIS evaluation process, gaps in scientific and clinical evidence for specific gene variants and variant combinations are highlighted for further study. Gaps in knowledge for each of the drug-gene pairs presented in this report are summarized in the respective ‘Gaps in PGx knowledge’ subsection of Additional file 2: Sections S1 to S7. Broadly, these include the following:
Limited published PGx data for many of the drug-gene pairs evaluated. Although all show clinical validity for at least one genetic result (association with an altered clinical outcome) most lack sufficient data, having only a limited number of studies demonstrating a clear association with drug response or tolerance (for example only evidence linking CYP2C9*3/*3 genotype and celecoxib-CYP2C9 tolerance; mostly case report-based evidence linking codeine ADRs and CYP2D6 UM metabolizer status; and limited data on CYP2C19*17 genotypes and PPI efficacy).
In particular, there are limited data on rare or ancestry-specific variants with respect to effects on protein function or drug-specific clinical response (typically variants with evidence codes ≥8).
A general need to expand basic and clinical research, given that the greatest body of published data comes from Caucasian populations, and therefore has limited application to the general world population (typically for variants with evidence code ≥2).
Missing genotype data on other known functional variants in the gene(s) under evaluation, confounding the interpretation of published drug response results (for example, the lack of genotype data on other loss of function variants and CYP2C19*17 in many of the earlier PGx studies of this gene; similarly, lack of qualitative and quantitative data on CYP2D6 copy number variants).
Lack of data on haplotype structure/phase with possible subsequent confounding of drug response interpretation (for example, the effect of SLCO1B1 variant N130D on simvastatin response (see Additional file 2: Section S7)); another example includes the presence of rare alleles such as the CYP2C19*17 variant in cis with either a CYP2C19*2 or CYP2C19*4 allele as observed in the CPMC cohort (data not shown) and reported by others . Given that most studies are population-based rather than family-based, and therefore lack phasing information, the presence of double heterozygotes for these variants may lead to misinterpretation of the true metabolizer type (for example, a CYP2C19*2/CYP2C19*17 intermediate metabolizer for PPI response vs. CYP2C19*1/CYP2C19*2+CYP2C19*17, for which metabolizer type is unknown).
In order to implement PGx reporting in the CPMC, and to facilitate interpretation and dissemination of personalized PGx data to the study participants, the CPMC set out to gather, systematically review, and critically appraise published and public PGx data from a variety of sources. An evidence-based scoring system was developed to parse the clinical relevance of gene variants in the context of specific drugs.
The CPMC PhAESIS method has several key strengths: 1) By taking a drug-centered approach, the full extent of current PGx knowledge is summarized, allowing simultaneous identification of genetic results with sufficient data to support clinical diagnostic applications, and highlighting the questions that remain to be answered. 2) The multi-tier evidence scoring system allows all published and supported key functional variants to be identified, including those in minority ethnic and racial populations. 3) The scoring system provides an invaluable overview of what genetic data are clinically supported and where gaps in knowledge exist. Filling these gaps is crucial to the successful development of diagnostic tools that are able to identify all patients likely to benefit from the targeted personalized drug therapies. 4) Another key feature of the CPMC PhAESIS system is the use of an external expert advisory panel to vet the results of the systematic review. This approach adds further weight to the conclusions and interpretations of the data to be reported. The PAG also provides guidance on which subset of genetic results for a particular drug are of sufficient clinical significance (highly actionable) and therefore warrant a higher level of communication with CPMC study participants (Table 2).
The CPMC is not alone in recognizing the need to develop a system that distills the published research data into clear and evidence-based therapeutic guidelines to ease the implementation of PGx in clinical practice. There are several other groups and organizations working to collate the research literature using a gene specific approach. These include, among others, the PharmGKB, a web-based database of curated and annotated data on PGx gene variants and gene-drug-disease relationships ; the Human Cytochrome P450 (CYP) Allele Nomenclature Committee website, which provides updated information on PGx relevant genetic variations of human CYP enzymes ; and the Cytochrome P450 Drug Interaction Table at Indiana University School of Medicine , which provides lists and publication references for drug-gene interactions. These are invaluable tools for researchers, including the CPMC. In the case of the drug interaction website, whose primary goal has been to provide information that can mitigate ADRs in polypharmacy settings, this resource is utilized by clinicians and researchers alike.
Other, more targeted efforts aimed at providing clinical pharmacogenomics guidelines that can be utilized by diagnostics developers and healthcare providers include those of the Clinical Pharmacogenetics Implementation Consortium (CPIC), established by the National Institutes of Health Pharmacogenomics Research Network and PharmGKB , and the Pharmacogenetics Working Group (PWG), established by the Royal Dutch Association for the Advancement of Pharmacy [40, 41]. Another initiative, aimed at establishing a systematic, evidence-based process for assessing genetic tests and other applications of genomic technology in transition from research to clinical and public health practice, is the CDC-sponsored Evaluation of Genomic Applications in Practice and Prevention (EGAPP) . The EGAPP initiative evaluates tests such as those for predictive testing for inherited risk of common diseases and pharmacogenetic testing for variation in drug response. All three of these groups aim to provide peer-reviewed guidelines for pharmacogenetics-based therapeutic (dose) recommendations. All have developed a process that involves systematic review of published literature, scoring of evidence for drug phenotype or genotype categories, and interpretation of this evidence to guide therapeutic recommendations. Like the CPMC, CPIC, PWG, and EGAPP also employ expert panels of researchers and clinicians working in the field of study to guide the evaluation process and resulting recommendations. However, the CPMC is unique in that the expert advisory panel is independent of the CPMC study and includes a broader representation of stakeholders including practicing physicians and an ethicist. In addition, CPMC PAG evaluation and approval occurs in the context of a research study, and the threshold for reporting may be lower, compared with the goals of CPIC and PWG, in order to include genetic variants that are potentially clinically relevant. For example, Swen et al. (PWG)  included CYP2C19*2, CYP2C19*3 and CYP2C19*17 only in their metabolizer type classifications, and the CPIC publications placed a greater emphasis on variants common in Caucasian populations for which there is a greater body of data (such as the *2 and *3 alleles of both CYP2C19 and CYP2C9), although reference to other variants of potential effect are made in the supplementary materials sections of the publications [36, 43]. Such variants (typically those with an evidence score of 2 to 7) are highlighted by the PhAESIS evaluation as needing further clinical validation by the CPMC or other researchers to support their clinical utility.
Like the CPMC approach, evidence scoring by CPIC, PWG, and EGAPP is based on level or strength of evidence and clinical relevance [39–41]. However, the CPMC tiered evidence scoring method allows clearer distinction of the clinical relevance of individual PGx genetic variants, and like the EGAPP effort, highlights gaps in knowledge for further study. For example, distinction can be made between a variant with a score of 1 (with published clinical outcomes data for the drug under review) versus a score of 3 (indicating in vitro data supporting the effect of the variant on protein function) versus a score of 5 (clinical outcomes data for another drug) versus a score of 13 (where there are no functional or clinical data available and the clinical relevance is therefore unknown). The primary goal of CPIC and PWG is to provide published guidelines for healthcare providers and diagnostics developers for immediate clinical implementation. PWG has the added advantage of integrating their recommendations into the Dutch electronic drug database that is utilized as part of the clinical automated medication surveillance system . By contrast, the primary goal of the CPMC is to deliver the PGx genetic interpretations within a research setting directly to the study participants, to allow both the investigation of participant understanding and behavior in response to receiving PGx risk results, and the carrying out of drug-gene specific discovery and validation research to confirm prior associations and/or address current gaps in knowledge.
The key limitation of the PhAESIS system is shared by all of the other described systems for evaluating and reviewing published and public PGx data, in that all the systems are limited to the data available at the time of the initial evaluation. All, including the CPMC, require efforts to update information on an ongoing basis. In the context of the CPMC research study, a revision schedule has not been systematically implemented. However, the CPMC has brought updates of previously approved drug-gene pairs to the PAG for re-evaluation in cases where subsequently published data could potentially reverse or modify the original decision of the PAG. This is the case for CYP2C19 and clopidogrel, which was first reviewed and approved by the PAG in March 2010 and re-evaluated in October 2010 following publication of controversial data in August 2010 . However, these new data did not affect the approval to release results for this drug-gene pair, and the results report was subsequently implemented and released to study participants. The CPMC is exploring the use of automation in many parts of the system to facilitate the PhAESIS process. This could include automated publication database searches and prioritization for review and evidence scoring by a scientist reviewer, and variant data-gathering for many of the tables included in the reports.
In addition, like other published approaches, the method is limited by the available published data both in terms of the completeness of the genetic data (inclusion of all relevant variants and information on phasing and gene linkage disequilibrium structure) and the uniformity of study design and treatment regimen used (including dosing and duration variability, and disclosure about other concomitant drug therapies).
Another limitation of the PhAESIS approach is that the evidence scoring was developed specifically for drugs that are affected by germline or inherited genomic variations and not those that are affected by somatic mutations, such as in tumor or cancer genomes. Although specific anticancer drugs (such as thiopurines, tamoxifen, and 5-fluorouracil) have been evaluated, the published data for these were based on genomic variants and not on the analysis of the tumor/cancer genome. In essence, a similar evidence scoring procedure can be developed that includes data from either or both inherited and cancer genomic data. At present, the evidence table is not designed to capture evidence from the tumor genome, but potentially can be adapted in the future to include this.
Finally, a limitation not of the PhAESIS method but of its implementation within the CPMC study is a focus on genes that are represented on the genotyping platforms currently used. The CPMC can interrogate 1.8 million SNPs and insertion/deletions across the genome in the Affymetrix Genomewide Human 6.0 array, and 1,936 variants specific to genes for drug absorption, disposition, metabolism, and elimination in the Affymetrix DMET Plus array. In addition, copy number variation at the CYP2D6 gene can be detected by a recently implemented Luminex® assay. In the future, adoption of whole genome sequencing by the project is likely to address this limitation.
In conclusion, the system described here for the evaluation and translation of PGx data for specific drug-gene interactions has broad application for guiding the development of PGx testing for diagnostic use, identifying gaps in knowledge for further research, and providing results interpretation guidelines for the education of stakeholders (healthcare professionals and health consumers). In this way, the CPMC is contributing to efforts facilitating the implementation of PGx into personalized medical practice.
Adverse drug reaction
Clinical Pharmacogenetics Implementation Consortium
Coriell Personalized Medicine Collaborative
Evaluation of Genomic Applications in Practice and Prevention
Electronic medical record
Food and Drug Administration
Informed Cohort Oversight Board
Pharmacogenomics Advisory Group
Pharmacogenomics Appraisal, Evidence Scoring and Interpretation System
Pharmacogenetics Working Group
Single nucleotide polymorphisms
Vizirianakis IS: Clinical translation of genotyping and haplotyping data: implementation of in vivo pharmacology experience leading drug prescription to pharmacotyping. Clin Pharmacokinet. 2007, 46: 807-824. 10.2165/00003088-200746100-00001.
Chung WK: Implementation of genetics to personalize medicine. Gend Med. 2007, 4: 248-265. 10.1016/S1550-8579(07)80044-1.
McCarthy AD, Kennedy JL, Middleton LT: Pharmacogenetics in drug development. Philos Trans R Soc Lond B Biol Sci. 2005, 360: 1579-1588. 10.1098/rstb.2005.1688.
Roses AD: Pharmacogenetics in drug discovery and development: a translational perspective. Nat Rev Drug Discov. 2008, 7: 807-817. 10.1038/nrd2593.
Winston A, Hatzimichael E, Marvin V, Stebbing J, Bower M: Host pharmacogenetics in the treatment of HIV and cancer. Curr Drug Saf. 2006, 1: 107-116. 10.2174/157488606775252683.
Tonon G, Anderson KC: Moving toward individualized cancer therapies. Clin Cancer Res. 2008, 14: 4682-4684. 10.1158/1078-0432.CCR-08-1134.
Lesko LJ, Woodcock J: Translation of pharmacogenomics and pharmacogenetics: a regulatory perspective. Nat Rev Drug Discov. 2004, 3: 763-769. 10.1038/nrd1499.
Burczynski ME, Oestreicher JL, Cahilly MJ, Mounts DP, Whitley MZ, Speicher LA, Trepicchio WL: Clinical pharmacogenomics and transcriptional profiling in early phase oncology clinical trials. Curr Mol Med. 2005, 5: 83-102. 10.2174/1566524053152933.
Relling MV, Hoffman JM: Should pharmacogenomic studies be required for new drug approval?. Clin Pharmacol Ther. 2007, 81: 425-428. 10.1038/sj.clpt.6100097.
Hamburg MA, Collins FS: The path to personalized medicine. N Engl J Med. 2010, 363: 301-304. 10.1056/NEJMp1006304.
Lesko LJ, Zineh I: DNA, drugs and chariots: on a decade of pharmacogenomics at the US FDA. Pharmacogenomics. 2010, 11: 507-512. 10.2217/pgs.10.16.
Pulley JM, Denny JC, Peterson JF, Bernard GR, Vnencak-Jones CL, Ramirez AH, Delaney JT, Bowton E, Brothers K, Johnson K: Operational implementation of prospective genotyping for personalized medicine: the design of the Vanderbilt PREDICT project. Clin Pharmacol Ther. 2012, 92: 87-95. 10.1038/clpt.2011.371.
Roberts JD, Wells GA, Le May MR, Labinaz M, Glover C, Froeschl M, Dick A, Marquis JF, O’Brien E, Goncalves S: Point-of-care genetic testing for personalisation of antiplatelet treatment (RAPID GENE): a prospective, randomised, proof-of-concept trial. Lancet. 2012, 379: 1705-1711. 10.1016/S0140-6736(12)60161-5.
Gatsonis C: The promise and realities of comparative effectiveness research. Stat Med. 2010, 29: 1977-1981. 10.1002/sim.3936. discussion 1996–1977
Epstein RS, Moyer TP, Aubert RE, Kane DJ O, Xia F, Verbrugge RR, Gage BF, Teagarden JR: Warfarin genotyping reduces hospitalization rates results from the MM-WES (Medco-Mayo Warfarin Effectiveness study). J Am Coll Cardiol. 2010, 55: 2804-2812. 10.1016/j.jacc.2010.03.009.
Keller M, Gordon ES, Stack CB, Gharani N, Schmidlen TJ, Mintzer J, Pallies J, Gerry N, Christman MF: The coriell personalized medicine collaborative: a prospective study of the utility of personalized medicine”. Pers Med. 2010, 7: 301-317. 10.2217/pme.10.13.
Stack CB, Gharani N, Gordon ES, Schmidlen T, Christman MF, Keller MA: Genetic risk estimation in the coriell personalized medicine collaborative. Genet Med. 2011, 13: 131-139. 10.1097/GIM.0b013e318201164c.
FDA Table of Pharmacogenomic Biomarkers in Drug labels. [http://www.fda.gov/Drugs/ScienceResearch/ResearchAreas/Pharmacogenetics/ucm083378.htm]
CYP450 Drug Interaction Table. [http://medicine.iupui.edu/clinpharm/ddis/table.aspx]
Pharmacy Times Top 200 Drugs. [http://www.pharmacytimes.com/publications/issue/2012/July2012/Top-200-Drugs-of-2011]
Drug Topics. [http://drugtopics.modernmedicine.com/]
Robarge JD, Li L, Desta Z, Nguyen A, Flockhart DA: The star-allele nomenclature: retooling for translational genomics. Clin Pharmacol Ther. 2007, 82: 244-248. 10.1038/sj.clpt.6100284.
Klein TE, Chang JT, Cho MK, Easton KL, Fergerson R, Hewett M, Lin Z, Liu Y, Liu S, Oliver DE: Integrating genotype and phenotype information: an overview of the PharmGKB project. Pharmacogenetics Research Network and Knowledge Base. Pharmacogenomics J. 2001, 1: 167-170. 10.1038/sj.tpj.6500035.
Sim SC, Ingelman-Sundberg M: The human cytochrome P450 (CYP) allele nomenclature website: a peer-reviewed database of CYP variants and their associated effects. Hum Genomics. 2010, 4: 278-281. 10.1186/1479-7364-4-4-278.
Yuan R, Madani S, Wei XX, Reynolds K, Huang SM: Evaluation of cytochrome P450 probe substrates commonly used by the pharmaceutical industry to study in vitro drug interactions. Drug Metab Dispos. 2002, 30: 1311-1319. 10.1124/dmd.30.12.1311.
Gardiner SJ, Begg EJ: Pharmacogenetics, drug-metabolizing enzymes, and clinical practice. Pharmacol Rev. 2006, 58: 521-590. 10.1124/pr.58.3.6.
Zanger UM, Raimundo S, Eichelbaum M: Cytochrome P450 2D6: overview and update on pharmacology, genetics, biochemistry. Naunyn Schmiedebergs Arch Pharmacol. 2004, 369: 23-37. 10.1007/s00210-003-0832-2.
Gaedigk A, Simon SD, Pearce RE, Bradford LD, Kennedy MJ, Leeder JS: The CYP2D6 activity score: translating genotype information into a qualitative measure of phenotype. Clin Pharmacol Ther. 2008, 83: 234-242. 10.1038/sj.clpt.6100406.
Schenk PW, Van Fessem MA, Verploegh-Van Rij S, Mathot RA, Van Gelder T, Vulto AG, Van Vliet M, Lindemans J, Bruijn JA, Van Schaik RH: Association of graded allele-specific changes in CYP2D6 function with imipramine dose requirement in a large group of depressed patients. Mol Psychiatry. 2008, 13: 597-605. 10.1038/sj.mp.4002057.
Steimer W, Zopf K, von Amelunxen S, Pfeiffer H, Bachofer J, Popp J, Messner B, Kissling W, Leucht S: Allele-specific change of concentration and functional gene dose for the prediction of steady-state serum concentrations of amitriptyline and nortriptyline in CYP2C19 and CYP2D6 extensive and intermediate metabolizers. Clin Chem. 2004, 50: 1623-1633. 10.1373/clinchem.2003.030825.
Kirchheiner J, Schmidt H, Tzvetkov M, Keulen JT, Lotsch J, Roots I, Brockmoller J: Pharmacokinetics of codeine and its metabolite morphine in ultra-rapid metabolizers due to CYP2D6 duplication. Pharmacogenomics J. 2007, 7: 257-265. 10.1038/sj.tpj.6500406.
CPMC Advisory Boards. [http://cpmc1.coriell.org/about-the-cpmc-study/advisory-boards]
CPMC Demo Accounts. [http://cpmc.coriell.org/Demo/DemoPeople.aspx]
Goetz MBD, Klein T, International Tamoxifen Pharmacogenomics Consortium: Adjuvant tamoxifen treatment outcome according to cytochrome P450 2D6 (CYP2D6) phenotype in early stage breast cancer: findings from the international tamoxifen pharmacogenomics consortium. Cancer Res. 2009, 69: Abstract nr 33-
Johnson JA, Gong L, Whirl-Carrillo M, Gage BF, Scott SA, Stein CM, Anderson JL, Kimmel SE, Lee MT, Pirmohamed M: Clinical Pharmacogenetics Implementation Consortium guidelines for CYP2C9 and VKORC1 genotypes and warfarin dosing. Clin Pharmacol Ther. 2011, 90: 625-629. 10.1038/clpt.2011.185.
Garcia D, Regan S, Crowther M, Hughes RA, Hylek EM: Warfarin maintenance dosing patterns in clinical practice: implications for safer anticoagulation in the elderly population. Chest. 2005, 127: 2049-2056. 10.1378/chest.127.6.2049.
Strom CM, Goos D, Crossley B, Zhang K, Buller-Burkle A, Jarvis M, Quan F, Peng M, Sun W: Testing for variants in CYP2C19: population frequencies and testing experience in a clinical laboratory. Genet Med. 2012, 14: 95-100. 10.1038/gim.0b013e3182329870.
Relling MV, Guchelaar HJ, Roden DM, Klein TE: Pharmacogenetics: call to action. Clin Pharmacol Ther. 2011, 90: 507-author reply 507–508
Swen JJ, Nijenhuis M, de Boer A, Grandia L, der Zee AH M-v, Mulder H, Rongen GA, Van Schaik RH, Schalekamp T, Touw DJ: Pharmacogenetics: from bench to byte--an update of guidelines. Clin Pharmacol Ther. 2011, 89: 662-673. 10.1038/clpt.2011.34.
Swen JJ, Wilting I, de Goede AL, Grandia L, Mulder H, Touw DJ, de Boer A, Conemans JM, Egberts TC, Klungel OH: Pharmacogenetics: from bench to byte. Clin Pharmacol Ther. 2008, 83: 781-787. 10.1038/sj.clpt.6100507.
Teutsch SM, Bradley LA, Palomaki GE, Haddow JE, Piper M, Calonge N, Dotson WD, Douglas MP, Berg AO, Group EW: The evaluation of genomic applications in practice and prevention (EGAPP) initiative: methods of the EGAPP working group. Genet Med. 2009, 11: 3-14. 10.1097/GIM.0b013e318184137c.
Scott SA, Sangkuhl K, Gardner EE, Stein CM, Hulot JS, Johnson JA, Roden DM, Klein TE, Shuldiner AR: Clinical pharmacogenetics implementation C: clinical pharmacogenetics implementation consortium guidelines for cytochrome P450-2C19 (CYP2C19) genotype and clopidogrel therapy. Clin Pharmacol Ther. 2011, 90: 328-332. 10.1038/clpt.2011.132.
Pare G, Mehta SR, Yusuf S, Anand SS, Connolly SJ, Hirsh J, Simonsen K, Bhatt DL, Fox KA, Eikelboom JW: Effects of CYP2C19 genotype on outcomes of clopidogrel treatment. N Engl J Med. 2010, 363: 1704-1714. 10.1056/NEJMoa1008410.
This work was supported in part by the United States Air Force Medical Support Agency, Innovations Division (SG9Z) (MFC, ESG, DEL, TJS, and LH) and the RNR Foundation (NG, MAK, CBS). We thank the members of the Pharmacogenomics Advisory Board (Issam Zineh, Howard L McLeod, David A Flockhart, Arthur L Caplan, Marialice Bennett, Michael D Ezekowitz, Andrew Godwin, Amalia M Issa, Teri Klein, Calvin H Knowlton, Michael F Murray, Steven AR Murphy, Michael Phillips, Wolfgang Sadee and Deepak Voora) for their advice and crucial role in the study. We thank Joseph Jarvis for critical review of the manuscript. We thank Coriell staff from the Genotyping and Microarray Center and the Information Systems Department for their contributions to the project.
The authors declare that they have no competing interests.
NG, MAK, and CBS conceived and developed the PhAESIS method and participated in the drafting and writing of the manuscript. NG, LH, TJS, and DEL generated drug-gene PhAESIS submission reports for PAG evaluation for the drug-gene pairs included in this paper. LH and DEL helped with the drafting of the manuscript. ESG and MFC provided intellectual input into the PhAESIS method. MFC participated in the coordination of the CPMC study. All authors edited the paper and read and approved the final manuscript.
Neda Gharani, Margaret A Keller contributed equally to this work.
Electronic supplementary material
Additional file 1: Contains all the tables (Tables S1 to S28) referenced in Additional file 2 and in the main manuscript. Note that, given the research setting, gene variant evaluations were prioritized to those present on the genotyping platforms used by the Coriell Personalized Medicine Collaborative (CPMC) study (Affymetrix DMET Plus and Genomewide Human 6.0 arrays). As such the gene variant evidence (see Additional file 1: Tables S3, S6, S9, S11, S13, S15, S20, S23, and S27) includes variants on these platforms and any other key variants identified during literature and database searches. Other reported variants are not systematically included. (DOCX 1 MB)
Additional file 2:Consists of extracts from Pharmacogenomics Appraisal, Evidence Scoring and Interpretation System (PhAESIS) submission documents for the seven drugs and nine genes approved for risk reporting by the Coriell Personalized Medicine Collaborative (CPMC) Pharmacogenomics Advisory Group (PAG). Sections S1 to S7 represent summary annotations of PhAESIS reports submitted to and subsequently approved by the CPMC PAG. The concise summaries include a description and mechanism of action of the drug under review, an overview of the PGx data for the drug, summary of the drug-gene evidence for the key PGx genes, strength of evidence scoring of genetic variants, genotype-phenotype interpretations, current FDA and other clinical association guidelines, and gaps in PGx knowledge for the drug-gene pair. The data are taken directly from PAG reports with the date of PhAESIS review by the PAG provided. In some cases, more recent data are also cited in the text. (DOCX 739 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
About this article
Cite this article
Gharani, N., Keller, M.A., Stack, C.B. et al. The Coriell personalized medicine collaborative pharmacogenomics appraisal, evidence scoring and interpretation system. Genome Med 5, 93 (2013). https://doi.org/10.1186/gm499
- Drug Response
- Genetic Result
- Clinical Outcome Data
- Evidence Code