Quantitative approaches to variant classification increase the yield and precision of genetic testing in Mendelian diseases: the case of hypertrophic cardiomyopathy

Background

International guidelines for variant interpretation in Mendelian disease set stringent criteria to report a variant as (likely) pathogenic, prioritising control of false-positive rate over test sensitivity and diagnostic yield. Genetic testing is also more likely informative in individuals with well-characterised variants from extensively studied European-ancestry populations. Inherited cardiomyopathies are relatively common Mendelian diseases that allow empirical calibration and assessment of this framework.

Methods

We compared rare variants in large hypertrophic cardiomyopathy (HCM) cohorts (up to 6179 cases) to reference populations to identify variant classes with high prior likelihoods of pathogenicity, as defined by etiological fraction (EF). We analysed the distribution of variants using a bespoke unsupervised clustering algorithm to identify gene regions in which variants are significantly clustered in cases.

Results

Analysis of variant distribution identified regions in which variants are significantly enriched in cases and variant location was a better discriminator of pathogenicity than generic computational functional prediction algorithms. Non-truncating variant classes with an EF ≥ 0.95 were identified in five established HCM genes. Applying this approach leads to an estimated 14–20% increase in cases with actionable HCM variants, i.e. variants classified as pathogenic/likely pathogenic that might be used for predictive testing in probands’ relatives.

Conclusions

When found in a patient confirmed to have disease, novel variants in some genes and regions are empirically shown to have a sufficiently high probability of pathogenicity to support a “likely pathogenic” classification, even without additional segregation or functional data. This could increase the yield of high confidence actionable variants, consistent with the framework and recommendations of current guidelines. The techniques outlined offer a consistent and unbiased approach to variant interpretation for Mendelian disease genetic testing. We propose adaptations to ACMG/AMP guidelines to incorporate such evidence in a quantitative and transparent manner.

Advances in sequencing technology have dramatically expanded the scope for genetic testing in rare Mendelian diseases, but have exposed variant interpretation as a key limiting factor for clinical application. In an effort to standardise variant assessment in clinical settings, guidelines from the American College of Medical Genetics and Genomics/Association for Molecular Pathology (ACMG/AMP) were produced in 2015 [1] and have now been widely adopted [2]. These were in part prompted by the plethora of erroneous variant-disease associations in the research literature [3, 4] and the increasing realisation that individually rare variants are collectively common for many genes, as highlighted by population datasets such as the Exome Aggregation Consortium (ExAC) [5]. A critical objective of the guidelines is to limit false-positive results in clinical genetic testing in order to avoid genetic misdiagnosis or false reassurance through predictive testing of a variant that is not causal.

The ACMG/AMP guidelines outline how different lines of evidence should be assessed when interpreting a variant, and the strength of evidence required for a pathogenic (or likely pathogenic) classification. However, they are deliberately broad in scope, with the intention that individual rules would be interpreted and adapted for specific diseases within the overall framework [6]. They are conservative in nature and require substantial evidence in order to classify a variant as disease-causing. In practice, while novel truncating variants can be classified as pathogenic (when found in a gene where loss of function is a known mechanism of disease and fulfilling other conditions such as rarity), variant-specific evidence (such as segregation in the family or prior functional evidence of pathogenicity) is required for non-truncating variants to be reported as pathogenic.

We have recently shown that clinical laboratories utilising these stringent approaches to variant classification are, as expected, under-calling pathogenic variants in well-established cardiomyopathy genes [3], prioritising high specificity at a cost of test sensitivity. Clinical outcome data from the SHaRe registry of hypertrophic cardiomyopathy (HCM) patients supports this finding, as patients with variants of uncertain significance (VUS) had outcomes intermediate between genotype-positive and genotype-negative patients, indicating a substantial proportion are likely to be pathogenic [7]. Some diseases, including cardiomyopathies, are highly genetically heterogeneous with thousands of distinct causative variants, many of which are private or only detected in a handful of families, so interpretation of previously unseen variants is essential to provide a molecular diagnosis to many patients. As a consequence, the likelihood of obtaining a positive genetic test result for patients is often dependent on whether the putative causative variant has been previously identified and characterised.

Furthermore, the degree of certainty required to consider a specific variant causal in an individual depends on the use of that information. While predictive testing or pre-implantation genetic diagnosis requires a high degree of confidence, some treatment decisions may be made at lower confidence. In early onset diabetes, a potentially causative variant suggesting possible MODY (maturity onset diabetes of the young) might trigger a trial of sulfonylureas even if formally a VUS [8]. Dilated cardiomyopathy due to variation in lamin a/c is associated with a poor prognosis, with a propensity for life-threatening arrhythmia. A lower threshold for the use of primary prevention implantable cardioverter defibrillators may be adopted if a novel variant in LMNA is identified, even if formally classified as a VUS and predictive testing would not be undertaken on the same variant [9,10,11].

The likelihood of obtaining a positive result, i.e. identifying a pathogenic or likely pathogenic variant, is also dependent on the ethnicity of the patient. Data from the Partners Laboratory of Molecular Medicine (LMM) in the USA showed that Caucasian patients are more likely to get a positive result in cardiomyopathy genetic testing than “underrepresented minorities” (including African-Americans and Hispanics) and that the proportion of patients with inconclusive results was significantly greater in both Asians and “underrepresented minorities” compared to Caucasians [12]. Similar findings were observed specifically for HCM—the proportion of positive/uncertain results was 34.7%/13.9% for Caucasians and 24.2%/20.6% for non-Caucasians (p < 0.0001) in the LMM cohort (n = 2912) [13]. One of the likely reasons for this discrepancy is that much of the research and clinical testing in this condition has been done in Caucasian-majority populations, and therefore, Caucasians are more likely to have a causative variant that has been previously characterised. Inequalities in healthcare provision and access to genetic testing in the USA may also exacerbate this disparity [14]. While more genetic research in non-Caucasian populations is clearly required, these findings underline the need for improved variant analysis techniques that reduce the reliance on prior characterisation of individual variants and better distinguish poorly characterised variants that have a high likelihood of pathogenicity from those that are unlikely to be disease-causing.

For genes with a significant excess of rare variation in case cohorts over the general population, the etiological fraction (EF) provides a quantitative estimate of the probability that a rare variant detected in an individual with disease is causative, and is dependent on the gene, variant class and variant location within the gene/protein. Here, we apply this approach in validated HCM genes to empirically determine the probability that a novel variant found in a case is pathogenic before considering other evidence and further expand the framework to identify sub-genic regions (“hotspots”) in which variants have an increased likelihood of being actionable. For HCM, an actionable variant refers to a variant classified as pathogenic or likely pathogenic that can be used for cascade screening in the family of the patient being tested, to identify individuals at risk, and those free from risk, of developing HCM, as recommended by current guidelines [15]. This provides a more quantitative approach to variant classification, with the aim of addressing the substantial false-negative rate associated with current stringent guidelines by increasing the yield of high confidence pathogenic variants detected in these genes, as well as enabling a more unbiased application of genetic testing. We outline a potential framework to integrate this approach with the ACMG/AMP guidelines for genes and diseases with available case series to derive these estimates, enabling such case-control data to be utilised in a more quantitative and transparent manner. While highlighting that variant interpretation is highly dependent on the context of gene and disease, this approach is widely applicable for other Mendelian diseases for which sufficient cases have been genetically characterised.

Calculation of etiological fraction for significantly enriched variant classes

The etiological fraction (EF) estimates the proportion of risk that can be attributed to a specific exposure, in a population with disease who have been exposed to a risk factor [3]. In the context of Mendelian disease, exposure refers to a rare protein-altering variant in a particular gene, and the EF estimates the proportion of cases with a rare variant in whom that variant is disease-causing. The EF is derived from the attributable risk percent (ARP) among exposed, i.e. expressing the risk as a proportion rather than a percentage, and derived from the odds ratio (OR) as described below, where the OR provides an accurate estimate of the relative risk (RR)—the ratio of risk among exposed to risk among unexposed [16]. The odds ratio (OR) is calculated by Altman [17]:

where a = disease cases with a variant, b = controls/reference population with a variant, c = disease cases without a variant, and d = controls/reference population without a variant. The 95% confidence intervals (CI) for OR values are calculated by:

where the standard error of the log OR was given by:

The EF is derived from the OR:

95% CIs for EF values are calculated as described by Hildebrandt et al. [18].

EF and OR values were calculated for both truncating (frameshift, nonsense, splice donor site, splice acceptor site) and non-truncating (missense, small in-frame insertions/deletions) variants in HCM genes where a significant excess of rare variants in cases over the ExAC reference population was observed [19]. For the eight core sarcomeric genes (MYBPC3, MYH7, TNNT2, TNNI3, TPM1, MYL2, MYL3, ACTC1), the case cohorts were derived from published data from the Oxford Molecular Genetics Laboratory (OMGL) and the Laboratory of Molecular Medicine (LMM), Partners Healthcare, comprising between 4185 and 6179 unrelated HCM probands [3, 13]. The OMGL cohort comprises apparently unrelated index cases referred from Clinical Genetics centres across the UK, with initial clinical diagnosis of HCM made by a consultant cardiologist. Data on patient ethnicity is not available for this cohort but is expected to be broadly representative of the UK population. The LMM HCM cohort comprised unrelated probands referred for HCM clinical genetic testing. Any individuals with an unclear clinical diagnosis of HCM, or with left ventricular hypertrophy due to an identified syndrome such as Fabry or Danon disease, or unaffected individuals with a family history of HCM were excluded. The LMM cohort was 62% Caucasian (see Alfares et al. for full details on ethnicity [13]), but data on ethnicity for individual patients was not available. For the minor HCM genes (CSRP3, FHL1, PLN, TNNC1), combined cohorts from OMGL and LMM, a prospective research cohort from our laboratory and published cohorts were used as previously described [19], comprising between 2061 and 5440 unrelated HCM probands. For FLNC and FHOD3, recently published cohorts of 448 [20] and 3189 [21] HCM patients respectively were used. All rare variants were included for these calculations, regardless of the clinical classification of the variants.

For all genes, ExAC was used as the reference population database for background variation as previously described [3]. To account for variable coverage of the exome sequencing in ExAC, the sample total for each gene was adjusted by calculating the mean number of called genotypes for each variant. Rare variants were defined as those with a filtering allele frequency in ExAC below the maximum credible allele frequency for HCM [22], defined as 4 × 10⁻⁵ (prevalence = 1 in 500, allelic heterogeneity = 0.02, penetrance = 0.5, monoallelic inheritance, as calculated at http://cardiodb.org/allelefrequencyapp/). To confirm that this frequency was the most appropriate threshold to use, a sensitivity analysis was performed with other thresholds (0.0001, 0.0005, 0.001), showing that OR and EF values decreased with higher frequency thresholds (Additional file 1: Table S1).

EFs as a means of quantifying performance of variant classifiers

The EF is dependent on the relative frequencies of variants in cases and population controls. While applying strict thresholds for rarity will focus on variants more likely to be disease-causing, thereby increasing the EF, this is usually not sufficient to adequately distinguish between benign and pathogenic variation for non-truncating variants. Therefore, additional methods are required to discriminate between causative and background variants. A perfect discriminator of pathogenic and benign variants will identify the proportion of causative variants that is equal to the case excess and yield an EF of 1.0, with the proportion of benign variants equal to the population reference frequency of ExAC (and an EF of 0)—see hypothetical example in Fig. 1. In practice, it is unlikely that full discrimination will be achieved but this EF-based approach allows us to evaluate methods that aim to differentiate between pathogenic and benign variants. In this study, we compare the widely used and generic missense functional prediction scores with gene and disease-specific variant clustering. This EF-based approach also offers the advantage of not requiring predefined lists of irrefutable pathogenic and benign variants, which can be limited when performing analyses on specific genes.

The use of etiological fractions to evaluate variant classification methods. Illustration of how EFs can be used to evaluate methods for distinguishing pathogenic from benign variants (for a hypothetical gene). The overall EF of 0.85 [1] is based on a case frequency of 9.5% and a reference frequency of 1.5%. The aim of variant classification methods is to fully distinguish between pathogenic variants (producing an EF of 1.0 with frequency equal to case excess [2]) and benign variants (producing an EF of 0 with frequency equal to population reference, here ExAC [3]). We propose that an EF of 0.95 would be required to indicate a likely pathogenic variant

Full size image

Assessing performance of missense functional prediction scores in HCM genes

Functional prediction scores from the dbNSFP database [23] (version 3.2) were downloaded for all missense variants in the 13 HCM genes. Eight scores that provide binary predictions, i.e. damaging vs benign/neutral, were assessed—fathmm-MKL coding, FATHMM, LRT, Mutation assessor, MutationTaster, Polyphen2-HDIV, PROVEAN and SIFT, as well as the CADD algorithm (damaging variants were defined with a CADD phred score ≥ 15). A consensus prediction between the 9 scores was defined as being damaging if greater than 50% of the scores that predicted a damaging effect. Additionally, two consensus algorithms, MetaLR and MetaSVM [24], were also evaluated. The proportion of available predictions for each score for all potential missense variants in each gene was calculated to identify algorithms that do not provide comprehensive predictions for specific genes.

To test the effectiveness of these prediction scores for individual HCM genes, missense variants of known consequence (pathogenic and benign missense) were identified. Pathogenic variants were defined by rarity in ExAC as described above and:

1. 1)

   Classified as pathogenic (P) or likely pathogenic (LP) in HCM patients by two or more clinical laboratories (OMGL, LMM and ClinVar submitters)

2. 2)

   Classified as P/LP by one clinical laboratory with no conflicting classifications (VUS or benign) by other laboratories

3. 3)

   Significantly enriched in the OMGL/LMM cohorts compared to ExAC (Fisher’s exact test)

Benign variants were defined as:

1. 1)

   Presence in more than one individual in ExAC and not associated with any disease in ClinVar (P/LP/VUS) or HGMD

2. 2)

   Associated with disease in ClinVar (though not P or LP) or HGMD but at a frequency > 0.001 in ExAC.

The sensitivity (true positive rate) and specificity (true negative rate) was calculated for the 9 functional prediction scores and 3 consensus scores for each of the 8 core sarcomeric genes (there were insufficient known pathogenic variants for the minor genes). As an alternative method for assessing these predictors, EFs were calculated for deleterious variants using the case and ExAC cohorts described above.

Clustering algorithm to detect regional enrichment of variants

Protein regions enriched for rare variants were identified using a bespoke unsupervised clustering algorithm developed within this project. The algorithm is based on a sliding window scanning the protein sequences from their N-terminal to C-terminal residues, with a binomial test used to detect whether there is significant variation enrichment within the tested window compared with the rest of the protein.

The results of this first step are influenced by the size of the sliding window, with a spectrum ranging from small windows enabling detection of smaller, highly enriched variation hotspots but prone towards overfitting (in the most extreme case each residue with multiple variant alleles is considered a cluster), to large windows enabling detection of more extended enriched regions such as large protein domains but at the risk of too low a resolution (in the most extreme case, a unique cluster starting at the first variant residue and ending at the last). In terms of model performance, the former situation is characterised by specificity = 1 (no variant-free residues are within clusters) and sensitivity close to 0 (the vast majority of variant residues are excluded from clusters), whereas the latter results in the opposite situation (many variant-free residues are included in the unique cluster [specificity close to 0] but also all variant amino-acids are [sensitivity = 1]). For this reason, the algorithm automatically selects the optimal window size for each protein by searching for one minimising the difference between sensitivity and specificity (in this case the mean difference between cases and controls for each gene). Of note, the sparseness of the data (resulting in a strong imbalance between positive data points [variant residues] and negative data points [variant-free residues]) make all classic model performance measures (e.g. accuracy, AUC, PPV) biased towards results obtained with smaller window sizes.

To look for the optimal window size, the algorithm starts by testing 19 different sizes ranging from 5% of the protein to 95%. Subsequently, the algorithm picks the best one (if any) and tests 18 sizes around it at a 10-fold finer resolution (e.g. if the initial best window size is 10%, the next iteration will be on windows between 5.5% and 14.5%). This iterative process is repeated until a performance plateau is reached (i.e. none of the 18 new window sizes decreases the difference between sensitivity and specificity by more than 0.001 compared with the previous iteration). Once the optimal window size is detected, multiple testing correction is applied to each definitive window significantly enriched for variation, on the basis of the average number of times each protein residue has been tested (which depends on the number of iterations made, and on the size of the tested windows). Whenever a significant enrichment is detected within a window, its coordinates (start/end) are stored until the whole protein is scanned and, subsequently, merged with any other significantly enriched window to obtain a first “raw” set of variation-rich clusters.

After this first step, the algorithm performs a “boundary trimming” procedure at both ends of each cluster. This step controls for potential inclusion of variant-free (or non-enriched) distal cluster tails that may have been included within a significantly enriched window due to variants occurring more proximally. The algorithm performs the same procedure at both the N- and the C-terminal cluster boundaries, starting with a single-residue window including only the most external amino-acid, and iteratively extending it as far as the cluster median residue. Before each extension, the binomial test is used to check if there is a significant depletion of variants compared to the rest of the cluster. The algorithm stores each test’s p value and tested region coordinates and eventually trims the cluster by removing the most (if any) significantly variation-depleted tail, to obtain a final, refined set of clusters. One last binomial test is performed on the refined clusters to measure the significance of their rare variant enrichment.

Distinguishing pathogenic from benign variants using clustering in case and control cohorts

EFs were calculated based on these clusters and compared to those produced by a consensus of missense functional prediction scores from the dbNSFP database [23] (MetaLR, MetaSVM and a consensus of 9 individual predictors as described above). These consensus scores were also evaluated in genes where no clustering of case variants was observed.

Using EFs to increase the yield of putatively pathogenic variants in HCM cohorts

Sarcomeric gene rare variants in the OMGL/LMM clinical cohort [3] were re-assessed based on the analysis described above. The proportion of patients with variants that would be upgraded to likely pathogenic based on the revised ACMG/AMP guidelines was calculated, i.e. those previously classified as VUS but in a variant class with an EF ≥ 0.95 for missense variants or EF ≥ 0.90 for inframe indels (as inframe indels will also activate the PM4 rule regarding variants that change protein length and therefore only the moderate PM1 rule would be required for a likely pathogenic classification).

Analysis of prospective HCM cohort

The effect of the new EF-based ACMG/AMP rules on the yield of actionable variants was assessed on a prospective cohort of 684 HCM patients recruited at the Royal Brompton & Harefield Hospitals NHS Foundation Trust, London, UK [19]. The ACMG/AMP rules described below were used to classify variants from the valid HCM genes defined in this study, with rule implementation as described in the CardioClassifier resource [6]. The following rules could be activated by automated script:

• PM2—filtering allele frequency in ExAC < 4 × 10⁻⁵. This rule must be activated to denote a causative variant for this analysis.

• PVS1—truncating variants in MYBPC3, TNNT2, TNNI3, CSRP3, FHL1, PLN (genes statistically enriched in HCM cohorts versus ExAC).

• PS4—individual variant statistically enriched in cases over controls, based on LMM/OMGL cohort versus ExAC with the rule activated if the case count was > 2 and the Fisher’s exact test p value < 1.79 × 10⁻⁶ (Bonferroni correction).

• PM4—protein length changing variant, i.e. an inframe indel or stop lost variant.

• PP3—missense variant with multiple lines of computational evidence suggesting a deleterious effect, i.e. of the 8 predictors assessed (SIFT, PolyPhen2 var., LRT, Mutation Taster, Mutation Assessor, FATHMM, CADD and Grantham scores), only 1 predicts benign and < 3 have unknown classifications, or if ≥ 3 have unknown classifications, all others predict damaging.

• PM5/PS1—novel missense change at an amino acid where a different missense variant is pathogenic (PM5) or novel missense variant with same amino acid change as an established pathogenic variant (PS1). Pathogenicity here is defined as a pathogenic classification in ClinVar by multiple submitters with no conflicting evidence.

Rare variants (i.e. with rule PM2 activated) were then manually assessed for human genetic evidence in ClinVar entries and published reports using the following rules:

• PP1—co-segregation with disease. This rule was defined as supporting for ≥ 3 observed meioses, moderate for ≥ 5 meioses and strong for ≥ 7 meioses.

• PS2/PM6—de novo inheritance (with/without confirmed paternity and maternity).

• The PS3 rule relating to effects in functional studies was not applied due to the lack of standardisation and validation in functional assays for HCM variants.

The number of patients with variants that still remained as VUS, i.e. unactionable according to current guidelines, but that would be upgraded to at least likely pathogenic based on the revised ACMG/AMP guidelines was calculated as described for the clinical HCM cohort, i.e. those in a variant class with an EF ≥ 0.95 for missense variants (activating PM1_strong) or EF ≥ 0.90 for inframe indels (activating PM1_moderate).

Genotype-phenotype analyses to validate variant pathogenicity

The clinical characteristics of two HCM cohorts were used to support the pathogenicity of variants upgraded on the basis of an EF ≥ 0.95. For the prospective HCM cohort, left ventricular (LV) mass values indexed to body surface area were derived from cardiac magnetic resonance imaging and compared between cases with pathogenic or likely pathogenic variants (current ACMG/AMP guidelines), VUS upgraded to likely pathogenic with EF rules, other VUS and genotype-negative cases (only variants in thick filament genes MYH7 and MYBPC3 were analysed due to the distinctive patterns of LV hypertrophy observed in cases with variants in thin filament genes [25]).

Outcome data was assessed using the Sarcomeric Human Cardiomyopathy Registry (SHaRe), a multi-centre international repository that aggregates clinical and genetic data from patients with cardiomyopathies including HCM. A total of 2694 HCM patients with both right-censored outcome data and known sarcomeric genotype were analysed—1254 patients with at least one pathogenic or likely pathogenic variant in any of the 8 sarcomeric genes; 1199 patients with no sarcomeric variants; and 241 patients with VUS in any of the sarcomeric genes. Of the 241 patients with VUS, 69 were reclassified as pathogenic as they had variants with an EF ≥ 0.95. Survival curves were calculated by Kaplan-Meier analysis with log-rank test for the proportion of patients free of the overall composite outcome for each of the four genotype groups [7].

Detection of enriched variant clusters in RYR2

Non-truncating variants in RYR2 are causative in up to 50% of patients with catecholaminergic polymorphic ventricular tachycardia (CPVT), a rare inherited arrhythmia affecting approximately 1 in 10,000 people. Variants in cases have been shown to cluster in specific regions of RYR2, which codes for a ryanodine receptor 4867 amino acids in length, with a subset of its 105 exons thought to account for the majority of disease-causing variation [26]. However, the relatively high level of background benign variation in RYR2 increases the uncertainty in interpreting novel variants detected in CPVT cases [27]. For RYR2 variants in CPVT, rare variants were defined as those with a filtering allele frequency in ExAC below the maximum credible allele frequency for CPVT [22], defined as 1 × 10⁻⁵ (prevalence = 1 in 10,000, allelic heterogeneity = 0.1, penetrance = 0.5, monoallelic inheritance, as calculated at http://cardiodb.org/allelefrequencyapp/). For variants without a filtering allele frequency, i.e. detected in a maximum of one individual for any major ExAC sub-population, those with an overall ExAC allele count less than three were deemed to be rare. All missense and single amino acid inframe insertions/deletions were included as non-truncating variants.

Case clusters were defined as described above using a recently published cohort of 1200 referral cases for CPVT and 155 well-phenotyped cases (78 classified as strong CPVT and 77 classified as possible CPVT) [27]. For calculating EFs, only the 1200 referral cases were used for comparison with ExAC. Although this will yield more conservative EFs than using definitively diagnosed cases or a mix of diagnosed and referral (the yield of RYR2 variants in the referral series was 18.2% compared to 59% in the well-phenotypes cases [27]), the EFs generated will be more relevant and applicable to real world referral genetic testing for CPVT. We compared results from our detected clusters with previously defined hotspot regions (exons 3–15, 44–50, 83–90 and 93–105) [26] and a recently refined set of exons based on variant enrichment in cases (3, 8, 14, 43, 47–49, 81, 83, 88–90, 93, 95, 97–101, 103, 105), using the same case cohort as here but calculated on an exon-by-exon basis [27].

In established HCM-associated genes, the majority of rare variants found in cases are pathogenic

We compared the prevalence of rare variants of different classes in established HCM-associated genes between HCM cases and population controls, and calculated the odds ratio (OR) for disease. From this, we derived the etiological fraction (EF) which, under a Mendelian disease model, provides an estimate of the proportion of rare variants found in affected individuals that are disease-causing, and therefore, the probability that an individual variant (found in a patient with disease) is pathogenic.

The etiological fraction (EF) and odds ratio (OR) for predicted non-truncating (missense, small in-frame insertions/deletions) and predicted truncating (frameshift, nonsense, splice donor site, splice acceptor site) variants in validated HCM genes [19] are shown in Table 1. Truncating variants in MYBPC3, which we can estimate based on case and reference frequencies are causative in over 9% of HCM cases, have an EF>0.99 confirming that this variant class has a high likelihood of pathogenicity concordant with pedigree and functional studies. Truncating variants in other genes with an excess over ExAC are less prevalent (occurring in < 0.2% of cases in each gene), but the probability that a variant found in a case is causal is nonetheless high (> 0.84). While non-truncating variants are more prevalent in the general population, leading to a lower signal to noise ratio and reduced interpretative confidence for individual variants, the majority of such variants are causal, when found in an individual with confirmed disease. However, at the gene level, only variants in TPM1 yield an EF ≥ 0.95.

Evaluation of missense functional prediction scores

The EF can be used to assess variant prioritisation algorithms, empirically estimating the proportion of variants that are pathogenic after applying a filter or prioritisation strategy. Some of the most commonly used tools for evaluating variants are missense functional prediction algorithms.

To initially evaluate the performance of these computational algorithms for HCM gene variants, the results of nine predictors (FATHMM, fMKL, LRT, mutation assessor, mutation taster, Polyphen-2, PROVEAN and SIFT, as well as CADD which integrates multiple annotations into one metric) and three consensus methods (MetaLR, MetaSVM [24] and a consensus of the nine algorithms) from the dbNSFP database [23] were assessed using known pathogenic (n = 298) and benign (n = 349) variants in the eight sarcomeric genes (see the “Methods” section). These algorithms generally provide high sensitivity but limited specificity, as has been previously reported, although in contrast the FATHMM predictor (and MetaLR and MetaSVM consensus scores that incorporate FATHMM) has a low sensitivity for detection of pathogenic variants for MYBPC3 and MYL2 (Additional file 1: Table S2). We also noted that dbNSFP does not provide predictions for certain gene/algorithm combinations (Additional file 1: Table S3).

Clustering analysis identifies interpretable “hot spots”, within which novel variants have a high probability of pathogenicity

For genes with an EF < 0.95 for rare non-truncating variants, we examined the regional distribution of variants found in cases along the protein sequence. A novel clustering algorithm (see the “Methods” section) identified a statistically significant aggregation of distinct variants (in cases) in 6 genes—MYH7, MYBPC3, TNNI3, TNNT2, MYL3 and CSRP3 (Fig. 2, Additional file 1: Table S4). For each cluster, the prevalence of rare variants in cases and controls was then used to calculate the EF as described above. Variants in four of these clusters (MYH7, MYBPC3, TNNI3, TNNT2) had an EF > 0.95 (Table 2). The regions highlighted by clustering analysis correspond to key functional and protein-binding domains—the myosin motor domain of MYH7, troponin C and actin-binding domains in TNNI3 and the tropomyosin-binding domain in TNNT2.

Distribution of rare variants in HCM and ExAC cohorts for 6 genes with HCM clustering. Clustering analyses identify regions enriched for disease-associated variation, and therefore within which variants have a high likelihood of pathogenicity. For six HCM genes, the location of rare missense and single amino acid inframe indel variants found in cases (all variants regardless of clinical classification) and controls are shown alongside a cartoon of the cDNA structure. Darker grey indicates higher variant density (overlapping variants not plotted separately). Regions in which variants cluster significantly in cases are shown in red, and regions with clustering in population controls (ExAC) are shown in yellow. The HCM clusters detected were: MYH7 (residues 167–931), MYBPC3 (485–502, 1248–1266), TNNI3 (141–209), TNNT2 (79–179), MYL3 (143–180) and CSRP3 (44–71). For MYH7, existing functional annotations (as described in the “Discussion” section) are superimposed: In green, key residues of the converter kinetic domain and myosin mesa surface area enriched in disease-associated variants (Homburger et al. [37]); in blue, sites of inter- and intramolecular interaction between pairs of myosin heads (Alamo et al. [38]); and in grey, regions previously identified as constrained (intolerant of variation as evidenced by depletion of protein-altering variation in population controls), with the darker shades indicating higher constraint (Samocha et al. [36]). The coordinates describe amino-acid position within the canonical protein sequence

Full size image

FLNC [28] and FHOD3 [21] have recently been proposed as novel genes for HCM, with both reports demonstrating an excess of rare variation over controls as well as strong supporting familial segregation data. However, the relative frequencies of rare variation between cases and ExAC in these two genes produce only modest overall EFs (0.44 for FLNC and 0.48 for FHOD3). Although enrichment of case variants towards the C-terminus of FLNC has previously been noted [20, 28], no clusters were detected in this study, though this may be due to the limited cohort size available (448 cases [20]). For FHOD3, a cluster between residues 321 and 849 was detected but still yielded a relatively modest EF of 0.78 (0.73–0.85) and OR of 4.7 (3.5–6.3) (Additional file 2: Figure S2). The authors of the FHOD3 study noted a clustering of case variants in the small coiled-coil domain (residues 622–655) although the EF for this region only reached 0.82 (OR = 5.6).

The performance of variant clustering and functional prediction scores in distinguishing between pathogenic and benign variants was then compared. In contrast to the significant enrichment of pathogenic variants obtained by analysis of the regional distribution of variation, functional prediction consensus scores only marginally increased EFs, compared to whole-gene estimates (Table 2), highlighting the limitations of using such generic predictors. For other HCM genes, no clear clustering of variants in the case cohorts was observed across the protein sequence (Additional file 2: Figure S1). Therefore, only consensus functional prediction scores are currently available for variant prioritisation, but again these provide only a marginal increase in EF values for these genes (Additional file 1: Table S5).

Adapting ACMG/AMP guidelines to incorporate EF prior probabilities

The ACMG/AMP guidelines incorporate the relative frequency of an individual variant in cases and controls as direct evidence of disease association (PS4). This rule is applicable only for the minority of individual HCM variants that are recurrently observed in large case series. For non-truncating variants, there are currently two further rules in the ACMG/AMP guidelines that can incorporate information on the differing aggregate frequencies of variants of particular classes between case and control cohorts and that can be activated by novel variants—PP2 (missense in gene with a low rate of benign missense variants and pathogenic missense variants are common) and PM1 (mutational hot spot or well-studied functional domain without benign variation). However, activating even the stronger of these rules (PM1) will not lift any novel or relatively uncharacterised variant beyond VUS without substantial segregation or functional characterisation, even if found in genes or regions that are completely intolerant of variation. Additionally, the rules are categorical (despite describing a quantitative class of evidence) and must be specified for each gene and disease, with no consensus yet on the circumstances in which these should be applied.

In order to apply a more quantitative approach to these rules, we propose an adaptation of the guidelines as shown in Fig. 3. The EF enables a unified approach and provides an empirical estimate of the probability of pathogenicity for a variant in a given gene (or region of a gene) that allows rules to be applied at different strengths. The non-quantitative related rules PP2 and PM1 would be replaced with a single rule (PM1) with three (or more) evidence levels depending on pre-defined EF for the relevant variant class. For genes where clustering of variants has been observed, regional EFs, rather than EFs at the gene level, should be applied. This semi-quantitative approach is similar to the PP1 rule for segregation data that allows the rule to be progressed from supporting to moderate to strong with increasing evidence [29, 30]. As the EF is calculated for rare variants found in cases, PM1 would only be activated in combination with the PM2 rule defining rarity, and if the variant has been identified in an individual suspected to have cardiomyopathy. Since PM1_strong (in conjunction with PM2) would enable a novel variant to be classified as likely pathogenic, we suggest an EF ≥ 0.95 could activate this rule. This is equivalent to an OR of 20, broadly similar to that adopted in the Bayesian modelling of the ACMG/AMP guidelines by Tavtigian et al. [31].

Proposed adaptation of ACMG/AMP guidelines for rule PM1, relating to the relative frequencies of non-truncating variants in case cohorts and population controls

Full size image

Since each level of evidence in the hierarchical ACMG/AMP framework represents a doubling in weight, a Bayesian interpretation of the ACMG/AMP guidelines [31] requires that the odds should increase by a power of 2 as you move to a higher evidence tier. This yields corresponding EF/OR thresholds of 0.776/4.47 for the PM1_moderate rule and 0.527/2.11 for the PM1_supporting rule given an EF threshold of 0.95 for PM1_strong. However, we believe a more conservative application of these rules may be more appropriate in a real world setting, and therefore for this study, we have defined PM1_moderate as an EF between 0.90 and 0.95 (minimum OR of 10) and PM1_supporting as an EF between 0.80 and 0.90 (minimum OR of 5). Future consensus-derived implementations of these rules may choose to incorporate the Bayesian model, although it should be noted that other recommendations for translating quantitative data into ACMG/AMP rules also do not account for exponentially scaled odds of pathogenicity [29, 30].

An EF-calibrated tiered application of PM1 increases the yield of actionable variants in HCM

To evaluate how the EF-based modified ACMG/AMP guidelines could improve the yield of genetic testing in HCM, we determined the proportion of VUS in a diagnostic referral cohort that were found in genes or regions with an EF ≥ 0.95 that might therefore trigger a PM1_strong rule (i.e. non-truncating variants throughout TPM1 and in case-enriched clusters of MYH7, MYBPC3, TNNI3 and TNNT2). In all, variants in 4.0% of cases could be upgraded to likely pathogenic by activating this strong evidence rule (Fig. 4a). This represents an increase in yield of pathogenic and likely pathogenic variants in the eight sarcomeric genes from 28.8% to at least 32.8% (14% relative increase) in this cohort. It should be noted this is a conservative estimate, focusing only on PM1_strong, whereas variants activating PM1_moderate and PM1_supporting might also lead to a change in interpretation when combined with other lines of existing evidence.

Effect of EF-based approach to variant classification in HCM cohorts. a Proportion of cases from the OMGL/LMM HCM cohorts with variants in 8 sarcomeric genes (only rare variants, ExAC filtering frequency < 4 × 10⁻⁵, are shown, excluding non-essential splice site variants). Coloured shading represents the clinical classification of the original diagnostic laboratory (OMGL and LMM), and, for variants originally classified as VUS, the proportion that could be reclassified as Likely Pathogenic based on occurrence within a gene or region with EF ≥ 0.95. Eighty-nine variants in 123 cases for MYH7, 12 variants in 27 cases for MYBPC3, 18 variants in 34 cases for TNNI3, 15 variants in 18 cases for TNNT2 and 22 variants in 33 cases for TPM1 would be upgraded based on this analysis. b Proportion of cases in a prospective HCM cohort classified as actionable based on application of fixed and automatable ACMG/AMP rules, alongside the addition of manual curation of published evidence and the proposed EF-calibrated PM1 rules. Thirty-one extra cases (4.5%) are upgraded with EF-based rules compared to just 4 (0.6%) with manual curation. c Comparison of indexed LV mass in cases with pathogenic variants, VUS in high EF (≥ 0.95) regions, and VUS in low EF regions (< 0.95) in MYH7/MYBPC3 as well as genotype-negative cases, from the prospective HCM cohort. The clinical phenotype of individuals with VUS at locations anticipated to be pathogenic is indistinguishable from known pathogenic/likely pathogenic variants, while individuals with VUS in other regions have a clinical phenotype more similar to individuals without a sarcomere variant. d Kaplan-Meier survival curve for the overall composite endpoint (including mortality, ventricular arrhythmia and heart failure composites) of the SHaRe cardiomyopathy registry stratified by genotype (HCM cases with pathogenic variants, VUS in high EF region (≥ 0.95), VUS in lower EF regions (< 0.95), and genotype-negative cases)

Full size image

Sarcomeric variants in a prospective cohort of 684 HCM cases [19] were also analysed. 19.1% of cases had actionable (pathogenic and likely pathogenic) variants with automatically applied rules (see the “Methods” section for details), with only 4 additional cases with VUS upgraded to actionable based on manual assessment of published evidence from family pedigrees. In contrast, VUS would be upgraded in 31 cases (of 82 with VUS) using the proposed PM1 modifications (4.5% of the cohort) in addition to automatically applied rules. In total, this corresponds to a 20.7% relative increase in actionable variants over current guidelines (Fig. 4b). See Additional file 1: Table S6 for details of the variants detected in this cohort.

Independent validation of variants upgraded from VUS under this framework

The distinctive clinical characteristics of genotype-positive and genotype-negative HCM patients offer an opportunity to validate variant classifications in the absence of an independent gold-standard set of variants for benchmarking. If cases with variants that are upgraded from VUS to P/LP are more phenotypically similar to cases with known pathogenic variants, this offers further supportive evidence to validate the reclassification. We assessed mean indexed left ventricular (LV) mass and event-free survival as clinical variables that are associated with pathogenic sarcomere variants.

In the prospective HCM cohort, overall LV mass is significantly greater in genotype-negative cases (101.0 ± 31.8 g/m²) compared to genotype-positive cases (88.7 ± 31.1 g/m²), despite the fact that patients with pathogenic sarcomeric variants tend to have greater maximum LV wall thickness. Cases with variants upgraded from VUS were similar to genotype-positive (86.0 ± 28.1 g/m², p = 0.98), with both significantly different from genotype-negative and cases with VUS that are not upgraded (104.3 ± 24.7 g/m²) (Fig. 4c). Genotype-positive cases have significantly worse outcomes than genotype-negative cases, as demonstrated most comprehensively by data from the SHaRe registry [7]. In this dataset, cases with VUS display intermediate outcomes, although more similar to genotype-positive (p = 0.07) than genotype-negative (p < 0.001). Sub-classifying these by EF, cases with VUS with an EF ≥ 0.95 had similar outcomes to genotype-positive cases (p = 0.9) and were significantly different to genotype-negative cases (p = 0.001) (Fig. 4d). In contrast, cases with VUS with an EF < 0.95 displayed cumulative outcomes intermediate between genotype-positive (p = 0.03) and genotype-negative (p = 0.03) cases, consistent with the expectation that these cases will include a mix of both pathogenic and rare benign variants.

Applicability of this approach to other genetic diseases

To assess how the approach described here could be applied to other genetic diseases, we analysed variants in RYR2 from a recently published referral cohort for catecholaminergic polymorphic ventricular tachycardia (CPVT) [27]. Rare, non-truncating RYR2 variants detected in 1200 referral cases and 155 well-phenotyped CPVT cases were used to define three case-enriched clusters in RYR2 (residues 2138–2538, 3935–4196 and 4721–4959), partially overlapping with previously identified disease hotspots (Fig. 5). EF and OR values were calculated by comparison of the 1200 referral cases to ExAC. Despite the use of a referral only case cohort (which has been shown to have a significantly lower yield of RYR2 variants), the EF for rare variants within the clusters was calculated at 0.982 (OR = 55.5) (Additional file 1: Table S7). Although RYR2 has a relatively high background rate of rare variants, by setting stringent population frequency thresholds (see the “Methods” section) and identifying enriched clusters, we can identify variant classes with a very high probability of pathogenicity—indeed the EF will be higher still for definitively diagnosed CPVT cases given the relatively low diagnostic yield observed in the referral cohort. Our unsupervised approach to defining variant-enriched clusters was more discriminatory than an exon-based strategy—the original 41 exon hotspot region [26] yielded an EF of 0.966 (OR = 29.2) and the recently refined 21 exon hotspot region [27] yielded an EF of 0.975 (OR = 39.8) (Additional file 1: Table S7), though the larger clusters do encompass more case variants. The limitations of using exon boundaries to define hotspots are highlighted by exon 90 (the largest RYR2 exon) in which pathogenic variants appear to be restricted to the first half of the exon (Fig. 5).

Distribution of rare variants in CPVT and ExAC cohorts for RYR2. All rare RYR2 non-truncating (missense and single amino acid inframe indel variants) variants in 1355 CPVT cases (well-phenotyped and referral) and ExAC are shown alongside a cartoon of the cDNA structure. Darker grey indicates higher variant density (overlapping variants not plotted separately). Three regions enriched for disease-associated variation were identified (shown in red)—residues 2138–2538, 3935–4196 and 4721–4959. Exons used in previously defined hotspot regions (original 41 exons and refined 21 exons) are highlighted as shown

Full size image

The accurate and comprehensive interpretation of rare variants underlying Mendelian disease remains one of the principal challenges facing genetics and one of the key obstacles to fulfilling the potential of genomics in clinical practice. Current guidelines are conservative and prioritise minimising false-positive results, given the potentially serious adverse consequences of predictive testing based on erroneously classified variants. However, this comes at the cost of sensitivity and denies many individuals the benefits of a molecular diagnosis. In HCM, case-control comparisons have highlighted that the majority of sarcomeric gene variants reported as VUS in leading clinical labs are in fact pathogenic variants, particularly for population groups that have not been extensively studied, highlighting the need for improved stratification of these variants. While the principal benefit of a molecular diagnosis in HCM is currently the potential for predictive testing of relatives, for applications of genetic testing other than diagnosis and predictive testing (such as prognostication and selection of specific therapies, that are emerging in HCM and established in other diseases), a different balance between sensitivity and specificity may be required, and variants may be actionable with a lower burden of proof of causality. It is also recognised that VUS, though not clinically actionable, can create uncertainty and confusion for recipients of genetic testing, with patients often over-interpreting their effect [32]. New methods for more comprehensive identification of disease-causing variants, while maintaining the stringency of clinical guidelines, are urgently required.

In this study, we have demonstrated that using large case and population cohorts, and applying strict population frequency thresholds for variants of interest, we can identify genes and gene regions in which variants of specific classes have high likelihoods of pathogenicity. The probability of pathogenicity can also be empirically estimated, providing a quantitative measure of interpretative confidence. We demonstrate how the ACMG/AMP framework could be adjusted to incorporate this information (where suitable case series exist) and enable a more quantitative and transparent assessment of this evidence class. Crucially, this new framework allows variants that are novel or otherwise not yet well-characterised, but which belong to variant classes with very high prior probabilities of pathogenicity, to be classified as (likely) pathogenic. Under existing rules, such variants will remain as VUS unless the family structure permits well-powered segregation analysis, or there are resources for functional characterisation.

As variant-specific evidence such as co-segregation data has typically been required to classify missense or non-truncating variants as disease-causing, we recognise that the novel approach to variant classification described here may require further piloting and replication before adoption of a clinical setting. However, we believe this method is consistent with the stringent approach to variant classification of current guidelines. While the ACMG/AMP guidelines define likely pathogenic as a “greater than 90% certainty of a variant being disease-causing” [1], a 95% threshold is arguably more in line with standard clinical practice, and therefore, we have proposed an EF cut-off of 0.95 to define strong evidence for this rule. We consider a 95% probability of pathogenicity to be a reasonable level of evidence for a “likely pathogenic” classification, and one that provides an effective balance between sensitivity and specificity in genetic testing. It is also important to recognise that there is an inherent uncertainty associated with all variant interpretation, particularly for those classified as likely pathogenic. The confidence of both clinicians and patients in the results of genetic testing could be improved by more effective reporting of the evidence for pathogenicity in genetic reports, including the EF for relatively uncharacterised variants, and more transparency about the level of certainty associated with any classification.

Importantly, the approach to variant classification described here is compatible with the existing framework of the ACMG/AMP guidelines that have been widely adopted in clinical genetics laboratories. The translation of EF values into semi-quantitative PM1 rules, with a twofold increase in ORs required to progress between evidence classes, is similar to that adopted for another quantitative data type—co-segregation with disease in affected family members. Recent studies have sought to translate segregation data into supporting, moderate or strong PP1 rules based on the number of meioses of the variant that are informative for co-segregation [29, 30]. The rule adaptations proposed here also address the discrepancy between the rules for truncating and non-truncating variants in the current guidelines. Truncating variants in genes where loss of function is a known mechanism for the disease in question will achieve a classification of at least likely pathogenic, courtesy of the (very strong) PVS1 rule, assuming a number of criteria are met [33]. While the weight of this rule partly derives from the fact that a non-functional protein is likely to be produced by the truncating variant (albeit with the caveats described by Richards et al. [1]), it also reflects the rarity of such variants in the population and consequently the high odds of a variant detected in a patient being pathogenic (as seen with MYBPC3 truncating variants in this study, with an EF > 0.99 and an OR of 115). Non-truncating variant classes that are similarly highly enriched in case cohorts should also have this evidence more appropriately weighted when evaluating variants.

Although we have introduced a more quantitative approach to variant classification in this study, we have deliberately stayed within the framework of the ACMG/AMP guidelines. These guidelines have been widely adopted in clinical genetics laboratories, and therefore, adaptations like those we have proposed here can be easily and readily integrated into existing variant analysis pipelines in these laboratories. In time, more comprehensive quantitative models assessing a wider range of evidence classes, and likely incorporating machine learning algorithms, may be developed that could offer a fully quantitative approach to variant interpretation. However, there will likely be substantial technical and cultural obstacles to be overcome before such novel methodologies are routinely applied in clinical testing.

Our findings highlight the necessity of applying gene and disease-specific expertise to both variant classification and the customisation of ACMG/AMP guidelines [6]. As we have shown, variant characteristics that are specific to the genes and disease in question, such as clustering of case variants in specific protein domains, are more powerful discriminators than generic techniques designed to be applied genome wide, such as the widely used missense functional prediction algorithms. This has also been recently demonstrated by an analysis of variation in the RYR2 gene in catecholaminergic polymorphic ventricular tachycardia [27]. Interestingly, the estimated 14–20% increased yield of actionable variants in sarcomeric genes described here is likely to have a greater impact on HCM genetic testing yield than all of the efforts over the last 10–20 years to identify novel, non-sarcomeric genetic causes in this condition [19] that have explained very few additional cases. This highlights how efforts and resources to improve variant interpretation and the yield of genetic testing can be inefficiently allocated. While discovering valid novel genes may advance our understanding of disease and identify new therapeutic targets, an over-emphasis on discovering “novel” causes of diseases may have less translational impact than efforts to improve our understanding of variation in known disease genes.

The publication and sharing of genetic data, as well as evidence about variant consequences in resources like ClinVar, is crucial for expanding our ability to interpret the results of clinical genetic testing of Mendelian disease [34]. This study also underscores the importance of clinical laboratories and research groups publishing and sharing genetic data with allele frequencies across case cohorts as well as recording observations in individual patients—a large proportion of the HCM data in this study was published previously by the LMM [13] and OMGL [3] clinical laboratories. This will be even more critical for extending this approach to rarer and less well-characterised genetic diseases than cardiomyopathies. In addition, further sequencing and publication of genetic data from non-Caucasian populations is becoming a critical issue across genetics [35], including Mendelian conditions like cardiomyopathies. Large case cohorts, as well as population data from resources like gnomAD, from currently underrepresented population groups will be needed to validate the methods described here in non-Caucasians. However, the analysis of the prospective HCM cohort in this study has also exposed the limitations of relying on variant-specific evidence such as segregation data for the interpretation of variants. Published segregation data was mostly restricted to those variants that are already enriched in HCM cases (and therefore can be used to increase confidence in the variant classification by upgrading from likely pathogenic to pathogenic) rather than enabling rarer variants to be progressed from VUS to likely pathogenic, highlighting the necessity of novel approaches to increase the sensitivity of genetic testing, such as those described in this study.

Comparisons with other methods that assess region pathogenicity

An alternative approach to identify functionally important genic regions seeks those that are depleted in (missense) variation in a reference population[36], in contrast to the analysis presented here that seeks a regional enrichment of variation in cases. Here depletion indicates negative selection of variation, implying that variation is not tolerated. Sub-genic regions of constraint were identified in only four of the HCM genes analysed in this study (MYH7, FLNC, TNNC1, FHOD3). There is partial overlap of the regions identified in this study (Fig. 2), e.g. a region of high constraint in MYH7 from residues 1–916 broadly corresponds to our HCM cluster (residues 167–931). Whatever the method for identifying a region of interest, empirical comparison of cases and controls provides a direct assessment of the strength of association with a specific disease, enabling us to directly estimate the likelihood of pathogenicity for variants in specific regions, as well as detecting pathogenic clusters in other genes for which no regional constraint data exists.

The EF (and OR) can of course be applied to calibrate an appropriate PM1 rule strength irrespective of the method by which the region is initially highlighted as potentially important. For example, two recent studies explored structure-function models in β-cardiac myosin (MYH7) to identify residues that are key to protein function (and therefore intolerant of variation), with variants affecting these residues enriched in case over population reference cohorts. Homburger et al. modelled β-cardiac myosin before and after the myosin power stroke and identified the converter kinetic domain and myosin mesa surface area as regions enriched in disease-associated variants using a spatial scan statistic [37]. Alamo et al. defined sites of inter- and intramolecular interaction between pairs of myosin heads (the interacting-heads motif—IHM), noting that variants in HCM cases disproportionately alter IHM residues [38]. The MYH7 residues identified by these studies largely overlap with the HCM cluster we have identified by one-dimensional clustering (Fig. 2). Particular groups of residues detected by these analyses are highly enriched in disease-associated variants (yielding higher EFs than our cluster), with 7 IHM groups yielding an EF > 0.99 and accounting for 44% of variants found in HCM cases [38]. EF-based variant analysis thus requires a balance between specificity and sensitivity, or a tiered approach with different confidence levels for pathogenicity.

Issues and limitations of this approach to variant classification

The calculation of EFs for particular variant classes is dependent on a number of factors. As we have previously shown, it is critical to adopt stringent, disease-specific frequency thresholds when assessing putative pathogenic variants [22]. Additionally, the choice of case and control/population cohorts will influence how EFs are generated. For cases, the use of clinical referral cohorts (the diagnostic case series from different centres in Europe and North America that we have employed in this study should be reasonably representative of real-world referral patterns) will produce more conservative EF values than highly selected case series, but we believe these more cautious, referral EFs are relevant to a clinical genetic setting. Nonetheless, these may change as referral patterns change (e.g. with increasing test availability). Although the use of population reference data without well-defined phenotypes has limitations, and is not optimally matched technically (e.g. differences in sequencing coverage, as previously discussed [3]), we believe the advantages (population size and ethnic diversity allowing more accurate calculation of rare variant frequencies) outweigh the disadvantages. It is also crucially important to note that the evidence described here should only be applied to assessing variants from patients with the disease in question, and not from incidental or secondary findings in healthy individuals or those being sequenced in the context of other conditions, as EFs correspond to the probability of pathogenicity given that the variant is identified in an individual with disease.

Although we have identified highly pathogenic variant classes in a number of HCM genes, for others it is more challenging to effectively differentiate between benign and pathogenic variation. In particular, although we detected some small case-enriched clusters of non-truncating variants in MYBPC3, these will correspond to only a small proportion of such variants that are responsible for HCM in up to 8% of cases. For such genes, further research and larger datasets are needed to identify the protein regions and specific residues at which variation is most likely to cause disease. This could include analysis of protein structure, as demonstrated in the MYH7 studies described above, or the development of computational prediction techniques that are specific to (and validated in) key disease genes, given the limitations of the generic and consensus scores that we have observed in this study. Genes like MYBPC3, i.e. those with a high diagnostic yield but poor signal-noise ratio that impedes the statistical prediction of pathogenicity, could also be prioritised for high-throughput functional classification studies [39].

In conclusion, we have demonstrated that by combining large case and control datasets, stringent population frequency thresholds, and the detection of pathogenic clusters in key disease genes, we can empirically estimate the likelihood that rare variants in specific genes or regions are pathogenic and can identify variant classes with a high prior probability of pathogenicity. Using this evidence to calibrate the appropriate weighting for rules within the ACMG/AMP framework, we believe the yield of genetic testing in diseases like HCM can be significantly increased, with less dependence on the prior characterisation of variants to define pathogenicity, while retaining a robust statistical framework. This may help to reduce the substantial false-negative rate associated with the use of the current stringent variant interpretation guidelines and increase the accuracy and sensitivity of genetic testing. It may also help to address the ethnicity bias associated with obtaining a positive result, enabling a more equitable application of genetic testing. This study also reinforces the concept that disease and gene-specific approaches are critical for accurate and comprehensive variant analysis. Finally, this quantitative approach moves us towards more transparent probabilistic variant classification for both Mendelian disease genetics and precision medicine.

ACMG/AMP:

American College of Medical Genetics and Genomics / Association of Molecular Pathology

ARP:

Attributable risk percent

CI:

Confidence interval

CPVT:

Catecholaminergic polymorphic ventricular tachycardia

EF:

Etiological fraction

ExAC:

Exome Aggregation Consortium

HCM:

Hypertrophic cardiomyopathy

LMM:

Laboratory of Molecular Medicine

LV:

Left ventricular

OMGL:

Oxford Molecular Genetics Laboratory

OR:

Odds ratio

RR:

Relative risk

TNR:

True negative rate

TPR:

True positive rate

VUS:

Variant of uncertain significance

Not applicable.

Funding

This work was supported by the Wellcome Trust (107469/Z/15/Z), the British Heart Foundation (SP/10/10/28431), the Medical Research Council, the National Institute for Health Research (NIHR) Cardiovascular Biomedical Research Unit based at Royal Brompton & Harefield NHS Foundation Trust and Imperial College London, the NIHR Biomedical Research Centre based at Imperial College London Healthcare NHS Trust and Imperial College London, the Fondation Leducq (11 CVD-01), and a Health Innovation Challenge Fund award from the Wellcome Trust and Department of Health, United Kingdom (HICF-R6-373). The views expressed in this work are those of the authors and not necessarily those of the NHS, the NIHR, Department of Health or the Wellcome Trust. IO and FM were supported by the Italian Ministry of Health – “Left ventricular hypertrophy in aortic valve disease and hypertrophic cardiomyopathy: genetic basis, biophysical correlates and viral therapy models” (RF-2013-02356787), and “Mechanisms and treatment of coronary microvascular dysfunction in patients with genetic or secondary left ventricular hypertrophy” (NET-2011-02347173).

Availability of data and materials

The datasets generated and/or analysed during the current study are available in the supplemental files of this study or in previously published studies – Walsh and Thomson et al [3] (https://doi.org/10.1038/gim.2016.90) and Walsh et al [19] (https://doi.org/10.1093/eurheartj/ehw603).

Affiliations

1. Cardiovascular Research Centre, Cardiovascular Genetics and Genomics group at Royal Brompton Hospital and Harefield NHS Foundation Trust, Sydney Street, London, SW3 6NP, UK

   • Roddy Walsh
   • , Francesco Mazzarotto
   • , Nicola Whiffin
   • , Rachel Buchan
   • , William Midwinter
   • , Alicja Wilk
   • , Nicholas Li
   • , Leanne Felkin
   • , Nathan Ingold
   • , Risha Govind
   • , Mian Ahmad
   • , Erica Mazaika
   • , Xiaolei Zhang
   • , Paul J. R. Barton
   • , Stuart A. Cook
   •  & James S. Ware

2. National Heart and Lung Institute, Imperial College London, London, UK

   • Roddy Walsh
   • , Nicola Whiffin
   • , Rachel Buchan
   • , William Midwinter
   • , Alicja Wilk
   • , Leanne Felkin
   • , Risha Govind
   • , Mian Ahmad
   • , Erica Mazaika
   • , Mona Allouba
   • , Xiaolei Zhang
   • , Paul J. R. Barton
   • , Stuart A. Cook
   •  & James S. Ware

3. Department of Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, Amsterdam, Netherlands

   • Roddy Walsh

4. Cardiomyopathy Unit, Careggi University Hospital, Florence, Italy

   • Francesco Mazzarotto
   •  & Iacopo Olivotto

5. Department of Clinical and Experimental Medicine, University of Florence, Florence, Italy

   • Francesco Mazzarotto

6. MRC London Institute of Medical Sciences, Imperial College London, London, UK

   • Nicola Whiffin
   • , Nicholas Li
   • , Antonio de Marvao
   •  & James S. Ware

7. Aswan Heart Centre, Aswan, Egypt

   • Mona Allouba

8. Division of Cardiovascular Medicine, University of Michigan, Ann Arbor, MI, USA

   • Sharlene M. Day

9. Division of Cardiovascular Medicine, Stanford University Medical Center, Stanford, CA, USA

   • Euan Ashley

10. Department of Cardiology, Boston Children’s Hospital, Boston, MA, USA

    • Steven D. Colan

11. Department of Cardiology, Thoraxcenter, Erasmus MC Rotterdam, Rotterdam, Netherlands

    • Michelle Michels

12. Heart Institute (InCor), University of Sao Paulo Medical School, Sao Paulo, Brazil

    • Alexandre C. Pereira

13. Yale University, New Haven, CT, USA

    • Daniel Jacoby

14. Cardiovascular Division, Brigham and Women’s Hospital, Boston, MA, USA

    • Carolyn Y. Ho

15. Oxford Medical Genetics Laboratory, Oxford University Hospitals NHS Foundation Trust, The Churchill Hospital, Oxford, UK

    • Kate L. Thomson

16. Radcliffe Department of Medicine, University of Oxford, Oxford, UK

    • Kate L. Thomson
    •  & Hugh Watkins

17. The Wellcome Trust Centre for Human Genetics, University of Oxford, Oxford, UK

    • Hugh Watkins

18. National Heart Centre Singapore, Singapore, Singapore

    • Stuart A. Cook

19. Duke-National University of Singapore, Singapore, Singapore

    • Stuart A. Cook

Contributions

RW and JW conceived and designed the study. RW analysed the data and wrote the manuscript. FM developed and applied the variant clustering algorithm. RB, WM, AW, LF, RG, EM and MA generated the data for the prospective HCM cohort. NW, NL, NI, MA, XZ and AdM performed the analysis of the data. SD, EA, SDC, MM, AP, DJ, IO and CH provided the data from the SHaRe registry and critically revised the manuscript. HW and KT provided the data from OMGL and critically revised the manuscript. JW, NW, FM, PB and SAC contributed to the study design and data interpretation and critically revised the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Roddy Walsh or James S. Ware.

Ethics approval and consent to participate

This study was based on previously published clinical genetics sequencing data from the OMGL and LMM laboratories. For the prospective HCM cohort from the Royal Brompton Hospital London, all patients provided written informed consent and the study was approved by the regional ethics committee. The research in this study conformed to the Declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Reprints and Permissions