New Results

Genomic prediction of celiac disease targeting HLA-positive individuals

Gad Abraham, Alexia Rohmer, Jason A. Tye-Din, Michael Inouye
doi: https://doi.org/10.1101/017608

Abstract

Background Genomic prediction aims to leverage genome-wide genetic data towards better disease diagnostics and risk scores. We have previously published a genomic risk score (GRS) for celiac disease (CD), a common and highly heritable autoimmune disease, which differentiates between CD cases and population-based controls at a clinically-relevant predictive level, improving upon other gene-based approaches. HLA risk haplotypes, particularly HLA-DQ2.5, are necessary but not sufficient for CD, with at least one HLA risk haplotype present in up to half of most Caucasian populations. Here, we assess a genomic prediction strategy that specifically targets this common genetic susceptibility subtype, utilizing a supervised learning procedure for CD that leverages known HLA-DQ2.5 risk.

Methods Using L1/L2-regularized support-vector machines trained on large European case-control datasets, we constructed novel CD GRSs specific to individuals with HLA-DQ2.5 risk haplotypes (GRS-DQ2.5) and compared them with the predictive power of the existing CD GRS (GRS14) as well as two haplotype-based approaches, externally validating the results in a North American case-control study.

Results Consistent with previous observations, both the existing GRS14 and the GRS-DQ2.5 had better predictive performance than the HLA haplotype approaches. GRS-DQ2.5 models, based on directly genotyped or imputed markers, achieved similar levels of predictive performance (AUC = 0.718—0.73), which were substantially higher than those obtained from the DQ2.5 zygosity alone (AUC = 0.558), the HLA risk haplotype method (AUC = 0.634), or the generic GRS14 (AUC = 0.679). In a screening model of at-risk individuals, the GRS-DQ2.5 lowered the number of unnecessary follow-up tests for CD across most sensitivity levels. Relative to a baseline implicating all DQ2.5-positive individuals for follow-up, the GRS-DQ2.5 resulted in a net saving of 2.2 unnecessary follow-up tests for each justified test while still capturing 90% of DQ2.5-positive CD cases.

Conclusions Genomic risk scores for CD that target genetically at-risk sub-groups improve predictive performance beyond traditional approaches and may represent a useful strategy for prioritizing individuals at increase risk of disease, thus potentially reducing unnecessary follow-up diagnostic tests.

Background

Genome-wide association studies (GWAS) have identified large numbers of genetic loci associated with complex human disease, particularly for many autoimmune diseases, where disease susceptibility is typically strongly linked to the Human Leukocyte Antigen (HLA) region as well as loci outside HLA [1-6]. The strong disease association of specific single nucleotide polymorphisms (SNP) have enabled genomic-based prediction models to be developed with substantial predictive power [7-12]. As new light continues to be shed on the fundamental role of these genetic links in disease pathogenesis, it is becoming increasingly likely that genomic-based tools to predict disease development and risk, as well as prognosis and clinical course, may be harnessed and applied with direct relevance to patient care.

Despite these advances, suitable clinical tools that quantify genomic risk for complex disease remain largely unrealized. This is largely due to a lack of understanding regarding how such tools might be utilized in clinical settings, hampered by the complexity of integrating such data into a risk model that often incorporates many other variables, such as clinical information and laboratory investigations. The role of genomic risk prediction in existing risk models and diagnostic pathways is still being determined, including whether genomic prediction is optimal as a complement or a replacement for existing assays. For autoimmune diseases in particular, genomic prediction needs to demonstrate improved risk stratification beyond known HLA risk haplotypes and have sufficient predictive power, particularly given the low disease prevalence in the general population (typically 1% or less). Here, we have sought to identify specific scenarios where there is a major clinical need to improve risk prediction in a highly heritable autoimmune disease, celiac disease (CD). We first show that genomic risk prediction methods have clear advantages over existing approaches for CD risk prediction, and next assess the clinical implications of genomic risk prediction for disease management.

Celiac disease (CD) is a common systemic autoimmune disease caused by dietary gluten in genetically susceptible individuals [13, 14]. CD affects ∼1% of the Western world and is strongly heritable (∼80% on the liability scale) [15]. The major genetic association is in the MHC locus, with specific HLA haplotypes present in almost all (∼99.6%) cases: HLA-DQ2.5 (DQA1*05 / DQB1*02) in ∼88%, HLA-DQ2.2 (DQA1*02 / DQB1*02) in ∼4%, and/or HLA-DQ8 (DQA1*03 /DQB1*03:02) in ∼6% [16]. This HLA association underpins the crucial pathogenic role of CD4+ T cells targeting a restricted repertoire of immunogenic gluten peptides [17]. Recent GWAS in CD implicate at least 41 other non-HLA loci with more modest contributions to risk [3, 4, 6, 18-21]. These regions are all linked to aspects of immune system function, and are likely to impact on CD susceptibility or clinical behavior.

Current diagnosis of CD relies on the presence of CD-specific autoantibodies and a confirmatory small-bowel biopsy to demonstrate the characteristic intestinal villous atrophy [13]. Importantly, while both methods are useful for detecting current CD, they do not provide predictive information on the future risk of developing CD in a person without active disease. Early detection of CD is a clinical priority in order to reduce long-term risk of disease complications, especially for individuals at higher-risk of CD, such as those who are a 1st-degree family members of an affected individual or those who have a related autoimmune disease. However, the follow-up care of people without active CD, particularly the question of whether and how often to perform follow-up testing, remains unresolved. This challenge stems from the desire for early disease detection conflicting with the need for minimizing repeated testing that is inconvenient, costly, anxiety-inducing, and entirely unnecessary for those individuals who will never develop disease.

Since the development of CD depends so strongly on several HLA risk haplotypes, HLA typing is able to achieve close to 100% sensitivity in detecting at-risk individuals while also excluding those at very low risk. As a result, HLA typing for CD has been widely embraced in clinical practice [22]. Indeed, recent consensus guidelines recommend HLA typing as a 1st line investigation in asymptomatic children at-risk of CD (for instance, if they have a family history of CD) [13]. Further, combining HLA typing with CD-serology may also provide a more cost-effective diagnostic approach in some situations such as population screening by identifying false-positive serology in non-genetically susceptible individuals, thus reducing the number of unnecessary and expensive confirmatory small bowel biopsies [23].

The presence of at least one of the CD-related HLA haplotypes, while necessary for the development of disease, carries little predictive value for eventual CD development and therefore has no role as a sole diagnostic for CD. The CD-related genotypes are highly prevalent in the community, with 30—40% of Europeans and up to 56% Australians carrying at least one [23]. Despite the fact that different HLA haplotypes impart varying levels of risk for CD, specifically HLA-DQ2.5 > DQ8 > DQ2.2, these differences in relative risk have not translated meaningfully into clinical practice. Thus HLA typing results are typically interpreted as simply “susceptibility present” or “susceptibility absent” regardless of the particular HLA haplotype detected, and therefore used primarily to exclude CD but not to detect high-risk individuals nor to predict future risk of disease [13].

Notwithstanding the limited clinical role of HLA typing, there has been renewed interest in the role of specific HLA alleles in the development on CD, with the risk of CD being far higher in children who are HLA-DQ2.5 homozygous (or have two copies of DQB1*02) than among those who are HLA-DQ2.5 heterozygous or are positive for HLA-DQ8 [24, 25]. A gene-dose effect has been reported, with HLA-DQ2.5 homozygosity associated in some studies with a more severe clinical presentation of CD, refractory disease, and a slower rate of intestinal healing on treatment [26, 27]. As a result, HLA-DQ2.5 zygosity status is a major variable in a recently proposed CD prognostic modeling tool [28]. Collectively, these studies highlight the important role of the HLA risk haplotypes, especially HLA-DQ2.5, in CD development, prognosis, and clinical behavior, but also highlight the current limitations in the clinical utility of HLA typing. There is a major need to develop tools that are more informative than HLA typing particular for those who have already been shown to possess at least one HLA-DQ2.5 allele (DQ2.5+).

We have recently performed a proof-of-principle study demonstrating that genomic data, derived from multiple case/control GWAS datasets, can be used to improve upon current genetic testing based on HLA typing [7]. A CD genomic risk score (GRS) based on genome-wide single nucleotide polymorphisms (SNPs), denoted here the “GRS14” [8], was induced by supervised learning models trained on a British case-control GWAS study [29, 30]. We have established the robustness of GRS14 to discriminate CD patients from population-based controls in UK, Dutch, Finnish, and Italian studies [3, 4, 31], achieving predictive performance (Area Under the receiver-operating characteristic Curve (AUC)) substantially higher than other methods which attribute risk based on 57 non-HLA SNPs together with HLA haplotypes [32].

Here, we first externally validate the predictive power of the existing GRS14 and novel variants thereof in a North American CD case-control study [21, 33], comparing their performance to a previous HLA haplotype risk approach. Next, we focus on the DQ2.5+ subset of individuals, and develop HLA-DQ2.5 specific genomic risk scores, one based on SNPs and others based on SNPs together with SNP2HLA imputed markers [34]. Finally, we assess the HLA-DQ2.5 specific genomic risk scores in screening scenarios to determine the number of unnecessary follow-up tests saved relative to other approaches.

Methods

Genotype and phenotype data

We obtained the North American dataset (cases and controls) from NCBI dbGaP (accession phs000274.v1.p1). Samples were genotyped on the Illumina 660W Quad v1A platform, assaying 2246 individuals in total (1716 cases, 530 controls, 723 male, 1523 female). Individuals were considered to have confirmed CD based on either (i) characteristic findings on small bowel biopsy according to ESPGHAN criteria, (ii) biopsy-proven dermatitis herpetiformis, or (iii) positive celiac serology panel (transglutaminase (tTG) and endomysial (EMA) antibodies). Controls were originally from the Illumina iControl database, matched by the original study authors for age, sex, and ethnicity [33]. To minimize the possibility of artificially inflating the apparent predictive ability of the models [35], we performed several stages of quality control on the genotype data using plink 1.9 (https://www.cog-genomics.org/plink2) [36]: removing non-autosomal SNPs, filtering SNPs by MAF <1%, missingness >10%, deviation from Hardy-Weinberg equilibrium in controls P <5×10-6, and filtering of individuals with missingness >10%. Next we removed 2473 SNPs with case/control SNP differential missingness P <10-3. We iteratively used principal component analysis (PCA), implemented in flashpca 1.2 [37], to identify outlier individuals, defined here as individuals with PC coordinates more than 3 standard deviations from the median of each of PC 1—50. After removing those individuals, PCA was repeated to verify the results. We used two iterations of this procedure, resulting in 1697 individuals remaining. Finally, we removed one of two individuals with identity-by-descent π > 0.05 (one individual was removed). The final QCd dataset consisted of 1696 individuals (1259 cases, 437 controls, 546 males and 1150 females) over 518,770 autosomal SNPs. The available clinical characteristics of the post-QC data are shown in Table 1.

View this table:
Table 1:

The North American NIDDK-CIDR dataset clinical characteristics (post QC).

The genotype data for the UK (n=6785), Finnish (n=2476), Dutch (n=1649), and Italian (n=1040) cohorts have been previously described [3, 4, 8, 31]; these datasets were genotyped on the Illumina 670-QuadCustom-v1, 610-Quad, and 1.2M-DuoCustom-v1 genome-wide SNP arrays. Each cohort underwent separate QC: removing SNPs with MAF <1%, Hardy-Weinberg deviation from equilibrium in controls P < 5×10-6, missingness >10%, or differential case/control missingness P < 10-3, and removing samples with missingness >10% or IBD Embedded Image, before being combined into a single dataset consisting of n=11,912 samples and 500,821 SNPs. The Immunochip dataset (n=16,002) was assayed on a custom Illumina fine-mapping array (Immunochip) comprising 115,746 SNPs after QC, as described [3, 8] (with SNPs further filtered by MAF >0.5%), of which 17,848 were common to both the Immunochip and GWA arrays. Since some individuals were genotyped both in the UK GWA dataset and in the Immunochip dataset, when combining the GWA and Immunochip datasets we included only individuals with pairwise identity-by-descent (PLINK IBD) Embedded Image, resulting in n=19,715 individuals in total.

In order to check whether the putative European descent of the North American individuals was indeed the case, we also combined an LD-thinned (plink –indep-pairwise) version of the North American data with an LD-thinned version of the UK, Finnish, Dutch, and Italian GWA data and performed PCA on the combined data (Additional File 1, Supplementary Figure 1). Finally, we computed the fixation index Fst [38] (plink --fst) on a combined dataset (European + North American) consisting of the 224 of the 228 SNPs in the GRS14, with the European and North American samples as two clusters.

Figure 1:
Figure 1: ROC curves for classifying all CD cases and controls using different predictors in the North American dataset.

Legend: GRS14: the published GRS (trained on the UK2 dataset); GRS-imputed: a GRS trained on all European GWA datasets (UK, Dutch, Finnish, Italian), consisting of SNPs and SNP2HLA imputed markers; HLA haplotype risk: a 3-level risk score based on the HLA haplotype status.

Ethics statement

All participants gave informed consent and the study protocols were approved by the relevant institutional or national ethics committees. Details for the ethics protocols for the European GWA and Immunochip datasets are given in [3, 4]. The North American NIDDK-CIDR dataset was obtained from the NCBI Database of Genotypes and Phenotypes (dbGaP), accession phs000274.v1.p1, following their respective access protocols.

Imputation of HLA haplotypes and other markers

We employed two complementary methods for HLA imputation based on the genotypes. First, we imputed 2 and 4-digit HLA-DQA1 and HLA-DQB1 haplotypes from the SNPs using the R package HIBAG 1.2.3 [39], using the European hg18 HLA4 reference dataset. Based on the imputed haplotype alleles, we inferred each individual’s heterodimer type as one of DQ2.5 heterozygous, DQ2.5 homozygous, DQ2.2, or DQ8, according to the mapping in ref [8]. Following [32], the HLA risk score was assigned as low for individuals that did not have any of the CD risk heterodimers (DQ2.2, DQ8, DQ2.5-heterozygous, and DQ-2.5-homozygous). High risk was assigned to individuals with DQ2.5-homozygous or those with both DQ2.5-heterozygous and DQ2.2. Medium risk was assigned to all other remaining individuals. The HLA risk profiles were coded as 0 for low, 1 for medium, and 2 for high risk. We did not examine the 57 non-HLA SNPs used in [32] as these are only present on Immunochip arrays and not on the genome-wide arrays, and were not well tagged by the existing SNPs on the genome-wide arrays.

In addition to using HIBAG, we also employed SNP2HLA v1.0.2 [34] to impute 8961 HLA SNPs, 4-digit HLA haplotypes of the genes HLA-A, HLA-B, HLA-C, HLA-DPA1, HLA-DPB1, HLA-DQA1, HLA-DQB1, and HLA-DRB1, and amino acid substitutions within these genes, based on the T1DGC reference panel, in the European GWA, Immunochip, and North American dataset. The non-SNP imputed markers were coded as present/absent. Quality control for the combined SNP + imputed marker data included (i) removal of imputed SNPs that were already assayed on the array; within each dataset (UK2, NL, Finn, IT), removal of SNPs/markers with MAF <1%, missingness >10%, deviation from Hardy-Weinberg equilibrium (HWE) in controls P <5×10-6, differential case/control missingness P <10-3, and removal of individuals with >10% missingness; removal of SNPs/markers that were not present in the four European datasets (UK2, NL, Finn, IT); (iv) removal of SNPs/markers with differential case/control missingness P <10-3 across the combined data; (v) removal of SNPs/markers not on the North American imputed dataset. For the Immunochip data, QC included (i) removal of imputed SNPs already assayed; (ii) SNP/marker filtering by MAF <0.5%, missingness >10%, deviation from HWE in controls P <10-3, and differential case/control missingness P <10-3, and removal of individuals with missingness >10%. We verified that the imputed markers included in genomic risk scores had high imputation accuracy (r2 >0.8) in the training data. The final SNPs + imputed marker European data consisted of 507,321 markers (500,821 assayed SNPs and 6500 imputed markers) over 11,912 individuals (5552 of which were DQ2.5+); after removal of individual assayed in the UK GWA data, the Immunochip dataset had 7803 individuals, of which 4732 were DQ2.5+, with 24,555 SNPs/markers (∼17,800 assayed SNPs and ∼6700 imputed markers) common with the other datasets. For the DQ2.5-specific GRS (GRS-DQ2.5), only SNPs present in the North American dataset were used in cross-validation, so that all SNPs present in the model could be used to determine the score in external validation. SNP2HLA had ∼100% concordance with HIBAG’s DQ2.5+ classification.

Validation of the published risk score

We used the previously published GRS14 risk score (comprising 228 SNPs, available at http://dx.doi.org/10.6084/m9.figshare.154193), which is given in terms of rs IDs, reference alleles, and a weight, to produce a per-individual score (using plink --score). The final score for each individual is the sum of the minor allele dosages of each SNP, weighted by the published weights. Four SNPs in this score were not found in the North American post-QC genotype data and were excluded; these four SNPs had relatively low weight (ranked 59th or lower, out of 228) and thus their absence is unlikely to have substantially affected the predictive power of the final model.

Cross-validation and novel genomic risk scores

We used the tool SparSNP [29], which fits L1/L2-penalized support-vector machine (SVM) models to SNP data, in 10×10-fold cross-validation on the European GWA dataset. Briefly, these models are additive in the minor allele dosage {0, 1, 2}, and take into account all SNPs (or other markers) in the data, however, only a proportion of the SNPs/markers receive a non-zero weight, tuned by the L1 penalty (higher penalties lead to fewer SNPs/markers with non-zero weight), together with an L2 (ridge) penalty varying from 10-6 to 103. The optimal penalties were determined via cross-validated AUC. We have previously shown that such penalized models produce superior predictive ability for CD compared with several widely-used alternatives [12]. We evaluated a range of L1/L2- penalized models over a grid of penalties, with the optimal model selected by the best average AUC. For cross-validation, the reported AUC is a LOESS-smoothed average over the 10×10 = 100 test sets. For independent validation, we derived a final consensus model consisting of the SNPs selected in >60% of the replications, with corresponding weights being the average weights over the replications. The consensus model was taken and tested without further modification on the North American dataset. Improvement in case/control discrimination (AUC) was tested using Harrell’s two-sided test for paired concordance (rcorrp.cens in R package Hmisc) [40], and 95% confidence intervals for the AUC were computed using DeLong’s method (R package pROC) [41].

The ratio of non-CDs incorrectly implicated per CD correctly implicated

We calculated the ratio r of non-CD individuals incorrectly implicated per CD case correctly implicated as r = (1 - PPV)/PPV, where PPV is the positive predictive value, calculated as Embedded Image where sens, spec, and prev are the sensitivity, specificity, and prevalence (as a proportion of the population under consideration), respectively, computed for each possible risk cutoff (forming the ROC curve). This ratio is also the reciprocal of the post-test odds of disease, that is, 1 / (likelihood-ratio × pre-test-odds).

To evaluate the difference in the ratios between two risk scores, we used a stratified bootstrap procedure in the test data, whereby B=10,000 replications were drawn (sampled with replacement), the rank statistics were estimated within each replicate for each risk score separately, and the average over the differences in the ratios was reported as the final bootstrap estimate, with 95% approximate confidence intervals for the difference derived using the 0.025 and 0.975 quantiles of the bootstrapped differences.

Results

Independent validation of genomic risk scores for CD

We applied the previously published GRS14 to the North American dataset and evaluated its predictive power using receiver-operating characteristic (ROC) curves (Figure 1). The GRS14 model achieved AUC = 0.831 (95% CI 0.808—0.854), indicating that the majority of the predictive power of the GRS14 model, previously estimated at AUC = 0.86—0.9 [8] on the Italian, Dutch, and Finnish datasets, was maintained in the North American dataset. For comparison, we also trained MultiBLUP [11] on the same European data and tested it on the North American dataset with identical results (AUC = 0.831, 95% CI 0.808—0.85; Additional File 1, Supplementary Figure 2), and in addition employed the same L1/L2-regularized SVMs in cross-validation within the North American data, yielding similar results (maximum average cross-validated AUC = 0.823, Additional File 1, Supplementary Figure 3). Further, there were no substantial differences in the genomic scores between CD cases diagnoses with different diagnosis methods (Additional File 1, Supplementary Results and Supplementary Figure 4).

In comparison to the GRS14, the 3-level haplotype risk method had substantially lower predictive power, with AUC = 0.773 (95% CI 0.751—0.795). The GRS model trained on the European GWA SNPs together with SNP2HLA imputed markers (“GRS-imputed”), improved the AUC over GRS14 by +0.007 (AUC = 0.838, CI 0.816—0.860, P <10-6 value for paired concordance test against the GRS14) (Figure 1). However, training a similar GRS-imputed model on the combined Immunochip + GWA dataset resulted in reduced performance relative to the GWA-only model (AUC = 0.835, 0.813—0.858, P <10-6 against the GRS-imputed model trained on the GWA data only), despite the larger sample size (Additional File 1, Supplementary Figure 2).

Celiac disease risk prediction within the HLA-DQ2.5+ subgroup

While risk scores that discriminate CD cases from controls in the general population are useful, a more pressing clinical question is whether discrimination is possible within the HLA-DQ2.5+ subgroup of individuals, who are at the highest risk for CD amongst all HLA+ individuals. It is estimated that ∼90% of HLA+ individuals are DQ2.5+, with those that are DQ2.5-homozygous being at greater risk for CD than those that are DQ2.5-heterozygous [25, 42-44].

Restricting our analysis to DQ2.5+ individuals, we trained two new GRS’s, one using a sparse linear model of SNPs only (GRS-DQ2.5), and another built similarly to GRS-DQ2.5 but also utilizing markers imputed by SNP2HLA (GRS-DQ2.5-imputed). These new GRS’s were then compared to three other predictive models:

  1. the imputed DQ2.5 zygosity status for each individual (DQ2.5-zygosity),

  2. the 3-level HLA haplotype risk score (HLA-haplotype-risk),

  3. and the published GRS14.

The GRS-DQ2.5 and GRS-DQ2.5-imputed models were evaluated using the average AUC over 10×10-fold cross-validation on the DQ2.5+ European GWA samples. For GRS-DQ2.5, the maximum AUC achieved was 0.727 at 2513 SNPs with non-zero weight together with an L2 penalty of 1. For the GRS-DQ2.5-imputed, the best AUC was 0.74 at 3317 non-zero weight SNPs/markers using an L2 penalty of 1 as well (Figure 2) (for the results of GRS-DQ2.5 using other L2 penalties see Additional File 1, Supplementary Figure 5).

Figure 2:
Figure 2: Cross-validation results for the GRS-DQ2.5 and GRS-DQ2.5-imputed models in the European GWA data.

Legend: 10×10 cross-validated AUC (LOESS-smoothed) for the novel GRS-DQ2.5 model trained on the DQ2.5+ subset of the European GWA data (n=5552), as a function of the number of SNPs assigned a non-zero weight in the model. Maximum AUC was 0.727 achieved at 2513 SNPs with non-zero weight when considering only SNPs (GRS-DQ2.5) and AUC of 0.74 at 3317 SNPs/markers when using SNPs and SNP2HLA-imputed markers (GRS-DQ2.5-imputed).

To externally validate these models, we utilized the North American DQ2.5+ individuals (n=1237, 1094 cases and 143 controls) (Figure 3a). The highest performance was observed for GRS-DQ2.5- imputed, achieving an AUC of 0.73 (95% CI 0.687—0.772), followed by GRS-DQ2.5 with AUC = 0.718 (95% CI 0.676—0.761) and the GRS14 with AUC = 0.669 (95% CI 0.625—0.713). The HLA-haplotype-risk and DQ2.5-zygosity models achieved AUCs of 0.634 (95% CI 0.597—0.671) and 0.558 (95% CI 0.534—0.582), respectively. Training similar models on a combined Immunochip and GWA dataset resulted in lower externally validated AUC of 0.707 (Additional File 1, Supplementary Results).

In a clinical setting, it is desirable to maintain high sensitivity, that is, capturing most CD cases while incurring a cost of some false positives (reduced specificity). In considering the corresponding region of the ROC curve with sensitivity > 0.9, while both the haplotype risk model and the GRS14 model had overall slightly higher specificity than the zygosity status, the greatest increase in specificity was observed for the GRS-DQ2.5 and GRS-DQ2.5-imputed models (specificity of 0.29 and 0.32, respectively, compared with specificity = 0.15 for the GRS14).

Utility of genomic risk scores in reducing unnecessary follow-up tests in the HLA-DQ2.5+ subgroup

In a clinical setting, a reduction in the number of unnecessary tests to screen for a disease or secure a diagnosis is desirable. The utility of a GRS for reducing unnecessary tests can be measured using the ratio of non-CD incorrectly implicated as CD to those CD cases correctly implicated (given that neither the proposed GRS nor HLA typing can act as a sole diagnostic for CD, we use the term “implicate” as distinct from “diagnosed”). This ratio should further be assessed relative to the sensitivity, as one should seek to minimize the former while maximizing the latter. A lower ratio (ideally <1) at high sensitivity indicates a better ability to avoid falsely implicating non-CD individuals as being at high CD risk, while capturing a substantial number of CD cases. Unlike the sensitivity and specificity, this ratio depends on the true prevalence of CD in the population being tested (here, all DQ2.5+ individuals). People at high-risk of CD, for instance, due to a family history of the illness, have a 10% prevalence of disease [45]. Therefore for this modeling we likewise assumed a prevalence of 10%, leading to a baseline ratio of 9:1 (equivalent to all DQ2.5- positive individuals being recommended for follow-up testing).

Overall, both the GRS-DQ2.5 and GRS-DQ2.5-imputed models implicated fewer non-CD individuals per CD case correctly implicated than the GRS14, the DQ2.5-zygosity, or the HLA-haplotype-risk score (Figure 3b). Note that since DQ2.5-zygosity within the DQ2.5+ individuals is limited to heterozygous (one risk allele) and homozygous (two risk alleles), the main point of interest for the curve is the one indicating heterozygotes, leading to ∼3.5:1 incorrect implications but achieving only 20% sensitivity. By comparison, both GRS-DQ2.5 and GRS-DQ2.5-imputed models achieved a ∼2:1 ratio at the same sensitivity as DQ2.5-zygosity. Similarly, the main point of interest for HLA-haplotype-risk separates high from medium risk, with a sensitivity of 50% and ∼4:1 incorrect implications, a level improved upon by GRS14, GRS-DQ2.5 and GRS-DQ2.5- imputed.

Figure 3:
Figure 3: External validation results on the DQ2.5+ individuals in the North American dataset.

Legend: (a) ROC curves for case/control prediction and (b) Non-CD implicated per CD correctly implicated, ((1 – PPV) / PPV, equivalent to 1 / [post-test-odds of disease]) versus sensitivity, for models developed on the European data and tested on the DQ2.5+ subset of the North American cohort. The DQ2.5 zygosity is the number of DQ2.5 alleles for each individual (heterozygous=1, homozygous=2). We assumed a CD prevalence of 10% in the DQ2.5+, corresponding to a baseline implication ratio of 9:1, that is, all DQ2.5+ implicated as having CD at 100% sensitivity.

At the more clinically-relevant sensitivity level of 90%, the incorrect implications ratio was lowest for GRS-DQ2.5-imputed (6.7:1), followed by GRS-DQ2.5 (6.9:1) and GRS14 (8.5:1). To evaluate the stability of these results we performed stratified bootstrap analysis of the North American samples (B=10,000 replications). The greatest improvements in the average bootstrap reduction in incorrect implications ratio was from GRS-DQ2.5-imputed at a reduction of 2.17 (95% CI 1.35— 3.02) over the 9:1 baseline, followed by GRS-DQ2.5 and GRS14, at 1.96 (1.16—2.78) and 1.61 (0.55—2.64) respectively.

Discussion

More widespread use of genomic risk prediction in autoimmune disease has been hampered by the inability to identify compelling advantages over existing approaches, mainly HLA haplotyping. Here, we have focused our analysis on individuals carrying the HLA-DQ2.5 heterodimer, which is the most common risk heterodimer and also imparts the highest risk for CD. Existing diagnostic tests are not useful in the absence of active disease and cannot predict risk of future disease. While approaches based on HLA haplotypes, including DQ2.5 zygosity and a HLA haplotype risk score [32], provide some predictive power, we have demonstrated that genomic risk scores focused on DQ2.5+ individuals have substantially higher predictive power than either approach, extending our previous findings [8].

Our genomic risk scores were based on direct modeling of SNPs, both within and outside of HLA. Further, combining the genome-wide SNP data with imputed HLA markers, including 4-digit HLA haplotypes outside the well-known HLA-DQA1 and HLA-DQB1 genes, imputed HLA SNPs, and HLA amino acid substitutions [34], led to an increase in predictive power on the North American dataset, thus suggesting that tools for imputing non-traditional risk factors have an important role in future predictive modeling.

The increased precision of both GRS-DQ2.5 and GRS-DQ2.5-imputed translated to an average increased saving of ∼2 unnecessary follow-ups per justified follow-up (a 22—24% average reduction), compared with the alternative strategy of considering all DQ2.5+ individuals for follow-up testing. Importantly, at this level, GRS-DQ2.5 and GRS-DQ2.5-imputed still captured 90% of DQ2.5+ CD cases. These results suggest that a GRS specific to HLA-DQ2.5+ individuals can achieve substantial cost savings while incurring only a small loss in sensitivity, relative to implicating all DQ2.5+ individuals for more intensive screening and follow-up. In real-life clinical practice, the slight loss of sensitivity in screening would likely not be of significance, as all patients would be advised to seek medical follow-up if they ever became unwell with symptoms suggestive of CD. Further, the top 15—20% of CD cases in terms of GRS-DQ2.5 were estimated to be detectable at a level of 1 unnecessary follow-up per true CD case, suggesting that relatively high confidence of CD can be conferred upon individuals with the highest GRS-DQ2.5/GRS-DQ2.5- imputed scores.

The ultimate clinical role, utility, and cost-effectiveness of genomic risk scores for CD remain to be determined in prospective clinical studies where genomic profiles are undertaken from the outset. However, several potential roles can be proposed. First, guiding ongoing care in people at-risk of CD who are also HLA-DQ2.5+ is one potential use. Some experts recommend increased surveillance of children at-risk of CD who are HLA-DQ2.5 homozygous over those with other HLA types, but the increased predictive power of our GRS may make it much better suited to this task. Second, genomic data may also be able to inform CD prognosis, such as the likelihood of complicated (refractory) disease or the natural history of latent CD (positive CD-serology and HLA susceptibility but a normal small bowel), or other aspects of care such as response to the gluten-free diet. Finally, another approach may be to combine a GRS with serology to optimize risk stratification for CD and determine who will benefit most from definitive small bowel biopsy. Such a strategy could leverage the strengths of each test: the high sensitivity for active CD using CD serology and the fine-grained CD risk quantification of the GRS, including its ability to provide predictive information and exclude CD. A major benefit of genetic testing in the diagnostic work-up of CD is that, unlike serology and small bowel histology, accurate results are not dependent on active gluten intake. This is particularly relevant as the gluten free diet has been adopted by 10% or more of the population in many Western countries, rendering traditional tests inaccurate. Establishing the clinical utility of genomic testing in CD will also support the feasibility of a genomics-based platform for a range of other autoimmune diseases, where both HLA and non-HLA genetic contributions are important as well, and which commonly overlap with CD [14].

Conclusions

Our findings highlight the value of genomic risk scores that target a clinically relevant subgroup of individuals at-risk for CD. Genomic risk scores that utilize both genome-wide SNPs, 4-digit HLA haplotypes and amino acid substitutions provided the highest predictive power in individuals who are DQ2.5+, surpassing that of approaches based on small numbers of well-known risk haplotypes or models of SNPs only. This improved predictive power directly translates to an ability to better stratify DQ2.5+ individuals by CD risk, meaning that for each justified test, two follow-up tests in people unlikely to develop CD could be avoided, which improves both patient care and health care delivery. Future clinical studies will enable optimization of such risk scores to particular clinical settings and assess how to best integrate genomic risk prediction with the current clinical diagnostic pathways for CD. Our results in CD suggest that employing such genomic-based approaches in other autoimmune disease is both feasible and potentially of clinical utility.

Competing interests

GA, AR, and MI declare that they have no competing interests. JT-D is a co-inventor of patents pertaining to the use gluten peptides in therapeutics, diagnostics, and non-toxic gluten. He is a shareholder of Nexpep Pty Ltd and a consultant to ImmusanT, Inc.

Author contributions

Designed the study: GA, JT-D, MI. Performed experiments and analyzed data: GA, AR. All authors contributed to and approved the final manuscript.

Additional files

Additional file 1: Supplementary results and figures.

Additional file 2: The GRS-DQ2.5 score, in terms of SNP ID, reference allele, and weight.

Additional file 3: The GRS-DQ2.5-imputed score, in terms of SNP/marker ID, reference allele, and weight.

Acknowledgments

The North American Celiac Disease Consortium study was conducted by the North American Celiac Disease Consortium Investigators and supported by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK). The data from the North American Celiac Disease Consortium reported here were supplied by the NIDDK Central Repositories. This manuscript was not prepared in collaboration with Investigators of the North American Celiac Disease Consortium study and does not necessarily reflect the opinions or views of the North American Celiac Disease Consortium study, the NIDDK Central Repositories, or the NIDDK.

We thank the chief investigators of the van Heel et al., 2007, Dubois et al., 2010 and Trynka et al., 2011 papers (David van Heel, Cisca Wijmenga, and Lude Franke) for providing the celiac disease data.

The authors acknowledge support and funding from NHMRC grant no. 1062227. MI was supported by a Career Development Fellowship co-funded by the NHMRC and Heart Foundation (no. 1061435).

Footnotes

  • ↵# Joint senior authors

References

  1. 1.↵
    Graham, R.R., C. Cotsapas, L. Davies, R. Hackett, C.J. Lessard, J.M. Leon, N.P. Burtt, C. Guiducci, et al., Genetic variants near TNFAIP3 on 6q23 are associated with systemic lupus erythematosus. Nat Genet, 2008. 40(9): p. 1059–61.
    OpenUrlCrossRefPubMedWeb of Science
  2. 2.
    Ramos, P.S., L.A. Criswell, K.L. Moser, M.E. Comeau, A.H. Williams, N.M. Pajewski, S.A. Chung, R.R. Graham, et al., A comprehensive analysis of shared loci between systemic lupus erythematosus (SLE) and sixteen autoimmune diseases reveals limited genetic overlap. PLoS Genetics, 2011. 7(12): p. e1002406.
    OpenUrl
  3. 3.↵
    Trynka, G., K.a. Hunt, N.a. Bockett, J. Romanos, V. Mistry, A. Szperl, S.F. Bakker, M.T. Bardella, et al., Dense genotyping identifies and localizes multiple common and rare variant association signals in celiac disease. Nature Genetics, 2011. 43: p. 1193–201.
    OpenUrlCrossRefPubMed
  4. 4.↵
    Dubois, P.C.A., G. Trynka, L. Franke, K.a. Hunt, J. Romanos, A. Curtotti, A. Zhernakova, G.a.R. Heap, et al., Multiple common variants for celiac disease influencing immune gene expression. Nature Genetics, 2010. 42: p. 295–302.
    OpenUrlCrossRefPubMedWeb of Science
  5. 5.
    Barrett, J.C., D.G. Clayton, P. Concannon, B. Akolkar, J.D. Cooper, H.A. Erlich, C. Julier, G. Morahan, et al., Genome-wide association study and meta-analysis find that over 40 loci affect risk of type 1 diabetes. Nature Genetics, 2009. 41(6): p. 703–7.
    OpenUrlCrossRefPubMedWeb of Science
  6. 6.↵
    Zhernakova, A., E.A. Stahl, G. Trynka, S. Raychaudhuri, E.A. Festen, L. Franke, H.J. Westra, R.S. Fehrmann, et al., Meta-analysis of genome-wide association studies in celiac disease and rheumatoid arthritis identifies fourteen non-HLA shared loci. PLoS Genetics, 2011. 7(2): p. e1002004.
    OpenUrl
  7. 7.↵
    Wei, Z., K. Wang, H.Q. Qu, H. Zhang, J. Bradfield, C. Kim, E. Frackleton, C. Hou, et al., From disease association to risk assessment: an optimistic view from genome-wide association studies on type 1 diabetes. PLoS Genet, 2009. 5(10): p. e1000678.
    OpenUrlCrossRefPubMed
  8. 8.↵
    Abraham, G., J.A. Tye-Din, O.G. Bhalala, A. Kowalczyk, J. Zobel, and M. Inouye, Accurate and robust genomic prediction of celiac disease using statistical learning. PLoS Genet, 2014. 10(2): p. e1004137.
    OpenUrlCrossRefPubMed
  9. 9.
    Wei, Z., W. Wang, J. Bradfield, J. Li, C. Cardinale, E. Frackelton, C. Kim, F. Mentch, et al., Large sample size, wide variant spectrum, and advanced machine-learning technique boost risk prediction for inflammatory bowel disease. Am J Hum Genet, 2013. 92(6): p. 1008–12.
    OpenUrlCrossRefPubMed
  10. 10.
    Hoggart, C.J., J.C. Whittaker, M. De Iorio, and D.J. Balding, Simultaneous analysis of all SNPs in genome-wide and re-sequencing association studies. PLoS Genetics, 2008. 4(7): p. e1000130.
    OpenUrl
  11. 11.↵
    Speed, D. and D.J. Balding, MultiBLUP: improved SNP-based prediction for complex traits. Genome Res, 2014. 24(9): p. 1550–7.
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    Abraham, G., A. Kowalczyk, J. Zobel, and M. Inouye, Performance and robustness of penalized and unpenalized methods for genetic prediction of complex human disease. Genetic Epidemiology, 2013. 37(2): p. 184–195.
    OpenUrlCrossRefPubMed
  13. 13.↵
    Husby, S., S. Koletzko, I.R. Korponay-Szabo, M.L. Mearin, A. Phillips, R. Shamir, R. Troncone, K. Giersiepen, et al., European Society for Pediatric Gastroenterology, Hepatology, and Nutrition guidelines for the diagnosis of coeliac disease. J Pediatr Gastroenterol Nutr, 2012. 54(1): p. 136–60.
    OpenUrlCrossRefPubMed
  14. 14.↵
    Abadie, V., L.M. Sollid, L.B. Barreiro, and B. Jabri, Integration of genetic and immunological insights into a model of celiac disease pathogenesis. Annu Rev Immunol, 2011. 29: p. 493–525.
    OpenUrlCrossRefPubMedWeb of Science
  15. 15.↵
    van Heel, D.a. and J. West, Recent advances in coeliac disease. Gut, 2006. 55: p. 1037–46.
    OpenUrlFREE Full Text
  16. 16.↵
    Karell, K., A.S. Louka, S.J. Moodie, H. Ascher, F. Clot, L. Greco, P.J. Ciclitira, L.M. Sollid, et al., HLA types in celiac disease patients not carrying the DQA1*05-DQB1*02 (DQ2) heterodimer: results from the European Genetics Cluster on Celiac Disease. Hum Immunol, 2003. 64(4): p. 469–77.
    OpenUrlCrossRefPubMedWeb of Science
  17. 17.↵
    Tye-Din, J.A., J.A. Stewart, J.A. Dromey, T. Beissbarth, D.A. van Heel, A. Tatham, K. Henderson, S.I. Mannering, et al., Comprehensive, quantitative mapping of T cell epitopes in gluten in celiac disease. Sci Transl Med, 2010. 2(41): p. 41ra51.
    OpenUrlAbstract/FREE Full Text
  18. 18.↵
    Hunt, K.A., A. Zhernakova, G. Turner, G.A. Heap, L. Franke, M. Bruinenberg, J. Romanos, L.C. Dinesen, et al., Newly identified genetic risk variants for celiac disease related to the immune response. Nat Genet, 2008. 40(4): p. 395–402.
    OpenUrlCrossRefPubMedWeb of Science
  19. 19.
    Ahn, R., Y.C. Ding, J. Murray, A. Fasano, P.H. Green, S.L. Neuhausen, and C. Garner, Association analysis of the extended MHC region in celiac disease implicates multiple independent susceptibility loci. PLoS One, 2012. 7(5): p. e36926.
    OpenUrlCrossRefPubMed
  20. 20.
    Festen, E.A., P. Goyette, T. Green, G. Boucher, C. Beauchamp, G. Trynka, P.C. Dubois, C. Lagace, et al., A meta-analysis of genome-wide association scans identifies IL18RAP, PTPN2, TAGAP, and PUS10 as shared risk loci for Crohn’s disease and celiac disease. PLoS Genet, 2011. 7(1): p. e1001283.
    OpenUrlCrossRefPubMed
  21. 21.↵
    Garner, C., R. Ahn, Y.C. Ding, L. Steele, S. Stoven, P.H. Green, A. Fasano, J.A. Murray, et al., Genome-wide association study of celiac disease in North America confirms FRMD4B as new celiac locus. PLoS One, 2014. 9(7): p. e101428.
    OpenUrlCrossRefPubMed
  22. 22.↵
    Tye-Din, J.A., D.J. Cameron, A.J. Daveson, A.S. Day, P. Dellsperger, C. Hogan, E.D. Newnham, S.J. Shepherd, et al., Appropriate clinical use of human leukocyte antigen typing for coeliac disease: an Australasian perspective. Intern Med J, 2015. 45(4): p. 441–50.
    OpenUrlCrossRefPubMed
  23. 23.↵
    Anderson, R.P., M.J. Henry, R. Taylor, E.L. Duncan, P. Danoy, M.J. Costa, K. Addison, J.A. Tye-Din, et al., A Novel serogenetic approach determines the community prevalence of celiac disease and informs improved diagnostic pathways. BMC Med, 2013. 11(1): p. 188.
    OpenUrlCrossRefPubMed
  24. 24.↵
    Lionetti, E., S. Castellaneta, R. Francavilla, A. Pulvirenti, E. Tonutti, S. Amarri, M. Barbato, C. Barbera, et al., Introduction of gluten, HLA status, and the risk of celiac disease in children. N Engl J Med, 2014. 371(14): p. 1295–303.
    OpenUrlCrossRefPubMedWeb of Science
  25. 25.↵
    Liu, E., H.S. Lee, C.A. Aronsson, W.A. Hagopian, S. Koletzko, M.J. Rewers, G.S. Eisenbarth, P.J. Bingley, et al., Risk of pediatric celiac disease according to HLA haplotype and country. N Engl J Med, 2014. 371(1): p. 42–9.
    OpenUrlCrossRefPubMedWeb of Science
  26. 26.↵
    Karinen, H., P. Karkkainen, J. Pihlajamaki, E. Janatuinen, M. Heikkinen, R. Julkunen, V.M. Kosma, A. Naukkarinen, et al., Gene dose effect of the DQB1*0201 allele contributes to severity of coeliac disease. Scand J Gastroenterol, 2006. 41(2): p. 191–9.
    OpenUrlCrossRefPubMed
  27. 27.↵
    Al-Toma, A., M.S. Goerres, J.W. Meijer, A.S. Pena, J.B. Crusius, and C.J. Mulder, Human leukocyte antigen-DQ2 homozygosity and the development of refractory celiac disease and enteropathy-associated T-cell lymphoma. Clin Gastroenterol Hepatol, 2006. 4(3): p. 315–9.
    OpenUrlCrossRefPubMedWeb of Science
  28. 28.↵
    Biagi, F., A. Schiepatti, G. Malamut, A. Marchese, C. Cellier, S.F. Bakker, C.J. Mulder, U. Volta, et al., PROgnosticating COeliac patieNts SUrvivaL: the PROCONSUL score. PLoS One, 2014. 9(1): p. e84163.
    OpenUrlCrossRefPubMed
  29. 29.↵
    Abraham, G., A. Kowalczyk, J. Zobel, and M. Inouye, SparSNP: Fast and memory-efficient analysis of all SNPs for phenotype prediction. BMC Bioinformatics, 2012. 13: p. 88.
    OpenUrlPubMed
  30. 30.↵
    Okser, S., T. Pahikkala, A. Airola, T. Salakoski, S. Ripatti, and T. Aittokallio, Regularized Machine Learning in the Genetic Prediction of Complex Traits. PLoS Genet, 2014. 10(11): p. e1004754.
    OpenUrl
  31. 31.↵
    van Heel, D.A., L. Franke, K.A. Hunt, R. Gwilliam, A. Zhernakova, M. Inouye, M.C. Wapenaar, M.C.N.M. Barnardo, et al., A genome-wide association study for celiac disease identifies risk variants in the region harboring IL2 and IL21. Nature Genetics, 2007. 39: p. 827–9.
    OpenUrlCrossRefPubMedWeb of Science
  32. 32.↵
    Romanos, J., A. Rosen, V. Kumar, G. Trynka, L. Franke, A. Szperl, J. Gutierrez-Achury, C.C. van Diemen, et al., Improving coeliac disease risk prediction by testing non-HLA variants additional to HLA variants. Gut, 2014. 63(3): p. 415–22.
    OpenUrlAbstract/FREE Full Text
  33. 33.↵
    Garner, C.P., J.A. Murray, Y.C. Ding, Z. Tien, D.A. van Heel, and S.L. Neuhausen, Replication of celiac disease UK genome-wide association study results in a US population. Hum Mol Genet, 2009. 18(21): p. 4219–25.
    OpenUrlCrossRefPubMedWeb of Science
  34. 34.↵
    Jia, X., B. Han, S. Onengut-Gumuscu, W.M. Chen, P.J. Concannon, S.S. Rich, S. Raychaudhuri, and P.I. de Bakker, Imputing amino acid polymorphisms in human leukocyte antigens. PLoS One, 2013. 8(6): p. e64683.
    OpenUrlCrossRefPubMed
  35. 35.↵
    Wray, N.R., J. Yang, B.J. Hayes, A.L. Price, M.E. Goddard, and P.M. Visscher, Pitfalls of predicting complex traits from SNPs. Nat Rev Genet, 2013. 14(7): p. 507–15.
    OpenUrlCrossRefPubMed
  36. 36.↵
    Purcell, S., B. Neale, K. Todd-Brown, L. Thomas, M.A. Ferreira, D. Bender, J. Maller, P. Sklar, et al., PLINK: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet, 2007. 81(3): p. 559–75.
    OpenUrlCrossRefPubMed
  37. 37.↵
    Abraham, G. and M. Inouye, Fast principal component analysis of large-scale genome-wide data. PLoS One, 2014. 9(4): p. e93766.
    OpenUrlCrossRefPubMed
  38. 38.↵
    Weir, B.S. and C.C. Cockerham, Estimating F-Statistics for the Analysis of Population-Structure. Evolution, 1984. 38(6): p. 1358–1370.
    OpenUrlCrossRefPubMedWeb of Science
  39. 39.↵
    Zheng, X., J. Shen, C. Cox, J.C. Wakefield, M.G. Ehm, M.R. Nelson, and B.S. Weir, HIBAG--HLA genotype imputation with attribute bagging. Pharmacogenomics J, 2014. 14(2): p. 192–200.
    OpenUrlCrossRefPubMed
  40. 40.↵
    Harrell, F.E.J., Regression Modeling Strategies. Springer Series in Statistics2001: Springer.
  41. 41.↵
    Robin, X., N. Turck, A. Hainard, N. Tiberti, F. Lisacek, J.C. Sanchez, and M. Muller, pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 2011. 12: p. 77.
    OpenUrlCrossRefPubMed
  42. 42.↵
    Megiorni, F., B. Mora, M. Bonamico, M. Barbato, R. Nenna, G. Maiella, P. Lulli, and M.C. Mazzilli, HLA-DQ and risk gradient for celiac disease. Human immunology, 2009. 70: p. 55–9.
    OpenUrlCrossRefPubMed
  43. 43.
    Fasano, A., I. Berti, T. Gerarduzzi, T. Not, R.B. Colletti, S. Drago, Y. Elitsur, P.H. Green, et al., Prevalence of celiac disease in at-risk and not-at-risk groups in the United States: a large multicenter study. Arch Intern Med, 2003. 163(3): p. 286–92.
    OpenUrlCrossRefPubMedWeb of Science
  44. 44.↵
    Husby, S. and J.A. Murray, Diagnosing coeliac disease and the potential for serological markers. Nat Rev Gastroenterol Hepatol, 2014. 11(11): p. 655–663.
    OpenUrlCrossRefPubMed
  45. 45.↵
    Sollid, L.M. and B.A. Lie, Celiac disease genetics: current concepts and practical applications. Clin Gastroenterol Hepatol, 2005. 3(9): p. 843–51.
    OpenUrlCrossRefPubMedWeb of Science
Back to top
Posted April 06, 2015.
Download PDF

Supplementary Material

Email
Genomic prediction of celiac disease targeting HLA-positive individuals
Gad Abraham, Alexia Rohmer, Jason A. Tye-Din, Michael Inouye
bioRxiv 017608; doi: https://doi.org/10.1101/017608
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools

Subject Area