ABSTRACT
Genome wide association (GWA) analysis of brain imaging phenotypes can advance our understanding of the genetic basis of normal and disorder-related variation in the brain. GWA approaches typically use linear mixed effect models to account for non-independence amongst subjects due to factors such as family relatedness and population structure. The use of these models with high-dimensional imaging phenotypes presents enormous challenges in terms of computational intensity and the need to account multiple testing in both the imaging and genetic domain. Here we present method that makes mixed models practical with high-dimensional traits by a combination of a transformation applied to the data and model, and the use of a non-iterative variance component estimator. With such speed enhancements permutation tests are feasible, which allows inference on powerful spatial tests like the cluster size statistic.
Introduction
Genome-wide association studies (GWAS) of neuroimaging data can advance our understanding of human brain by discovering genetic variants associated with normal and disorder-related phenotypic variance in brain structure and function1–6. The genetic association analysis with the quantitative phenotypes from structural (i.e. brain volume, cortical thickness, white matter integrity) or functional imaging modalities (brain response to particular cognitive task or resting state) at hundred thousand locations in the human brain present statistical challenges including statistical power, multiple comparisons correction and like other association studies correction for population structure, a term that encompasses cryptic/family relatedness and population stratification.
In the GWA studies of unrelated individuals, non-independence due to latent population stratification or due to unknown (often termed cryptic) relatedness7, 8 is generally thought to be a confounding factor that can lead to excessive false positives when ignored. This type non-independence has been studied throughly in the recent GWA era9–13. While genomic data can be used to control for population stratification by including the top principal components as a fixed effect covariates in a linear regression model14, usually individuals with close estimated relatedness from identity-by-state (IBS) matrix or different ethnicities are excluded from the study sample. This might not be a problem in genetic studies with 4 digits sample sizes, but may make substantial differences in GWA studies with neuroimaging phenotypes where sample size is much smaller. Also, even in a carefully design GWA study, it is hard to avoid spurious associations because of population structure; in particular it is likely that in studies with large sample sizes i.e the UK biobank some level of population structure are induced within a same population. Moreover, GWA studies with neuroimaging phenotypes require fitting a marginal model at each point (voxel/element) in the brain, the large number of measurements presents a challenge both in terms of computational intensity and the need to account for elevated false positive risk because of the multiple testing problems both in terms of number of elements in image and number of markers being tested. Although the emergence of large scale neuroimaging consortia like ENIGMA or CHARGE can help to conduct well-powered genetic association studies through meta analysis framework, still it is crucial to use a powerful statistical method at the site level. Hence, there is a compelling need for a analytical technique that addresses these challenges.
There has been great interest in the field of quantitative genetic to develop sophisticated statistical methods to control population structure in GWA studies of unrelated individuals. Linear mixed models (LMM) allowing for the rigorous testing of genetic associations (and, more generally, fixed effects) have long been employed in human genetics as the standard to exploit and/or correct for the non-independence among subjects due to known familial relatedness in pedigree-based studies15–19. Linear mixed effect models using molecularly-derived empirical relatedness measures have gained popularity recently for both studies of related and unrelated individuals since they do not require prior information on biological relatedness and/or represent a framework where such complexities are automatically accounted for. One popular utilization of the LMM is as an alternative method to linear regression models where the association statistic incorporates a component of trait variance that is explained by a genetic relationship matrix (GRM) that captures the genome-wide similarity between “unrelated” individuals by modeling it as a random effect20–31. Additionally, it has been shown that the correction for the problem of latent population structure in GWA with an LMM is both effective and power preserving30–32.
Due to the required inversion of potentially large matrices, the general LMM is computationally intensive where the complexity includes the deriving of the GRM, variance component parameter estimation, fixed effect estimation, and the calculation of the required association statistic for each marker grows with sample size and number of candidate markers for association testing. Several approximate or exact methods have been proposed to speed up LMM-based testing. Approximate methods assume the total polygenic random effect is same for all markers under the null hypothesis of no marker effect, hence the relevant residual genetic variance component is estimated only once using all markers. In contrast, exact methods, which is the correct LMM practice24, 25, 30, 30, estimate a residual variance component conditional on each marker’s effect. In studies of “unrelated” subjects, this residual variance component often involves re-estimation of the GRM which is constructed excluding the candidate marker and surrounding markers in linkage disequilibrium.
The LMM efficiency in controlling confounding factors in the genetic association analysis and possible boost in power inspires using it with high-dimensional imaging phenotypes. However fitting LMM at each voxel/ROI in the brain is computationally intensive or even intractable at the voxel level while variance component estimation relies on likelihood function optimisation using numerical methods. Moreover, search for genetic association across the genome at different locations with imaging phenotypes requires intense multiple testing corrections both for number of elements in an image and number of markers. Whether the association analysis is conducted at the reduced search space in the brain i.e., summary measure from a region of interest or voxel level, naive application of bonferroni correction for number of hypothesis testing in the image with usual GWA P-value leads to invalid statistical inference procedure while it ignores complex spatial dependence between elements in the imaging phenotypes. The parametric null distribution of cluster size34 or threshold free cluster enhancement (TFCE) statistics35 that are the most common and sensitive inference tools in imaging, could be invalid due to untenable stationary assumption36, 37 or in the later case be unknown. Familywise error rate (FWE) correction, controlling the chance of one or more false positives across the whole set (family) of tests38 requires the distribution the maximum statistic, can be computed for either voxels/ROI or cluster size with permutation test39 which is the standard tool to conduct inference in neuroimaging.
Despite many analytical techniques have been developed to accelerate the GWA with LMM, these advances do not eliminate problems related to numerical optimisation nor multiple testing problem. This paper makes two major contributions to reduce the complexity of LMM in the genetic association specifically with the imaging phenotypes. First, variance component estimation step computational cost is reduced using non-iterative one-step random effect estimator40. Second, complexity of association testing is dramatically decreased with projecting the model and phenotype to a lower dimension space.
To our knowledge the fastest implementation of exact LMM is Fast-LMM24, which transforms the phenotype and LMM model with the genetic similarity matrix (GRM) eigenvectors and uses a profile likelihood approach to simplify variance component estimation. The eigenvector matrix diagonalisation along with the profile likelihood with only one variance parameter reduces optimisation time substantially. In Fast-LMM the covariance matrix is estimated only under the null hypothesis of no marker effect, and then a generalized least squares (GLS) is applied to estimate the marker effect and the likelihood ratio test is used for hypothesis testing. Note that small sample size behavior of this approach has not been validated, using it for association analysis of imaging phenotypes with only, say 300, subjects might not be valid. In addition to concerns about the finite sample validity, Fast-LMM requires numerical optimisation for each element (voxel/ROI) of image that makes it computationally intensive or essentially impractical for large-scale imaging phenotypes.
The key to our method is the projection of the phenotype and the model to a lower dimension space, and a score statistic for association testing. This projection is based on the eigenvectors of the adjusted GRM for the fixed effect nuisance terms. In this setting, the projected phenotype likelihood function is equivalent to that used with restricted maximum likelihood (REML) of the LMM (??), going forward we call this approach simplified REML. While both models have the same statistical properties, our particular projection provides several computational benefits that reduces LMM complexity dramatically as follows: (I) As we described in previous work40, the diagonalized covariance allows a non-iterative one-step variance component estimator, taking the form of a weighted regression of squared projected data on eigenvalues of the GRM adjusted for nuisance fixed effect terms, an approach that we henceforth call WLS-REML (weighted least squares REML); (II) The regression form of our estimator is easily vectorized, meaning that many image elements and SNPs can be tested in a single and fast computational test in several high-level programming languages (Online Methods); (III) Finally, the simplicity and fast computation of the score test statistic makes permutation testing feasible, allowing exact, non-parametric control over the FWE, accounting for the number of tests conducted over all image elements and markers. Two permutation schemes can be defined, free and constrained, where in the latter case the permutation is confined to exchangeability blocks defined based on the eigenvalues distribution.
The reduced computational complexity of our method represents a significant advance over existing methods. The complexity of LMM association has two components, one for the variance component estimation, the other is for fixed effect parameter estimation and test statistic computation. For a GWA over S markers and V imaging phenotype elements on N individuals, the variance component likelihood optimization complexity of FaST-LMM is O(N3 + INV), where I is the average number of iterations, while for WLS-REML the random effect estimator (Online Methods) it is O(N3 + NV) (the common O(N3) term is the time complexity of the GRM eigendecomposition). More critically, the estimation and test statistic computation complexity of FaST-LMM is O(SPN2 V), where P is the number of nuisance fixed effects, while for WLS-REML (Eq. (15)) this is O(SNV), a substantial reduction for imaging phenotypes when number of image elements V is much bigger than the sample size N. Even for a single trait GWA (V = 1), our proposed projection reduces the association (Eq. (12)) complexity to O(SN) which is significantly less than FaST-LMM for large sample GWA.
In our previous work40 we introduced WLS-ML random effect estimator that exploits this one-step optimization approach combined with eigen-rotation of phenotype and model (see Online Methods for more details). The non-iterative estimator has a simple form, with variance components estimated as a weighted regression of squared ordinary least square residuals on eigenvalues of the GRM, and fixed parameters estimated with a weighted regression of eigen-transformed phenotype on eigen-transformed model. In this paper we evaluate our non-iterative ML and REML estimators (WLS-ML and WLS-REML) with their fully converged counterparts (Full ML or Full REML), comparing score, likelihood ratio (LRT) and Wald tests on intensive simulation studies. The score test based on the simplified REML function is compared with FaST-LMM using the simulation study and real data analysis.
Results
Simulation Results
Simulation results on the accuracy of genetic random effect estimation shows that the non-iterative one-step approaches are similar to their fully converged counterparts (Supplementary Figure 1), using either likelihood or restricted likelihood functions. When the data are independent , the methods are indistinguishable in terms of bias and mean squared error (MSE). When , the fully converged methods have less bias, but the difference is modest in absolute value; in terms of MSE, the non-iterative one-step methods have just slightly worse performance. The first simulation also shows good performance of fixed effect (β1) estimation (Supplementary Figure 2). Both the non-iterative one-step and fully converged have similar bias and MSE, with WLS-REML again closely following fully converged REML.
Simulations show that the false positive rates for the fixed effect score test for H0: β1 = 0 (Supplementary Figure 3a) are nominal; for both simplified ML or REML functions, for all simulation settings considered, test statistic type and type of random effect estimator, the false positive rates lay within the Monte Carlo confidence interval (MCCI) (See also Supplementary Figures 4a & 4b).
The simulation results on the power of score test reveal negligible differences between the random effect estimation methods (Supplementary Figure 3b). Similar findings are obtained for the power of LRT and Wald tests (Supplementary Figures 4c & 4d). Like the parametric approach, we found that both permutation schemes, free or permutation within exchangeability blocks, control the false positives at the nominal level 5% (Figure 1a and Supplementary Figures 5a & 5b), and could provide nearly equivalent power (Figure 1b, Supplementary Figures 5c & 5d) for all statistics either based on the simplified ML or REML functions. However, for all test statistics and , the free permutation scheme is slightly more powerful than the constrained permutation test when a kinship matrix is used.
Simulations show that the null distribution of the score test for H0: β1 = 0 based on the simplified models using the fully converged and non-iterative variance component estimators are valid and indistinguishable (Figure 2 & Supplementary Figure 6). However, we stress that the latter is much faster to calculate. Based on all of these results, we selected the score test based on the simplified REML function as the computationally most efficient test to be considered for genome-wide simulations and real data analysis.
Genome wide simulations were conducted to compare the parametric P-values from FaST-LMM and the score test based on the simplified REML using non-iterative variance component estimator in terms of false positives and power. The simulation results reveal that both approaches provide overall valid error rates (FaST-LMM=4.94% and the WLS-REML score test = 4.89%, Figure 3a). Power simulation shows that FaST-LMM and the score test have largely similar power (FaST-LMM=15.25%, WLS-REML score test=15.22%), however, FaST-LMM is slower (Figure 3b). Despite reasonable concordance of P-value and fixed effect parameter estimates (β1) between FaST-LMM and simplified REML (Supplementary Figure 7), FaST-LMM’s estimates of parameter estimate variance exhibits some systematic bias (Supplementary Figure 8).
Association Analysis of FA data
We performed GWA of whole brain fractional anisotropy (FA) data, using a whole brain parcellation of 42 regions of interest (ROIs) as well as a voxel-wise analysis for 53,458 voxels (332 subjects, 1,376,877 SNPs; for full details see Supplementary Methods), comparing the WLS-REML score test with the fully converged random effect estimators with FaST-LMM. We also evaluate the use of ordinary least square (OLS) with MDS as nuisance fixed effects regressors for control of population structure in GWA with unrelated individuals.
The random effect estimators, one-step and fully converged REML are compared directly in Figure (4) with a scatter plot, showing an apparent trade-off between accuracy and running time as the non-iterative method has lower estimates of for some regions.
Even with the tendency for genetic variance to be underestimated with the non-iterative method, the association statistic show remarkable concordance, with both approaches having almost the same performance (Figure 5). FaST-LMM comparisons with the score test using the simplified REML function shows slightly larger statistics consistently for all ROIs, regardless of random effect estimation method (Supplementary Figures 10 & 11). Furthermore, comparing different approaches genomic control shows that regardless of random effect estimation method, the score test based on the simplified REML has smaller genomic control values than OLS with MDS nuisance regressors for all ROIs consistently. The genomic control of OLS with MDS nuisance regressors is poor, while the score test using both fully converged, one-step estimators and FaST-LMM have similar values close to unity (Supplementary Figure 9).
Figure 6 compares QQ-plot of association statistics between our model, FaST-LMM and OLS with MDS. These plots show either an identical distribution or slightly larger values for the OLS approach; however, the OLS approach has poor genomic control (Supplementary Figure 9,) and after adjustment we get essentially identical results (Supplementary Figures 12 & 13).
A permutation test was used to find FWE-corrected P-values for 42 ROIs and 1,376,877 SNPs to assess association significance. Among the 42 × 1, 376, 877 ≈ 57 million statistics, 8 passed the permutation based FWE threshold . Application of a Bonferroni correction for 42 tests to the usual GWA alpha level (5 × 10-8) yields to a more stringent threshold where only one association survives, indicating the potential improved power from a permutation-based inference that accounts for dependency among the tests (Figure 7).
Finally we performed voxel-wise genome-wide association analysis of 53,458 voxels with 1,376,877 SNPs, using our proposed WLS-REML score test for association. Cluster-wise inference was performed on each spatial association map; we used a threshold corresponding to a P-value of 0.01 to create clusters, and 1000 permutations were used to compute the maximum distribution of cluster size over space and SNPs, offering FWE control over the entire search space; voxel-wise FWE thresholds were also computed. The level 5% FWE-corrected voxel-wise statistic threshold was 66.42, producing 6 significant association out of 84 billion tests. The 5% FWE corrected cluster size threshold is 7370 but no SNP’s statistic map had a cluster exceeding this value; the largest observed cluster size is 6,648, which had a image-, genome-wide FWE-corrected cluster size P-value of 0.09.
Benchmarking and running times
We compared running time of our WLS-REML score test to that of FaST-LMM, which to our knowledge is the fastest implementation of LMM. The comparison was done using simulated and read data with a Intel(R) core(TM) 3.4 GHz i7-2600 CPU and 16GB RAM. Parametric association testing of 5000 phenotypes with 6000 simulated markers using a sample of 300 individuals took 1 hour with FaST-LMM, however, our implementation of the score test (Eq. (4.12)) only took 3 seconds. On real data, parametric whole genome association on 22 ROIs, required 756 minutes using FaST-LMM while our approach took only 2 minutes.
Discussion
Neuroimaging genetics has moved from establishing a heritable phenotypes to finding genetic markers that are associated with imaging phenotypes. Despite emerging world-wide consortia to boost GWA studies power using the largest possible sample sizes, there is a compelling need for powerful and computationally efficient analytic techniques that control for population structure at the site level.
Whether using the linear mixed model for controlling population structure or kinship, high dimensional imaging phenotypes presents challenges in terms of computational intensity and elevated false positive risk; growing sample sizes and whole genome sequence data add to the computational burden.
To tackle this problem, we used an orthogonal transformation that substantially reduced LMM complexity for GWA. The equivalence between projected model and REML function helped us to reduce complexity of association testing. Specifically, the projection reduces the information matrix to a scalar that enables efficient vectorized implementation of score test with time complexity O(SNV). Further improvements in speed can be achieved by using the WLS-REML random effect estimator with O(NV) that we found to be more accurate than the WLS-ML estimator.
We conducted intensive simulation studies, evaluating a broad set of test statistics for association testing using the simplified ML and REML functions accompanied by one-step and fully converged random effect estimators. The one-step random effect estimator using simplified REML function provides more accurate approximation of the fully converged one in comparison to the WLS-ML variance component estimator. The simulation and real data analysis shows that only minor differences in marker effect estimation and association test statistics between one-step and fully converged random effect estimator. However, the former requires less computational resources. Also, we could not observe any appreciable differences in performances in terms of the error rate and power using the GRM from unrelated individuals or kinship matrix from a family study.
The WLS-REML random effect estimator is fast enough to be used to estimate voxel-wise heritability. Although the proposed one-step random effect estimator is not as accurate as fully converged one, it can be used for filtering a small number of elements for further investigation with more computational intense tools. Furthermore, when restricted to individuals with European ancestry we found LMM had genomic controls values closer to 1 than OLS values, indicating the success of the LMM in dealing with population structure.
We selected the score test based on the simplified REML function for further investigations because it only requires a single variance component estimate, common to all markers under the null hypothesis. Furthermore, efficient vectorized implementation of score test for images accelerates association testing. The null distribution of WLS-REML score test P-values was nearly as accurate as for the fully converged REML score test, meaning that permutation is not required for element-wise inference.
Our contribution in the acceleration of the exact LMM can be seen at two steps. First, covariance matrix estimation using WLS-REML random effect estimator reduces time complexity from O(N3 + INV) to O(N3 + NV). Further improvement in speed is also obtained by using the score test based on simplified REML function. Our proposed method allows efficient implementation that reduces running time complexity to O(SNV). In addition, the efficient implementation of score test is fast enough to allow the permutation test to control family-wise error rate for number of elements in image and number of markers, and allow the use of spatial statistics like cluster size or TFCE.
Software implementation of this method, Nonparametric Inference for Genetics Analysis (NINGA), is available at http://nisox.org/software/ninga/.
1 Online Methods
At each voxel/element, a LMM for the genetic association for N individuals can be written as: where Y is the N-vector of the measured phenotype; X1 is a N-vector of a given marker’s minor allele count, implementing an additive genetic model; X2 is the N × (P1) matrix containing an intercept and fixed effect nuisance variables like age and sex; β1 is the scalar genetic effect; β2 is the (P 1)-vector of nuisance regression coefficients and g is the N-vector of latent (unobserved) additive genetic effects; and ε is the N-vector of residual errors. The trait covariance, var(Y)= var(g + ε)= ∑ can be written
where and are the additive genetic and the environmental variance components, respectively; I is the identity matrix; and 2Φ is the GRM matrix where element (i, j) is calculated as: where xik is the minor allele count of the i-th subject’s k-th marker, coded as coded as 0, 1 or 2; pk is frequency of the k-th marker; and M is the total number of markers.
Under the assumption that the the data follows a multivariate normal distribution, the model specified by Equations (2) and (1) have a log-likelihood of and a Restricted Maximum likelihood (REML) function of where X = [X1 X2] and β = [β1 β2] are the full design matrix of fixed effects and their parameter estimate vector, respectively, and P = ∑-1 (I X (X ′ ∑-1 X)-1 X ′ ∑-1), the projection matrix. The fixed effect parameters are estimated using generalized least squares (GLS) where comes from optimised REML function (Eq. (4)).
Several algorithms have been proposed to accelerate ML or REML optimisation by transforming the model with the eigenvectors of the GRM and/or using a different covariance matrix parametrisation21, 24, 33, 33,40. Here we consider standard additive model covariance matrix parametrisation (Eq. (2)) as we can efficiently estimate it with our one-step, regression based approach40.
1.1 Simplified REML and ML Functions
The simplified ML function for LMM is discussed in40. For completeness, we review shortly the simplified ML function, to be next followed by development of the simplified REML function. The simplified ML function is obtained by transforming the data and model with an orthogonal transformation S, the matrix of eigenvectors of 2Φ that crucially coincide with the eigenvectors of ∑: which we write as where Y∗ is the transformed data, X∗ is the transformed covariate matrix, g∗ and ε∗ are the transformed random components. The diagonalising property of the eigenvectors then gives a simplified form for the variance: where ∑∗ is the variance of the transformed data and Dg = diag {λgi} is a diagonal matrix of the eigenvalues of 2Φ.
The log likelihood takes on the exact same form as Equation (3) for Y∗, X∗, β and ∑∗, except is easier to work with since ∑∗ is diagonal: where is the i-th element of Y∗, and is the i-th row of X∗.
A simplified form of the REML function (Eq. (4)) is obtained by projecting the polygenic model (Eq. (1)) using eigenvector matrix of the adjusted GRM for the fixed effect nuisance terms as follows: where M = I X (X ′ X)-1 X′ is the residual forming matrix based on the fixed effects regressors; Dg r = diag λgri is the (N − P) (N − P) diagonal matrix of non-zero eigenvalues; and Sr is the N × (N − P) matrix of eigenvectors that corresponds to non-zero eigenvalues. The projected polygenic model is obtained by pre-multiplying to the both sides of polygenic model (Eq. (1)): which we write as: where and are N − P projected phenotype, genetic and residual vectors, respectively. In this fashion, the projected phenotype covariance matrix becomes diagonal:
That is, the projected data, , loglikelihood takes on a simpler form: where is the square of the i-th element of .
In the ?? we show that this is equivalent to Equation (4), and thus we can use the eigenvectors of the adjusted GRM for nuisance fixed effects to build the REML log likelihood. It is clear from the Equation (7) that working with the simplified version of REML is computationally easier than the original one (Eq. (4)). Beside accelerating the REML optimisation, this approach facilitates performing likelihood ratio test for fixed effects (β s) and leads to a computationally efficient estimator and test statistic, described below.
1.2 REML and ML Parameter Estimation
We choose Fisher’s scoring method to optimize the simplified ML and REML functions because it leads to computationally efficient variance component estimators. The score and the expected Fisher information matrices for the simplified models can be expressed as: and where ; U = [1, λg] and U = [1, λgr] are N × 2 and (N − P) × 2 matrices; and λg is the vector of eigenvalues of (2Φ); λgr the vector of eigenvalues of M(2Φ)M; 1 and 1r are N and (N − P)-vectors of one, respectively; is the element wise product of ; and ε∗2 is the element wise product of ε∗. Following Fisher’s scoring method it can be shown that at each iteration, maximum likelihood estimation of β and θ are updated based on WLS regression of Y∗ on X∗ and ε∗2 on U, respectively, as follows: and restricted maximum likelihood estimation of θ is updated based on WLS regression of on Ur as follows: where j indexes iteration; and are constructed with θML, j and θREML, j respectively; is the element-wise square of ; is the element-wise square of ; and the variance parameters θ must be positive, hence the maximum operator. As usual, these updates are iterated until convergence criteria holds.
It has been shown that when the initial value is a consistent estimator, the estimator based on the first iteration is asymptotically normal and consistent42. Such initial value for and could be derived from OLS regression coefficients of Y∗ on X∗ and squared residuals on U, respectively:
For REML, initial values for can be found as OLS regression coefficient of on Ur:
Hence our one-step, non-iterative estimators are: where and are formed by and respectively, and is the element-wise square of . Going forward, we will use “ML” or “REML” to refer to the iterated estimators and “WLS” to refer to these one-step estimators.
1.3 Association Testing
The Score, likelihood ratio (LRT) and the Wald tests can be used for the genetic association testing using either ML or REML functions of the model in Equation (1).
The score statistic43 that requires the value of score and information matrices under the the null hypothesis constraint (H0: β1 = 0) for the simplified ML model (Eq. 5) can be written where C is a P× 1 contrast vector; encompasses the full transformed covariate matrix; and are the ML residual and covariance matrix estimates under the null hypothesis constraint. The score statistic for the projected model (Eq. (6)) can be derived like TS,ML following the projection with respect to the H0 fixed effects, i.e. nuisance, terms X2, where and are (N − P + 1)-vectors of the projected phenotype and allele frequency count, respectively; and the projection matrix S2r is comprised of the eigenvectors of M2 (2Φ)M2 with non-zero eigenvalues, ; and is the projected model covariance matrix estimation under the null model constraint.
Likelihood Ratio Test The LRT44 statistic is twice the difference of the optimised log-likelihoods, unrestricted minus H0-restricted. For ML this requires optimizing the likelihood function twice, once under the null H0: β1 = 0, once under the alternative. We denote the test statistic for this test TL,ML. A well-known aspect of REML is that it cannot be used to tests of fixed effects, since the null hypothesis would represent a change of the projection that defines the REML model. However, we can consistently use the same projection S2r, under the unrestricted and restricted models, to diagonalise our covariance and carry out such a hypothesis test. To be precise, the unrestricted model is where by the construction of S2r, and the restricted model is
Following the same procedure as ML, the test statistic is denoted by TL,REML.
The Wald Test For a scalar parameter, the Wald test43 is the parameter estimate divided by the standard deviation of the estimate under an unrestricted model. For an vector parameter β and contrast C, it takes the form where and are the parameter estimations under the alternative hypothesis; this form holds for both ML and REML. A test for genetic association testing can be calculated either using fully converged or one-step variance component estimators. In the parametric framework, all of the aforementioned tests null distribution follow chi square distribution with one degree of freedom asymptotically.
1.4 Inference Using Permutation Test
In neuroimaging the permutation test is a standard tool to conduct inference while controlling the family wise error rate (FWE)39. It only requires an assumption of exchangeability, that the joint distribution of the error is invariant to permutation, and can be provide exact inference in the absences of nuisance variables, or approximately exact control with nuisance variables45. Control of the FWE of a voxel-wise or cluster-wise statistic is obtained from a maximum distribution of the corresponding statistic. However naive use of permutation test for the genetic association testing, ignoring dependence structure between individuals, leads to invalid inferences46, 47. Here we propose two permutation schemes that account for dependence explained by our model, one free and one constrained permutation approach.
Free Permutation
The genetic association testing in the context of LMM using a permutation test requires proper handling of fixed effect and random effect nuisance variables in order to respect the exchangeablity assumption. While there are a variety of methods for testing for a fixed effect when the errors are independent45. However little work has been done for fixed effect inference using permutation test in linear mixed models where the error term is correlated46.
Free Permutation for the simplified ML Model: For the simplified model (Eq. 5) we create permuted data using the reduced, H0: β1 = 0 null model residuals and use them to create surrogate null data, where is one of N! possible N × N permutation matrices; is the reduced model nuisance estimate found with either fully converged (Eq. (8)) or one-step (Eq (9)) methods; denotes the reduced model residuals likewise found with either fully converged or one-step estimators; and the tilde accent on the data and permutation denotes one of many null hypothesis realisations. The reduced null model is not exchangeable due heteroscedasticity of ∑∗, but we account for this in each permutation step by fitting the simplified model (5) with the permuted covariance matrix
With this approach we obtain samples from the empirical null distribution of the maximum score, LRT and the Wald tests (or cluster-size, after thresholding one of these test statistics), where the maximum is taken over all voxels and SNPs to control FWE.
Free Permutation for Simplified REML model: While above, we created null hypothesis realizations by permuting the nullmodel residuals and adding back on estimated nuisance, here we will permute data after reduced-model eigen-transformation. We do this because projection removes the nuisance fixed effect covariates. In both cases, though, we must account for the dependence existing under H0.
An alternate permutation scheme could be built based on projecting the LMM model (Eq. (1)) to the lower dimension space with respect to the null hypothesis reduced model, i.e. using only the nuisance fixed effect terms. Let M2 be the residual forming based on X2 alone and, as Section 1.1, define S2r as the transformation based on the non-trivial eigenvectors of M2 (2Φ)M2, creating a model with dimension N-(P-1): where is the reduced transformed data; is as above, the reduced transformed additive genetic effect; and are the latent genetic effect and random error terms, respectively, after the reduced transformation. Here we permute the data, producing , with permuted covariance matrix fit in each permutation step. However, under the null hypothesis of no genetic effect, estimated random effects for permuted phenotype are exactly as same as the un-permuted phenotype and hence the variance components only need to be estimated once.
Constrained Permutation: exchangeability blocks
In the free permutation approaches we permute despite the lack of exchangeability, but then permute the covariance structure to account for this. An alternate approach is to define exchangeability blocks where observations within each block can be regarded as exchangeable. Precisely, with exchangeability blocks, the assumption is that permutations altering the order of observations only within each block preserve the null hypothesis distribution of the full data.
While not feasible for the original correlated model (1), in the simplified ML (5) or simplified REML (6) model we can define approximate exchangeability blocks. In simplified models the sorted eigenvalues arrange the observations by variance (increasing or decreasing, depending on software conventions). Hence blocks of contiguous observations Y∗ or will have variance that is as similar as possible and will be, under the null hypothesis, approximately exchangeable.
We propose to define exchangeability blocks such that the range of Dg or Dg r values within a block is no greater than 0.01. This cut off ensured the eigenvalues did not vary by more than a factor of 10% within a block. Permutation is constrained within these blocks and the test procedure is as described above for simplified ML and REML free permutation schemes above, except that the test statistic is computed using the unpermuted covariance matrix.
1.5 Efficient score statistic implementation for vectorized images
To fully exploit the computational advantage of our non-iterative, reduced-dimension projected model estimation method we require a vectorized algorithm. That is, even without iteration, the method will be relatively slow if the evaluation of the estimates is so complex that each phenotype must be looped over one-by-one. For fast evaluation with a high-level language like Matlab, the estimation process for a set of phenotypes must be cast as a series of matrix algebra manipulations.
In this section we develop the vectorized algorithm for association one chromosome’s worth of SNPs and all image voxels/elements (subject to memory constraints). To avoid proximal contamination24 and efficient implementation of LMM, we follow leave one chromosome out approach where all markers on a chromosome being tested are excluded from the GRM30, 32.
Let Yr and Xr be a (N − P) × V and (N − P) × G matrices of projected traits and allele frequencies respectively, where V and G are number of elements in image and number of SNPs the tested chromosome, respectively. The score test requires parameter estimation under the null hypothesis constraints, and since X2 is the same for all SNPs, the estimated covariance matrix will be the same all markers the chromosome. Thus the covariance matrix only need to be estimated once as follows: where F and Yr are (N − P) ×V matrices, where each column of Yr is (Eq. (6)) for one image element and F is the element-wise squaring of Yr; ⊙ denotes Hadamard product; ⊘ denotes element-wise division; θ is the 2 ×V matrix of OLS solutions which is matrix counterpart of ; 0 is the 2 ×V matrix of zeros; and here max(·,·) is an element-wise maximum between the two operands, evaluating to a 2 ×V matrix; W and 1NV are the (N − P) ×V matrices, where each column of W is for the corresponding image element and 1NV is a matrix of ones. With the following notation, where 1V is the length-V column vector of ones, we can compute the variance components of the vectorized image as: where and are the length-V column vectors of genetic and environmental variance components, respectively; and S is a (N-P) × V matrix which here each column of S is the element-wise reciprocal of the diagonal of the variance matrix of the corresponding image element’s data Yr for each element of image. In this fashion, the score statistic matrix for all markers being tested and the vectorized image can be expressed as: where TS,R is a G×V matrix of score statistics for all SNPs and traits.
Author contributions statement
H.G. developed the statistical method, ran the simulations and analyzed the simulated and real data. P.K. provided the human data and supervised its analysis. B.D. implemented the method both in CPU and GPU. A.M.W., D.C.G. and J.B helped in writing the paper. T.E.N. supervised the project. All authors contributed to critical review of the manuscript during its preparation.
1 Supplementary Methods
1.1 Simplified REML Function
At each voxel/element, a LMM for the genetic association for N individuals can be written as: where Y is the N-vector of the measured phenotype; X1 is a N-vector of a given marker’s minor allele count, implementing an additive genetic model; X2 is the N× (P − 1) matrix containing an intercept and fixed effect nuisance variables like age and sex; β1 is the scalar genetic effect; β2 is the (P 1)-vector of nuisance regression coefficients and g is the N-vector of latent (unobserved) additive genetic effects; and ϵ is the N-vector of residual errors. The trait covariance, var(Y) = var(g + ϵ) = ∑ can be written where and are the additive genetic and the environmental variance components, respectively; I is the identity matrix; and 2< I is the GRM matrix.
Under the assumption that the the data follows a multivariate normal distribution, the model specified by Equations (2) and (1) have a Restricted Maximum likelihood (REML) function of where X = [X1 X2] and β = [β1 β2] are the full design matrix of fixed effects and their parameter estimate vector, respectively, and P = ∑-1 (I X(X′ ∑-1 X)-1 X′ ∑-1), the projection matrix. The fixed effect parameters are estimated using generalized least squares (GLS) where comes from optimised REML function (Eq. (3)).
It is clear from Equation (3) that computational burden of REML function is substantial even for small datasets. Here we introduce an orthogonal transformation that accelerates the REML function optimisation dramatically. To obtain such transformation, we first show that the likelihood function of transformed data with any orthogonal residualising matrix, that is a matrix that maps Y to the null space of X, is exactly the same as the REML function. Then, a simplifed form of the REML function (Eq. (3)) can be obtained using a particular transformation that makes the covariance matrix of transformed data diagonal.
Let M = I X(X′ X)-1 X′ be the residual forming matrix based on the fixed effects regressors. Since M is idempotent, it can be diagonalised where A is the N × (N − P) matrix of the eigenvectors of M corresponding to the non-zero eigenvalues. Crucially, A also residualises the data, because it is orthogonal to the design matrix X:
Hence A′ Y ∼ N (0, A′ ∑A) and the log likelihood of the transformed data is
Now we show that this (Eq. (4)) is equivalent to Equation (3), and thus we can use the eigenvectors of the residual-forming matrix to build the REML log likelihood. Assuming that X is a full column rank, then [A X] is the N × N square non-singular matrix. To show that the project data loglikelihood is the same as the REML function (Eq. (3)) we use the following identity:
Taking the determinant of LHS of the Equation (5) gives us:
The RHS determinant of the Equation (5) using the block matrix determinant rule can be written as
Hence taking the determinant from the identity in the Equation (5) gives us where using A′ A = I, A′ X = 0, it can be shown that
Finally, using A(A′ ∑A)-1 A = P [Searle et al., 2009, M4.f p. 451], it is clear that Equations (3) and (4) are equivalent. Hence, transformed data likelihood function is exactly as same as the REML function.
As A is not unique, we seek to find one that diagonalises the covariance of the residualised data. The transformation matrix could be derived from eigendecomposition of GRM adjusted for the fixed effect covariates as follows: where is the (N − P) × (N − P) diagonal matrix of non-zero eigenvalues; and Sr is the N × (N − P) matrix of eigenvectors that corresponds to non-zero eigenvalues. Firstly, Sr is a valid A, because its columns are orthogonal and [Kang et al., 2008]. Thus we define the projected polygenic model by pre-multiplying both sides of polygenic model (Eq. (1)): which we write as: where and are N − P projected phenotype, genetic and residual vectors, respectively. In this fashion, the projected phenotype covariance matrix becomes diagonal: where we have used the identity . That is, therefore the projected data, , loglikelihood takes on a simpler form: where is the square of the i-th element of .
1.2 Simulations
Intensive simulation studies are conducted to evaluate proposed methods for association estimation and testing. The aim of the first study is to compare fully converged and one-step random effect estimators based on the simplified ML and REML functions. In the second study, the performance of various test statistics for the association testing are compared using a fully converged or one-step random effect estimators for ML and REML functions. Finally, we compare FaST-LMM [Lippert et al., 2011] to our preferred test, the score test based on the simplified REML function, TS,REML, using both false positive error rates and empirical power using simulated genetic markers.
In all simulations the response variable is assumed to follow Y = Xβ + ϵ, where ϵ ∼ N (0, ∑) and , giving a unit variance phenotype. As above, the design matrix is partitioned X = [X1 X2], where X1 is the allele count per subject for a given marker, and X2 are all other non-genetic fixed effects. In our simulations, X1 is based on simulated marker, where each marker has a reference allele frequency sampled from a uniform distribution on [0.1, 0.9]. The X2 matrix has 3 columns, an intercept, a linear trend from −1 to 1, and the element-wise square of the linear trend. Kinship matrices from a family study, genetic analysis workshop 10 (GAW10), and genetic similarity matrix from simulated genetic markers for a sample of unrelated individuals with different sizes were chosen to set the covariance, for a range of genetic variances, . Specifically, the Cholesky decomposition of ∑ was used to premultiply i.i.d normal random variables with 5000 realisations.
1.3 Genome wide simulations
FaST-LMM and the score test performances based on P-value, parameter estimate and variance of parameter estimate are compared using simulated SNPs and phenotype when there is no population structure. 60,000 SNPs for 300 individuals with minor allele frequency between (0.05, 0.5) were simulated. 6000 null and 100 causal markers were used to compare the false positive rates in 5000 realisations. In the null simulations 6000 markers were used to induce different level of heritability under the additive model and where markers are standardised to have mean zero and unit variance. Finally for power simulations 100 markers were explained 30% of phenotipic variance where the effect for each marker was drawn from N (0, 0.3/100).
1.4 Real Data
To validate our proposed methods for association estimation and inference for imaging data, we applied them on a dataset from healthy and schizophrenic individuals to perform ROI and voxelwise genome wide association analysis using cluster wise inference. The sample was 54% healthy individual (175 control/155 schizophrenic) and had a mean age of 39.12 (SD= 14.9) where 50% of the sample is male.
Diffusion Tensor Imaging
Imaging data was collected using a Siemens 3T Allegra MRI (Erlangen, Germany) using a spinecho, EPI sequence with a spatial resolution of 1.7 × 1.7 × 4.0 mm. The sequence parameters were: TE/TR=87/5000ms, FOV=200mm, axial slice orientation with 35 slices and no gaps, twelve isotropically distributed diffusion weighted directions, two diffusion weighting values (b=0 and 1000 s/mm2), the entire protocol repeated three times.
ENIGMA-DTI protocols for extraction of tract-wise average FA values were used. These protocols are detailed elsewhere [Jahanshad et al., 2013] and are available online http://enigma.ini.usc.edu/protocols/dti-protocols/. Briefly, FA images from subjects were non-linearly registered to the ENIGMADTI target brain using FSL’s FNIRT [Jahanshad et al., 2013]. This target was created as a minimal de-formation target based on images from the participating studies as previously described (Jahanshad et al., 2013b). The data were then processed using FSL’s tract-based spatial statistics (TBSS; http://fsl.fmrib.ox.ac.uk/fsl/fslwiki/TBSS) analytic method [Smith et al., 2006] modified to project individual FA values on the handsegmented ENIGMADTI skeleton mask. The protocol, target brain, ENIGMADTI skeleton mask, source code and executables, are all publicly available (http://enigma.ini.usc.edu/ongoing/dti-working-group/). The FA values are normalized across individuals by inverse Gaussian transform [Servin and Stephens, 2007, Allison et al., 1999] to ensure normality assumption. Finally, we analyzed the voxel and cluster-wise FA values with applying along the ENIGMA skeleton mask.
Genetic Quality Control
In this study only genotyped Single Nucleotide Polymorphisms (SNPs) from genome-wide information were included in the analysis. Visual inspection of multi-dimensional scaling analysis was used to extract individuals with European ancestry. SNPs from individuals with European ancestry that do not meet any of the following quality criteria were excluded: genotype call rate 95%, significant deviation from HardyWeinberg equilibrium p< 10-6 and minor allele frequency 0.1 was used to ensure that sufficient numbers of subjects would be found in our sample in each genotypic group (homozygous major allele, heterozygous, homozygous minor allele) using an additive genetic model. After all quality control steps, 962,885 out of 1000,000 SNPs remain for genome-wide association analysis.
Acknowledgements
TEN is supported by the Wellcome Trust. HG, TEN & PK were supported by National Institutes of Health R01 EB015611-01.