Abstract
Biophysical models enable the non-invasive estimation of microstructural tissue features of the central nervous system such as the axonal volume fraction using diffusion weighted imaging (DWI)-data. However, these models trade accuracy with complexity and demands for time-efficient data acquisition. In this study, we hypothesise that their accuracy can be improved substantially through biophysically motivated, linear calibration. We test this hypothesis in the context of axonal volume fraction estimation in four different DWI-models of different complexity using multi-modal data including ex-vivo diffusion MRI- and electron microscopy (EM)-data in mice with broad dynamic range, whereby the latter served as gold standard. We found that two calibration parameters, an offset accounting for the fraction of unmyelinated axons in severely hypomyelinated mice and a scaling accounting for the compartment-specific relaxation, substantially improved the accuracy of axonal volume fraction. Furthermore, we theoretically predict the scaling parameter, and demonstrate that similar accuracy improvement can be achieved for a subset of DWI-models, if the scaling parameter is fixed to the predicted value instead of estimating it on basis of data. This is of practical relevance because it allows to estimate the remaining offset calibration parameter from a limited amount of multi-modal data and thus makes the proposed method usable in human brain data.
1. Introduction
All models are wrong but some are useful
This often cited aphorism attributed to the statistician George Box describes the dilemma that neuroscientists encounter when using biophysical models of the MR-signal as a non-invasive tool to infer microstructural tissue features. The most prominent model based on diffusion-weighted-imaging is Neurite Orientation Dispersion and Density Imaging (NODDI) which is often used to estimate the axonal volume fraction (fA). Accurate estimation of fA of white matter (WM) is of great interest because it is required, e.g., for the computation of the g-ratio which is indicative of neuronal conduction velocity and thus of the functional integrity of WM fibres (Stikov et al., 2015; Campbell et al., 2018; Mohammadi & Callaghan, 2021). In vivo, MR-based fA estimation is usually achieved by rescaling the axonal water fraction metrics from DWI-models with myelin volume fraction estimates from other non-DWI MR-techniques such as, e.g. proton density mapping or magnetisation transfer imaging (Stikov et al., 2015). The employment of non-DWI MR-techniques for estimating the myelin volume fraction is necessitated by the short transverse relaxation time of the macromolecular water, which renders it practically invisible to DWI.
A whole range of biophysical multi-compartment DWI-models, connecting the diffusion weighted signal with the axonal volume fraction, have been proposed such as, e.g., White Matter Tract Integrity (WMTI) (Fieremans et al., 2011), NODDI (Zhang et al., 2012), a reduced version of NODDI (NODDI-DTI) (Edwards et al., 2017), and most recently a model by Jespersen et al. (JESP) (Jespersen et al., 2018), which represents an extension of the WMTI-model. Each of these DWI-models is based on certain simplifying assumptions regarding white matter microstructure and the diffusion of water inside it, which result in different numbers of free model parameters. The JESP model has five free parameters, one intra-cellular (i.e. axonal) diffusivity parallel to the WM fibres, two extra-cellular diffusivities one parallel and one perpendicular to the fibres, the dispersion of fibres, and the axonal water fraction. Furthermore, due to the degeneracy of its solution, the JESP model possesses two solutions JESP+ and JESP-. WMTI assumes no fibre dispersion, i.e. WM fibres are assumed to be parallel inside a given voxel, which reduces the number of free parameters to four. NODDI is the only three compartment (four compartment ex-vivo) model and includes an isotropic, cerebrospinal fluid compartment in addition to the extra-cellular and the axonal compartments shared by all DWI-models of this study. The free parameters of NODDI are fibre dispersion, axonal water fraction and isotropic water fraction and, for the ex-vivo NODDI model, the signal fraction of the dot compartment (restricted water pool (Alexander et al., 2010; Panagiotaki et al., 2012)) for the ex-vivo NODDI model. The compartmental diffusivities are fixed and not independent to avoid overfitting. Finally, NODDI-DTI is the simplest model because it considers only WM voxels, in which the isotropic and the dot compartmment can be ignored. Therefore, it has only two free parameters, fibre dispersion and axonal water fraction. The remaining compartmental diffusivities are fixed as for NODDI.
Although the limitations of these biophysical DWI-models are well-known, they are increasingly used in clinical research and neuroscience, e.g. NODDI (Cox et al., 2016; Elliott et al., 2018; Genç et al., 2018; Donat et al., 2021) or WMTI (Coutu et al., 2014; Karolis et al., 2019). One important limitation is the fact that these models neglect different compartmental T2 values in the intra- and extracellular signal (Veraart et al., 2018; Lampinen et al., 2019; Gong et al., 2020; Frigo et al., 2021). Another limitation is that their sensitivity to the fraction of unmyelinated axons is unknown. While additional linear calibration has often been used to improve the accuracy of MR-based myelin metrics (Campbell et al., 2018; Jung et al., 2018; West et al., 2018b), the question about whether additional calibration can also improve the accuracy of DWI-based axonal water estimates has remained unanswered (Mohammadi & Callaghan, 2021). The signals of the aforementioned multi-compartment DWI-models are essentially modeled as the sum of signal contributions from the individual compartments (e.g. axonal, extracellular, isotropic compartments). The fraction of the signal of the axonal compartment is then usually taken directly as the metric for the axonal water fraction (fA). However, signal fraction and axonal water fraction are not truly interchangeable, because of the different transverse relaxation times (T2) in the compartments. Instead, the signal fractions are potentially weighted fractions whose weights depend on the compartmental R2-differences (R2 = 1/T2) and on the employed echo time TE. Employing an MR-protocol with multiple-echo-times can be used to estimate the axonal water fraction at TE = 0 through direct fitting of the TE-dependent two-compartment model (e.g. (Veraart et al., 2018)) or through fitting to an analytic expression (Gong et al., 2020). Although physically motivated, it takes substantially longer to acquire the DWI-data than in case of a single TE acquisition. Here we suggest an alternative whereby an additional scaling calibration could be used to convert model estimates into true volume fractions using standard DWI at a single TE. This hypothesis has to be tested by comparison to a gold standard. Most commonly, electron microscopy has served as the gold standard. But due to low contrast in EM, unmyelinated axons are difficult to discriminate from other entities such as, e.g. glial cells, and thus they are typically not quantified (Lee et al., 2019; West et al., 2018b; Zaimi et al., 2018). Therefore, the application of EM as gold standard for testing DWI-based metrics of the axonal volume also revives the question whether DWI-based fA-estimates are covering the whole population of axons, i.e. myelined and unmyelinated axons, or whether they are affected by the fraction of myelinated axons, only (Beaulieu & Allen, 1994).
In this study, we investigate whether additional calibration through an offset accounting for the fraction of unmyelinated axons, or a scaling factor accounting for compartmental T2 differences, or a combination of both parameters, can improve the one-to-one correspondence between DWI-based metrics of the axonal volume fraction and their corresponding electron-microscopy counterparts. To this end, we use a multi-modal, ex-vivo dataset of DWI- and EM-data of mouse WM from the corpus callosum and fornix. The dataset includes several mouse models with varying degrees of myelination ranging from hypo- to hypermyelination (Kelm et al., 2016; West et al., 2018a), thereby providing a broad dynamic range of axonal and myelin volume metrics. The EM-based fA and myelin volume fraction (fM) are used as gold standards and utilised to validate the accuracy of DWI-based fA markers derived from four different biophysical model of the axonal water fraction, WMTI, NODDI, NODDI-DTI and JESP± (Fieremans et al., 2011; Zhang et al., 2012; Edwards et al., 2017; Jespersen et al., 2018).
2. Background
We model WM tissue as being composed of three distinct, non-overlapping compartments quantified by the axonal (fA), the myelin (fM), and the extracellular volume fraction (fE) with in every WM voxel (see also Fig. 1 for a schematic description of the modelled volume fractions and the metrics glossary in table 1). Since the myelin compartment is in practice not affecting the DWI-signal due to its short relaxation time, the DWI-signal is determined by the axonal water fraction (fAW). In the two-compartment model of WM shown in th second row of Fig. 1 fAW is given by which can be converted into the axonal volume fraction fA by rescaling the right side of Eq. 2 by 1 − fM, with fM being estimated using another non-DWI technique. In order to distinguish DWI-based metrics from the “true” axonal water fraction fAW given by Eq. 2, we denote them in the following by AW (≈ fAW). For testing the performance of DWI-models, a gold standard is required for comparison. Here, we used electron microscopy metrics for both, the axonal volume fraction, denoted by α, and for the myelin volume fraction, denoted by μ, as the gold standard. To avoid ambiguities about whether the calibration parameters are correcting the DWI- or the myelin-marker, our strategy was to rescale the axonal water fraction (defined by Eqs. 1 and 2) by 1 − μ to get a DWI-based estimate of the axonal volume fraction A:
In EM only the myelinated axons are assessed, i.e. with fA,M + fA,U = fA, where the subscripts M and U denote myelinated and unmyelinated, respectively. Taking α (Eq. 4) as the gold standard therefore raises the question how sensitive the DWI-based signal is to the fraction of unmyelinated axons, which would occur as an additional offset calibration parameter U to A:
Eq. 3 is based on the assumption that apart from measurement error AW is equal to fAW, which is a common assumption implying that compartmental T2 differences in transverse relaxation (T2) are negligible. If compartmental differences cannot be neglected, the fraction of the axonal signal would become a function of the employed echo time TE with AW (TE = 0) = fAW (see, e.g. (Gong et al., 2020)). We will show in the subsequent section that this TE-dependence can be separated into a scaling calibration factor:
In the following we tested the hypothesis that calibration parameters U and s (Eqs. 5 and 6) can improve the one-to-one correspondence between α and A (Eqs. 3 and 4). For further details on calibration parameters and optimisation see the corresponding methods section.
2.1 Analytical derivation of the scaling calibration
Each of the tested DWI-models (WMTI, NODDI, NODDI-DTI, and JESP) includes a number of assumptions about the underlying WM microstructure (see, e.g. (Mohammadi & Callaghan, 2021)). All signal models tested in this study can be derived on the basis of the four-compartment ex-vivo NODDI-model composed of an axonal (with index a), extracellular, isotropic (iso) and a so-called dot (dot) compartment, which accounts for water trapped inside small cavities in fixed tissue with effectively no diffusivity (Alexander et al., 2010; Panagiotaki et al., 2012), given by where νdot, νiso, and ν are the signal fractions of the dot-, isotropic-, and axonal compartments, respectively. The usual in-vivo NODDI-model is obtained by setting νdot = 0 and the signal models for WMTI, JESP+/- and NODDI-DTI assume νdot = νiso = 0. The compartmental signals (Sdot, Siso, and Sa) are functions of the diffusion b-vector b and a set of biophysical parameters {pi}, which depend on the DWI-model (see table 2), with the assumption that at b = 0 SA = SE = Siso = Sdot = 1. In analogy to the volume fractions from the introduction (see also Fig. 1), the signal fractions in Eq. 7 are: ν = fA/(fA + fE), νiso = fiso/(fA + fE + fiso), and νdot = fdot/(fA + fE + fiso + fdot), so that ν + νiso + νdot = 1. In this signal model the axonal water fraction is given directly by the corresponding coefficient of SA: (ex-vivo NODDI) AW = (1 − νdot)(1 − νiso)ν, (NODDI, i.e. νdot = 0) AW = (1 − νiso)ν, and (WMTI, JESP+/- and NODDI-DTI, i.e. νdot = νiso = 0) AW = ν. This changes if the compartmental signals are functions of the corresponding compartmental transverse relaxation times. A simple signal model accounting for compartmental relaxation times is given by where TE is the echo-time, and T2,a, T2,e and T2,iso are the transverse relaxation times in the axonal-, extra-cellular, and isotropic compartments. For this signal model S0 1 and hence the coefficient of Sa is now and hence TE-dependent. The application of a model that does not account for compartmental relaxation to diffusion MR-data will therefore require a calibration scaling factor s(TE) in order to retrieve the desired axonal water fraction from the coefficient of the axonal signal. As can be directly seen from the ex-vivo NODDI signal model Eq. 8 where Δe = 1/(T2,a − 1/T2,e), Δiso = 1/(T2,a − 1/T2,iso), and Δdot = 1/(T2,a − 1/T2,dot). Then we have spredAW = (1 − νdot)(1 − νiso)ν ≡ fA again. For the usual NODDI signal model νdot = 0 and for the remaining two-compartment models of this study νdot = νiso = 0. The scaling can be predicted for the DWI-models using Eq. 9 once the compartmental signal fraction, the compartmental T2 and the echo-times are known from literature or estimated from multi-echo measurements.
2.1.1. Estimation of compartmental T2 from the literature
For estimating spred, we rescaled the compartmental T2-values T2,a(3T) ≈ 83 ms and T2,e(3T) ≈ 59 ms from (Tax et al., 2021) from 3T to 15.2T. The scaling was estimated from average values for the transverse relaxation time in ex-vivo human white matter on the basis of monoexponential models: T2(3T) = 83.8 ms (Birkl et al., 2014), and T2(15.2T) ≈ 33 ms (from the supplementary of (West et al., 2018b)). The decrease of the relaxation time from 3T to 15.2T can then be estimated by the ratio
With Eq. 10 the relaxation rates of the individual compartments can be estimated as
From Eqs. 11 the compartmental differences are then Δe ≈ 12.6 s−1 and Δiso ≈ −32.0 s−1, where T2,iso = 1 ms was assumed (Gong et al., 2020). For T2,dot no values could be found to the best of our knowledge. We assumed T2,dot = T2,e, i.e. Δdot = Δe in Eq. 9.
2.1.2. Estimation of the scaling based on theory and literature
Taking Δe, Δiso, and Δdot from the previous subsection, taking TE = 19ms from (Kelm et al., 2016), and taking ν = 0.5 and νiso = 0.05 from Gong et al. (2020), Eq. 9 yields for NODDI spred ≈ 0.91. The predicted scaling for the remaining DWI-models (WMTI, JESP+/-, and NODDI-DTI) yields spred ≈ 0.883, following again from Eq. 9 with the assumption νdot = νiso = 0, ν = 0.45 from Veraart et al. (2018), and any missing constants as for NODDI.
3. Methods and Materials
3.1. Dataset
The dataset used in this study is described in detail in (Kelm et al., 2016; West et al., 2018a). The data included DWI and EM-histology data in an ex-vivo cohort of N = 15 mice. Six of which were healthy controls (i.e. NControls = 6) and nine were genetically modified mouse models: three Pten CKO (hypermyelinated), three Rictor CKO (hypomyelinated) and three Tsc2 CKO (severely hypomyelinated), i.e. (NPten = NRictor = NT sc2 = 3). In each mouse model, DWI-based axonal water fraction estimates acquired at 15.2T were available from four DWI-models (AW with ∈ {DWI WMTI, NODDI, NODDI-DTI, JESP+/-}) and EM metrics α and μ in four ROIs, three in the corpus callosum (genu, mid-body, splenium) and one ROI in the fornix as indicated by the colored boxes in Fig. 1. In total, this resulted in N = 60 numerical values (15 mice x 4 ROIs) for each EM and DWI metric. Resolution in DWI was 150 × 150 μm2, i.e. 22500 μm2 cross-sectional voxel area. EM-based tissue metrics were assessed on images of size 2304 × 1888 px (controls) and 2048 × 1632 px (Pten, Rictor and Tsc2) at a resolution of 0.004 × 0.009 μm2, i.e. with a total area of ≈ 156 μm2 or ≈ 126 μm2, respectively. Eight data points violating the DWI-model conditions of NODDI-DTI and JESP+/- were excluded from all further analyses, i.e. all analyses were based on the remaining N = 52 data points. All DWI-models assume that WM fibres are impermeable sticks with no diffusion perpendicular to their orientation (Novikov et al., 2018b, 2019). EM-section size ranged between ≈ 10 × 10 to 40 × 40μm2 with 0.022μm thickness, while DWI resolution was 150 × 150 × 150μm3.
For a summary of the biophysical output parameters of the DWI-models see table 2. All DWI-models except NODDI took as input all or a subset of the 21 standard diffusion-kurtosis-imaging (DKI) parameters, i.e., the five independent elements of the diffusion tensor and 16 independent elements of the kurtosis tensor. The DKI-parameters were estimated using the non-linear least squares DKI-framework implemented in the ACID toolbox (https://www.diffusiontools.com).
WMTI: AW was estimated using the WMTI model (Fieremans et al., 2011) implemented in (https://github.com/m-ama/DKI-Designer) using all 21 DKI-parameters as input. Free bio-physical parameters of WMTI are the compartmental diffusivities and the axonal water fraction. WM fibres are assumed to be in parallel.
JESP+/JESP-: AW was estimated using an in-house fitting algorithm implementation of the biophysical model introduced by (Jespersen et al., 2018) including two branches (JESP+ and JESP-). Input parameters were the following five DKI-parameters: parallel diffusivity D, perpendicular diffusivity D⊥, parallel kurtosis W, perpendicular kurtosis W⊥, and mean kurtosis ⟨W⟩. Free parameters of the JESP DWI-model are like for WMTI but in addition also axially symmetric fibre dispersion (κ) is accounted for via the Watson distribution.
NODDI: AW was estimated from the ex-vivo NODDI model (Zhang et al., 2012) implemented in the NODDI MATLAB toolbox (https://www.nitrc.org/projects/noddi_toolbox). In contrast to the other DWI-models, NODDI took as input directly the DWI-signal. Moreover, for the ex-vivo case NODDI features foru tissue compartments: axonal, extra-cellular, isotropic, and dot compartment. NODDI accounts for axially symmetric fibre dispersion but fixes the diffusivities of the compartments as follows: parallel diffusivities in the axonal and the extracellular spaces are the same, and the perpendicular diffusivity of the extracellular compartment is related to the parallel diffusivity via a tortuosity assumption (Szafer et al., 1995). Furthermore, the fixed parallel diffusivity (0.35 μm2ms−1) was chosen so that the correlation between MRI and histology was maximised (West et al., 2018a).
NODDI-DTI: AW was determined from the aforementioned DKI fit using the fractional anisotropy (FA) and mean diffusivity (MD) from the standard DKI model as input. The FA and MD maps used as input for NODDI-DTI were calculated from the DKI fit as recommended in (Edwards et al., 2017) to avoid the kurtosis bias in MD. Model assumptions are the same as for NODDI but with νiso = νdot = 0.
3.1.1. Statistical analysis of differences between the EM-based metrics of mouse models
We assessed differences in α across the mouse-models in terms of an ANOVA with the Null hypothesis that the mean value of α was the same across all models.
3.2. Calibration parameter combinations
While the volume fraction of unmyelinated axons fA,U was not assessed with EM histology, it probably contributes to the DWI-based estimate of the axonal water fraction (Beaulieu & Allen, 1994; Sepehrband et al., 2016). To test this hypothesis it was assumed that the DWI-based estimate for the axonal water fraction was accurate, i.e. AW = fA for all DWI-models. This defined our baseline. We pooled the 15 individual mice and four ROIs (excluding the eight invalid data points) into two groups according to the results from an ANOVA: (group 1: comprising healthy controls and only moderately hyper- or hypomyelinated mice) controls, Pten, Rictor and (group 2: heavily hypomyelinated mice) Tsc2, respectively, since we observed only a significant difference in the EM-based axonal volume fraction α between these two groups but not between any of the mouse models in the first group. Then we allowed for the estimation of individual average values of the fraction of unmyelinated axons in each of the two groups (1: Controls, Pten, Rictor, and 2: Tsc2). For the purpose of optimisation they were written as column vectors Uj = Ujej (with Uj being the mean fraction of unmyelinated axons of group j and ej being a Nj × 1 vector of ones) with j ∈ {1, 2}, N1 = 41, and N2 = 11 (for all DWI models). In this notation Eq. 3 including an offset calibration (Eq.5) and scalar scaling (Eq.6) calibration reads where U = [U1, U2]T, and μ and AW indicate column vectors whose components are sorted in agreement with U and s is the scaling calibration parameter. To assess the sensitivity of DWI-based axonal metrics to the fraction of unmyelinated axons either a single group was allowed to vary while the other was fixed to zero, i.e. U1 ≠ 0 and U2 ≠ 0 or U1 ≠ 0 and U2 ≠ 0, and also both groups were allowed to vary individually at the same time, i.e. U1 ≠ U2 ≠ 0. For each DWI-model, we analysed six combinations of the calibration parameters, denoted in the following as {U1}, {U2}, {s}, {U1, U2}, {U1, s}, {U2, s}, {U1, U2, s}, and the baseline {}.
3.3. Calibration parameter estimation
The volume fractions of unmyelinated axons Uj and the scaling parameter s were estimated by minimising the residual-sum-of-squares (RSS) between the DWI-based estimate for the axonal volume (Eq. 12) and the EM-based gold standard (defined in Eq. 4): where again the bold-faced quantities represent vectors including all available numerical values assembled into column vectors. In order to ensure physically reasonable estimates of the axon volume fraction, the optimization function 7 had to be complemented by two boundary conditions. The first constraint concerns the upper limit of the sum of volume fractions, i.e., A+μ ≤ 1. The second set of constraints is concerned with the scaling parameter s (Eq. 6), which is required to yield values larger or equal to zero, i.e., sAW,DWI ≥ 0. All parameter estimations were performed using Matlab 2020a (Mathworks, CA, USA).
3.4. Calibration parameter selection
To quantify the intra-model performance improvement of each DWI-model due to the calibration parameters Uj and s, we used the Bayesian information criterion (BIC) (Burnham et al., 2002): where k is the number of model parameters, which varied between zero (baseline {}) and three depending on the combination of Uj, n is the number of evaluated data points, and RSS is defined in Eq. 13. The BIC measures a model’s capability of explaining given data while penalising overfitting. A lower BIC indicates less information loss, meaning that the model with the lowest BIC best explains the data. Since we employed the uncalibrated case {} as baseline, we only report differences ΔBIC with respect to this case, i.e. ΔBIC was always calculated using all available data. For assessing the variation in Uj and s, we performed a leave-one-out analysis by successively discarding the data of one mouse individually until each mouse was left out once.
3.5. Correspondence to EM data
To asses the models’ capability to explain the EM-based gold standard, we performed a Bland-Altman (BA) analysis (Martin Bland & Altman, 1986) of the differences versus the mean
As usual, the error given by is reported. Furthermore, we also report the mean difference ⟨δ⟩, i.e. the bias, and bias and error relative to the dynamic range in the EM-based axonal metric, i.e. and where Δα = αmax − αmin and angles indicate average.
4. Results
We tested the hypothesis that linear calibration including a scaling parameter s accounting for compartmental relaxation, and an appropriate number of offsets Uj accounting for the volume fraction of unmyelinated axons in the different groups of mice (see Eq. 12), can improve the accuracy of DWI-based axonal volume estimates of four DWI-models (WMTI, JESP+/-, NODDI, and NODDI-DTI). Furthermore on the basis of a simple DWI-signal expression including compartmental T2 (Eq. 8), we predicted the scaling calibration (Eq. 9) and analysed how much improvement can be achieved if the scaling is fixed to the predicted values and only the offset is estimated on the basis of data. Our analyses can be divided into four steps.
First, we statistically assessed differences of the mouse models with respect to the EM-based axonal volume α. The maximum number of mouse models that could be discriminated statistically corresponded to the maximum number of offset parameters that were used in the subsequent analyses.
In a second step, we determined via data fitting, which combination of calibration parameters has the highest evidence of improving the one-to-one correspondence between DWI-based axonal volume A and its EM-based counterpart α. To this end we employed the Bayesian Information Criterion (BIC in Eqs. 14 and 15).
Third, we fixed the scaling parameter of the best calibration parameter combination determined in the previous analysis to the value predicted by our theory and only determined the remaining offset as in the second step via a fit to the data.
Finally, we compared the accuracy of A for all DWI-models in terms of relative bias and error (Eqs. 16 - 19) between the axonal volume fraction from DWI, A, and EM, α, for three combinations of calibration parameters: (i) the baseline with no additional calibration, (ii) the best combination determined in the second step, and (iii) the best combination but with the scaling fixed to the predicted value.
4.1. Statistical analysis of differences between the EM-based metrics of mouse models
To prevent subsequent parameter optimisation from modeling noisy data, we performed an ANOVA on the EM-based gold standard axonal volume fraction α. For this analysis, we assumed that the total axonal volume fraction, i.e. the sum of unmyelinated and myelinated axons, is similar across all mouse models and thus the measured differences in α essentially reflect the differences in fA,U. The result of the analysis shown in Fig. 2 revealed a significant (p < 0.05) difference between the Tsc2 mice and any of the other models, while no significant differences were observed among Pten, Rictor and Controls. As a consequence, the four mouse models were pooled into two groups, (1) controls, Pten, Rictor, and (2) Tsc2 for further analysis. For each group, one offset parameter correcting for the fraction of unmyelinated axons was introduced: U1 for group 1 and U2 for group 2.
4.2. Calibration parameter selection
For selecting the best combination of the offset calibration parameters, U1 and U2 for the two groups of mice, and the scaling factor s, we tested all possible combinations of calibration parameters. As optimisation function we used the residual-sum-of-squares between A and α (Eq. 13). To evaluate each model we determined the BIC (Eq. 14) and report the differences ΔBIC (Eq. 15) with respect to the uncalibrated case (baseline). The ΔBIC for the tested parameter combinations are shown in Fig. 3 for each DWI model separately. Greatest evidence for improvement was achieved in most of the DWI-models for the {U2, s} combination of calibration parameters, i.e. when the fraction of unmyelinated axons for the severely hypomyelinated group 2 (U2) was included together with the scaling (s), except for JESP- and NODDI, for which {U2} and {U2, s} performed equally well.
4.2.1. Best performing calibration parameter combinations
Table 4 summarises the BIC, volume fractions of unmyelinated axons U2, scaling s as determined based on data. Values are given the for the baseline ({}) without calibration and for the best combination of calibration parameters as indicated in Fig. 3. For a summary of all validated calibration parameter combinations see table A.6 in the appendix. The estimated average volume fractions of unmyelinated axons U2 for the Tsc2 mouse-model varied between 0.19 - 0.30 for WMTI, JESP, and NODDI, while it was much lower with 0.08 for NODDI-DTI. The scaling varied between 0.6 and 0.97 (note that a scaling s = 1 is equivalent to no scaling calibration).
4.3. Prediction of the scaling calibration factor from theory
Based on a simple model of the DWI-signal including different T2-times in the compartments (Eq. 8), we derived analytical expressions of the scaling calibration for WMTI, JESP+/-, and NODDI-DTI and for NODDI (Eq. 9). Using T2 times (section 2.1.1) metrics (section 2.1.2) from the literature and we found spred ≈ 0.91 for NODDI and spred ≈ 0.883 for the other DWI-models. Table 4 shows that the smallest relative difference between fitted and predicted scaling Δs was found for NODDI (3%) and the largest relative difference was found for JESP+ (−31%). Details about how the scaling was predicted are given in the corresponding methods sections.
4.4. Correspondence to EM data before and after calibration
We assessed the one-to-one correspondence of the DWI-based axonal volume fraction A to the EM-based axonal volume fraction α for the baseline and for the best performing calibration parameter combination {U2, s} from the previous analyses. Furthermore, we quantified change of the accuracy, gained by introducing the two calibration parameters, when the scaling is replaced with the value predicted by theory and only U2 was determined based on data, i.e. for the combination {U2, spred}. To this end we report a Bland-Altman-analysis of the bias and variance. Moreover, we report bias and variance relative to the dynamic range (Δα) observed in the gold standard (see Eq. 18 and Eq. 19).
In Fig. 4 we compare different scatter-plots of the histological gold standard α versus its DWI-based counterpart A for the calibration parameters combinations (i)-(iii) described in the introduction of the results. The first row of the figure shows the baseline (i), i.e. without any calibration parameters. WMTI and JESP+ clearly overestimated the axonal volume fraction in both groups of mice indicated by the global offset from the line of unity. For JESP- and NODDI only the Tsc2 mice featured an obvious positive offset, while for NODDI-DTI all mouse models showed considerably better one-to-one mapping, although with large variance along A. The second row shows the two-parameter calibration using {U2, s}, which performed the best for all DWI-models (ii). A substantially better one-to-one mapping was observed for all models except for NODDI-DTI, whereby WMTI and JESP+ appear to benefit the most by the additional calibration. The third row shows the scatter-plots for the calibration parameter combination {U2, spred}, i.e. when the scaling was fixed to its predicted value and only the offset was determined via fit to the data (iii). A similar degree of improvement as for {U2, s} (second row) was observed for all models except JESP+.
The capability to predict the EM-based gold standard is quantified in terms of Bland-Altman (BA) plots shown in Fig. 5 and bias and error relative to the dynamic range of the EM gold standard summarised in table 5. The results for the same calibration parameter combinations (i)-(iii) as in Fig. 4 are shown. The BA-plots show a substantial reduction in bias and error for the best calibration parameter combination {U2, s} for all DWI-models, except for the bias of NODDI-DTI, for which the bias increased while the error decreased. Bias (error) relative to the dynamic range in the gold standard α was lowest for WMTI 0%(22%), followed by JESP+ 0%(24%), JESP-2%(26%), NODDI 3%(36%), and NODDI-DTI 3%(46%). When the scaling was fixed to its predicted value, the relative bias and error increased only by a few percent except for JESP+, indicating that the predicted scaling factor can be used as a proxy without substantial loss in accuracy. For JESP+ the increase was larger, but relative error and bias were still lower than in case of no additional calibration.
5. Discussion
In this study we verified the hypothesis that linear calibration improves the accuracy of axonal volume fraction estimates from a range of DWI-based models with varying complexity. Using a multi-modal dataset of ex-vivo mouse models with varying degrees of myelination, we could identify two biophysically motivated calibration parameters, which substantially improve the accuracy of DWI-based axonal volume fraction estimates: one offset accounting for the fraction of unmyelinated axons of the most severely hypomyelinated mouse model, and a scaling factor accounting for compartmental differences in T2-relaxation. We propose a hybrid method to determine these two calibration parameters, in which the scaling is determined analytically and the offset is estimated from multi-modal data.
5.1. Calibration parameters
The biophysical interpretation of the fitted calibration parameters provides new insights about the DWI-models. First, it revealed that the sensitivity to the fraction of unmyelinated axons of investigated DWI-models is rather limited. Including the fraction of unmyelinated axons could substantially improve the model performance, but only an effect due to the most hypomyelinated mouse model could be detected (U2). For the first group of less affected mouse models the fraction of unmyelinated axons (modeled by U1) could not be detected. Furthermore, on the basis of a simple approximation, we expect that the fraction of unmyelinated axons U2 in hypomyelinated mice (ranging from 0.08 (NODDI-DTI) to 0.22 (JESP+/-)) was underestimated as well. This expectation is based on the approximation that the total axonal volume fraction (i.e. the sum of myelinated and unmyelinated axons) is the same for all mouse models although their relative proportion might change across mouse models. Given this approximation, the fraction of unmyelinated axons can be estimated as follows: observing from Fig. 2 that the fraction of myelinated axons is about 0.35 and taking the percentage (of the fraction of all axons) of unmyelinated axons reported in the literature, e.g. 33% in (Abdollahzadeh et al., 2019) or 30% in (Jelescu et al., 2016), the total axonal volume would approximately be given by ≈ 0.35/(1.0 − 0.33) ≈ 0.50 to 0.52. Assuming this total axonal volume fraction in Tsc2 mice (we used 0.5), we can estimate from Fig. 2 the fraction of unmyelinated axons to be 0.4, which is larger than the DWI-model-based predictions. While our results confirm the knowledge that the unmyelinated axons contribute to the DWI-signal in general (Beaulieu & Allen, 1994) (Takahashi et al., 2002) (Beaulieu, 2009), they additionally suggest a rather limited sensitivity to this fraction of axons.
Second, differences between the fitted and biophysically predicted scaling parameters divide the DWI-models into two groups: WMTI and JESP+ yield values below the theoretical value, and JESP-, NODDI, and NODDI-DTI yield values larger than predicted. In part this might be related to underlying non-uniqueness of solutions of the standard model (Jelescu et al., 2016; Novikov et al., 2018a). Hereby, WMTI and JESP+ employ the positive branch of the solutions, while JESP-represents the negative branch. In turn, NODDI and NODDI-DTI impose constraints on the relation between the axonal and the extracellular diffusivities. The intra- and extracellular diffusivities, however, determine the compartmental signals and hence constraints on them such as, e.g. fixed diffusivities or the tortuosity condition, could affect the estimated scaling. Interestingly, our findings for the scaling s, compared to the theoretically predicted value spred, are in favor of the negative branch JESP-, which contradicts the common agreement in the literature that the positive branch JESP+ yields more realistic model parameters than the negative branch (Jelescu et al., 2020). This apparent contradiction could be related to the neglection of macromolecules other than in myelin in our tissue model, e.g. in the membranes of astrocytes. This means the rescaling of the axonal water fraction given by Eq. 3 should more rigorously be 1 − μ − fNM, where fNM would account for non-myelin macromolecules. As a consequence, one would expect the scaling calibration parameter s to be smaller than the theoretical scaling parameter spred.
5.2. Impact of calibration parameters to the accuracy of DWI-models
There are a number of observations related to the response of the tested DWI-models with respect to the calibration parameters and in comparison with each other that deserves further discussion. While without calibration all DWI-models are similarly inaccurate (, see table 5), DWI-models with fewer free model parameters improve less through calibration. While WMTI benefits the most from calibration, followed by JESP+, and JESP-, calibration had much less of an impact on NODDI, and finally NODDI-DTI hardly benefits from any of the calibration parameters. Thereby it is striking that the accuracy of the DWI-models, which fit the compartmental diffusivities, improves the most. The observation that WMTI seems to be superior to JESP was surprising because JESP also accounts for fibre dispersion whereas WMTI does not. A possible explanation could be that the larger number of free parameters in the JESP-model leads to a less well conditioned optimisation problem, which makes JESP potentially more prone to noise. The additional drop in the impact of the calibration parameters from NODDI to NODDI-DTI could be explained by the fact that NODDI is modeling two additional compartments (isotropic and dot) whereas NODDI-DTI is not. Interestingly, NODDI-DTI had the best one-to-one correspondence for the baseline, i.e. without calibration parameters, as seen in the scatter plots, which could be due to the fact that in the implementation of NODDI-DTI in the ACID toolbox (https://www.diffusiontools.com) voxels violating NODDI-DTI model assumptions are automatically identified and were removed in our study from any further analysis for all DWI-models. If only a single calibration parameter was estimated, JESP- and WMTI performed best followed by NODDI, whereas JESP+ improved less in terms of relative error and NODDI-DTI hardly showed any improvement. Here, it is also worth noting the different behaviour of the two branches JESP+ and JESP-when a second calibration parameter is included. In contrast to the positive branch, JESP-does not improve through the additional scaling. This might be due to the absence of proper minima in the optimisation function of JESP- as indicated in the original publication (Jespersen et al., 2018). Therefore, it seems recommended to treat the parameters of the JESP-branch with some caution.
5.3. Practical impact
Our findings have a potentially significant impact on the interpretation of existing neuroscience studies using DWI-based biophysical models to estimate the axonal volume fraction. We showed that commonly used DWI-based metrics of the axonal volume fraction, e.g. from WMTI and NODDI, possess a large error (46-53%, see table 5) if no calibration is used and thus biophysical interpretation of the results should be avoided. This is particularly important for MR-based g-ratio mapping where the axonal volume fraction from NODDI or WMTI is combined with a metric of the myelin volume fraction. Our study shows that additional calibration of the DWI-based metric can substantially improve the accuracy of axonal volume fraction estimation and thus should be employed for MR-based g-ratio mapping. Furthermore, the biophysical interpretation of the calibration parameters have practical impact. For example, we demonstrated for the standard DWI and the NODDI signal models with compartmental T2-dependence, that the scaling parameter for the calibration of the axonal volume can be predicted independently of the MRI protocol if the compartmental T2-values are known. Furthermore, using the predicted values and an offset U2 determined based on data achieved similar accuracy to estimating both calibration parameters based on EM histology data. This is of practical relevance because it allows the remaining offset calibration parameter to be estimated from a limited amount of multi-modal data and thus makes the proposed method usable in human brain data. Moreover, our finding that the contribution of the fraction of unmyelinated axons to the DWI-signal was only detectable with the investigated DWI-models for the severely hypomyelinated mouse model is of practical importance in clinical research. For example, it was suggested that it is unlikely that the changes of the axonal volume fraction observed in multiple sclerosis patients (Yu et al., 2019) are directly driven by the fraction of unmyelinated axons.
5.4. Limitations
Although the additional calibration parameters substantially improved the investigated DWI-models’ accuracy, the error relative to the dynamic range in the gold standard remains rather large (22% for the best model, WMTI). This remaining, rather large error may partly be attributed to a potentially large variance in the gold standard originating in the relatively small EM-section size which is probably not sufficient to representatively capture the distribution of axons in the MRI voxels (cross-sectional area of MRI-voxels was ≈ 144 (for controls) or ≈ 187 (for Pten, Rictor, and Tsc2) times larger than for EM-sections). Also the fact that our measure for the DWI-based axonal volume A is actually a hybrid DWI-EM-measure cannot entirely be excluded as an additional source of variance. However, according to the literature the EM-based myelin volume μ can be assumed to be rather accurate (West et al., 2018b)), hence unwanted variance in A is more likely due to the DWI-based axonal water fraction AW than due to the EM-based μ. We favored this approach over an approach which would have involved an MRI-biomarker of the myelin volume fraction to avoid ambiguities since it would be unclear whether any observed improvement through calibration should be attributed to a correction of MRI-based myelin volume or DWI-based axonal volume. Finally, we estimated the theoretical scaling factors on the basis of in-vivo compartmental T2 values rescaled from 3T to 15.2T by a factor estimated from ex-vivo values in human brain and finally compared it to ex-vivo mouse models. Despite these limitations the predicted scaling factors spred improved the accuracy of most of the DWI-models compared to the case where the scaling is neglected (see table A.6), indicating that the chosen approach to estimate the scaling factor is valid.
5.5. Conclusion
In summary, we demonstrated that two biophysically motivated calibration parameters, an offset accounting for the fraction of unmyelinated axons and a scaling factor accounting for compartmental T2 differences, can improve the accuracy of four DWI-based models of the axonal volume fraction. Our findings suggest that after calibration WMTI was the most accurate of the tested DWI-models, followed by JESP+ and NODDI. NODDI-DTI hardly improved through calibration, indicating an interaction between free model parameters and efficacy of calibration. The fact that calibration improved the accuracy of the DWI-models opens the perspective to use calibrated DWI-models as an alternative to more complex biophysical models, which typically require more elaborate data acquisitions and may be prone to numerical instability. On the other hand, once determined the biophysical interpretation of the calibration parameters enables their subsequent application to more complex models as fixed model parameters.
Acknowledgements
The research leading to these results has received funding from the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013) / ERC grant agreement No. 616905.
This work was supported by the German Research Foundation (DFG Priority Program 2041 “Computational Connectomics”, [MO 2397/5-1; MO 2249/3-1; GE 2967/1-1], by the Emmy Noether Stipend: MO 2397/4-1) and by the BMBF (01EW1711A and B) in the framework of ERA-NET NEURON and the Forschungszentrums Medizintechnik Hamburg (fmthh; grant 01fmthh2017).