Abstract
Objective HIV testing services (HTS) are a crucial component of national HIV responses. Learning one’s HIV diagnosis is the entry point to accessing life-saving antiretroviral treatment and care. Recognizing the critical role of HTS, the Joint United Nations Programme on HIV/AIDS (UNAIDS) launched the 90-90-90 targets stipulating that by 2020, 90% of people living with HIV know their status, 90% of those who know their status receive antiretroviral therapy, and 90% of those on treatment have a suppressed viral load. Countries will need to regularly monitor progress on these three indicators. Estimating the proportion of people living with HIV who know their status (i.e., the “first 90”), however, is difficult.
Methods We developed a mathematical model (henceforth referred to as “F90”) that formally synthesizes population-based survey and HTS program data to estimate HIV status awareness over time. The proposed model uses country-specific HIV epidemic parameters from the standard UNAIDS Spectrum model to produce outputs that are consistent with other national HIV estimates. The F90 model provides estimates of HIV testing history, diagnosis rates, and knowledge of HIV status by age and sex. We validate the F90 model using both in-sample comparisons and out-of-sample predictions using data from three countries: Côte d’Ivoire, Malawi, and Mozambique.
Results In-sample comparisons suggest that the F90 model can accurately reproduce longitudinal sex-specific trends in HIV testing. Out-of-sample predictions of the fraction of PLHIV ever tested over a 4-to-6-year time horizon are also in good agreement with empirical survey estimates. Importantly, out-of-sample predictions of HIV knowledge are consistent (i.e., within 4% points) with those of the fully calibrated model in the three countries, when HTS program data are included. The F90 model’s predictions of knowledge of status are higher than available self-reported HIV awareness estimates, however, suggesting –in line with previous studies– that these self-reports are affected by non-disclosure of HIV status awareness.
Conclusion Knowledge of HIV status is a key indicator to monitor progress, identify bottlenecks, and target HIV responses. The F90 model can help countries track progress towards their “first 90” by leveraging surveys of HIV testing behaviors and annual HTS program data.
Introduction
HIV testing services (HTS) are the entry point for diagnosis and access to life-saving antiretroviral therapy (ART)[1]. Early diagnosis and initiation of ART have been shown to drastically decrease viral load, which reduces individual morbidity and mortality, and limits onward HIV transmission[2]. HTS can also offer a pathway for primary prevention interventions, including programs to deliver pre-exposure prophylaxis, voluntary medical male circumcision, and prevention of mother-to-child-transmission.
Recognizing the critical role of HTS in a country’s national response the Joint United Nations Programme on HIV/AIDS (UNAIDS) launched in 2014 the 90-90-90 targets stipulating that by 2020, 90% of people living with HIV (PLHIV) know their status, 90% of PLHIV who know their status receive ART, and 90% of those on treatment have a suppressed viral load[3–5]. To reach those targets, countries need to monitor progress on these three indicators, identify bottlenecks, and implement or adapt targeted testing and treatment services in a timely manner.
As of 2017, UNAIDS estimates that the largest gap globally in achieving the 90-90-90 targets is access to HIV testing, with about 25% of PLHIV estimated to not know their HIV status. Estimating the proportion of PLHIV who know their status (i.e., the “first 90”), however, is difficult. In countries with robust and comprehensive HIV case surveillance systems, the proportion of diagnosed PLHIV can be estimated by triangulating HIV incidence and mortality with the cumulative number of new HIV diagnoses annually. In sub-Saharan Africa (SSA), where more than two-thirds of PLHIV reside[6], surveillance systems are not sufficiently developed. Many countries estimate the proportion of PLHIV who know their status primarily from nationally representative household surveys.
Most Demographic and Health Surveys (DHS) and AIDS Indicator Surveys (AIS) in SSA include HIV serology, with respondents self-reporting whether they have ever been tested for HIV, but are rarely being asked directly if they are aware of their HIV status. The proportion of HIV positive respondents who report ever having been tested for HIV serves as an upper bound for the level of HIV awareness, since the last HIV test might have been HIV-negative (i.e., occurring before the person seroconverted). In recent years, Population-based HIV Impact Assessments (PHIA) surveys and a few other surveys conducted in SSA countries have collected information on both HIV seroprevalence and self-reported awareness status. These data have been used directly to estimate the “first 90”[7, 8]. However, comparison of self-reported awareness of HIV status with biomarker measurements of antiretroviral usage and viral load suppression reveals sometimes substantial non-disclosure of awareness of HIV status for persons who are on ART[8, 9], and potentially greater non-disclosure among those who are not on ART[10, 11].
The infrequency of large population-based seroprevalence surveys, which are typically conducted every 5 years, also hampers regular monitoring of HIV awareness[12]. UNAIDS has previously estimated the change in knowledge of status over time in countries with survey data by applying additional increases in knowledge of status proportional to the scale-up in ART coverage between the current reporting year and the year of the last survey[13]. However, there is a need to better estimate progress towards the “first 90” in relation to changes in ART coverage and HTS program efforts[14]. For example, the relationship between ART coverage and knowledge of status has likely changed as a function of eligibility for treatment initiation. Further, programmatic data of the numbers of people tested and those testing HIV-positive could help to inform changes in testing levels, although it is important to capture changes in testing patterns and retesting rates over time.
To address these challenges, we developed a mathematical model –henceforth referred to as the “F90 model”– that formally synthesizes population-based surveys and HTS program data within a Bayesian framework to estimate knowledge of status among people (≥15 years) over time in SSA. F90 estimates HIV testing and diagnosis rates over time by age, sex, and previous HIV testing history, and to generate estimates of the “first 90” and other indicators of interest such as positivity among HIV testers and yield of new HIV diagnoses. Key features of this new F90 model include:
takes as inputs—and therefore is fully consistent with—national modeled estimates of HIV prevalence, incidence, mortality, and ART coverage derived using the UNAIDS-supported Spectrum modeling software.
uses data about self-reported HIV testing history from surveys that both include and do not include HIV serology testing.
incorporates programmatic data about annual numbers of HIV tests administered (e.g., testing volume) and number of positive HIV tests (positivity) where available.
Methods
Modeling framework
To estimate knowledge of status, the F90 model uses as inputs annual estimates of HIV incidence, HIV prevalence, mortality, and ART coverage developed by countries and published by UNAIDS[15]. At the heart of the annual estimation process is Spectrum’s AIDS Impact Module and its Estimation and Projection Package (EPP)[16]. The Spectrum model, its assumptions, data requirements, and software are described in detail elsewhere[17]. Importantly for the new F90 model, Spectrum produces epidemic statistics stratified by age and sex, CD4+ cell count category, and ART status.
In the F90 model, we extend the existing Spectrum model structure to further stratify the population aged 15 years and older by their HIV testing histories and, among PLHIV, by knowledge of status. This extension is adapted from a previously developed model for South Africa[18]. Uptake of HTS is dynamically modeled using a deterministic framework based on a system of ordinary differential equations. A schematic of the compartmental flows between these different stratifications is presented in Figure 1.
Inter-compartmental flow describing HIV testing uptake as a function of HIV status (susceptible versus living with HIV), testing history (never versus ever tested), HIV awareness status and antiretroviral treatment (ART) status. In rare instances, rapid ART scale-up depletes the compartment of PLHIV aware not on treatment. In this case, individuals newly initiated on ART (in a proportion relative to the size of PLHIV ever/never tested) are assumed to be immediately put on ART after diagnosis. These rates are informed by Spectrum/EPP.
Model specification
The rate τkius(t) at which individuals are tested for HIV varies by calendar time (t), gender (k), age (i), HIV testing history and awareness status (u), and, for PLHIV, CD4+ cell count (s). Specifically, it takes the following form:
Here, b(t) is the referent testing rate for women in the 15-24 age group for calendar year t, which is assumed to be negligible in sub-Saharan Africa before 1995. Between 1995 and 2000, the HIV testing rate is assumed to increase linearly to β2000 in 2000 and, after that date, when nationally representative survey data become widely available, log(b(t>2000)) is modeled as a first-order random walk (RW1) with annual steps. Mk(t) is the HIV testing rate ratio for men (k=1) age 15-24 years relative to women age 15-24 at time t. Rate ratios are piecewise linear over time: they are equal to ω2005, before 2005 M1(t≤2005) and increase to ω2012 at which time they remain constant at M1(t≥2012) = ω2012. Large changes between ω2005 and ω2012 are penalized using a RW1 process on the log-transformed male rate ratios. This specification, allowing a change in the relative testing rate by sex, was chosen to allow for the scaling-up of prevention of mother-to-child transmission programs after 2005 in sub-Saharan Africa countries[19, 20] which would necessarily have affected differences in uptake of HIV testing between men and women. The term RRki is the age/sex-specific HIV testing rate ratio for ages 15-24 (i=1), 25-34 (i=2), 34-49 (i=3), and 50+ (i=4) age groups, which are assumed to be time-invariant[7, 18, 21, 22].
The term Fu(t) allows for potential differences in HIV testing rates according to prior HIV testing history and HIV status between HIV-susceptible never tested (u=1), HIV-susceptible previously tested (u=2), PLHIV never tested (u=3), PLHIV unaware ever tested (u=4), PLHIV aware not on treatment (u=5), and PLHIV on ART (u=6). In many SSA countries, a substantial fraction of the population is tested every year but the proportion of people reporting being ever tested remains lower than what would be expected if everybody in the population tested at an equal rate. Reconciling these data suggests that rates of HIV testing must be higher among people who have previously been tested for HIV[23–27]. Further, the number of positive tests is often very large, such that the cumulative number of positive HIV tests reported by HTS programs substantially outstrips the number of PLHIV who could have been newly diagnosed. This could entail that a non-negligible fraction of PLHIV aware of their status and PLHIV receiving ART are also re-tested for HIV each year[28, 29]. For example, in many countries (e.g., Côte d’Ivoire[30], Mozambique (F. Mbofana, pers. comm.), Senegal[31], Sierra Leone[32], U ganda[33]), the annual numbers of positive tests reported often represent up to 25-30% of the whole estimated population of PLHIV, which is inconsistent with survey data on the proportion of PLHIV ever tested. To reproduce the number of positive tests, we allowed testing rates for PLHIV aware of their status to vary with time. The main studies informing differential testing rates are summarized in supplementary material (Tables S1-S2).
Finally, we consider that HTS uptake will depend on the proportion of PLHIV experiencing HIV/AIDS-related symptoms who are not on ART. OIs is the time-invariant incidence of opportunistic infection by CD4+ cell count category s [34, 35] (as tracked in Spectrum) and ρk(t) is the sex-specific proportion of these infections that are tested for HIV at time t (and that can reach a maximum value of 95%). This proportion ρk(t) is assumed to be proportionally related to the sex-specific ART coverage through a δ parameter that is calibrated. These parameters are further described in Table 1.
Description of the F90 model parameters, their symbols, and values or prior distributions.
List of surveys of with information on the proportion of respondents having ever been tested for HIV (2000-2017) and HIV testing services program data used to calibrate the F90 model in Côte d’Ivoire, Malawi, and Mozambique.
Data sources, likelihood function, and model calibration
Two main data sources are used for model calibration: 1) household survey data about the proportion of adults who have ever been tested for HIV and 2) HTS program data about the total number of HIV tests conducted each year and number of HIV positive tests. For national surveys, we used the proportion of respondents reporting having “ever been tested and received the result of the last HIV test”, stratified by sex, age (15-24, 25-34, and 35-49), and, if available, HIV serostatus from nationally representative household surveys, including DHS, AIS, Multiple Indicator Cluster Surveys (MICS), PHIA surveys, and relevant country-specific surveys (e.g., HSRC, KAIS). For surveys that do not include HIV serostatus (e.g., some MICS and DHS), data about ever testing by age and sex, irrespective of HIV status, are used in model calibrations. Aware of potential limitations, we assume that self-reports of “ever having been tested and receiving the result of the last HIV test” are unbiased estimates of HIV testing history.
For HTS program data, the F90 model can also be calibrated to the annual number of HIV tests performed in the population (≥15 years) and, if available, the number of positive tests (≥15 years) (stratified by sex or overall). Such data may be useful to inform testing trends after the last population-based surveys have been performed. Details of the likelihood specification can be found in the supplemental material (Text S2).
Notably, we purposely excluded two commonly referenced data types from surveys as potential inputs into F90. First, information on HIV testing in the past year is not used in model calibration due to evidence that this likely overstates the true annual testing rate[18, 36], perhaps due to “telescoping bias” in which respondents may inadvertently recall testing that occurred beyond the last 12 months[37] (see supplemental materials, Text S1). Second, information on self-reported awareness of HIV-positive status, even when partially adjusted for detection of ART among PLHIV who report not knowing their status, is not incorporated due to evidence of systematic nondisclosure of knowledge of status[8–11, 38–43]. In particular, non-disclosure of HIV status was found to be 1.4 times higher among individuals not on ART in Mozambique[11] compared to those on ART. This implies that any adjustments for presence of ART metabolites are likely insufficient, especially when ART coverage is low.
Model parameters were estimated using a Bayesian framework. To constrain the parameters space to plausible values in data-limited settings, we elicited weakly informative prior distributions following a review of the literature (Table 1, Tables S1-S2). Posterior modes of model parameters were obtained via non-linear optimization using the Broyden-Fletcher-Goldfarb-Shanno algorithm[44]. The joint posterior distribution was estimated using a Laplace approximation[45, 46], and 95% credible intervals for quantities of interest were obtained by sampling 3,000 parameter sets from this approximated joint posterior distribution and summarizing the posterior of relevant outputs using the median, and 2.5th and 97.5th percentiles. Table S3 presents a comparison of coverage properties of the Laplace approximation with both Sampling Importance Resampling (SIR) and Incremental Mixture Importance Sampling (IMIS)[47] algorithms. These suggest good performance of the Laplace approximation in our setting.
All analyses were conducted in the R statistical software[48]. The system of ordinary differential equations was solved using a Euler algorithm with a time step of 0.1 years. All functions are available for download from a Github repository (https://github.com/mrc-ide/first90).
Model outputs (estimates)
The F90 model generates results for comparisons to input data and indicators of interest. It estimates the total number of tests (negatives and positives), tests among first-time testers, positivity (the percent of positive tests among all tests) and yield (the percent of new HIV diagnoses among all tests), the proportion of the population ever tested for HIV, the proportion of PLHIV who know their HIV status, and other indicators (Table S4).
Model validation
There are few empirical estimates of awareness status among PLHIV and, as described above, these estimates are likely to reflect substantial underreporting of HIV awareness[8–11, 38–43]. We therefore validated the F90 model by performing both in-sample comparisons (A) and out-of-sample predictions (B and C) of the proportion of the population ever tested for HIV (stratified by sex and HIV status). We focused our analyses on three countries with multiple surveys and availability of HTS program data: Côte d’Ivoire, Malawi, and Mozambique. For the out-of-sample predictions, we first excluded all surveys conducted after 2012 and all HTS program data after the last available pre-2012 survey (B). This was performed to examine the F90 model’s ability to predict testing histories over a time horizon of approximately 5 years (the maximum time interval often observed between two population-based surveys). We then re-calibrated the model, this time incorporating the post-2012 HTS program data. To appreciate the added value of the HTS program data sources, we re-calibrated our model both on the sex-combined (C1) and sex-disaggregated HTS data (C2). In the case of Mozambique, HTS program data were not stratified by sex and we instead used the fully-calibrated model (A) to predict sex-stratified HTS program data (2009-2017) which was then used for the out-of-sample validation (C2). The data sources used for model calibration are presented in Table 3.
Comparisons of empirical survey estimates of the proportion of individuals aged 15-49 years old ever tested for HIV (by sex and HIV status) and self-reported awareness status among PLHIV with F90 model predictions from A) the fully calibrated model and from out-of-sample predictions that B) excluded all post-2012 survey and HIV testing services (HTS) program data, C1) excluded all post-2012 survey data (included sex-combined HTS program data), and C2) excluded all post-2012 survey data but included sex-disaggregated HTS data.
Ethics
All analyses were performed on anonymized and de-identified data. Further, all DHS/AIS survey protocols have been approved by the Internal Review Board of ICF International in Calverton (USA) and by the relevant country authorities for other surveys (MICS and PHIA). Further information on the ethics approval can be found in the individual country reports. Ethics approval was obtained from McGill University’s Faculty of Medicine Institutional Review Board (A10-E72-17B).
Results
In each of the three countries, the proportion of the population reporting having ever been tested for HIV and receiving the last test’s result increased from under 15% at the beginning of the 2000s to 50% in Côte d’Ivoire (2016), 75% in Malawi (2016), and 51% in Mozambique (2015) (Figure 2). Women are more likely to report having ever been tested than men. As for age, the highest proportions of participants reporting a history of HIV testing is consistently found in the 25-34-year-old age group in all three countries. Testing among PLHIV is higher than in the general population, with survey estimates indicating that 68%, 93%, and 68% of PLHIV in Côte d’Ivoire (in 2017), Malawi (in 2016), and Mozambique (in 2015), respectively, report a history of HIV testing (Figure 2).
Comparison of calibrated F90 model fits with programmatic and survey data for Côte d’Ivoire, Malawi, and Mozambique (2000-2017). The shaded areas correspond to the 95% credible intervals of the posterior estimates.
HTS program data suggest that a high fraction of the population has been tested for HIV. For example, the reported maximum annual number of tests performed corresponds to 21% of the population aged 15-49 years old in Côte d’Ivoire, 49% in Malawi, and 59% in Mozambique (Figure 2). Concomitant with important increases in total testing volume, the number of positive tests has decreased in all three countries, resulting in downward trends in positivity rates. In addition, the number of positive tests reported in HTS program data suggests that a substantial fraction of diagnosed PLHIV could be retested every year. For example, the volume of positive tests corresponds to the equivalent of up to 30% of the total PLHIV population aged 15-49 years in Côte d’Ivoire, 29% in Malawi, and 31% in Mozambique. If these were all new diagnoses, we would expect that close to all PLHIV should be aware of their status within a short time frame.
A) In-sample comparisons – calibration on all available survey and HTS program data
The calibrated F90 models for Côte d’Ivoire, Malawi, and Mozambique can accurately reproduce HTS program data both for the number of HIV tests annually performed and for the number of those tests that are found to be positive (Figure 2). In addition, the model adequately reflects sex-specific survey estimates of the proportion of respondents ever tested for HIV. In 2017, these were estimated to be of 33%, 71%, and 42% among men in Côte d’Ivoire, Malawi, and Mozambique, respectively. Testing was notably higher among women, with 53% (Côte d’Ivoire), 86% (Malawi), and 69% (Mozambique) of women reporting having ever been tested for HIV. Overall for 2017, average testing rates were estimated to be 0.17 year−1 in Côte d’Ivoire, 0.21 year−1 in Malawi, and 0.52 year−1 in Mozambique.
The F90 model is also able to replicate longitudinal trends in the proportion of PLHIV ever tested. It is estimated that 66%, 95%, and 76% of PLHIV in Côte d’Ivoire, Malawi, and Mozambique, respectively, have ever been tested for HIV in 2017. In turn, knowledge of HIV status is estimated at 58% in Côte d’Ivoire, 84% in Malawi, and 72% in Mozambique. These numbers are within the range of values that were estimated based on the previous UNAIDS methodology for 2017 in Côte d’Ivoire (54%; uncertainty range 38-75%) and Malawi (90%; 84 to >95%), but the previous estimate was lower in Mozambique (59%; 49-70%)[49].
The F90 model also suggest important differences in knowledge of status by gender, with higher proportions of women being aware of their status than men. HIV status knowledge is higher in older age groups in all three countries. It increases from 41% among 15-24-year-olds to 65% among 35-49-years-olds in Côte d’Ivoire, from 69% (15-24 years) to 89% (35-49 years) in Malawi, and from 57% (15-24 years) to 74% (35-49 years) in Mozambique for the year 2017. The proportions of PLHIV aware of their status are higher than survey measures of self-reported awareness, when these are available (Table 3 and Figure 3), consistent with previous literature suggesting non-disclosure of awareness of HIV status. In Malawi, estimates of knowledge of status are generally between estimates of PLHIV ever tested and the proportion on ART. In Côte d’Ivoire and Mozambique, the “first 90” is closer to the proportion of PLHIV ever tested because survey and HTS program data suggest high rates of re-testing. For example, the rate ratios for re-testing were estimated to be of 3.7 in Côte d’Ivoire and 7.2 in Mozambique, as compared to 1.2 in Malawi. Posterior estimates for the main model parameters are reported in supplemental materials (Table S5).
Comparison of calibrated F90 model fits with survey data on proportion of people living with HIV (PLHIV) aged 15-49 years ever tested, model-predicted proportion of PLHIV aware of their status (“first 90”), and survey estimates of awareness status and Spectrum/EPP antiretroviral therapy (ART) coverage estimates. The shaded areas correspond to the 95% credible intervals of the posterior estimates. (Estimates used for cross-validation are shown as empty symbols).
B) Out-of-sample predictions: removing both recent survey and HTS program data
When excluding all data from surveys conducted after 2012 and HTS program data after the last survey, the F90 model predictions underestimate by 6% points the 2016 survey estimate of the proportion of the population ever tested for HIV in Côte d’Ivoire (susceptible and PLHIV combined). In Malawi, the model’s out-of-sample predictions for 2016 are higher than the survey estimates among women by 5% points and underestimate the same proportion among men by 5% points, but both are encompassed within the predictions’ uncertainty intervals (Table 3 and Figure 4). Finally, in Mozambique the proportion of women ever tested is overestimated by 4% in 2015 but, for men, the underestimation is 10% points for that same year.
Out-of-sample predictions (B; full lines) of F90 models calibrated to survey data from 2000-2012, excluding all program data, for Côte d’Ivoire, Malawi, and Mozambique and model predictions for the 2013-2017 period. Dashed lines represent predictions from the fully calibrated models. The vertical lines indicate the date of the last survey data estimates included in the fitting (to the right of the lines are the predictions). The shaded areas correspond to the 95% credible intervals of the posterior estimates. (Empty symbols indicate that these outcomes were not included in the likelihood but are shown for cross-validation purposes.)
Estimates of ever testing among PLHIV are, arguably, a more relevant outcome to the “first 90” than corresponding estimates among the overall population. For PLHIV, out-of-sample predictions are relatively accurate, even over a full 5-year time horizon for the three countries (Figure 4). In Côte d’Ivoire, the difference between the 2017 model prediction of the fraction of PLHIV ever tested and the empirical estimates is less than 3% points (for both sexes combined). A similar pattern is observed for Malawi with differences of less than 1% and 3% points between predictions and empirical estimates for women and men, respectively. In Mozambique, there are differences of 4% and 10% points of the proportion ever tested among men and women, respectively. As for the proportion of PLHIV aware of their status in 2017, the out-of-sample predictions are within 2% points of the ones obtained using full data calibration in Côte d’Ivoire and Malawi. In Mozambique, the difference is 13% points but the uncertainty intervals are very wide and encompass the estimate from the full data calibration.
C) Out-of-sample predictions: added value of HTS program data
Adding the post-2012 HTS program data (sex-combined) yields mixed results with respect to improving estimates (Figure 5, C1). It adds little to the already accurate predictions in Côte d’Ivoire. In Malawi, however, it improves estimates for women but magnifies the underestimation in men (Table 3, Figure 5). For Mozambique, HTS program data increase the accuracy of predictions for men but result in overestimating the proportion of women ever tested. Predictions of knowledge of HIV status are nevertheless within 4% points of the ones obtained using the full data calibration, and have overlapping uncertainty intervals (Table 3).
Out-of-sample predictions of F90 models calibrated to survey data from 2000-2012, including all available program data, for Côte d’Ivoire, Malawi, and Mozambique and model predictions. The top panel (C1) uses the overall (both sex combined) HIV Testing Services (HTS) program data whereas the bottom panel (C2) uses the sex-disaggregated HTS program data. Dashed lines represent predictions from the fully calibrated models. The vertical lines indicate the date of the last survey data estimates included in the fitting (to the right of the lines are the predictions). The shaded areas correspond to the 95% credible intervals of the posterior estimates. (Empty symbols indicate that these outcomes were not included in the likelihood but are shown for cross-validation purposes.)
On the other hand, the sex-disaggregated HTS program data generally increases the accuracy of the predictions –in both the overall population and among PLHIV (Figure 5, C2). In all countries, the F90 model’s predictions for the proportion of the population ever tested for HIV were ≤6% points different from the predictions obtained using the full data calibration (Table 3). Among PLHIV, all predictions had overlapping uncertainty intervals with those of the empirical survey estimates and differences were always less than 7% points. Predictions of the proportion of PLHIV aware of their status were also in very good agreement with those of the full data calibration, with differences of less than 3% points in all three countries.
Discussion
Knowledge of HIV status is a key indicator that countries need to monitor progress, identify bottlenecks, and ultimately implement effective HIV responses. In this paper, we describe a new model that combines survey and HTS program data to estimate the “first 90” in SSA. We validated the F90 model through in-sample comparisons and our results demonstrate that it can accurately reproduce longitudinal sex-specific trends in HIV testing among the overall population and, more importantly, among PLHIV. Out-of-sample predictions of the fraction of individuals ever tested over a 4-to-6-year time horizon are also in good agreement with empirical survey estimates for PLHIV. When recent population-based surveys are not available, the accuracy of the F90 model predictions for the proportion of the population ever tested for HIV is improved by the addition of sex-disaggregated HTS program data. Importantly, our out-of-sample validations provided estimates of the fraction of PLHIV aware of their status that are consistent with the ones obtained using full data calibration and their uncertainty intervals overlap.
We compared our results to empirical estimates of awareness status among PLHIV. As expected, our F90 model predictions are higher than self-reported awareness status –even adjusted for presence of antiretroviral metabolites. For example, our model-based estimates of knowledge of HIV status are 58% (95%CrI: 53-61%) and 81% (95%CrI: 79-82%) in Côte d’Ivoire and Malawi, respectively, compared to 37% (not antiretroviral metabolites-adjusted) and 76% (antiretroviral metabolites-adjusted) for PLHIV who self-reported being aware of their HIV status in the 2017 Ivoirian and 2016 Malawian surveys, respectively. The fundamental reason for the higher estimates of HIV status awareness is that the gap between the proportion of PLHIV ever tested, which are well reproduced by the model, and the proportion with knowledge of their status is constrained by the high rate of testing (i.e., any PLHIV who have ever been tested, but are not aware, must have been infected since the most recent HIV test). For the model’s predictions to be consistent with survey-based estimates of self-reported awareness, country-specific HIV incidence rates would need to be several-fold higher than the ones estimated by Spectrum/EPP and PHIA surveys and/or re-testing rates among PLHIV ever tested would have to be much lower than suggested by the survey and HTS program data. Other possible explanations include over-reporting of HIV testing history by survey respondents who were not aware, or very substantial levels of return of false-negative HIV test results, though such levels would have to be extremely high considering the high levels of re-testing.
The F90 model can be applied to countries with at least two population-based surveys that collected information on both HIV testing history and HIV prevalence. Because model predictions are expected to be more accurate over the short term, it is advisable to interpret with caution estimates produced for countries where the last population-based survey was conducted more than 5 years in the past. HTS program data on the number of tests performed should be carefully assessed to ensure that it accurately represents annual national testing volume among the population aged 15 years and over, and that it includes information from both private and public sectors. Sex-disaggregated HTS program data should be especially useful for countries without recent survey estimates of HIV testing histories. However, model predictions should be reasonably accurate, even if sex-disaggregated HTS data are unavailable, if the male/female testing ratios have remained relatively constant in recent years. Finally, to ensure some temporal degree of overlap between survey and program data is advised to facilitate estimation of re-testing parameters. The latter is especially important if countries wish to examine additional model outputs of interest. For example, the model can provide information on the distribution of negative tests among first-time and repeat testers, and the distribution of positive tests among new diagnoses, retests among aware PLHIV, and retests among PLHIV on ART (Figure 6).
Model predictions of the distribution of the annual total number of HIV negative tests performed among first-time testers versus repeat-testers, distribution of HIV positive tests by awareness status and antiretroviral treatment (ART) status, and longitudinal trends in HIV testing positivity, yield of new diagnoses, and Spectrum/EPP’s estimates of HIV prevalence (aged 15 years or more).
To facilitate model use, an online version was developed using the RShiny framework. Users can freely access the web-app (https://shiny.dide.imperial.ac.uk/shiny90/), review data sources, edit information, add new data, and run the model. It requires the users to provide a Spectrum/EPP projection file to use as input. Users can save their current analyses, perform sensitivity analyses, and export their results.
Model limitations
Our proposed approach to estimate the “first 90” has several limitations, mainly due to data considerations. First, we assumed that self-reports of ever testing are accurate. Quantifying the sensitivity and specificity of those self-reports is difficult and their accuracy could differ by HIV status[18]. However, limited evidence suggest that testing histories are probably better reported than other potential indicators[50] and incorrect reports of HIV testing history could result in underestimation of the “first 90”[51]. An additional source of uncertainty lies in the accuracy of HIV tests results provided back to HTS users. In the model, we assume that national HIV testing algorithms are accurate but some programs have reported suboptimal field sensitivity and specificity[52–54]. Second, published HTS program statistics usually relate to public sector programs and don’t necessarily reflect private sector testing, NGO testing programs, and self-testing. The latter poses additional challenges to the correct estimation of the number of HIV tests performed annually and difficulty in assessing trends over time in terms of positivity and yield of new diagnoses. We recommend sensitivity analyses to explore model robustness to assumptions regarding completeness of HTS program data. Thirdly, some national programs may have difficulties differentiating between tests performed on children aged less than 15 years from those in the modeled population. Data from Malawi suggest that children (<15 years) can comprise a small but non-negligible fraction (~16%) of overall testing volume[55], though pediatric tests account for a substantially lower fraction of HIV-positive tests due to the low HIV prevalence in children, the results of effective prevention of mother-to-child transmission programs.
Regarding model structure and assumptions, a fourth limitation is that the current model implementation does not incorporate uncertainty in both the denominator of the “first 90” and the estimated ART coverage. This may result in an underestimation of uncertainty. Finally, the model does not currently disaggregate indicators by members of key populations (e.g., men who have sex with men, female sex workers, clients) or produce estimates of HIV diagnosis among children. Key populations are important to overall transmission dynamics in several countries[56–59] and the sustainable control of HIV epidemics also hinges on also achieving the 90-90-90 targets in these groups[60]. The general framework outlined above could in theory be used to monitor awareness status for key populations, but additional challenges related to representativeness of key population surveys, among others, are expected[14].
Model strengths
Our proposed approach to estimate the proportion of PLHIV who know their status has several strengths. First, our model uses Spectrum outputs and is therefore fully consistent with other epidemiological data (e.g., sex and age-specific HIV incidence, prevalence, mortality) and programmatic outcomes (ART coverage). Second, it integrates routinely collected HTS program data with population-based surveys. This data triangulation enables monitoring of HTS’ effectiveness by providing estimates of annual new HIV diagnoses. Third, our approach attempts to overcome the limitations of self-reported knowledge of HIV status by pooling information on ART coverage, HIV re-testing rates, and HIV incidence to estimate how many PLHIV acquired their infection after their last HIV-negative test. Finally, the current framework enables us to further refine the F90 model and its assumptions as more granular program data become available (e.g., age-stratified HIV testing program data) and provides a foundational framework for future work to incorporate data about HIV testing and diagnosis into estimates of HIV incidence trends.
Conclusions
Identifying the proportion of PLHIV who know their status is challenging and relying solely on self-reported estimates of HIV awareness could be misleading. The aim of our F90 model is to triangulate different data sources to improve the accuracy of the “first 90” indicator. Beyond the estimation of HIV status knowledge, the F90 model also produces estimates of annual number of new HIV diagnoses. Such information can help countries improve the effectiveness of their HIV testing programs and assist them in reaching the first 90 target by 2020.
Authors’ contribution
CH, DB, JWE, KM, MMG, and RB conceived and designed the model. AG, AJ, AK, CD, CLD, FM, JWE, KM, and MMG obtained, administered, and processed the different databases. AG, AJ, CD, JE, JL, KM, MCB, ME, and MMG contributed to model development and/or revisions. AG, CD, CLD, JWE, and MMG performed the analyses and all authors contributed to results interpretation. MMG drafted the manuscript and all authors critically reviewed it for important intellectual content. All authors approved the final version.
Acknowledgments
We are grateful to Shelley Clark for her comments and suggestions and to Alexandra Hill and Martin Eden for help in developing the Shinny 90 app. Also to thank are Joshua Salomon, John Stover, Ray Shiraishi and other participants of the UNAIDS Reference Group on Modelling, Estimates, and Projections for useful feedback on an earlier version of the proposed modeling framework.
We acknowledge funding from the Steinberg Fund for Interdisciplinary Global Health Research (McGill University) and the Bill and Melinda Gates Foundation. MMG’s research program is funded by a career award from the Fonds de recherche du Québec – Santé. JWE was supported by UNAIDS and the Bill and Melinda Gates Foundation.