Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A Comparison of South African National HIV Incidence Estimates: A Critical Appraisal of Different Methods

  • Thomas Rehle ,

    trehle@hsrc.ac.za

    Affiliations Human Sciences Research Council, Cape Town, South Africa, Centre for Infectious Disease Epidemiology and Research, School of Public Health and Family Medicine, University of Cape Town, Cape Town, South Africa

  • Leigh Johnson,

    Affiliation Centre for Infectious Disease Epidemiology and Research, School of Public Health and Family Medicine, University of Cape Town, Cape Town, South Africa

  • Timothy Hallett,

    Affiliation Department of Infectious Disease Epidemiology, Imperial College London, London, United Kingdom

  • Mary Mahy,

    Affiliation UNAIDS, Geneva, Switzerland

  • Andrea Kim,

    Affiliation Centers for Disease Control and Prevention, Center for Global Health, Division of Global HIV/AIDS, Atlanta, GA, United States of America

  • Helen Odido,

    Affiliation UNAIDS, Pretoria, South Africa

  • Dorina Onoya,

    Affiliation Human Sciences Research Council, Cape Town, South Africa

  • Sean Jooste,

    Affiliation Human Sciences Research Council, Cape Town, South Africa

  • Olive Shisana,

    Affiliations Human Sciences Research Council, Cape Town, South Africa, Department of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa

  • Adrian Puren,

    Affiliation National Institute for Communicable Diseases, Johannesburg, South Africa

  • Bharat Parekh,

    Affiliation Centers for Disease Control and Prevention, Center for Global Health, Division of Global HIV/AIDS, Atlanta, GA, United States of America

  • John Stover

    Affiliation Futures Institute, Glastonbury, CT, United States of America

Abstract

Background

The interpretation of HIV prevalence trends is increasingly difficult as antiretroviral treatment programs expand. Reliable HIV incidence estimates are critical to monitoring transmission trends and guiding an effective national response to the epidemic.

Methods and Findings

We used a range of methods to estimate HIV incidence in South Africa: (i) an incidence testing algorithm applying the Limiting-Antigen Avidity Assay (LAg-Avidity EIA) in combination with antiretroviral drug and HIV viral load testing; (ii) a modelling technique based on the synthetic cohort principle; and (iii) two dynamic mathematical models, the EPP/Spectrum model package and the Thembisa model. Overall, the different incidence estimation methods were in broad agreement on HIV incidence estimates among persons aged 15-49 years in 2012. The assay-based method produced slightly higher estimates of incidence, 1.72% (95% CI 1.38 – 2.06), compared with the mathematical models, 1.47% (95% CI 1.23 – 1.72) in Thembisa and 1.52% (95% CI 1.43 – 1.62) in EPP/Spectrum, and slightly lower estimates of incidence compared to the synthetic cohort, 1.9% (95% CI 0.8 – 3.1) over the period from 2008 to 2012. Among youth aged 15-24 years, a declining trend in HIV incidence was estimated by all three mathematical estimation methods.

Conclusions

The multi-method comparison showed similar levels and trends in HIV incidence and validated the estimates provided by the assay-based incidence testing algorithm. Our results confirm that South Africa is the country with the largest number of new HIV infections in the world, with about 1 000 new infections occurring each day among adults aged 15-49 years in 2012.

Introduction

Incidence estimates provide critical insights into the dynamics of the HIV epidemic and are the most direct means of assessing the impact of HIV prevention programmes. The wide-scale implementation of prevention and treatment interventions means that, more than ever, real-time estimates of HIV incidence levels and trends are essential for evaluating the epidemic trajectory, to inform a more efficient and effective response to both the national and global HIV pandemic [1].

Southern Africa remains the region most severely affected by the HIV epidemic. With over six million people living with HIV/AIDS, South Africa has the largest population of HIV- infected individuals in the world, representing a quarter of the estimated HIV infections in sub-Saharan Africa [1]. It is therefore fitting that South Africa has implemented comprehensive national HIV surveillance efforts with the annual antenatal surveys and repeated national HIV household surveys as the core components for monitoring the HIV epidemic. Antenatal surveillance in South Africa has been carried out since 1990 [2] and there have been four large nationally representative household-based surveys, in 2002, 2005, 2008 and 2012 [3].

As the epidemic matured in South Africa and as access to antiretroviral treatment (ART) was rapidly scaled up in the period post-2004, the interpretation of HIV prevalence trends became increasingly complex. ART has increased the survival time of people living with HIV, with the result that HIV prevalence has increased. Hence, measuring ART coverage and estimating HIV incidence at the population level are critical to assessing the impact of treatment and prevention programs on HIV prevalence. Population-based survey methodology has advanced to address these evolving data needs in South Africa. The inclusion of novel laboratory methodologies in the survey protocol has enabled direct estimation of exposure to ART among HIV-positive individuals as well as direct assay-based HIV incidence measures from cross-sectional blood specimens [4]. The prevalence data from the repeated national HIV household surveys were also ideally suited to estimate HIV incidence using a mathematical approach [5].

Incidence assays, which can discriminate those who have been infected recently from others previously infected with HIV, can indicate recent changes in HIV incidence at a population level. Direct assay-based incidence measures using blood samples also provide incidence estimates by risk categories and for selected sub-populations. However, incidence estimation based on testing cross-sectional blood specimens is often established on relatively small numbers of persons that are classified as recently infected, which means that estimates so derived have large confidence intervals. Furthermore, incidence assays should be used in an algorithm where assay-recent specimens are further tested for additional markers such as ART exposure and HIV viral load, to exclude ‘false recent’ results [6, 7].

Mathematical models, such as the Estimates and Projection Package (EPP) / Spectrum [8, 9] and Thembisa [10], can also generate estimates of incidence by leveraging household survey data together with data from antenatal clinic surveillance and information on survival patterns of people living with HIV (and behaviours, in the case of Thembisa). However, there is a risk, in these models, that biases in the estimates can be introduced when certain assumptions do not hold, and as the method is based on using prevalence data, sudden changes in incidence will not be detected rapidly, since such changes only manifest in prevalence levels after a considerable delay. The incidence trajectory in the Spectrum model is fairly flexible, but irregular patterns in the scale-up of ART can induce severe deviations in the estimated incidence trend. Meanwhile, the incidence trajectory in Thembisa is constrained to follow a path dictated by the patterns of risk assumed, for which some reliance is placed upon a simplified scheme of sexual behaviour derived from self-reported data, which may be inaccurate [11]. Finally, simpler modelling techniques based on the synthetic cohort principle, which compare only age-specific prevalence levels at two points in time, can also be used to generate estimates of incidence [12, 13]. However, such methods also have to rely on many assumptions, especially in the era of ART, which leads to highly uncertain estimates and biases where relative levels of incidence across age-groups are not stable.

As each of these methods has different strengths and weaknesses, a synthesis of the different approaches can generate useful insights into the estimates of HIV incidence in a given setting, as well as revealing information about the performance of the methods. In this paper we compare the different methods to estimate HIV incidence in South Africa in order to arrive at an agreement on estimates of incidence. We also compared the performance of the different components of the assay-based incidence testing algorithm to assess the effect of antiretroviral drug testing and viral load testing on direct incidence measures in cross-sectional blood samples.

Methods

Ethics Statement

The survey protocols were approved by the Human Sciences Research Council’s Ethics Committee. All information collected from study participants was anonymized and de-identified prior to analysis. Written informed consent was obtained from study participants and only samples from individuals who consented to have their samples used for future research were used in the cross-sectional incidence testing investigation. The research was conducted according to the principles expressed in the Declaration of Helsinki.

Survey data

Our incidence estimation methods used nationally representative data collected in HIV household surveys conducted in South Africa in 2005, 2008, and 2012. The surveys applied a multi-stage stratified sampling design with data weighting procedures taking into account the complex sampling design and adjusting for HIV testing non-response. The surveys collected data not only on HIV status but also information on socio-demographic and behavioural characteristics of the South African population, for each sex, age group, race, locality type and province. The 2012 survey included testing for antiretroviral drugs and HIV incidence, providing direct estimates of age- and sex-specific ART exposure and new HIV infections in the South African population [3].

Direct HIV incidence estimates: HIV incidence testing algorithm

The detection of recent infections was performed on confirmed HIV-positive samples from survey respondents aged 2 years and older. Fig 1 shows the recent infection testing algorithm we applied for the 2012 HIV incidence estimation. The HIV incidence testing algorithm used the Limiting-Antigen Avidity Assay (LAg-Avidity EIA, Maxim Biomedical Inc., Rockville, MD, USA) with a cutoff normalized optical density (ODn) of 1.5 [14, 15] in combination with additional information on antiretroviral treatment exposure and HIV-1 RNA viral load (Abbott m2000 HIV Real-Time System, Abbott Molecular Inc, Des Plaines, IL, USA). The presence of the antiretroviral drugs Zidovudine, Nevirapine, Efavirenz, Lopinavir, Atazanavir and Darunavir was confirmed by means of High Performance Liquid Chromatography coupled to Tandem Mass Spectrometry; the limit of detection was set to 0.2 μg/ml for each of the drugs.

thumbnail
Fig 1. Testing algorithm for recent infection.

The figure shows the multi-assay algorithm that was applied for the 2012 HIV incidence estimation on confirmed HIV-positive samples from individuals 2 years and older. The algorithm used the Limiting-Antigen Avidity assay (LAg-Avidity EIA) in combination with testing for antiretroviral drugs (ARV) and HIV-1 viral load (VL copies/mL).

https://doi.org/10.1371/journal.pone.0133255.g001

2 758 HIV-positive samples were subjected to HIV incidence testing (Fig 1), 195 specimens were identified as LAg-Avidity EIA recent and 2 563 specimens were determined as non-recent infections. LAg-Avidity EIA recent specimens which tested positive for antiretroviral drugs (n = 96) were considered chronically infected individuals on treatment. Ten out of 99 LAg-Avidity EIA recent, ARV-negative specimens had an HIV viral load < 1 000 copies/ mL (LAg +/ARV-/VL<1 000) and were classified as long-term infections found in elite suppressors or in individuals maintaining a low viral load. Only 89 LAg-Avidity EIA recent, ARV-negative specimens with an HIV viral load > 1 000 copies/ mL (LAg +/ARV-/VL>1 000) were classified as recently-infected individuals in this multi-assay algorithm.

HIV incidence calculations were performed as proposed by the WHO Technical Working Group on HIV Incidence Assays [6, 16]. Incidence was calculated as an annual instantaneous rate. HIV incidence estimates were based on weighted samples to take into account the survey design and adjusted to account for specimens with missing LAg-Avidity EIA test results. Confidence intervals were computed applying a design effect (DEFT) of 2.0 [3]. The mean duration of recent infection (MDRI) was specified as 130 days in the incidence formula [15]. No adjustment factor for false recent results was applied to the incidence calculation based on this multi-assay testing algorithm.

Mathematically derived incidence from sequential household surveys

An existing method to estimate the average annual HIV-incidence rate in the interval between two surveys was used [12, 13]. A correction was applied that accounted for the effect of ART on HIV prevalence due to increased survival of HIV-infected persons [13, 5]. This required assumptions about the scale-up of ART [17, 18], mortality rates on ART [19] and the mean survival time without ART from the point of ART initiation [20]. A sigmoid time-trend was assumed for the latter, with mean survival increasing from between 0.8 and 1.8 years in 2005 to between 2.0 and 5.1 years in 2012. Bootstrapping was used to reflect sampling uncertainty in the prevalence measurements and parametric uncertainty in the ART correction procedure [21]. Point estimates were the means of the generated distributions and the intervals span the 2.5th to the 97.5th percentiles. Updates in assumptions about the impact of ART on survival and a fuller representation of uncertainties in the present method meant that estimates for the period 2005–2008 were slightly modified from earlier presentations [5].

EPP/Spectrum model

Incidence was estimated in Spectrum through the EPP model developed by East/West Center [8]. Briefly, HIV prevalence data from antenatal clinic surveillance was used to determine the trends in prevalence over time using a Bayesian melding statistical model [22, 23]. However since pregnant women attending antenatal clinics are not representative of the adult population, the level of the prevalence curve was determined by the household surveys. The household surveys also informed the shape of the prevalence curve. The model estimated incidence trajectories that were consistent with the prevalence data taking into consideration survival of people living with HIV (including whether or not they are receiving ART).

Thembisa model

Thembisa is a model of the South African HIV epidemic, described elsewhere [10]. Briefly, the model stratified the population by demographic characteristics (age and sex), sexual behaviour characteristics (marital status, risk group and sexual experience), engagement in HIV prevention programmes (history of HIV testing and male circumcision status) and HIV disease stage (HIV-positive individuals were stratified by CD4 count if untreated, and by baseline CD4 count and ART duration if treated). Assumptions regarding sexual behaviour and changes in behaviour over time were based on reviews of South African sexual behaviour data [24, 25], and assumptions regarding changes over time in HIV testing and ART uptake were based on reported rates of HIV testing [3] and reported numbers of ART patients [18]. The model was fitted to age-specific HIV prevalence data from antenatal surveys and household surveys, as well as age-specific reported death data, using a Bayesian procedure. Parameters varied in the model fitting procedure included rates of partnership formation, probabilities of HIV transmission per act of sex, rates of HIV-related mortality and CD4 decline, and the percentage reduction in unprotected sex following an HIV-positive diagnosis.

A comparison of key model inputs and assumptions used by EPP/Spectrum and Thembisa is provided in Table 1.

thumbnail
Table 1. Comparison of EPP/Spectrum and Thembisa: Model inputs and assumptions for adult HIV incidence estimation.

https://doi.org/10.1371/journal.pone.0133255.t001

Results

Prevalence results from the 2005, 2008 and 2012 national HIV household surveys served as key input data to inform indirect model-based incidence estimation. Fig 2 shows the survey estimates of HIV prevalence trends by age group and survey year. There was a significant decline in HIV prevalence among persons aged 15–24 years from 10.3% (95% CI 8.7–12.0) in 2005 to 7.1% (95% CI 6.2–8.1) in 2012 (p<0.001). In contrast, among persons aged 25–49 years, prevalence increased significantly from 20.0% (95% CI 18.2–21.9) in 2005 to 25.2% (95% CI 23.2–27.3) in 2012 (p<0.001).

thumbnail
Fig 2. HIV prevalence trends by age group and survey year, South Africa 2005–2012.

HIV prevalence among youth aged 15–24 years and adults aged 25–49 years estimated in the years 2005, 2008 and 2012. Source: Human Science Research Council Surveys [3].

https://doi.org/10.1371/journal.pone.0133255.g002

Level of HIV incidence by estimation method, 2011/2012

In Table 2, we compare national HIV incidence estimates by method. In addition, Fig 3 illustrates the main findings for 2012 by age group and estimation method. In 2012, we found no significant difference when we compared incidence generated by the assay-based approach, the synthetic cohort method, the Thembisa model and the EPP/Spectrum model. Assay-based HIV incidence was estimated at 1.72% (95% CI 1.38–2.06) for persons aged 15–49 years, but higher among females (2.28%; 95% CI 1.84–2.74) compared to males (1.21%; 95% CI 0.97–1.45). The synthetic cohort approach estimated HIV incidence to be 1.9% (95% CI 0.8–3.1) in the same age-group for the inter-survey period 2008–2012, with a less substantial difference between females (2.1%; 95% CI 1.0–3.4) and males (1.6%; 95% CI 0.6–2.7).

thumbnail
Table 2. Comparison of South African national HIV incidence estimates, 2005–2012.

https://doi.org/10.1371/journal.pone.0133255.t002

thumbnail
Fig 3. HIV incidence by age group and estimation method, South Africa 2012.

2012 HIV incidence rates (males and females combined) for the age groups 15–49 years, 15–24 years and 25–49 years provided by the four different estimation methods (LAg-Avidity/ARV/VL, Synthetic cohort, EPP/Spectrum, Thembisa). The error bars show the 95% uncertainty interval.

https://doi.org/10.1371/journal.pone.0133255.g003

The mathematical models produced similar results to one another for the age group 15–49 years. The Thembisa model estimated incidence at 1.47% (95% CI 1.23–1.72), with HIV incidence significantly higher among females (1.88%; 95% CI 1.48–2.28) than males (1.10%; 95% CI 0.84–1.36), while the EPP/Spectrum model estimated incidence at 1.52% (95% CI 1.43–1.62), and, similar to Thembisa, produced incidence estimates that were higher among females (1.78%; 95% CI 1.67–1.90) than males (1.29%; 95% CI 1.21–1.37).

Among young persons aged 15–24 years, incidence was similar by estimation method, ranging from as low as 1.49% (95% CI 1.21–1.88) using the assay-based approach to as high as 1.77% (95% CI 1.56–1.98%) using the Thembisa model. Similar trends were observed by sex among persons aged 15–24 years, with female incidence ranging from as low as 2.1% (95% CI 1.2–3.1) using the synthetic cohort to as high as 2.83% (95% CI 2.38–3.29) using the Thembisa model, and significantly higher than incidence for males which ranged from a low of 0.55% (95% CI 0.45–0.65) using the assay-based approach to a high of 1.0% (95% CI 0.4–1.6) using the synthetic cohort approach. In contrast, among persons aged 25–49 years, incidence differed considerably by estimation method, with lower estimates generated by the Thembisa (1.27%; 95% CI 0.93–1.63) and EPP/Spectrum models (1.42%; 95% CI 1.22–1.61) compared with the assay-based (1.87%; 95% CI 1.51–2.23) and synthetic cohort methods (2.1%; 95% CI 0.8–3.7).

Trends in HIV incidence by estimation method, 2005–2012

We observed different temporal trends in HIV incidence by estimation method between 2005 and 2012 for persons aged 15–49 years. Estimates generated by the synthetic cohort method indicate stable incidence: 1.9% (95% CI 0.8–3.3) between 2005 and 2008, and 1.9% (95% CI 0.8–3.1) between 2008 and 2012. Both the Thembisa and EPP/Spectrum models suggest a declining trend in HIV incidence between 2005 and 2012, with a percentage point (pts) change of -0.51% pts between 2005/2006 and 2011/2012 for the Thembisa model and -0.49% pts between 2005/2006 and 2011/2012 for the EPP/Spectrum model.

Among persons aged 15–24 years, a declining trend in HIV incidence was estimated by all three methods: the percentage point change was -0.80% pts between 2005–2008 and 2008–2012 for the synthetic cohort method; -0.30% pts between 2005/2006 and 2011/2012 for the Thembisa model; and -0.53% pts between 2005/2006 and 2011/2012 for the EPP/Spectrum model.

Among persons aged 25–49 years, we observed a similar pattern of declining incidence for the two mathematical models, with a percentage point change of −0.65% pts between 2005/2006 and 2011/2012 for the Thembisa model and -0.44% pts between 2005/2006 and 2011/2012 for the EPP/Spectrum model. This was not consistent with the synthetic cohort method, which produced a pattern suggestive of increasing incidence over time, with a percent change of +0.60% pts between 2005–2008 and 2008–2012.

Performance of incidence testing algorithm by testing component

Table 3 compares the performance of the different components of the multi-assay recent infection testing algorithm we used for direct HIV incidence estimation. The 3-assay algorithm consisting of the LAg–Avidity assay in combination with antiretroviral drug testing and viral load testing estimated an incidence rate of 1.72% in the 15–49 years age group, with a zero false recent rate (FRR) assumed (see discussion for explanatory comments). When used in a single-assay format, the LAg–Avidity assay provided an incidence estimate of 3.58% for the same age group, which would require a FRR of 3.10% to be included in the incidence calculation in order to reproduce the incidence estimated by the 3-assay algorithm (LAg/ARV/VL). The LAg–Avidity assay in combination with antiretroviral drug testing (LAg/ARV) estimated an HIV incidence of 1.98% compared to 2.24% estimated by the Lag—Avidity assay in combination with viral load testing (LAg/VL). The computed false recent rates associated with these testing components, 0.40% for LAg/ARV and 0.86% for LAg/VL (assuming zero FRR for the 3-assay algorithm), are substantially smaller than the FRR of 3.1% found with the performance of the LAg–Avidity assay alone.

thumbnail
Table 3. Assay- based HIV incidence and FRR by testing component, South Africa 2012.

https://doi.org/10.1371/journal.pone.0133255.t003

Discussion

Given the evolving field of HIV incidence estimation and limitations of current methods for estimating incidence, our results suggest that a synthesis of multiple methods for estimating incidence in the same population is helpful in producing robust estimates of national HIV incidence levels and trends. More confidence can be placed in such results, as opposed to relying on findings from individual methods alone [26]. In the era of rapidly expanding antiretroviral treatment programs, HIV incidence estimation among different age groups is difficult but nevertheless critical for assessing the changing age-specific pattern of HIV prevalence.

Overall, the different incidence estimation methods were in remarkable agreement on 2012 HIV incidence estimates among persons aged 15–49 years. Though the direct assay-based method produced slightly higher estimates of incidence compared with mathematical models and slightly lower estimates of incidence compared to the synthetic cohort, the multi-method comparison shows similar levels and trends in HIV incidence, validating the results of the incidence testing algorithm and highlighting its utility in estimating incidence in cross-sectional settings.

There has been substantial progress over the past decade in the development and evaluation of HIV incidence assays [14, 27]. The LAg-Avidity EIA, used in an algorithm where assay-recent specimens are further tested for HIV RNA levels and for the presence of antiretroviral drugs, is currently the recommended approach to classify recent infections [28]. Our analysis of the performance of the different components of the incidence testing algorithm confirms the utility of testing for ART exposure and viral load to correct for the main sources of false recent misclassifications [29]. We have also demonstrated the relatively poor performance of the LAg-Avidity assay if applied in a single-assay format, requiring a false recent rate correction of 3.1% to reproduce the incidence estimate provided by the full algorithm. Out of 195 LAg-Avidity assay-recent specimens, 106 (54.4%) were re-classified as non-recent infections after testing for antiretroviral treatment exposure and viral load. This algorithm can be performed using dried blot spot (DBS) specimens, which is an important advantage in large population-based surveys [15]. The use of self-report of ART exposure in an incidence testing algorithm may be highly unreliable, as has been shown by several studies [30, 31, 32].

Based on the latest recalibration of the LAg-Avidity EIA in different HIV-1 subtypes, we applied a normalized optical density (ODn) cutoff of 1.5 and the corresponding mean duration of recent infection of 130 days for the incidence estimation [15]. Our assay-based HIV incidence estimates seem to confirm the validity of the selected parameters in the incidence calculation. A recently published assessment by the Consortium for the Evaluation and Performance of HIV incidence Assays (CEPHIA) proposed an alternative MDRI of 177 days and a false recent rate of 1.3% for the LAg-Avidity EIA (1.5 ODn cutoff) in subtype C specimens which excluded treated subjects and elite controllers [33]. However, applying those parameters in the incidence calculation based on our testing algorithm would have resulted in a change of the incidence estimate from 1.72% (95% CI 1.38–2.06) to 0.66% (95% CI 0.04–1.28) in the 15–49 year age group—an estimate that is not supported by any of the epidemiological/mathematical models. A recent revision by the CEPHIA group suggested a MDRI of 140 days and a FRR between 0% and 0.5% for an algorithm that assessed the LAg-Avidity EIA (1.5 ODn cutoff) in combination with a viral load threshold of ≥ 1000 copies/ml [34]. This parameter setup would have produced incidence rates more in agreement with our results, with estimates varying from 1.31% to 1.60%.

We did not include a false recent rate in our incidence calculation, relying on the correction of potential “false recent” results by means of additional testing for antiretroviral drugs and viral load in LAg-Avidity EIA recent specimens. Incidence testing algorithms of this type can reduce the false recent rate to almost zero, as has been demonstrated in samples from individuals in the United States [35]. Although the debate has focused so far on the potential false recent rate, we may also have to consider potential ‘false long-term’ misclassifications associated with this testing algorithm. HIV seroconverters who have been exposed to early treatment may be misclassified as chronically infected individuals on ART, e.g. recently infected pregnant women enrolled in prevention of mother-to-child-transmission (PMTCT) programs or persons on post-exposure prophylaxis (PEP) and pre-exposure prophylaxis (PrEP) regimens [36]. However, the extent of these potential misclassifications in the context of the 2012 national household survey was most likely extremely small. Finally, we should note that antibody-based screening assays are unable to detect acute HIV infections in the pre-seroconversion window. In the recently conducted national household survey in Swaziland, 13 (0.1%) of the 12 338 HIV antibody-negative specimens were identified as HIV RNA positive recent infections [37]. Based on these considerations discussed above we decided not to apply a correction factor to the multi-assay algorithm-derived 2012 HIV incidence estimates at this point in time.

Two mathematical models produced consistent estimates of HIV incidence level and trend, despite important differences in model assumptions and calibration procedures. While the EPP/Spectrum model allows a fair degree of flexibility in the estimation of HIV incidence trends, the Thembisa model estimates of HIV incidence are to some extent constrained by assumptions about trends in sexual behavior. The models also differ in their assumptions regarding ART rollout, with Thembisa assuming greater ART uptake and estimating a greater reduction in AIDS mortality due to ART. While the Thembisa model is calibrated to age-specific HIV prevalence data and recorded death data, the EPP/Spectrum model is calibrated to HIV prevalence data for the entire 15–49 age group. Since HIV prevalence data are not disaggregated by age groups in the model, EPP/Spectrum is not able to capture a scenario in which the incidence trend for 15–24 year olds is different from the trend observed in 25–49 year olds. A future step will be for the models to use age-specific data in their inference of epidemic trends.

All incidence estimation methods produced similar estimates for 15–24 year olds, and were consistent in their estimates of trends. In the population aged 25–49 years, however, the discrepancies between modelled estimates and the 2012 survey-based estimates are more evident. The Thembisa model may have overestimated treatment exposure among older adults aged 25–49 years and, as a result, overestimated the impact of ART on HIV incidence reduction in this age group. In the Thembisa model, 40.6% of HIV-positive adults aged 25–49 were estimated to be on ART in 2012 compared to 31.2% treatment exposure measured in the HIV-positive blood samples [3].

While important differences were observed in HIV incidence levels by sex, age, and time in our analysis, the wide confidence intervals around the incidence estimates suggest that these differences should be interpreted with caution. The synthetic cohort model appears to produce more uncertain estimates than other modelling approaches. This is because the method is unconstrained—i.e. the incidence pattern estimated from the HIV prevalence data does not have to be consistent with any theory or hypothesis about epidemic dynamics. The synthetic cohort approach is more sensitive to sampling errors or other aberrations in the data compared to the mathematical models, which are constrained to follow smooth changes over time or changes that are consistent with an underlying theory of epidemic dynamics. For example, if the previous survey in 2008 slightly underestimated adult HIV prevalence compared to the results obtained by the more representative 2012 survey design, the underestimate would particularly affect the synthetic cohort approach. The incidence estimate among persons aged 15–49 years produced by this method would be 1.5% instead of 1.9% if the bias in the 2008 prevalence estimate was about one percentage point overall and uniform by age and sex. Moreover, many assumptions required by this method are not readily identifiable from the input data, meaning that uncertainties, especially about ART, are propagated to the results.

Our results confirm that South Africa ranks first in the world in the annual number of new HIV infections [1]. The HIV incidence rates presented in this analysis suggest that about 1 000 new infections occurred each day among South Africans aged 15–49 years in 2012. Although the declining trend in HIV incidence between 2005 and 2012 observed among young adults aged 15–24 years is encouraging, the incidence rates still remain at unacceptably high levels, especially among female youth. The current National Strategic Plan on HIV, STIs and TB 2012–2016 states as its primary goal a reduction in new infections of at least 50% [38]. This would require a reduction in HIV incidence well below the 1% level among persons aged 15–49 years by 2016—a considerable challenge given the transmission dynamics that still prevail in the country. The 2012 survey findings indicated that there was a drop in condom use at last sex, an increase in the proportion of people reporting multiple sexual partners, and an increase in the proportion of young women reporting age-disparate relationships [3]. South Africa needs to balance treatment and prevention with a strong focus on the reduction of new HIV infections in the sexually active population.

Acknowledgments

The authors would like to thank the study teams and participants of the 2005, 2008 and 2012 national HIV household surveys.

Disclaimer: The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention/the Agency for Toxic Substances and Disease Registry.

Author Contributions

Conceived and designed the experiments: TR LJ TH MM. Performed the experiments: TR LJ TH MM AK JS. Analyzed the data: TR LJ TH MM AK HO DO SJ JS. Contributed reagents/materials/analysis tools: TR LJ TH MM AK JS HO DO SJ OS AP BP. Wrote the paper: TR LJ TH MM AK JS HO DO SJ OS AP BP.

References

  1. 1. UNAIDS (2014) UNAIDS Gap report. Geneva: UNAIDS.
  2. 2. National Department of Health (2012) The National antenatal sentinel HIV and syphilis prevalence survey, South Africa, 2011. Pretoria: NDOH
  3. 3. Shisana O, Rehle T, Simbayi LC, Zuma K, Jooste S, Zungu N, et al. (2014) South African National HIV Prevalence, Incidence, and Behaviour Survey, 2012. Cape Town: HSRC Press.
  4. 4. Rehle T, Shisana O, Pillay V, Zuma K, Puren A, Parker W (2007) National HIV incidence measures—new insights into the South African epidemic. South African Medical Journal 97: 194–199. pmid:17440667
  5. 5. Rehle TM, Hallett TB, Shisana O, Pillay-van Wyk V, Zuma K, Carrara H, et al. (2010). A decline in new HIV infections in South Africa: Estimating HIV incidence from three national HIV surveys in 2002, 2005 and 2008. PLoS ONE 5(6): e11094. pmid:20559425
  6. 6. WHO Technical Working Group on HIV Incidence Assays (2011). When and how to use assays for recent infection to estimate HIV incidence at a population level. Geneva: WHO/UNAIDS.
  7. 7. Incidence Assay Critical Path Working Group (2011) More and better information to tackle HIV epidemics: Towards improved HIV incidence assays. PLoS Med 8(6): e1001045. pmid:21731474
  8. 8. Brown T, Bao L, Raftery AE, Solomon JA, Bagaley RF, Stover J, et al. (2010) Modelling HIV epidemics in the antiretroviral era: the UNAIDS Estimation and Projection Package 2009. Sex Transm Infect 86(Suppl 2):ii3eii10.
  9. 9. Stover J, Brown T, Marston M. (2012) Updates to the Spectrum/Estimation and Projection Package (EPP) model to estimate HIV trends for adults and children. Sex Trans Infect 88:i11–ii16.
  10. 10. Johnson L (2014) THEMBISA version 1.0: A model for evaluating the impact of HIV/AIDS in South Africa. Centre for Infectious Disease Epidemiology and Research, University of Cape Town. Available: http://www.cider.uct.ac.za/publications/publications_rep.php.
  11. 11. Phillips AE, Gomez GB, Boily MC,Garnett GP (2010) A systematic review and meta-analysis of quantitative interviewing tools to investigate self-reported HIV and STI associated behaviours in low- and middle-income countries. International Journal of Epidemiology 39: 1541–55. pmid:20630991
  12. 12. Hallett TB, Zaba B, Todd J, Lopman B, Mwita W, Biraro S, et al. (2008) Estimating incidence from prevalence in generalised HIV epidemics: methods and validation. PLoS Med 5: e80. pmid:18590346
  13. 13. Hallett TB, Stover J, Mishra V, Ghys P, Gregson S, Boerma T. (2010) Estimates of HIV incidence from household-based prevalence surveys. AIDS 24(1): 147–152. pmid:19915447
  14. 14. Duong YT, Qiu M, De AK, Jackson K, Dobbs T, Kim AA, et al. (2012). Detection of recent HIV-1 infection using a new Limiting-Antigen avidity assay: potential for HIV-1 incidence estimates and avidity maturation studies. PloS ONE 7(3): e33328. pmid:22479384
  15. 15. Duong YT, Kassanjee R, Welte A, Morgan M, De A, Dobbs T, et al. (2015) Recalibration of Limiting Antigen Avidity EIA to determine mean duration of recent infection in divergent HIV-1 subtypes. PLoS ONE 10(2): e0114947. pmid:25710171
  16. 16. Kassanjee R, McWalter TA, Bärnighausen T, Welte A (2012) A new general biomarker-based incidence estimator. Epidemiology 23: 721–728. pmid:22627902
  17. 17. National Department of Health (2013) District Health Information System, November 2013. Pretoria: NDOH.
  18. 18. Johnson LF (2012) Access to antiretroviral treatment in South Africa, 2004–2011. Southern African Journal of HIV Medicine 13: 22–27.
  19. 19. Cornell M, Schomaker M, Garone DB, Giddy J, Hoffmann CJ, Lessells R, et al. for the International Epidemiologic Databases to Evaluate AIDS Southern Africa (IeDEA-SA) Collaboration (2012) Gender differences in survival among adult patients starting antiretroviral therapy in South Africa: A Multicentre Cohort Survey. PLoS Medicine, 9 (9): e1001304. pmid:22973181
  20. 20. Lodi S, Phillips A, Touloumi G, Geskus R, Meyers L, Thiébaut R, et al. on behalf of the CASCADE Collaboration in EuroCoord (2011) Time from human immunodeficiency virus seroconversion to reaching CD4+ cell count thresholds <200, <350, and <500 cells/mm3: Assessment of need following changes in treatment guidelines. Clin Infect Dis. 53 (8): 817–825. pmid:21921225
  21. 21. Kirkwood B and Sterne JAC (2003) Essential Medical Statistics (Second Edition): Blackwell Science.
  22. 22. Bao L, Solomon JA, Brown T, Raftery AE, Hogan DR (2012) Modelling national HIV/AIDS epidemics: revised approach in the UNAIDS Estimation and Projection Package 2011, Sex Transm Infect 88:i3–i10.
  23. 23. Hogan DR, Solomon JA (2012) Spline-based modelling of trends in the force of HIV infection, with application to the UNAIDS Estimation and Projection Package, Sex Transm Infect 88:i52–i57. pmid:23172346
  24. 24. Johnson LF, Dorrington RE, Bradshaw D, Pillay-Van Wyk V, Rehle TM (2009) Sexual behaviour patterns in South Africa and their association with the spread of HIV: insights from a mathematical model. Demographic Research 21: 289–340.
  25. 25. Johnson LF, Hallett TB, Rehle TM, Dorrington RE (2012) The effect of changes in condom usage and antiretroviral treatment coverage on HIV incidence in South Africa: a model-based analysis. Journal of the Royal Society Interface 9: 1544–54.
  26. 26. Kim AA, Hallett T, Stover J, Gouws E, Musinguzi J, Mureithi PK, et al. (2011) Estimating HIV incidence among adults in Kenya and Uganda: a systematic comparison of multiple methods. PLoS ONE 6(3): e17535. pmid:21408182
  27. 27. Busch MP, Pilcher CD, Mastro T, Kaldor J, Vercauteren G, Rodriguez W, et al. for the WHO Working Group on HIV Incidence Assays (2010) Beyond detuning: 10 years of progress and new challenges in the development and application of assays for HIV incidence estimation. AIDS, 24: 2763–2771. pmid:20975514
  28. 28. WHO/UNAIDS (2013) Technical update on HIV incidence assays for surveillance and epidemic monitoring. Geneva: WHO/UNAIDS.
  29. 29. Longosz AF, Mehta SH, Kirk GD, Margolick JB, Brown J, Quinn T, et al. (2014) Incorrect identification of recent HIV infection in adults in the United States using a limiting-antigen avidity assay. AIDS Feb 6. [Epub ahead of print].
  30. 30. Fogel JM, Wang L, Parsons TL, Ou SS, Piwowar-Manning E, Chen Y, et al. (2013) Undisclosed antiretroviral drug use in a multinational clinical trial (HIV Prevention Trials Network 052). J Infect Dis. 15; 208(10): 1624–1628.
  31. 31. Marzinke MA, Clarke W, Wang L, Cummings V, Liu TY, Piwowar-Manning E, et al. (2014) Nondisclosure of HIV status in a clinical trial setting: antiretroviral drug screening can help distinguish between newly diagnosed and previously diagnosed HIV infection. Clin Infect Dis. 58(1):117–20. pmid:24092804
  32. 32. Kahle EM, Kashuba A, Baeten JM, Fife KH, Celum C, Mujugira A, et al. for Partners in Prevention HSV/HIV Transmission Study Team (2014) Unreported antiretroviral use by HIV-1-infected participants enrolling in a prospective research study. J Acquir Immune Defic Syndr. 65(2):e90–94. pmid:24442233
  33. 33. Kassanjee R, Pilcher CD, Keating SM, Facente SN, Mckinney E, Price M, et al. (2014) Independent assessment of candidate HIV incidence assays on specimens in the CEPHIA repository. AIDS Aug19 [Epub ahead of print].
  34. 34. Consortium for the Evaluation and Performance of HIV Incidence Assays (CEPHIA, Available: http://www.incidence-estimation.org/page/cephia). Confidential presentation and private communication, WHO and CEPHIA Working Group on HIV Incidence Assays, Barcelona, Spain, 13–15 October, 2014.
  35. 35. Konikoff J, Brookmeyer R, Longosz AF, Cousins MM, Celum C, Buchbinder SP, et al. (2013) Performance of a limiting-antigen avidity enzyme immunoassay for cross-sectional estimation of HIV incidence in the United States. PLoS ONE 8(12): e82772. pmid:24386116
  36. 36. Hatano H, Bacon O, Cohen S, Liu A, Buchbinder S, Chomont MK, et al. Lack of detectable HIV DNA in a PrEP study participant during “hyperacute” HIV infection. 21st Conference on Retroviruses and Opportunistic Infections, March 3–6, 2014; Boston, Massachusetts. Abstract 397LB.
  37. 37. Duong YT, Mavengere Y, Patel H, Moore C, Manjengwa J, Sibandze D, et al. (2014) Poor performance of the Determine 4th generation HIV 1/2 Ag/Ab combo rapid test to detect acute infections in a national household survey in Swaziland. J Clin Microbiol. Aug 13 [Epub ahead of print].
  38. 38. South African National AIDS Council (2011). National strategic plan on HIV, STIs and TB 2012–2016. Pretoria: SANAC.