New Results

Primary care use of laboratory tests in Northern Ireland’s Western Health and Social Care Trust: a cross-sectional study

Magda Bucholc, Maurice J O’Kane, Ciaran Mullan, Siobhan Ashe, Liam Maguire
doi: https://doi.org/10.1101/573949

Abstract

Objectives To describe the laboratory test ordering patterns by general practitioners (GPs) in Northern Ireland Western Health and Social Care Trust (WHSCT) and establish demographic and socio-economic associations with test requesting.

Design Cross-sectional study.

Setting Western Health and Social Care Trust, Northern Ireland

Participants 55 WHSCT general practices requesting laboratory tests in the period from 1 April 2011 to 31 March 2016

Outcomes To identify the temporal patterns of laboratory test ordering behaviour for 8 commonly requested clinical biochemistry tests/test groups in WHSCT. To analyse the extent of variations in laboratory test requests by GPs and to determine whether these variations can be accounted for by clinical outcomes or geographical, demographic, and socioeconomic characteristics.

Results We identified substantial changes in the median number of request rates over five consecutive years of the study period as well as a large variation of adjusted test request rates for individual tests (lowest for electrolyte profiles, liver profiles, and HbA1c and highest for immunoglobulins). No statistically significant relationship between ordering activity and either demographic (age and gender) and socioeconomic factors (deprivation) or Quality and Outcome Framework (QOF) scores was observed. We found that practice setting accounted for some of the between-practice variation in test requesting. Rural practices were characterized by both higher between practice variability and median number of order tests than urban practices at all time points.

Conclusions A large between-practice variation in GP laboratory test requesting appears unrelated to demographic and socioeconomic indicators of the practices or crude clinical outcome indicators, most likely reflects differences in the clinical practice of individuals, potentially amenable to change through clinical interventions.

Strengths and limitations of this study

  • The study provides a comprehensive analysis of temporal changes in laboratory test utilization patterns and establishes the extent of variability in test requesting activity across general practices in Northern Ireland’s Western Health and Social Care Trust.

  • The substantial variation in test ordering, not related to demographic and socioeconomic characteristics of practices, practice location or clinical outcome indicators, may reflect inappropriate laboratory test utilization and hence, suggest a potential for more efficient demand management of laboratory services.

  • Given a cohort of general practices within one catchment area, our results provide evidence of differences in behaviour of individual GPs when managing patients with similar clinical symptoms.

  • Failure to collect and cross-tabulate data on characteristics of general practitioners (GPs), such as GP’s age, years of experience, medical training was a study limitation and a missed opportunity in assessing the influence of practitioner factors on the variation in test ordering behaviour.

Introduction

Despite the important role of laboratory testing in the diagnosis and monitoring of disease, there is concern about the increasing number of requested tests and in particular, large differences in laboratory utilization between clinical teams.1 In the UK, laboratory test orders grew by approximately 5% per year in recent years and inappropriate test requests are considered to be an important cause for this increase2,3. Although pathology expenditures account for only 5–6% of the UK total health budget, they are viewed as a potential source of savings, most likely because the costs can be easily identified and measured.4 According to the Department of Health, the rationalization of pathology services, including demand management of laboratory tests and elimination of unnecessary requesting, could produce savings of at least £500 million.5

Unnecessary testing is not only wasteful of resources but impacts on patients directly through the requirement for venepuncture and the follow up of minor (and possibly insignificant) abnormalities which may cause patient anxiety. On the other hand, inappropriate under requesting may cause harm through failure to diagnose or manage disease optimally. Several studies suggested that unnecessary and inappropriate utilization of laboratory services is closely linked to inter-practitioner variability in test requesting.6-8 Despite the increased availability of clinical management guidelines promoting harmonization of the use of laboratory tests, there is still substantial variation in test utilization among general practitioners.7,9 These differences appear to be unrelated to demographic characteristics of patient populations, socio-economic status of GP practices, disease prevalence or clinical outcome indicators.6,7,10,11 Even if some of these variables have been shown to have an effect on test ordering patterns, the variation in requesting rates is so large that it can only be explained by differences in attitudes towards the use of laboratory tests of individual practitioners.10 Accordingly, factors such as confidence in clinical judgement, clinical experience, an attitude about clinical practice guidelines, a lack of knowledge regarding the correct use of tests and fear of litigation have been identified as potential sources of practice variation.12-15

Since unwarranted variation can lead to suboptimal clinical outcomes,16,17 identification of factors contributing to differences in test requesting can provide useful information for optimising utilization of laboratory services. The aim of our study was to establish the extent of variability in test requesting and characterise temporal changes in test ordering patterns across general practices within the catchment area of the Northern Ireland (NI) Western Health and Social Care Trust (WHSCT) for a range of commonly requested clinical biochemistry tests/test groups. In addition, we investigated potential factors associated with inter-doctor variability in the use of laboratory tests including geographical, demographic, and socioeconomic factors as well as Quality and Outcome Framework (QOF) scores.

Materials and Methods

Study design and data sources

We conducted a cross-sectional study of laboratory test ordering activity across general practices in the WHSCT in the period from 1 April 2011 to 31 March 2016. The data on the use of laboratory tests were obtained from a HSC Business Object XI clinical information system. We investigated requesting rates for 8 clinical biochemistry tests/test groups including electrolyte profile, thyroid profile (FT4 and TSH), liver profile, lipid profile, urine albumin/creatinine (ACR) ratio, glycosylated haemoglobin (HbA1c), prostate-specific antigen (PSA), and immunoglobulins. The number of laboratory tests requested in each general practice was normalized by the number of registered patients and expressed as requests per 1000 patients, with the exception of HbA1c and ACR for which ordering rates were expressed as tests per patient with diabetes and PSA rates, calculated per 1000 male patients. GP practice list size data (including the number of patients with diabetes) and patient demographic data was extracted from the Business Services Organisation (BSO) Family Practitioner Service Information and Registration Unit system. The rural-urban distribution of GP practices was based on the data from the Census Office of the Northern Ireland Statistics and Research Agency (NISRA).18 Socioeconomic characteristics of GP practices were determined using the NISRA Neighbourhood Information System (NINIS).19 QOF scores for individual practices were extracted from the website of Northern Ireland Department of Health.20

Participants and setting

Data on laboratory tests requested from 55 general practices within the WHSCT were collected from the laboratory databases of Clinical Chemistry departments of the Altnagelvin Area Hospital, Tyrone County Hospital, and the Erne Hospital (subsequently the South West Acute Hospital). WHSCT provides health and social care services throughout the west of Northern Ireland, across the council areas of Derry City and Strabane District Council, Limavady in the Causeway Coast and Glens Borough Council, and Fermanagh and Omagh District Council.

Inclusion criteria

We examined only laboratory test requests from 55 separate primary care medical practices within the catchment area of WHSCT that remained open throughout the study period i.e. during five consecutive years: Apr 2011 – Mar 2012, Apr 2012 – Mar 2013, Apr 2013 – Mar 2014, Apr 2014 – Mar 2015, and Apr 2015 – Mar 2016, were examined. To ensure the completeness and consistency of the data, test orders from WHSCT practices that closed or merged during the period of investigation were not taken into account.

Variables and characteristics

Our analysis was limited to 8 frequently requested clinical biochemistry tests/test groups including electrolyte profile, thyroid profile, liver profile, lipid profile, ACR, HbA1c, PSA, and immunoglobulins. All considered tests/profiles (with the exception of immunoglobulins and ACR) were listed on a paper pathology request form and ordered by ticking a box adjacent to the test name; requests for ACR and immunoglobulins were made by writing the test name in an open text field.

Rates of test requests were analysed in the context of geographical and socioeconomic characteristics of practices, patient demographics (age and gender), and clinical outcome indicators. Note that we were not able to obtain a consolidated data on both gender and age of patients registered in individual GP practices.

The practice setting (rural v. urban area) was determined using the urban-rural classification of the Department for Environment, Food and Rural Affairs (DEFRA)21 while the size of settlements was obtained from the NISRA Census Office.18 A GP practice was defined as rural if its physical address was situated in a settlement of less than 10,000. Accordingly, we classified 24 practices as rural and 31 as urban. Furthermore, GP practices were categorised based on the Northern Ireland Multiple Deprivation Measure (MDM) identified for individual Super Output Areas (SOAs).19 The MDM comprises a weighted combination of 7 component measures (Income Deprivation; Employment Deprivation; Health Deprivation and Disability; Education, Skills and Training Deprivation; Proximity to Services; Living Environment; and Crime and Disorder) and ranges from 1 (most deprived SOAs) to 890 (least deprived SOAs). The Health Deprivation & Disability rank (one of the MDM domains)19 was analysed separately as a potential factor contributing to inter-doctor variability in the use of laboratory tests.

Given a detailed breakdown of the age of patients on the individual practice lists, we examined the relationship between the percentage of patients over age 65 and ordering rates for electrolyte, thyroid, liver, and lipid profiles. In addition, we investigated the link between gender and requesting activity for PSA (for males) and thyroid profiles (for females) and evaluated test requesting patterns for diabetes mellitus and their relationship to QOF clinical indicator scores in diabetes.

Outcome measures

Our outcome of interest was to identify the presence and extent of variations in primary care laboratory tests ordering and to evaluate temporal changes in both the standardised number of test requests and between-practice variability in requesting. In addition, we studied demographic, socio-economic, geographical, and clinical factors that may explain this variation.

Statistical analysis

Inter-practice variability in test requests was assessed by calculating the variance (σ2). Furthermore, we computed ‘variability index’ (Vari) defined as the top decile divided by the bottom decile of standardized test request rates.10 Vari is a dimensionless measure of dispersion allowing us to compare the amount of variation in request rates of individual tests despite their differences in scale. The Shapiro-Wilk test of normality was used to determine if the distribution of test ordering data deviated from a normal distribution.22 Since the distribution of laboratory test request rates was found to be non-normal, the non-parametric statistics were implemented to perform further analysis. Mann Whitney U (MWU) test was employed to compare distributions of laboratory test rates between GP practices located in rural and urban areas.23 The homogeneity of variances for requesting activity in rural and urban GP practices was assessed with the Fligner-Killeen (FK) test.24 Significance of temporal changes in median and variability in test requesting rates was examined with the Mann–Kendall (MK) test.25 In all conducted tests, a p < 0.05 was considered significant. Kendall rank correlation coefficient (τ)26 was calculated to test the relationship between adjusted requesting rates and 1) Multiple Deprivation Measure; 2) Health Deprivation & Disability Deprivation rank; 3) proportions of patients over age 65; 4) distribution of patient’s gender; and 5) QOF clinical indicator scores. The Kendall coefficient (−1 ≤ τ ≤ 1) measures the strength of a correlation between two variables and assesses the degree of overall correspondence of variables’ ranking.26

Patient and public involvement

No patients or general practitioners were involved in defining the research question or outcome measures nor were they engaged in the design or implementation this study. The study was approved by the Western Health and Social Care Trust (WHSCT). All identifiable information used for the purpose of the study was anonymised and not traceable to individual patients or general practitioners.

Results

Test ordering patterns

We analysed the laboratory test request rates of 55 general practices within the catchment area of the WHSCT comprising a total of 316 382 (2011-12), 316 688 (2012-13), 318 057 (2013-14), 319 383 (2014-2015), and 326 429 (2015-16) patients. Figure 1 shows the total number of 8 considered clinical biochemistry tests/test groups ordered during the study period of five consecutive years. The total number of ordered tests was 523 111 (2011-12), 531 849 (2012-13), 531 583 (2013-14), 525 146 (2014-2015), and 542 118 (2015-16) with electrolyte profiles found to be the most frequently ordered tests, making up approximately 30% of all requests in each year.

Figure 1.
Figure 1.

The total number of 8 considered clinical biochemistry tests/test groups ordered by 55 general practices during the period 1 Apr 2011 – 31 Mar 2016.

We observed substantial between-practice variability for all studied tests (table 1). In the considered period, the Vari was lowest for electrolyte profiles (2.0-2.3), liver profiles (2.2-2.5), and HbA1c (2.2-2.9) and highest for immunoglobulins reaching the value of 69.8 in 2012-13. The large variability was caused by several GP practices with abnormally high/low ordering rates of laboratory tests (figure 2). For the majority of tests, the median of test request rates was found to be generally lower than the mean, suggesting that the distribution of ordered test was primarily affected by the presence of GP practices with extremely high numbers of standardized requests.

View this table:
Table 1.

Overview of general statistics

Figure 2.
Figure 2.

Temporal variability of the standardized laboratory test requests for (a) electrolyte profiles, (b) lipid profile, (c) prostate-specific antigen (PSA), (d) thyroid profiles, (e) liver profiles, (f) HbA1c, (g) urine albumin/creatinine ratio (ACR), and (h) immunoglobulins (Immunos) for 55 considered general practices. Each data point (dot): a single practice. Solid, horizontal line inside the box: median. Lower and upper “hinges” of the boxplots: 1st and 3rd quartiles, respectively. Lower and upper extremes of whiskers: interval boundaries of the non-outliers (black dots). Data outside interval: outliers.

Changes in the number and variation of test requests over time

Over the period of investigation, we observed an increase in the median standardized number of electrolyte profiles, immunoglobulins, PSA, and HbA1c (figure 3); however, the Mann–Kendall (MK) test indicated the statistically significant upward trend only for requesting rates of PSA (pMK = 0.03) and HbA1c (pMK = 0.03). For lipid profiles, thyroid profiles, liver profiles, and ACR, we reported the overall decline of the median number of test request rates. Yet, the downward trend was found statistically significant only for lipid profiles (pMK = 0.03).

Figure 3.
Figure 3.

Trend lines for median (blue) and variance (red) of the standardized number of (a) electrolyte profiles, (b) lipid profile, (c) prostate-specific antigen (PSA), (d) thyroid profiles, (e) liver profiles, (f) HbA1c, (g) urine albumin/creatinine ratio (ACR), and (h) immunoglobulins (Immunos).

The variance for electrolyte profiles, lipid profiles, thyroid profiles, and liver profiles requests fell by 16.8%, 15.3%, 28.3%, and 23.5% respectively (figure 3). The increase in variance was observed for immunoglobulins (272%), ACR (40%), and HbA1c (500%). Nonetheless, only the increase in variance of HbA1c requests (pMK = 0.03) and decrease in variance of standardized number of liver profiles (pMK = 0.03) were found significant at the 95% confidence level. For PSA test request rates, we observed fluctuations in variance with no clear trend.

Test ordering variation between general practices and explanatory factors

The relationship between test requesting rates and potential explanatory factors was established based on the information on the number of ordered tests, patient demographics, and Quality and Outcomes Framework indicator scores obtained for the period 1 Apr 2015 – 31 Mar 2016.

Demographic characteristics of patient population

Proportion of the oldest age category of patients (> 75) constituted a relatively small group in each GP practice (mean = 6.1%, 95%CI = (5.7%,6.5%)). Hence, we combined the 65-74 and > 75 age categories to create a more meaningful group of patients in the older age band. We examined four tests for which differences in proportions of older patients were expected to be reflected in test requesting i.e. electrolyte profiles, liver profiles, lipid profiles, and thyroid profiles. Since we were unable to obtain a consolidated data on both gender and age of patients, we did not assess the relationship between the PSA requesting rates and the category of males aged 65 and over. We found a very weak correlation between the adjusted request rates of selected laboratory tests and the percentage distribution of patients of age over 65, with τ ranging from 0.08 for thyroid profiles to 0.23 for lipid profiles (supplementary table S1). Since previous studies reported on a higher rate of testing of thyroid hormones in females,27 we looked at the strength of a relationship between the percentage of females in individual GP practices and requesting rates for thyroid profiles. We found a weak, in fact negative, association between these two characteristics, with τ = −0.2 (supplementary figure S2).

In addition, we examined the effect of gender distribution on the standardized number of PSA tests, with the PSA ordering rates expected to be higher for GP practices with higher percentage of males (supplementary figure S2). The coefficient τ = 0.2 implied a weak degree of correlation between these two variables. Note that we acknowledge the fact that a combined effect of sex and age distributions might have had a more significant effect on PSA requesting activity. However, we were unable to extract such data.

Practice setting

Figure 4 shows a temporal median-variance relationship of the standardized number of laboratory test requests for rural and urban areas. Large differences were identified for PSA, lipid profiles, thyroid profiles, and liver profiles. The median number of tests ordered annually by practices located in rural areas was higher by approximately 27-37% for PSA, 14-30% for lipid profiles, 14-38% for thyroid profiles, and 8-23% for liver profiles. For ACR and immunoglobulins the median requesting rates were lower in rural areas by 1-27% and 18-57% respectively. Across five consecutive time periods, Mann Whitney U (MWU) test showed significant differences between ‘rural’ and ‘urban’ distributions of laboratory test rates for lipid profiles (pMWU ranging from 0.00004 to 0.03) and PSA (pMWU between 0.003 and 0.03). The significant rural-urban differences in requesting activity of thyroid and liver profies (pMWU < 0.05) were observed only in the first two years of the study (table 2).

View this table:
Table 2.

The significance of differences in the distribution and variability in test request rates between GP practices located in rural and urban areas. pMWU: Mann Whitney U p-value assessing differences in distributions of laboratory test rates between rural and urban practices. pFK: Fligner-Killeen p-value referring to the significance level of differences in variances. For both tests, a p < 0.05 was considered significant (*).

Figure 4.
Figure 4.

The temporal median-variance relationship of the standardized number of laboratory test requests across the years. Circle/triangle: rural/urban general practices.

Rural practices had significantly higher variability in test requesting than urban practices at all five time points. The variance in requesting rates in rural GP practices was higher by 9-52% for electrolyte profiles, 280-460% for lipid profiles, 280-1212% for PSA, 224-367% for thyroid profiles, 29-82% for liver profiles, 2-301% for HbA1c (except for the period 2012-13 when the variance was 16% lower in rural areas), 34-50% for ACR (except for the periods of 2011-12 and 2012-13 when the variance in rural areas was lower by 15% and 16% respectively), and 36-161% for immunoglobulins (except for the period of 2015-16 when the variance was 9% lower in rural areas). Furthermore, we found the rural-urban differences in variance for ordering rates of PSA and thyroid profiles statistically significant (pFK < 0.05) (table 2)

Socioeconomic factors

We observed a very weak association between the Multiple Deprivation Measure (MDM) and requesting activity. Accordingly, the lowest Kendall τ of 0.01 was reported for HbA1c while the highest τ = 0.18 for PSA (supplementary table S3). Similarly, the relationship between the Health Deprivation & Disability rank and the standardized number of test request was the lowest for HbA1c (τ = 0.06) and highest for PSA (τ = 0.31). Again, the τ value indicated a weak correlation in both cases.

Quality and Outcomes Framework indicators

To evaluate the relationship between standardized number of laboratory tests and QOF indicator scores, we looked at the management of diabetes. There are two main reasons for that. First, the guidelines for management of diabetes are widely used by practitioners to guide the care of their patients. Secondly, HbA1c is a specific test in diabetes care and does not play an important role in the monitoring or diagnosis of any other condition.

The three target levels for HbA1c (59, 64, and 75 mmol/mol) in the QOF were introduced to improve glycaemic control across the distribution of values. We investigated the overall QOF points under these 3 categories i.e. DM007 (‘The percentage of patients with diabetes in whom the last HbA1c is 59 mmol/mol or less in the preceding 15 months’), DM008 (‘The percentage of patients with diabetes in whom the last HbA1c is 64 mmol/mol or less in the preceding 15 months’), and DM009 (‘The percentage of patients with diabetes in whom the last HbA1c is 75 mmol/mol or less in the preceding 15 months’). We also combined the number of points for each of these 3 categories, calculated the overall achievement rate, and investigated its relationship with inter-practitioner variability in test requesting of HbA1c.

All practices achieved the maximum 17 points available under QOF clinical indicator DM007. All but nine practices attained the maximum 8 points available under DM008 (range: 4.1-8.0) and 31 practices attained the maximum 10 points available under DM009 (range: 6.36-10.0). The strength of relationship between the number of HbA1c tests performed and the GP practice effectiveness, as measured by the QOF overall achievement rate (combined DM007, DM008, and DM009) was very weak (τ = 0.12).

Discussion

We evaluated temporal changes in variability and number of laboratory tests ordered by individual GP practices in the WHSCT. We also investigated a range of key demographic, socioeconomic, geographical, and clinical factors to assess whether any of these factors are likely to explain a part of the observed variation in requesting activity.

While we found an overall decrease in the median request rates for lipid profiles, thyroid profiles, liver profiles, and ACR (statistically significant only for lipid profiles), we observed an increase in the median standardized number of PSA, HbA1c, immunoglobulins, and electrolyte profiles (statistically significant only for PSA and HbA1c). Furthermore, we identified substantial differences in variation of adjusted test request rates for individual tests, with an index of variability oscillating between 2.0-2.9 for electrolyte profiles, liver profiles, and HbA1c, 2.8-3.3 for thyroid profiles, 3.1-3.7 for lipid profiles, 6.3-7.6 for PSA, and reaching up to 69.8 for immunoglobulins. Our finding of high levels of variability between practices is consistent with previous research.6,10,28,29 This large variation may suggest that a portion of ordered tests had been not clinically relevant according to standards and guidelines and therefore, had limited or no benefit to the patient care.

Temporal changes in between practice variability of request rates were associated with a reduction in variance for electrolyte profiles (16.8%), lipid profiles (15.3%), thyroid profiles (28.3%), and liver profiles (23.5%) and the increase in variation of ordering rates for ACR (40%), immunoglobulins (272%), and HbA1c (500%) over the period of investigation. The overall downward trend in variability of profile test request rates might have been related to the implementation of the demand optimization intervention in the WHSCT over the three year period from Apr 2012 to Mar 2015. The intervention was developed to support appropriate use of laboratory testing in the WHSCT and consisted of several elements including educational materials on the benefits of the optimal tests utilization, information on minimal retest intervals, the review of the test requesting processes, and financial incentive. The 500% increase in variability of HbA1c ordering rates, on the other hand, may have been caused by between practice differences in the adoption of HbA1c as a diagnostic test (from 2012) and inconsistent implementation of new guidelines on appropriate rate of diabetes monitoring.

The inter-practitioner variations in test ordering were found unrelated to demographic and socioeconomic factors. We showed that distributions of patients’ age and sex had little impact on ordering rates for a predetermined set of pathology tests. The socioeconomic status of GP practice also did not appear to identify low or high requestors of laboratory tests. No clear relationship between test ordering and age, gender or deprivation measures was reported by other studies.6,30-32

The practice location was found to be a significant factor associated with variability in test use. Both the variability and median number of request rates were generally higher in GP practices located in rural areas at all time points. This probably reflects the differences in clinical practice associated with the specific aspects of practice organisation and workflow in rural and urban practices as well as personal characteristics of general practitioners. The practice location was previously related to the between-practice variation in prescribing.33-35 Further studies are needed to explore in more detail the potential reasons for the rural-urban discrepancy in test utilization.

Finally, we found no evidence of a significant correlation between test requesting rates and clinical outcomes. This observation is consistent with other studies.10 The fact that the majority of practices attained maximum points for the three target levels for HbA1c (59, 64, and 75 mmol/mol) implies that the glycaemic control was generally good and could not explain the variability in HbA1c testing.

Implications for practice and research

The findings of our study suggest that there may be considerable potential for the rationalization of test ordering through minimizing the between practice variability in test utilization. Yet, it is important to establish whether the observed variation is, and to what extent, associated with over-requesting (unnecessary repeat requesting of tests) in GP practices with high ordering rates or on the contrary, it reflects a failure to prescribe clinically indicated tests by GP practices characterized by low use of tests. Further analysis on the degree and detection of inappropriate use of laboratory resources in primary care could contribute to improving the consistency, efficiency, and cost-effectiveness of patient diagnostics, monitoring, and treatment and hence, reduce unnecessary costs to patient care.

Further exploration of variations in requesting activity in the context of factors not considered in this study (e.g. practitioner-specific characteristics) may help identify and implement appropriate optimization strategies to manage demand for laboratory tests. Previous studies reported on the number of successful approaches in fostering best practice and reducing variation in test utilization including implementing locally agreed clinical guidelines, changing test order forms, incorporating clinical decision support tools with embedded retest interval rules, conducting audits of GPs on their request rates, and providing financial incentives.36-42 In fact, several studies showed that multifaceted interventions were most successful in optimizing laboratory demand.43,44

Finally, it is essential to better understand implications of variability in laboratory test requesting for the cost and quality of care. In particular, an important question to be answered is whether or not the growing costs associated with increased use of laboratory services has led to commensurate benefits to the patient.

Strengths and limitations

Test requesting data were directly extracted from the HSC Business Object system that captures information on tests’ use from three clinical chemistry departments of Altnagelvin Area Hospital, Tyrone County Hospital, and South West Acute Hospital. Accordingly, our analysis was based on all available data regarding requesting activity in the N. Ireland Western Health and Social Care Trust (WHSCT) in the period of 1 Apr 2011 – 31 Mar 2016 and hence, was not subject to selection bias. Furthermore, our study provides a first comprehensive insight into the use of laboratory tests and factors accounting for the variation in between practice test utilization in the WHSCT primary care system.

Due to data unavailability, we were unable to investigate the relationship between laboratory use patterns and practitioner-specific characteristics including GP’s age, education, and medical training. Such analysis could help identify potential reasons behind variation in clinical practice. Besides the lack of information on the practitioners, the present study was limited by a paucity of research evidence in this area. We were also unable to retrieve consolidated data on both gender and age of patients registered in individual GP practices and therefore, assess the combined effect of sex and age distributions on test requesting activity.

Conclusion

This study investigated the patterns and temporal changes in request rates across a range of frequently ordered laboratory tests. In addition, it explored potential factors of the substantial inter-practice variability in the use of laboratory tests and found that differences in requesting activity appear unrelated to either demographic and socioeconomic characteristics of GP practices or clinical outcome indicators. Our results highlight the need for further investigations to identify other potential factors that may account for the differences in test utilization between practitioners.

Contributors

MB and MJO had the original idea for this study. SA led the data collection. MB designed the methodology, performed the analysis, and drafted the manuscript. MJO, CM, and LM contributed to the drafting and critical revision of the manuscript.

Funding

This project was supported by the European Union’s INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB).

Competing interests

None declared.

Ethics approval

Not applicable.

Data sharing statement

No additional data are available.

Acknowledgments

The authors would wish to thank Dr KongFatt Wong-Lin for helpful discussions and Graham Moore for computing and technical support.

References

  1. 1.↵
    Newman-Toker DE, McDonald KM, Meltzer DO, et al. How much diagnostic safety can we afford, and how should we decide? A health economics perspective. BMJ Qual Saf. 2013; 22:ii11–ii20.
    OpenUrlFREE Full Text
  2. 2.↵
    Karakusevic S, Edwards N, Lewis R, et al. The future of pathology services. Nuffield Trust. 2016.
  3. 3.↵
    Smellie WSA. Demand management and test request rationalization. Ann Clin Biochem 2012; 49(4):323–36.
    OpenUrlCrossRefPubMed
  4. 4.↵
    Bareford D, Hayling A. Inappropriate use of laboratory services: long term combined approach to modify request patterns. BMJ 1990; 301(6764):1305–1307.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    An Independent Review for the Department of Health. Report of the Review of NHS Pathology Services in England. Chaired by Lord Carter of Coles. 2006.
  6. 6.↵
    Smellie WSA, Galloway MJ, Chinn D, et al. Is clinical practice variability the major reason for differences in pathology requesting patterns in general practice? Journal of Clinical Pathology. 2002; 55(4):312–314.
    OpenUrlAbstract/FREE Full Text
  7. 7.↵
    Sá L, Teixeira AS, Tavares F et al. Diagnostic and laboratory test ordering in Northern Portuguese Primary Health Care: a cross-sectional study. BMJ Open. 2017; 7(11):e018509.
    OpenUrlAbstract/FREE Full Text
  8. 8.↵
    Kwok J, Jones B. Unnecessary repeat requesting of tests: an audit in a government hospital immunology laboratory. Journal of Clinical Pathology. 2005; 58(5):457–462.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    Vaidya B, Ukoumunne OC, Shuttleworth J, et al. Variability in thyroid function test requests across general practices in south-west England. Qual Prim Care. 2013; 21: 143–8.
    OpenUrl
  10. 10.↵
    O’Kane MJ, Casey L, Lynch PM, et al. Clinical outcome indicators, disease prevalence and test request variability in primary care. Ann Clin Biochem 2011; 48(2):155–158.
    OpenUrlCrossRefPubMed
  11. 11.↵
    Smellie W, Galloway M, Chinn D. Benchmarking general practice use of pathology services: a model for monitoring change. Journal of Clinical Pathology. 2000; 53(6):476– 480.
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    Weydert JA, Nobbs ND, Feld R, et al. A simple, focused, computerized query to detect overutilization of laboratory tests. Arch Pathol Lab Med 2005; 129(9):1141–1143.
    OpenUrlPubMedWeb of Science
  13. 13.
    Wong ET, McCarron MM, Shaw ST. Ordering of laboratory tests in a teaching hospital: can it be improved? JAMA 1983; 249(22):3076–3080.
    OpenUrlCrossRefPubMedWeb of Science
  14. 14.
    Young DW. Improving laboratory usage: a review. Postgrad Med J 1988; 64(750):283–289.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    Epstein AM, McNeil BJ. Relationship of beliefs and behavior in test ordering. Am J Med 1986; 80:865–870.
    OpenUrlCrossRefPubMedWeb of Science
  16. 16.↵
    van Diepen S, Bakal JA, Lin M et al. Variation in critical care unit admission rates and outcomes for patients with acute coronary syndromes or heart failure among high- and low-volume cardiac hospitals. J Am Heart Assoc 2015; 4:e001708.
    OpenUrlAbstract/FREE Full Text
  17. 17.↵
    Adam MA, Goffredo P, Youngwirth L et al. Same thyroid cancer, different national practice guidelines: When discordant American Thyroid Association and National Comprehensive Cancer Network surgery recommendations are associated with compromised patient outcome. Surgery 2016; 159:41–50.
    OpenUrl
  18. 18.↵
    Northern Ireland Statistics and Research Agency. Review of the Statistical Classification and Delineation of Settlements. 2015. Available at: http://www.nisra.gov.uk/archive/geography/review-of-the-statistical-classification-and-delineation-of-settlements-march-2015.pdf. Accessed: Aug 2018.
  19. 19.↵
    Northern Ireland Statistics and Research Agency. Northern Ireland Multiple Deprivation Measures 2017. 2017. Available at: https://www.nisra.gov.uk/publications/nimdm17-results. Accessed: Jul 2018.
  20. 20.↵
    Department of Health. Quality and outcomes framework (QOF) achievement data 2015/16. 2016. Available at: https://www.health-ni.gov.uk/publications/quality-and-outcomes-framework-qof-achievement-data-201516. Accessed: Aug 2018
  21. 21.↵
    Department for Environment, Food & Rural Affairs. Rural Urban Classification. 2016. Available at: https://www.gov.uk/government/collections/rural-urban-classification. Accessed: Aug 2018.
  22. 22.↵
    Sen A, Srivastava M. Regression analysis: theory, methods, and applications. Springer Science & Business Media; 2012.
  23. 23.↵
    Jekel JF, Katz DL, Elmore JG et al. Epidemiology, biostatistics and preventive medicine. Elsevier Health Sciences; 2007.
  24. 24.↵
    Conover WJ, Johnson ME, Johnson MM. A comparative study of tests for homogeneity of variances, with applications to the outer continental shelf bidding data. Technometrics. 1981; 23(4):351–61.
    OpenUrlCrossRefWeb of Science
  25. 25.↵
    Li WK, Stanford DA, Yu H. Advances in Time Series Methods and Applications. Springer; 2016.
  26. 26.↵
    Gibbons JD, Fielden JD. Nonparametric measures of association. Sage. 1993
  27. 27.↵
    Gupta S, Verma M, Gupta AK, et al. Are we using Thyroid Function Tests Appropriately? Indian Journal of Clinical Biochemistry 2011; 26(2):178–181.
    OpenUrl
  28. 28.↵
    Mogyorosy, Z, Mogyorosy, G. Practice pattern and geographic variation in test ordering: a literature review. Orv Hetil 2006; 147:25–31.
    OpenUrlPubMed
  29. 29.↵
    Larsson, A, Palmer, M, Hulten, G, et al. Large differences in laboratory utilisation between hospitals in Sweden. Clin Chem Lab Med 2000; 38:383–9.
    OpenUrlCrossRefPubMedWeb of Science
  30. 30.↵
    Selvin, E, Steffes, MW, Zhu, H, Glycated haemoglobin, diabetes, and cardiovascular risk in nondiabetic adults. N Engl J Med 2010; 362:800–11.
    OpenUrlCrossRefPubMedWeb of Science
  31. 31.
    Miyakis, S, Karamanof, G, Liontis, M, Mountokalakis, TD. Factors contributing to inappropriate ordering of tests in an academic medical department and the effect of an educational feedback strategy. Postgrad Med J 2006; 82:823–9
    OpenUrlAbstract/FREE Full Text
  32. 32.↵
    Beckett, GJ, Toft, AD. First-line thyroid function tests – TSH alone is not enough. Clin Endocrinol 2003; 58:20–1.
    OpenUrlCrossRefPubMed
  33. 33.↵
    Bucholc M, O’Kane M, Ashe S, et al. Prescriptive variability of drugs by general practitioners. PloS One 2018; 13(2):e0189599.
    OpenUrl
  34. 34.
    Morrison J, Anderson MJ, Sutton M, Munoz-Arroyo R, McDonald S, Maxwell M, et al. Factors influencing variation in prescribing of antidepressants by general practices in Scotland. Br J Gen Pract 2009; 59(559):e25–e31.
    OpenUrlAbstract/FREE Full Text
  35. 35.↵
    Holm M, Olesen F. Factors affecting prescription of psychotropic drugs in general practice. Scandinavian journal of primary health care 1988; 6(3):169–73.
    OpenUrlCrossRef
  36. 36.↵
    Bugter-Maessen AM, Winkens RA, Grol RP, et al. Factors predicting differences among general practitioners in test ordering behaviour and in the response to feedback on test requests. Fam Pract. 1996; 13: 254–258.
    OpenUrlCrossRefPubMedWeb of Science
  37. 37.
    Baker R, Falconer Smith J, Lambert PC. Randomised controlled trial of the effectiveness of feedback in improving test ordering in general practice. Scand J Prim Health Care. 2003; 21(4):219–223.
    OpenUrlCrossRefPubMedWeb of Science
  38. 38.
    Buntinx F, Knottnerus JA, Crebolder HF, et al. Reactions of doctors to various forms of feedback designed to improve the sampling quality of cervical smears. Qual Assur Health Care 1992; 4(2):161–166.
    OpenUrlPubMed
  39. 39.
    Bunting PS, Van Walraven C. Effect of a controlled feedback intervention on laboratory test ordering by community physicians. Clin Chem. 2004; 50(2):321–326.
    OpenUrlAbstract/FREE Full Text
  40. 40.
    Showstack JA, Schroeder SA, Matsumoto MF. Changes in the use of medical technologies, 1972–1977: a study of 10 inpatient diagnoses. N Engl J Med. 1982; 306: 706–712.
    OpenUrlCrossRefPubMedWeb of Science
  41. 41.
    Pysher TJ, Bach PR, Lowichik A, et al. Chemistry test ordering patterns after elimination of predefined multitest chemistry panels in a children’s hospital. Pediatr Dev Pathol 1999; 2:446–53.
    OpenUrlPubMed
  42. 42.↵
    Martins CM, da Costa Teixeira AS, de Azevedo LF, et al. The effect of a test ordering software intervention on the prescription of unnecessary laboratory tests - a randomized controlled trial. BMC Med Inform Decis Mak 2017; 17:20.
    OpenUrl
  43. 43.↵
    Oxman AD, Thomson MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. Can Med Assoc J 1995; 153:1423–31.
    OpenUrlAbstract
  44. 44.↵
    Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet 1993; 342:1317–22.
    OpenUrlCrossRefPubMedWeb of Science
Back to top
Posted March 12, 2019.
Download PDF
Email
Primary care use of laboratory tests in Northern Ireland’s Western Health and Social Care Trust: a cross-sectional study
Magda Bucholc, Maurice J O’Kane, Ciaran Mullan, Siobhan Ashe, Liam Maguire
bioRxiv 573949; doi: https://doi.org/10.1101/573949
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools