Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation of Inverse Seasonal Peak Mortality in Medieval Plagues, Including the Black Death, in Comparison to Modern Yersinia pestis-Variant Diseases

Abstract

Background

Recent studies have noted myriad qualitative and quantitative inconsistencies between the medieval Black Death (and subsequent “plagues”) and modern empirical Y. pestis plague data, most of which is derived from the Indian and Chinese plague outbreaks of A.D. 1900±15 years. Previous works have noted apparent differences in seasonal mortality peaks during Black Death outbreaks versus peaks of bubonic and pneumonic plagues attributed to Y. pestis infection, but have not provided spatiotemporal statistical support. Our objective here was to validate individual observations of this seasonal discrepancy in peak mortality between historical epidemics and modern empirical data.

Methodology/Principal Findings

We compiled and aggregated multiple daily, weekly and monthly datasets of both Y. pestis plague epidemics and suspected Black Death epidemics to compare seasonal differences in mortality peaks at a monthly resolution. Statistical and time series analyses of the epidemic data indicate that a seasonal inversion in peak mortality does exist between known Y. pestis plague and suspected Black Death epidemics. We provide possible explanations for this seasonal inversion.

Conclusions/Significance

These results add further evidence of inconsistency between historical plagues, including the Black Death, and our current understanding of Y. pestis-variant disease. We expect that the line of inquiry into the disputed cause of the greatest recorded epidemic will continue to intensify. Given the rapid pace of environmental change in the modern world, it is crucial that we understand past lethal outbreaks as fully as possible in order to prepare for future deadly pandemics.

Introduction

Recent reanalysis of medieval Black Death data (qualitative and quantitative) has resulted in a growing number of published works noting inconstancies between Yersinia pestis-variant disease (bubonic and pneumonic plague) and its attribution to this historical pestilence [1], [2], [3][10]. Discrepancies have been noted pertaining to unsupported vector-host dynamics [1], [4], [5], [8], epidemic velocity and peak seasonality of mortality [2], [3], [5], [9], symptomatic descriptions [1], [5], [9], [10], spatiotemporal dynamics [2], [3], [7], and empirical observations of modern Y plagues [11][15] among other factors. Nevertheless, the paradigm of medieval Black Death causation (bubonic/pneumonic plague) adopted around the turn of the 20th century remains the dominant etiologic theory.

One of the difficulties in supporting an alternative etiologic hypothesis for the Black Death is the uncertainty inherent in historical epidemic records and documentation. This uncertainty is unfortunate in that the temporal dynamics of an individual disease's epidemiological distribution can suggest transmission routes, seasonal peaks in virulence, and in replicate, a similar etiology. Yet detailed and clearly articulated descriptions of Black Death symptoms (that fail to match either bubonic or pneumonic plague) by doctors (and writers) of the period are known (e.g., Boccaccio in 1353 [16]; William Boghurst writing in 1666 [17]; Dr George Thompson describing an autopsy in 1666 [17]; Dr Nathaniel Hodges writing in 1666 [18]). In fact, by 1632, doctors in England had been asked to identify five different human-to-human infectious diseases (TB, Small Pox, Measles, French Pox, and Plague) when submitting information for the ‘Bills of Mortality’ [19].

In addition to the difficulties in reconstructing epidemiologic parameters from scattered historical quantitative data, suggesting disease etiology from historical non-empirical data (e.g., symptomatic descriptions) is even more difficult and suspect. Yet this is exactly what occurred in the late 19th century based on symptomatic comparisons between an Asian epidemic of bubonic plague [20] and selected historical accounts of the medieval Black Death. Nonetheless, historical records can be of use in extracting defensible information pertaining to an individual epidemic's parameters, while not extrapolating to an etiologic conclusion. Here, we utilize ranks rather than absolute values in order to aggregate historical mortality data – originally at varying scales of resolution from daily through monthly - from medieval “plagues” and modern bubonic and pneumonic plague outbreaks to a monthly resolution. We examine an aspect of the Black Death which has received growing attention in the literature during the last few years: the difference in the seasonality (month) of peak mortality between modern and historical plagues. We believe that using ranks of peak mortality addresses some of the issues regarding data uncertainty in historical epidemic documentation.

Materials and Methods

Quantifying Epidemiologic Data on Medieval and Modern Plagues

A number of ‘quasi-empirical’ datasets of Black Death mortality have now been transcribed from original documentation by various historians and epidemiologists, and are compiled here in this analysis. These include daily mortality at Givry, France [21] in 1348 during the primary epidemic wave (1347–1351) and St. Nizier-de-Lyon [22] at the beginning of the primary epidemic wave; daily mortality at Penrith, England, in 1597–8 [23] and Eyam, England, in 1665–66 [24], and weekly data from England and Wales after 1532, with the advent of ‘Bills of Mortality’ [25], presented here in its original weekly tabulated form (from 1639–47) and aggregated to a monthly resolution (for the years 1625 and 1666). Additional aggregated monthly mortality totals are also available for Marseille (France; 1720–21) [26], Debrecen (Hungary; 1739) [26], [27] and Moscow (1771) [26], [28].

Historical accounts, such as parish records, burial registers, Bills of Mortality, and documentary “plague tracts”, composed during the time of the Medieval Black Death (and extending through the Plague of Moscow in 1771), suggest that mortality peaked during the warm weather months between April and October. This is in stark contrast to pre-1347 monthly mortality records for England that show two peaks, one between January-February, and one between October-November [29]. This suggests a single peak replaced the pre-existing bimodal distribution of monthly deaths during the medieval Black Death [1]. Recent research results [1], [2], [30] also note this pattern of mortality and dissimilarities to observations of seasonal mortality maxima in laboratory-confirmed Y plague epidemics, which generally peak between November – April [2]. In this note, we compile monthly aggregated datasets of Y. pestis epidemics, in both bubonic [11] and pneumonic variants [12], and compare monthly peaks in mortality with those from 1348 [21], [22] and later suspected Black Death occurrences [17], [26]. (see Tables 1, 2: this includes the actual data on mortality for each outbreak included in Figure 1, 2 and 3).

thumbnail
Figure 1. Monthly Mortality Data for the Medieval Black Death and later Plague Epidemics.

Figure includes suspected Black Death epidemics through 1771, Bubonic Plague (Poona 1897, Bombay 1897, 1898), and Pneumonic Plague (Manchuria 1911). Monthly data include aggregated daily and weekly mortality records.

https://doi.org/10.1371/journal.pone.0008401.g001

thumbnail
Figure 2. Monthly Peak Mortality for both Medieval Black Death and Bubonic and Pneumonic Plagues.

Peak mortality among Y. pestis-variant diseases (bubonic and pneumonic plague) and suspected Black Death epidemics are inversely correlated by season.

https://doi.org/10.1371/journal.pone.0008401.g002

thumbnail
Figure 3. Monthly Peak Mortality for the Primary Wave of the Medieval Black Death: 1348–49.

Barcelona data is based on ecclesiastical replacements, and London data is based on wills. The peak season of mortality is consistent for multiple locations during the time series.

https://doi.org/10.1371/journal.pone.0008401.g003

thumbnail
Table 1. Recorded monthly mortality for MBD (and suspected MBD) epidemics.

https://doi.org/10.1371/journal.pone.0008401.t001

thumbnail
Table 2. Recorded monthly mortality for Y. pestis plague epidemics. Note minima in warm season.

https://doi.org/10.1371/journal.pone.0008401.t002

We limit our analysis of Y. pestis-variant plague outbreaks to the widespread, highly lethal epidemics that hit Manchuria and India prior to 1920. Plague erupted in Manchuria in 1910–11 leaving ∼60,000 dead and again in 1920–21 killing ∼9300. Crowded inns and trains in winter provided optimal conditions for close personal contact and transmission of pneumonic plague, even though the basic reproductive number (R0) for both epidemics is ∼1 [15], [31]. Living conditions in Manchuria between 1910–1920 among the fur trappers who first contracted plague and the general population resemble the crowded, unsanitary conditions common throughout Europe during the medieval Black Death. Manchuria's humid continental climate is cold in winter during the fur trade's open hunting season [15], [31], [32]. In contrast, medieval Europe experienced pronounced seasonal trade and medieval fair activity that peaked in late summer/early fall, likely increasing transmission probabilities [1], [33], [34]. Previous comparative analysis of the propagation of the 1347–1351 primary wave of the medieval Black Death through Europe versus the propagation of plague through India established that: (1) medieval Black Death mortality was two orders of magnitude greater than plague in India; (2) modern Bubonic Plague is a rural disease while the medieval Black Death afflicted both urban and rural areas; (3) medieval Black Death propagation velocities were higher than those observed in India, even though India had modern railway transportation; and (4) the areal extent of the medieval Black Death was at a maximum in late fall while India's plague extent peaked in mid-late spring [2]. To reduce unnecessary confusion, we do not analyze the Sydney 1900–02 plague epidemic since Southern Hemisphere climatological seasons are inverted [13]. However, published reports on this Y. pestis epidemic are in agreement with our findings here; daily epidemic mortality peak occurred shortly after the coldest months of the year [13].

Since the 1920's, both bubonic and pneumonic plague epidemics have expanded beyond Asia to include cases in North and South America, Africa and Australia. Typically these epidemics are isolated. Repeated pneumonic plague outbreaks in Madagascar [14] tend to be ‘small, scattered, highly localized, and self-limiting’ [14], and bear no resemblance to the medieval Black Death, which had a broad, fast-moving epidemic front in the primary wave. Furthermore, recent work has noted that pneumonic plague is much less contagious that originally assumed, and that ‘bubonic plague never spreads directly from one person to another’ [15]. The most recent pneumonic plague outbreaks have occurred in tropical environments and therefore cannot be compared to seasonal, temperate outbreaks we analyze here.

Our objective was to validate the prior suggestions of inverse mortality peaks between medieval Black Death “plagues” and modern lab-confirmed Y. pestis-caused plague, and present a comprehensive monthly mortality meta-analysis of these epidemic data. Although calibrating historical data with modern observations and levels of laboratory confirmed accuracy is not possible, an analysis of the consistency of seasonal peaks in mortality among multiple data sets is possible. In this paper, we utilize data consistency in terms of seasonal peaks in mortality to evaluate data quality and identify consistent trends in peak mortality across spatial and temporal domains. In this manner, the likelihood of bias in one data set significantly altering our conclusions becomes less probable as additional data sets support or refute our original hypothesis.

Results

Identifying Seasonal Peaks in Mortality

Figure 1 illustrates the differences in monthly mortality between Y. pestis plague and suspected medieval Black Death epidemics. It is important to note that there are few complete records of lab-confirmed bubonic or pneumonic plague epidemics, and most of the records from such epidemics are from the late 1800's and early 1900's. Figure 1 includes weekly aggregated bubonic plague records from the Indian Plague Commission for Poona (1897) and Bombay (1897 and 1898). We also include daily aggregated data from the best-known pneumonic plague epidemic, which occurred in Manchuria in 1910 and 1911 and was originally collected by Japanese administrators in Manchuria and here supplied by H. Nishiura. Mortality records of the medieval Black Death in Givry, France in 1348 (probably the most complete daily dataset of mortality during the primary wave [30]) and St. Nizier-de-Lyon, France, in 1348 (a partial daily record of the primary epidemic wave [22]) is included, along with suspected Black Death outbreaks which occurred sporadically until 1771 (these are weekly data aggregated to month). Y. pestis plague is depicted in black and suspected Black Death outbreaks are depicted in color. The figure demonstrates that an inverse seasonal association exists between aggregated monthly Black Death mortality peaks and known Y. pestis plague. The data for these Y. pestis plague epidemics indicates a peak in lethality during the cool-months of the year (Nov. – Mar.) while the Black Death was more lethal during warm-months (Apr. – Oct.). It is also interesting to note that the Manchurian pneumonic plague epidemic (human-to-human versus the vector-borne transmission route of exposure which occurs in the bubonic variant) experiences a rapid decline in lethality as seasonal temperatures warm.

Figure 2 modifies Figure 1 to symbolize only the month of peak mortality. This figure clarifies the great differences in monthly peak mortality between Y. pestis plague (peak  =  February) and suspected Black Death outbreaks (peak  =  mid-July). Suspected Black Death epidemic mortality peaks during warm-weather months (red dashed box) and Y. pestis mortality peaks during cool-weather months (blue dashed box).

Figure 3 depicts mortality records of Black Death outbreaks during the primary wave of the medieval Black Death as it passed through Europe in 1348 and 1349. Included in Figure 3 are mortality peaks from Spain (Barcelona – based on ecclesiastical replacements [35]), France (Givry [21]), London (based on register of wills [36]), central England (deaths in Halesowen [37]) and the Dioese of York (actual clerical deaths from York, Cleveland, East Riding, Nottingham [38]), and Wales (deaths in Colyan, Llanfair, Dogg, Abergwillar, Rutin Town [39]). Both 1348 and 1349 exhibit peaks during two warm-weather seasons - occurring from April through October, and no location experiences a mortality peak during the cooler months of the year.

Figure 4 illustrates weekly plague mortality recorded in London from 1639–1647 [40]. This data does not depict any large-scale, widespread epidemic; rather the graph illustrates weak endemic mortality and the mortality peaks are consistent, occurring in the late summer through early fall.

thumbnail
Figure 4. Annual Mortality Peaks Recorded in English “Bills of Mortality”: 1639–1647.

Data depict an annual peak in mortality during the warmer months of the year. Only deaths specifically noted in the records as due to “plague” are included.

https://doi.org/10.1371/journal.pone.0008401.g004

In order to compare peak mortality between Y. pestis and suspected Black Death epidemics, we assign an ordinal value to the peak month of mortality in disparate epidemic data (Jan.  = 1−Dec.  = 12) and then utilize a two-sample difference of means test (2-tailed, unequal variances assumed). The mean peak month for Y. pestis mortality is month 2 (February) and is 7.4 (mid-July) for suspected Black Death – indicating a near-exact inverse correlation between the month of peak mortality between these diseases (5.4 months between peaks). As expected, we find that a statistical comparison between the peak mortality months in Y. pestis epidemics and suspected Black Death occurrences demonstrates a highly significant difference (p<0.001). Moreover, mortality peaks by month in Figure 2 are consistent over time and exhibit no significant difference between the peak epidemic months in suspected Black Death epidemics throughout the time series (p = 0.59). A statistically significant difference (p<0.001) also occurs between Y. pestis mortality peaks and aggregated 1348–49 peaks, even when additional data from districts of Bombay and Poona during the Indian bubonic plague outbreak of 1897–98 are included. Furthermore, a significant statistical difference (p<0.001) occurs between the medieval epidemic mortality peaks and Y. pestis mortality peaks which also includes data from widespread outbreaks in seasonal, northern hemisphere locations prior to 1953 (e.g., Burma, Vietnam, Thailand [41]). In summary, basic statistical t-tests between the peak months of Y. pestis-variant mortality and historical accounts of “plague” mortality indicate that they are undoubtedly different.

Discussion

Possible Explanations for Inverse Seasonal Peaks in Mortality

Previous works [2], [3], [5] have noted seasonal discrepancies in selected Black Death records of mortality versus observed Y. pestis outbreaks. Our analysis verifies these previous assertions with a multitude of compiled historical mortality data. We offer several possible explanations for the inverse seasonality of peak mortality. One possibility is that, if the Black Death was caused by Y. pestis-variant disease, then the characteristics of that organism, and perhaps its particular genetic strain, may differ from that which exists today [6]. Another possibility is that the route of exposure during the Black Death epidemics mimicked the route of exposure during modern plague outbreaks, albeit at different times of the year. A third option is the possibility of climate changes affecting disease transmission, but we discount this possibility due to the centuries across which suspected Black Death epidemics were recorded. Fourthly, there is the possibility that the Black Death was caused by a human-to-human virus [5], which would account for many of the factors noted in contrast to Y. pestis-variant plagues that are vector-borne. We suggest that a combination of factors may be to blame for the inverse seasonal mortality peaks [3]: perhaps not only was the etiologic agent of the Black Death something other than modern Y. pestis, but that market trade and religious pilgrimage during the medieval centuries allowed for human intermingling and disease transmission around the time when such activity occurred most – the warm-season. These possibilities require much more research, including interdisciplinary investigations, in order to validate any of these explanations.

Significance

Reanalyzing the medieval Black Death and verifying its etiologic agent is becoming increasingly important, and not less so, in an age of rapid environmental and population changes. Similar changes were likely underway in the 1300's, and the primary wave of the Black Death came out of Asia and within a period of 4 years (1347–1351) killed anywhere from 30–60% of Europeans. Some event, perhaps a genetic mutation, climate shift, human-vector encounter, transportation network establishment, or a combination of environmental and human actions precipitated this deadly epidemic. As a result, we have begun analyzing historical “plague” records for as much information for reconsideration as possible. After all, our knowledge of pathogenic agents (including viruses, rickettsia, and prions, etc.) has increased exponentially since Yersin's [20] proclamation that the Black Death was an epidemic of bubonic plague.

The results presented here support prior research suggesting that there was an inverse seasonal peak in mortality between suspected Black Death epidemics and observations of Y. pestis plague mortality. The warm-season Black Death mortality peak is consistent for 420 years as illustrated in daily mortality data from Givry (1349) [21] to Moscow (1771) [26], [28]. This peak mortality is congruent with a seasonal peak in travel, trade and religious pilgrimage during this period [3]. We draw no specific etiologic conclusions from the results presented here, but do note that the frequency of published research questioning Y. pestis as the causative agent of the medieval Black Death has increased over the last decade. These findings add additional evidence toward future research into the deepening mystery of the medieval Black Death; however, this work represents only one of a number of investigational lines that may allow a reexamination of Yersin's original MBD paradigm going forward.

Acknowledgments

The authors thank Hiroshi Nishiura for providing the Manchuria data; Susan Scott for providing the Penrith and Eyam data; and John Steinberg and Helen Sullivan (REEEC Research Librarian, UIUC) for their assistance in locating the Moscow data.

Author Contributions

Conceived and designed the experiments: MRW BB. Performed the experiments: MRW BB. Analyzed the data: MRW BB. Wrote the paper: MRW BB.

References

  1. 1. Scott S, Duncan CJ (2001) Biology of plagues: Evidence from historical populations. Cambridge: Cambridge University Press . 420 p.
  2. 2. Christakos G, Olea RA, Yu HL (2007) Recent results on the spatiotemporal modeling and comparative analysis of black death and bubonic plague epidemics. Pub Hlth 121: 700–720.
  3. 3. Bossak BH, Welford MR (2009) Did medieval trade activity and a viral etiology control the spatial extent and seasonal distribution of black death mortality? Med Hypo 72: 749–752.
  4. 4. Twigg G (1984) The black death: A biological reappraisal. London: Batsford Academic and Educational . 254 p.
  5. 5. Scott S, Duncan C (2004) Return of the black death: The world's greatest serial killer. Chichester: Wiley . 310 p.
  6. 6. Wood JW, DeWitte-Avina SN (2003) Was the black death yersinial plague? Lancet Infect Dis 3: 327–328.
  7. 7. Wood JW, Ferrell RJ, DeWitte-Avina SN (2003) The temporal dynamics of the fourteenth-century black death: new evidence from English ecclesiastical records. Hum Bio 75: 427–448.
  8. 8. Karlsson G (1996) Plague without rats: The case of fifteenth century Iceland. J Medieval Hist 22: 263–284.
  9. 9. Cohn SK Jr (2002) The black death transformed: Disease and culture in early renaissance Europe. London: Arnold . 106 p.
  10. 10. Duncan CJ, Scott S (2005) What caused the black death? Postgrad Med J 81: 315–320.
  11. 11. Indian Plague Commission Report 1898–99 (1899) Bombay: Times of India. Available: http://www.nls.uk/indiapapers/find/vol/index.cfm?vbid=3734941. Accessed 2009 July 31.
  12. 12. Nishiura H (2006) Epidemiology of a primary pneumonic plague in Kantoshu, Manchuria, from 1910–1911: Statistical analysis of individual records collected by the Japanese empire. Int J Epid 35: 1059–1065.
  13. 13. Curson P, McCraken K (1989) Plague in Sydney: The anatomy of an epidemic. Kensington, N.S.W.: New South Wales University Press . 213 p.
  14. 14. Ratsitorahina M, Chanteau S, Rahalison L, Ratsifasoamanana L, Boisier P (2000) Epidemiological and diagnostic aspects of the outbreak of pneumonic plague in Madagascar. Lancet 355: 111–113.
  15. 15. Kool JL (2005) Risk of person-to-person transmission of pneumonic plague. Clin Infect Dis 40: 1166–1172.
  16. 16. Boccaccio G (1353, repr. 2002) The Decameron: Prencipe Galeotto. New York: Signet Classic. 848 p.
  17. 17. Creighton C (1965) A history of epidemics in Britain. 2nd ed. Cambridge: Frank Cass . 883 p.
  18. 18. Bell WG (1951) The great plague in London in 1665. London: The Bodley Head Ltd . 861 p.
  19. 19. Graunt J (1662) Natural and political observations made upon the bills of mortality. London. Available: http://www.edstephan.org/Graunt/bills.html. Accessed 2009 August 5.
  20. 20. Yersin A (1894) La peste bubonique a Hong-Kong. Ann Inst Pasteur 8: 662–667.
  21. 21. Gras P (1939) Le registre paroissial de Givry (1334-1357) et la peste noire en Bourgogne. Biblio de l'école des chartes 100: 295–308.
  22. 22. Biraben JN (1975) Les hommes et al peste en France et dans les pays europeens et mediterraneens. Volumes 1 (455 p.) & 2 (416 p.). Paris: Mouton.
  23. 23. Scott S (1995) Demographic study of Penrith, Cumberland, 1557-1812, with particular reference to famine, plague and smallpox. University of Liverpool, Ph.D. Dissertation.
  24. 24. Eyam Plague Data. Available: http://www.warwick.ac.uk/statsdept/staff/WSK/Courses/ST333/eyam.html. Accessed on July 28, 2009.
  25. 25. Picard L (2005) Elizabeth's London: Everyday life in Elizabethan London. London: St. Martin's Griffin . 368 p.
  26. 26. Alexander JT1980, repr. 2003 repr. 2003. Bubonic plague in early modern Russia: Public health and urban disaster. Oxford: Oxford University Press. 385 p.
  27. 27. Horvath R (1962) La statistique de la peste de Debrecen (1739–40), et du cholera de Pest (1831) en Hongrie et leurs consequences socials. Act Univeritatis Szegediensis, Sect. Jur. et. Pol. 9, Szeged.
  28. 28. Shafonskii A1775, repr. 1787 repr. 1787. Opisanie morovoi iazvy, byvshei v stolichnom gorode Moskve s 1770 po 1772 god. Russia: Moscow University Press. 622 p.
  29. 29. Shrewsbury JFD1971, repr. 2005 repr. 2005. A history of bubonic plague in the British Isles. Cambridge: Cambridge University Press . 680 p.
  30. 30. Benedictow OJ (2004) The black death 1346–1353: The complete history. Woodbridge, Suffolk: Boydell Press . 433 p.
  31. 31. Wu LT, Chun JWH, Pollitzer R (1936) Plague: a manual for medical and public health workers. Shanghai: Weishengshu National Quarantine Service . 547 p.
  32. 32. Sharov LA (1960) Life in Siberia and Manchuria, 1898–1922: A memoir. Berkeley: University of California . 300 p.
  33. 33. Abu-Lughod JL (1991) Before european hegemony: The world system A.D. 1250–1350. Oxford: Oxford University Press . 464 p.
  34. 34. Bailey M (2007) Medieval Suffolk: An economic and social history, 1200–1500. Woodbridge, Suffolk: Boydell Press . 360 p.
  35. 35. Gyug R (1983) The effects and extent of the black death of 1348: New evidence for clerical mortality in Barcelona. Medieval Stud 45: 385–398.
  36. 36. Megson BE (1998) Mortality among London citizens in the black death. Medieval Pros 19: 125–133.
  37. 37. Razi Z (1980) Life, marriage & death in a medieval parish. Cambridge: Cambridge University Press . 162 p.
  38. 38. Thompson AH (1911) Registers of John Gynewell, Bishop of Lincoln, for the years 1347–1350. Arch J 68: 301–360.
  39. 39. Shrewsbury JFD1971, repr. 2005 repr. 2005. A History of bubonic plague in the British Isles. Cambridge, UK: Cambridge University Press. 680 p.
  40. 40. Bell JS (1665) London's remembrancer or, A true accompt of every particular weeks christnings and mortality in all the years of pestilence within the cognizance of the bills of mortality, being xviii years.London: Cotes . 29. Microfilm (1982) Ann Arbor, Mich.: University Microfilms International.
  41. 41. Pollitizer R (1953) Plague studies: Epidemiology. Bull World Hlth Org 9: 131–170.