Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 23, Number 4—April 2017
Dispatch

Assessing Sensitivity and Specificity of Surveillance Case Definitions for Zika Virus Disease

Author affiliations: Tan Tock Seng Hospital, Singapore

Cite This Article

Abstract

We evaluated performance of 5 case definitions for Zika virus disease surveillance in a human cohort during an outbreak in Singapore, August 26–September 5, 2016. Because laboratory tests are largely inaccessible, use of case definitions that include rash as a required clinical feature are useful in identifying this disease.

Zika virus infections in humans were first reported in Nigeria, Uganda, and Tanganyika (now Tanzania) in 1951–1952 (1,2). Until 2006, sporadic cases and small clusters of Zika virus infections were reported (3). In 2007, the first major outbreak occurred on Yap Island, where ≈1/5 infected persons were symptomatic, predominantly with rash, fever, arthralgia, and conjunctivitis (4). In a recent outbreak in Brazil in 2015, similar signs and symptoms predominated (5). Rash (67%), fever (64%), arthralgia (29%), myalgia (24%), headache (22%), and conjunctivitis (21%) were the 6 most common signs and symptoms reported during January 1964–February 2016 (3).

Unlike dengue virus (a related flavivirus), Zika virus was not considered to be a major pathogen until recent reports of its association with Guillain-Barré syndrome and microcephaly (6). Thus, there is little information on the performance of surveillance case definitions for detection of Zika virus disease.

Responding to the rapidly evolving Zika virus epidemic to guide surveillance for Zika virus disease, the US Centers for Disease Control and Prevention worked with the Council of State and Territorial Epidemiologists (CSTE) to approve an interim definition in February 2016 and a final case definition in June 2016 for noncongenital Zika virus disease as >1 of the following signs or symptoms: acute onset of fever, maculopapular rash, arthralgia, and conjunctivitis (7). The interim case definition (February 2016) of the World Health Organization (WHO) for suspected Zika virus disease includes rash or fever and >1 of the following signs or symptoms: arthralgia, arthritis, and conjunctivitis (nonpurulent/hyperemic) (8). The case definition of the European Centre for Disease Prevention and Control (ECDC) includes rash and optional symptoms in the WHO definition plus myalgia (9). The case definition of the Pan American Health Organization (PAHO) includes rash and >2 of the following signs or symptoms: fever, conjunctivitis (nonpurulent/hyperemic), arthralgia, myalgia, and periarticular edema (10).

The first outbreak of Zika virus disease in Singapore occurred in August 2016 (11). Singapore is a densely populated tropical country to which dengue fever is endemic. With the identification of the first local case of Zika virus disease, the Singapore Ministry of Health (MOH) initiated active case finding (12,13). The MOH recommended Zika virus screening for persons with fever and maculopapular rash, and 1 of the following: arthralgia, myalgia, headache, and nonpurulent conjunctivitis.

Clinical criteria for disease surveillance are a balancing act for satisfying 2 potentially conflicting needs: sensitivity and specificity. A more sensitive case definition will identify a larger proportion of true cases, but at the cost of finding a large number of cases from other causes. In comparison, a more specific case definition will provide a more accurate description of true cases, but at the expense of missing true cases (14).

The Study

We evaluated the performance of surveillance case definitions for Zika virus disease recommended by the CSTE, WHO, PAHO, ECDC, and the Singapore MOH by using a cohort of 359 adult patients with suspected Zika virus disease who came to the Institute of Infectious Diseases and Epidemiology, Tan Tock Seng Hospital, Singapore, the national referral center for Zika virus disease during the containment phase of the Zika virus outbreak during August 26– September 5, 2016. All adults living or working in the outbreak area who were sick and had symptoms that partially or fully met the MOH definition were screened for Zika virus disease.

At their first visit to the hospital, all patients had their signs and symptoms documented, and blood and urine samples were obtained for detection of Zika virus nucleic acids by reverse transcription PCR (RT-PCR) (15). Parallel testing in the hospital laboratory and at the National Public Health Laboratory (Singapore) was conducted to maximize sensitivity and negative predictive values to rule out Zika virus infection.

A total of 42.0% of the cohort had Zika virus infection confirmed in blood (4%), urine (36%), or both (60%) samples (Table 1). Most (80%) infected and noninfected patients were tested <5 days after illness onset (infected patients, mean 3.6 days; noninfected patients, mean 4.6 days). Infected and noninfected patients were similar in age and sex. No female patients were pregnant. Among Zika virus–infected patients, rash (93.3%) was the most common symptom, followed by fever (79.2%) and myalgia (42.3%). Headache, arthralgia, and conjunctivitis were reported in <25% patients with Zika virus disease. Pruritus (11.4%) and gastrointestinal symptoms (6.7%) were relatively uncommon. For patients not infected with Zika virus, fever (86.2%) was the most common symptom, followed by myalgia (59.1%) and rash (44.8%).

The case definition recommended by CSTE for use in the United States (US definition) had a sensitivity of 100% and a specificity of 2% in detecting Zika virus in the cohort (Table 2). The WHO case definition had the lowest sensitivity (38%). The Singapore MOH case definition had a sensitivity of 54% and a high specificity of 76%, and performed well in diagnosing Zika virus disease (positive likelihood ratio [LR+] 2.2, 95% CI 1.7–3.0). The performances of PAHO (LR+ 2.1, 95% CI 1.5–2.8) and ECDC (LR+ 2.1, 95 % CI 1.6–2.8) case definitions were similar.

Conclusions

Despite increasing incidence of Zika virus disease and its spread across the Americas and Asia, there is no internationally adopted common clinical criteria for the surveillance of this disease. We report a large outbreak cohort of patients with suspected Zika virus infection and comprehensive documentation of clinical symptoms and parallel RT-PCR conducted on blood and urine samples for these patients by 2 laboratories. Evaluation of the performance of surveillance case definitions in such a cohort would provide useful findings that would contribute to development of guidance for Zika virus disease surveillance.

Diagnosis of Zika virus disease remains suboptimal because of limited availability of confirmatory testing by RT-PCR during acute illness and cross-reactivity of serologic tests for Zika virus with other co-circulating flaviviruses (3,4). Thus, a good discriminatory clinical criteria for disease surveillance is crucial for prevention and control of Zika virus transmission.

The US case definition would identify all Zika virus infections and be useful for prevention of autochthonous transmission by imported cases. However, because this definition is not specific, considerable resources would be required for confirmatory testing of identified cases. The definition requires laboratory testing to report a case. Thus, sensitivity of the definition is most likely appropriate in the US setting. Conversely, the WHO case definition might miss 60% of Zika virus infections. For Zika virus disease surveillance in the absence of commercially available diagnostic laboratory tests, case definitions incorporating rash as a required clinical criteria, such as the PAHO, ECDC, and Singapore MOH case definitions, would be useful (LR+ >2), although ≈50% (range 44%–51%) of cases of Zika virus disease could be missed.

The main limitation of this study is that it included only adults. However, the small number of children infected with Zika virus during the containment phase of the outbreak in Singapore had symptoms similar to those for adults (A. Chow et al., unpub. data). Some Zika virus infections could have been misclassified as noninfections because RT-PCR could have missed infections late in the illness course or after development of antibodies against Zika virus.

In conclusion, we evaluated the performance of 5 case definitions for Zika virus disease surveillance. In the current effort to halt transmission of this virus worldwide, and with laboratory tests being largely inaccessible, use of surveillance case definitions that include rash as a required clinical criteria would provide a high yield in identifying Zika virus disease.

Dr. Chow is a preventive medicine physician at and head of the Department of Clinical Epidemiology, Institute of Infectious Diseases and Epidemiology, Tan Tock Seng Hospital, Singapore. Her primary research interest is infectious disease epidemiology

Top

References

  1. MacNamara  FN. Zika virus: a report on three cases of human infection during an epidemic of jaundice in Nigeria. Trans R Soc Trop Med Hyg. 1954;48:13945. DOIPubMedGoogle Scholar
  2. Smithburn  KC. Neutralizing antibodies against certain recently isolated viruses in the sera of human beings residing in East Africa. J Immunol. 1952;69:22334.PubMedGoogle Scholar
  3. Plourde  AR, Bloch  EM. A literature review of Zika virus. Emerg Infect Dis. 2016;22:118592. DOIPubMedGoogle Scholar
  4. Duffy  MR, Chen  TH, Hancock  WT, Powers  AM, Kool  JL, Lanciotti  RS, et al. Zika virus outbreak on Yap Island, Federated States of Micronesia. N Engl J Med. 2009;360:253643. DOIPubMedGoogle Scholar
  5. Brasil  P, Calvet  GA, Siqueira  AM, Wakimoto  M, de Sequeira  PC, Nobre  A, et al. Zika virus outbreak in Rio de Janeiro, Brazil: clinical characterization, epidemiological and virological aspects. PLoS Negl Trop Dis. 2016;10:e0004636. DOIPubMedGoogle Scholar
  6. Paploski  IA, Prates  AP, Cardoso  CW, Kikuti  M, Silva  MM, Waller  LA, et al. Time lags between exanthematous illness attributed to Zika virus, Guillain-Barré syndrome, and microcephaly, Salvador, Brazil. Emerg Infect Dis. 2016;22:143844. DOIPubMedGoogle Scholar
  7. Centers for Disease Control and Prevention. Zika virus disease and Zika virus infection, 2016 case definition, approved June 2016 [cited 2016 Oct 11]. https://wwwn.cdc.gov/nndss/conditions/zika-virus-disease-and-zika-virus-congenital-infection/case-definition/2016/
  8. World Health Organization. Zika virus disease: interim case definition. Feb 12, 2016 [cited 2016 Oct 11]. http://www.who.int/csr/disease/zika/case-definition/en/
  9. European Centre for Disease Control and Prevention. Zika virus infection: case definition, Jul 21, 2016 [cited 2016 Oct 11]. http://ecdc.europa.eu/en/healthtopics/zika_virus_infection/patient-case-management/Pages/case-definition.aspx
  10. Pan American Health Organization. Zika case definitions. Apr 1, 2016 [cited 2016 Nov 19]. http://www.paho.org/hq/index.php?option=com_content&view=article&id=11117:2015-zika-case-definitions-&Itemid=41532&lang=en
  11. Sadarangani  SP, Hsu  LY. The 2016 outbreak of Zika in Singapore. Ann Acad Med Singapore. 2016;45:3812.PubMedGoogle Scholar
  12. Maurer-Stroh  S, Mak  TM, Ng  YK, Phuah  SP, Huber  RG, Marzinek  JK, et al. South-east Asian Zika virus strain linked to cluster of cases in Singapore, August 2016. Euro Surveill. 2016;21:30347. DOIPubMedGoogle Scholar
  13. Ministry of Health Singapore. First case of locally transmitted Zika virus infection. Aug 27, 2016 [cited 2016 Oct 11]. https://www.moh.gov.sg/content/moh_web/home/pressRoom/pressRoomItemRelease/2016/first-case-of-locally-transmitted-zika-virus-infection.html
  14. Giesecke  J. Modern infectious disease epidemiology. New York: Oxford University Press; 2002.
  15. Lanciotti  RS, Kosoy  OL, Laven  JJ, Velez  JO, Lambert  AJ, Johnson  AJ, et al. Genetic and serologic properties of Zika virus associated with an epidemic, Yap State, Micronesia, 2007. Emerg Infect Dis. 2008;14:12329. DOIPubMedGoogle Scholar

Top

Tables

Top

Cite This Article

DOI: 10.3201/eid2304.161716

Table of Contents – Volume 23, Number 4—April 2017

EID Search Options
presentation_01 Advanced Article Search – Search articles by author and/or keyword.
presentation_01 Articles by Country Search – Search articles by the topic country.
presentation_01 Article Type Search – Search articles by article type and issue.

Top

Comments

Please use the form below to submit correspondence to the authors or contact them at the following address:

Angela Chow, Institute of Infectious Diseases and Epidemiology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, Singapore

Send To

10000 character(s) remaining.

Top

Page created: March 17, 2017
Page updated: March 17, 2017
Page reviewed: March 17, 2017
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
file_external