[Paper Review] Real-time projections of epidemic transmission and estimation of vaccination impact during an Ebola virus disease outbreak in the Eastern region of the Democratic Republic of Congo

Lee Worden, Rae Wannier+11 more|arXiv (Cornell University)|Nov 3, 2018

Viral Infections and Outbreaks ResearchMedicine12 references3 citations

TL;DR

This study develops and validates a multi-method real-time forecasting framework for the 2018 Ebola outbreak in eastern DRC, integrating stochastic branching processes, autoregression, Theil-Sen regression, and Gott’s law to project case counts and vaccine impact. It finds transmission is higher than expected under 62% vaccination coverage, with short-term forecasts outperforming long-term ones, and concludes the outbreak had not yet peaked, with limited vaccine impact due to conflict-related disruptions.

ABSTRACT

As of October 12, 2018, 211 cases of Ebola virus disease (EVD) were reported in North Kivu Province, Democratic Republic of Congo. Since the beginning of October the outbreak has largely shifted into regions in which active armed conflict is occurring, and in which EVD cases and their contacts are difficult for health workers to reach. We modeled EVD transmission using a branching process with gradually quenching transmission estimated from past EVD outbreaks, with outbreak trajectories conditioned on agreement with the course of the current outbreak, and with multiple levels of vaccination coverage. We used an autoregression for short-term projections, a regression model for final sizes, and a simple Gott's law rule as an ensemble of forecasts. Short-term model projections were validated against actual case counts. During validation of short-term projections, models consistently scored higher on shorter-term forecasts. Based on case counts as of October 13, the stochastic model projected a median case count of 226 by October 27 (95% prediction interval: 205-268) and 245 by November 10 (95% PI: 208-315), while the auto-regression model projected median case counts of 240 (95% PI: 215-307) and 259 (95% PI: 216-395) for those dates, respectively. Projected median final counts range from 274 to 421. Except for Gott's law, the projected probability of an outbreak surpassing 2013-2016 is exceedingly small. The stochastic model estimates that vaccine coverage in this outbreak is lower than reported in its trial. Based on our projections we believe that the epidemic had not yet peaked at the time of these estimates, though an outbreak like 2013-2016 is not likely. We estimate that transmission rates are higher than under target levels of vaccine coverage, and this model estimate may offer a surrogate indicator for the outbreak response challenges.

Motivation & Objective

• To generate real-time, data-driven projections of Ebola transmission and final outbreak size during the 2018 DRC outbreak.
• To evaluate the impact of vaccination on transmission dynamics in a conflict-affected region with limited health access.
• To validate short-term forecasting models against actual case counts during the early phase of the outbreak.
• To compare multiple forecasting methods—stochastic branching, autoregression, Theil-Sen regression, and Gott’s law—for robustness and accuracy.
• To assess whether the outbreak trajectory aligns with historical Ebola outbreaks or indicates a distinct, more severe course.

Proposed method

• Used a stochastic branching process to model transmission with gradually quenching transmission rates estimated from prior Ebola outbreaks.
• Applied negative binomial autoregression for short-term case count projections, conditioning on real-time case data.
• Employed Theil-Sen regression to estimate final outbreak sizes based on historical case count trends.
• Applied Gott’s law as a minimum-information baseline projection to form an ensemble forecast.
• Validated short-term forecasts (1–4 weeks ahead) by comparing model predictions to actual case counts collected from August 20 to October 13, 2018.
• Incorporated vaccination coverage scenarios (high, low, none) into the stochastic model to estimate vaccine impact, using West Africa-derived effectiveness estimates.

Experimental results

Research questions

• RQ1 How accurately can real-time forecasting models project short- and long-term Ebola case counts during an outbreak in a conflict zone?
• RQ2 To what extent does vaccine coverage in the current outbreak align with the 62% target level associated with effective contact tracing and vaccination in prior outbreaks?
• RQ3 Does the observed increase in case detection in conflict zones reflect higher transmission or reduced surveillance?
• RQ4 How do different forecasting methods (stochastic, autoregressive, regression, Gott’s law) compare in performance and reliability?
• RQ5 Is the current outbreak trajectory consistent with historical Ebola outbreaks, or does it indicate a distinct, more severe epidemic?

Key findings

• The stochastic model projected a median of 226 cases by October 27, 2018 (95% prediction interval: 205–268), with 245 cases by November 10 (95% prediction interval: 208–315).
• The autoregression model projected 240 cases by October 27 (95% prediction interval: 215–307) and 259 cases by November 10 (95% prediction interval: 216–395).
• Median final outbreak size projections ranged from 274 to 421 cases, depending on the model and assumptions.
• The probability of an outbreak comparable in scale to the 2013–2016 West African Ebola outbreak was deemed exceedingly small by all models except Gott’s law.
• The stochastic model estimated that actual vaccine coverage was lower than the 62% target level, indicating limited impact of vaccination due to conflict-related disruptions.
• Short-term forecasts (1–4 weeks ahead) were consistently more accurate than long-term forecasts, validating the utility of real-time model updating.