 Methodology
 Open Access
 Published:
A versatile web app for identifying the drivers of COVID19 epidemics
Journal of Translational Medicine volume 19, Article number: 109 (2021)
Abstract
Background
No versatile web app exists that allows epidemiologists and managers around the world to comprehensively analyze the impacts of COVID19 mitigation. The http://covidwebapp.numerusinc.com/ web app presented here fills this gap.
Methods
Our web app uses a model that explicitly identifies susceptible, contact, latent, asymptomatic, symptomatic and recovered classes of individuals, and a parallel set of response classes, subject to lower pathogencontact rates. The user inputs a CSV file of incidence and, if of interest, mortality rate data. A default set of parameters is available that can be overwritten through input or online entry, and a userselected subset of these can be fitted to the model using maximumlikelihood estimation (MLE). Model fitting and forecasting intervals are specifiable and changes to parameters allow counterfactual and forecasting scenarios. Confidence or credible intervals can be generated using stochastic simulations, based on MLE values, or on an inputted CSV file containing Markov chain Monte Carlo (MCMC) estimates of one or more parameters.
Results
We illustrate the use of our web app in extracting social distancing, social relaxation, surveillance or virulence switching functions (i.e., time varying drivers) from the incidence and mortality rates of COVID19 epidemics in Israel, South Africa, and England. The Israeli outbreak exhibits four distinct phases: initial outbreak, social distancing, social relaxation, and a second wave mitigation phase. An MCMC projection of this latter phase suggests the Israeli epidemic will continue to produce into late November an average of around 1500 new case per day, unless the population practices socialrelaxation measures at least 5fold below the level in August, which itself is 4fold below the level at the start of July. Our analysis of the relatively late South African outbreak that became the world’s fifth largest COVID19 epidemic in July revealed that the decline through late July and early August was characterised by a social distancing driver operating at more than twice the percapita applicablediseaseclass (pcadc) rate of the social relaxation driver. Our analysis of the relatively early English outbreak, identified a more than 2fold improvement in surveillance over the course of the epidemic. It also identified a pcadc social distancing rate in early August that, though nearly four times the pcadc social relaxation rate, appeared to barely contain a second wave that would break out if social distancing was further relaxed.
Conclusion
Our web app provides policy makers and health officers who have no epidemiological modelling or computer coding expertise with an invaluable tool for assessing the impacts of different outbreak mitigation policies and measures. This includes an ability to generate an epidemicsuppression or curveflattening index that measures the intensity with which behavioural responses suppress or flatten the epidemic curve in the region under consideration.
Background
The corona viral disease, 2019 (COVID19) outbreak that in February, 2020, threatened to overwhelm the healthcare system of Wuhan, China, was brought under control in early March through a combination of social distancing, contact tracing and quarantine measures [1,2,3,4]. Since then, these measures have been used by municipalities, counties, states and countries around the world to bring COVID19 outbreaks under full or partial control. Many of outbreaks have subsequently experienced prominent second waves, as control measures—which we refer to as drivers—have been prematurely relaxed.
As of late August, 2020, the pandemic state of COVID19 was closing in on twenty five million recorded cases, and over 800,000 recorded deaths. In the US itself, the number of recorded cases was around 6 million and approaching 200,000 recorded deaths. Though the management of outbreaks has been impressive in some countries, in many others healthcare officials and civic leaders at various administrative levels have been in dire need of quantitative tools to help formulate and implement policies designed to flatten and ultimately extinguish state, provincial, and country level epidemics. Currently, policy assessment tools exist only in the hands of computational epidemiologists and modelling and data analysis groups. These individuals and groups are insufficient to meet the policy development and assessment needs of most communities around the world. Without easy entry, versatile, policy evaluation tools, governors, mayors, and other civic leaders responsible for implementing healthcare policy are flying blind when making critical decisions whether or not to open schools or various business sectors representing different levels of severe acute respiratory syndrome covid virus 2 (SARSCoV2) transmission risk.
Here we present an easy entry, userfriendly analytical tool: the COVID19 http://covidwebapp.numerusinc.com/ (Numerus Model Builder Data and Simulation Analysis) web app. It can be used to address questions regarding the impact of social distancing, social relaxation, changes in surveillance, implementation of contact tracing with quarantining, patient isolation, and vaccination (when widely available) on incidence and mortality rates. NMBDASA does not require the user to have a mathematical or epidemiological modelling background or an understanding of the computational procedures needed to carry out deterministic and stochastic simulations for model parameter estimation or epidemic forecasting. It only requires users to provide a commaseparated values file (CSV: a standard used by all common spreadsheet applications and data management programs) that contains the incidence and mortality time series of the particular outbreak to be analysed, to read this paper, and to undergo less than an hour of training using videos supplied for this purpose at the website. The user is also able to load a set of generic default parameters that come with our COVID19 NMBDASA, or modify these by either entering new values or manipulating sliders on web pages. We also illustrate, using data from the Israeli, South African, and English COVID19 epidemics, how the NMBDASA web app can be used to: i) forensically analyze the dynamic aspects of outbreaks by identifying implicit drivers (viz., surveillance levels, social distancing and relaxation, quarantining, improvement in therapeutics, rolling out vaccination programs); and, ii) evaluate or forecast the impacts of changes to these drivers.
Methods
Model
The epidemiological simulation and forecasting engine of our website is based on a modified SEIR (Susceptible, Exposed, Infectious, Recovered) formulation called SCLAIV (Fig. 1), which expands disease class E into a contact class C and latent class L. Individuals in C, having made contact with SARSCoV2, can either thwart potential infection (e.g., through physical barriers or operation of the innate immune system) and return to S or succumb and moving onto L. SCLAIV also adds an asymptomatic infectious class A to the general infectious component of an SEIR process, which is known to be important component of SARSCoV2 transmission [5,6,7,8]. Individuals in A are assumed to be less infectious than in the class I [9] and can either move to I or directly to the acquired immunity (i.e., akin to naturally “vaccinated”) class V. A SCLAIV+D formulation also explicitly separates out the removed class R in the SEIR process into V and the class D of individuals that have died.
SEIR and SCLAIV+D formulations need to be augmented to include the epidemiological driving process used to “flatten incidence and mortality curves” during outbreaks, if models are used to assess the impacts of healthcare policies on epidemics. The structure and equation details of our full SCLAIV+D+response model are provided in Appendix A of the Additional file 1. Details of our discrete time deterministic and stochastic implementations of our SCLAIV+D+response model, at the computational core of our web app, can be found in Additional file1: Appendix B. This implementation includes 8 response drivers (Fig. 1), each of which can either be specified as a constant or time varying rate—the latter, specifically, as a five parameter switching function (Additional file 1: Appendix A.3; Fig. A.2). These driving rates are responsible for transferring individuals among basic SCLAIV and SCLAIVresponse classes (Fig. 1). Specifically, they are a social distancing rate (transfers individuals from the susceptible class S to the susceptible response class \(\hbox {S}_\text{r}\)), which involves a possible dynamic change in a contact rate reduction parameter, a social relaxation rate (transfers individuals from \(\hbox {S}_\text{r}\) to S), a quarantine rate linked to contact tracing (transfers individuals from C, L and A to \(\hbox {C}_\text{r}\), \(\hbox {L}_\text{r}\), and \(\hbox {A}_\text{r}\) respectively), case isolation (transfers individuals from I to \(\hbox {I}_\text{r}\)) and vaccination rates (transfers individuals from preinfectious classes to \(\hbox {V}_\text{r}\); see Fig. 1), the level of surveillance (i.e., proportion of cases detected) implemented to monitor the state of the outbreak, and the impacts of treatment on diseaseinduced mortality rates (the latter is also referred to as the virulence).
The number of individuals in each of these classes is denoted by the italic form of these names (e.g., S(t) and \(S_r(t)\) respectively represent the number of individuals in classes S and \(\hbox {S}_r\) at time t). Further, the proportion of susceptibles in the susceptibleresponse class over time—i.e.,
is a measure of the degree to which the epidemic is being “curveflattened” or suppressed through the social distancing and social relaxation drivers. This follows because the infection risk for individuals in class \(\hbox {S}_\text{r}\) compared with class S is reduced by a factor \(\delta _\text{con}\) (Table 1, Additional file 1: Appendix A).
Parameters and data
Many, but not all, of the basic epidemiological parameters used to model COVID19 and other infectious disease outbreaks can be obtained independently from data on the case histories individuals infected with SARSCoV2 [3, 10,11,12], while others can be estimated by fitting models to incidence, mortality and other types of data. Those estimated prior to model fitting (Table 1) are likely to include the latent, asymptomatic, recovery (i.e., from classes A, \(\hbox {A}_\text{r}\), I and \(\hbox {I}_\text{r}\) to V), and immune periods (the latter can only be estimated from future data, depending on the mean period of acquired immunity that will be realised over time), because these are more directly observable from clinical studies than, for example, contact rates and transmission probabilities associated with particular types of contact events. We also note that many parameters are correlated because they act together to produce particular types of observable phenomena, such as growth rates or changes in incidence or mortality levels from one point in time to the next. Thus, for example, contact rates, probability of pathogen transmission per contact, and average infectious period length are linked when it comes to generating the more directly estimable quantity called \(R_0\) [13], which is the average number of individuals an infected individual can expect to infect at the initial stage of an outbreak. So, if a value for the infectious period is selected a priori to be higher than it really should be, fitting a contact rate parameter value to the incidence time series using, say, maximumlikelihood estimation (MLE) will yield a concomitantly lower value for this rate than if the a priori infectious period had been lower.
In Table 1 a default set of point estimates of parameter values are listed for modelling the initial phase of a nonspecific COVID19 outbreak (also see Fig. 2). These values are used to derive probabilities of disease progression events at the individual level, scaled up to the population level using multinomial distributions (stochastic simulations) or proportions of individuals undergoing disease class transitions (deterministic simulations) (see Appendix B of Additional file 1). Further, these values can be overridden when values more appropriate to a specific region are available, or values can be selected according to their likelihoods from a distribution of values when available from a suitable source (e.g., from an MCMC procedure, as discussed in Appendix C, Additional file 1). Of course, incidence and mortality time series data, as well as response driver parameters, will be region specific and depend on policies implemented to help control local outbreaks.
The disease induced mortality rate can also be obtained directly from epidemiological data and the average mortality rate over any period of time can be estimated from the number cases observed and the ultimate fate of those cases: recovery or death. During the course of an outbreak, in the context of COVID19, however, the time between an individual being infected with SARSCoV2 and a definitive outcome can be several weeks. So this time lag has to be taken into account when estimating mortality [12]. Further, during the course of an outbreak, provided the healthcare system is not overwhelmed, we might expect mortality rates to drop as hospitals learn how to take care of the more serious cases admitted for treatment and care.
Parameters that are difficult to explicitly identify from casehistory data include the absolute contact rates as a function of behaviour (social distancing or not) and the probability of transmission as a function of the proximity, duration, and background environmental conditions (e.g., humidity, temperature, air movement, fomite characteristics [14] during contact). Also difficult to obtain is the state of the population at the time that the first few cases are detected. The first cases are the first group of individuals identified in disease class I at the nominal start of modelling an outbreak, which for convenience we denote as time \(t=0\). Of course, we anchor this point to some suitable calendar day to facilitate interpretation of results. The number of individuals assigned the value I(0) depends on the level of surveillance at time t. In a welldeveloped health care system, depending on the proportion of asymptomatic carriers and the severity of the disease, more than half the cases may easily go undetected during the first few weeks of an outbreak, though surveillance should improve during the course of the outbreak. In a poorlydeveloped healthcare system, the proportion of cases detected during the initial stage of an outbreak may be considerably lower.
Of course, only symptomatic cases will initially be detected: asymptomatic cases will require the implementation of some sort of testing regimen. Thus, at the start of an epidemic, the numbers of individuals in disease classes C (C(0)), L (L(0)) and A (A(0)) are unknown and, thus, need to be estimated. The latter two can be expressed in terms of the estimated value I(0) if the initial growth rate of the epidemic can be reasonably guessed at from past experience with similar epidemics, in which case L(0) and A(0) may computed from the estimate of I(0) (see Appendix B.2, Additional file 1) rather than having to be estimated as well. The value of C(0), however, also needs to be estimate since its relationship to I(0) depends on various other parameters, such as the thwart and succumb periods. Since these two periods are complementary rates out of the same disease class C, and (as a first cut) the net rate through C is more critical to estimate than the size of C itself, we can fix the thwart period at 1. In this case, the fit of the contact rate and succumb periods will then scale relative to the thwart period. The sensitivity of results to this firstcut assumption can later be tested or relaxed, as deemed appropriate.
The initial value V(0) for the number of individuals assumed to be immune to infection by SARSCoV2 at the start of the outbreak can be set to be 0, since this virus is thought to be novel for humans. Of course, it may emerge that some cross immunity exists for individuals that have previously been exposed to SARSCoV1 or other corona viruses [15]. In this case, initial immunity data can be used to estimate a value for V(0) or we can think of the population at risk, as discussed below, to be some appropriate fraction of its true size. In this case, a slightly higher estimate of the true contact rate will emerge from fitting the model to incidence data because contact rates are inversely proportional to the population size N(t) (see Eqs. A.17 in Additional file 1).
Initially, two of the drivers—surveillance and patient isolation rates—can be set at positive constant values, based on a crude expectation of the current level of efficiency of the healthcare infrastructure. For a developed country, we may want to set initial surveillance levels at, say, 0.5 (50%) and hospitalisation levels at, say, 0.35, or some other values that are more reflective of the severity or mildness of the disease. For countries with poor health infrastructure, or diseases milder than COVID19, values of 0.1 for both these levels may be more suitable. These guesses can be changed later, as the forensic analysis of the structure of the outbreak proceeds, and the sensitivity of projected outcomes to these initial guesses are evaluated.
Another parameter that remains somewhat uncertain at the start of an outbreak is the size N of the population at risk. In an isolated, spatially homogeneous population (e.g., an island where all individuals randomly encounter others from different parts of the island—that is, the population is well mixed at, say, a weekly scale), N should be the size of the population. In large metropolitan areas where the boundaries separating the relatively wellmixed portion of the population compared to outlying areas, we may want to set the value of N to some nominal/effective value \(N_\text{eff}\) that is, say, 1 million or even 10 million when the population size justifies this choice. Initially the actual choice is not critical, because the outbreak dynamics in standard SEIR models, including SCLAIV, is insensitive to the value of \(N_\text{eff}\) [16]. As the outbreak progresses and the total number of infections approaches, say \(10\%\) of \(N_\text{eff}\), then our choice for this value becomes significant. The reason is that \(N_\text{eff}\) determines how rapidly the exponential phase of the initial outbreak begins to lose steam as the decreasing proportion of susceptible individuals in the population begins to play a role in cresting the incidence curve. Thus for epidemics in which the total number of infections exceeds 10%, it may be useful to estimate the “effective population size” \(N_\text{eff}\) when fitting the model output to incidence data [16].
Fitting the model
NMBDASA uses a maximumlikelihood estimation (MLE) method to fit selected parameters to the incidence and simultaneously or separately to the mortality data by selecting a value for Wt:Incidence/Deaths, as discussed below (also see Fig. 3). It also provides for parameter values obtained from Bayesian Markov chain Monte Carlo (MCMC) methods [17, 18] generated elsewhere to be used in forecasting simulations (See Section C.3, Additional file 1). We plan to include MCMC directly in future versions of NMBDASA
The following is an outline of the process we used to undertake a forensic analysis of the Israeli incidence and mortality rate data and, in part, the South African and English incidence and mortality rate data. In all cases, we fitted our model to a 7day lagged moving average of the incidence data because of an obvious sevenday oscillation in new cases reported around the world [19] and, also, newly identified cases are likely associated with individuals actually transferring to the I class some days prior to this reporting event.
A stepwise procedure for running and fitting the SCLAIV model (also see the videos provided at the website (Additional file 2) is:

1
Load Data. Load the incidence and mortality data using a CSV (commaseparated values) file in which the first row is an incidence data time series and the second row is a mortality time series of the same length as the first. Load the default set of epidemic and driver parameters. If any of the default parameters require modification, these can be overwritten by directly entering data into the appropriate window and then saved by selecting the SAVE SETTINGS button for direct loading next time around.

2
Fit Initial Outbreak Phase. Fit those basic SCLAIV epidemic parameters that cannot be independently estimated by checking them off on the optimisation page (purple panel in Fig. 3), setting Wt:incidence/deaths to 1, Fit Range to some desired value, such as 14 or 30, and then pressing the Opt button (pink panel in Fig. 3). These parameters are likely to be the contact rate kappa, the succumb period P_suc, the initial value C_0 for the contact class, and the initial value I_0 for the symptomatic infectious class. Note, as discussed above, the ratio P_suc/P_thw is more salient than either parameter on its own, so we have normalised P_thw=1. After running an optimisation, the MLE values obtained can be saved using the SAVE SETTINGS button. If desired, an MLE value for the mortality rate can be obtained by unchecking all the variables use in the previous fitting, checking vir_const, resetting Wt:incidence/deaths=0 and then pressing the Opt button again. We note that fitting incidence and mortality are not entirely independent processes, but they are nearly so while the proportion dying is just a few percent and the proportion of susceptibles remains greater than 90%. By selecting Wt:incidence/deaths in between 0 and 1 we can fit both simultaneously, but are then faced with obtaining different solutions for different values of the Wt:incidence/deaths setting on (0, 1).

3
Fit Social Distancing Phase. When using the model to project the outbreak pattern beyond the initial fit phase, a point will likely be reached where the simulated incidence time series is growing much more rapidly than the empirical time series. If the reverse occurs, then the Fit Initial Outbreak Phase step described above should be repeated using a shorter Fit Range value. The reason for this over estimation is either because the effects of social distancing are beginning to take affect, or the effective population size is considerably smaller than initially anticipated. If the latter case is suspected then \(N_\text{eff}\) should be increased, or it can be replaced by an \(N_\text{eff}\) parameter whose size is estimated as part of the MLE process, as discussed in [16]. At this point, one can proceed by unchecking all variables fitted in the Fit Initial outbreak Phase optimisation procedure, and then checking all the social relaxation driver variables to carry out a new MLE fitting procedure with the Fit Range parameter now set beyond its Fit Initial Outbreak Phase by several weeks, using the data as a rough guide to where the end of the social distancing phase appears to be occurring because incidence is beginning to decline less steeply or even rise (e.g., see Fig. 4).

4
Fit Social Relaxation Phase. The model can now be used to project the outbreak pattern beyond the Fit Social Distancing Phase. If the outbreak has been successfully quelled then the fitting task is complete. In many cases, however, the outbreak may either not be dampened sufficiently fast (as in the case of the COVID19 in England, see “Results” section for details) or may even exhibit a second growth phase that is stronger than the first (Fig. 4). In either case, the MLE values obtained in the Fit Initial Outbreak Phase and Fit Social Distancing Phase can be saved and a third round of MLE fitting executed. In this case we may choose to check only the social distancing driver parameters and optimise over a Fit Range that goes several weeks beyond the Fit Social Distancing Phase. Other approaches can be taken, discussed in the different case studies below.

5
Scenario Projection and Counterfactual Assessments. We have considerable freedom to run counterfactuals and forecasts (see Appendix C.2, Additional file 1), depending on what values we give to the Fitting Interval and Finish Timing for simulation variables (Fig. 2). Forecasting using MCMC parameter estimates can also be undertaken (see Appendix C.3, Additional file 1), as illustrated in the Israel COVID19 case study. The forecasting page of the web app is designed to permit the flexibility of working with two data sets and two time windows: the first is to simulate the model in deterministic mode on an interval \([0,t_\text{fit}]\) and second to allow one (in deterministic mode) or repeated runs (in stochastic mode) on the interval \([t_\text{fit},t_\text{fin}]\). The latter can be either executed by incorporating demographic stochasticity alone, or it can include a file of parameter values obtained from an MCMC fit of the model to data.
Results
The Israeli, South African, and English COVID19 illustrative studies presented here are of limited scope. Deeper studies typically involve teams of individuals including those familiar with any idiosyncrasies of the data. Thus our examples are meant to be purely illustrative of how NMBDASA can be used rather than comprehensive analyses of the epidemics considered.
COVID19 in Israel
The first COVID19 infections in Israel occurred in late February [20, 21]. A steady stream of cases only began to be recorded starting around March 1. On March 9, a 14day home isolation was imposed on all individuals arriving from abroad. A national state of emergency was declared in the Israel on March 19 with the first recorded COVID19 death of an Israeli citizen occurring on March 20 [20, 21].
A plot of the COVID19 incidence data from March 1 to August 18 (7day lagged moving average to August 12) in Israel reveals a rising initial outbreak phase in March, followed by a steady drop during a social distancing phase to an average of fewer than 20 new cases per day during the second and third weeks of May (Fig. 4). During the last week of May, incidence began to rise steadily again during a social relaxation phase. A second wave mitigation phase set in around midJuly, as the second wave was flattened in response to measures used to try and bring the epidemic under control [22].
We begin by first using MLE to fit our basic free set of SCLAIV parameters (i.e., values for the contact rate kappa, succumb period P_suc, and initial number of individuals in classes C (C_0) and I (I_0), which were not set a priori from literature data—see Table 1) to the first two weeks of the initial outbreak data in March 2020. The fit was tight, as shown in Fig. 5 along with the four MLE values (Fig. 5 obtained from the optimisation procedure and other relevant SCLAIV parameters used in model. A subsequent fit to the first month of data indicated that the effects of social distancing were already retarding the outbreak in the second half of March (Fig. 3), yielding a new set of four MLE values applicable to fitting the model over the first 31 days. This 31day fit, however, was quite poor, so we decided to added a social distancing component to MLE fitting of the initial outbreak phase (Fig. 6a).
We thus added a social distancing switching function to our MLE fit of incidence over the first 31 days to obtain Fig. 6a, which includes simulation of the model out to day 100. This simulation indicates that the 31day MLE continues to fit incidence well to around day 80, but then fails to fit to day 100. To correct this, we could either: i.) fix the 8 MLE parameters obtained in our 31day fit (kappa, I_0, C_0, P_suc in panel Fig. 6a and SocDist_on, SocDist_init, SocDist_fnl, SocDist_switch in panel Fig. 6b), but now check the 4 social relaxation parameters SocRel_on, SocRel_init, SocRel_fnl, SocRel_switch in panel Fig. 6d to obtain a new 4 parameter MLE fit over the first 100 days; or ii) we could simultaneously fit all 12 parameters to the first 100 days. We followed the former case to obtained the fit illustrated in Fig. 6c and the 4 new MLE parameter values provided in Fig. 6d. Again we note that SocRel_init=0 is part of a solution induced by the constraint SocRel_init\(\ge 0\).
We also decided to see how well our MLE procedure would perform when fitting all 12 parameters simultaneously, but we did this in the context of all 135 days of incidence data. The result of this MLE undertaking is illustrated in Fig. 7a. In both of the above fits to the first 100 and then 135 incidence data points, we set the diseaseinduced mortality rate to 0.001 (i.e., Vir_init=0.001). The fits of the mortality rate time series thereby obtained, appear reasonable for the initial phase of the outbreak, but fail beyond the third week of April (e.g., see middle graph in Fig. 7). We thus decided to fit a switching curve to the mortality data, by fixing all the values used to obtain the MLE fit depicted in Fig. 7a, setting Wt:Incidence/Deaths to 1, and allowing the parameters Vir_init, Vir_fnl, and Vir_switch to vary in an MLE fit of the model to the mortality data. The resulting MLE fit is depicted in Fig. 7b. We note that the values for Vir_onset and Vir_steep were a priori set at 0 and 1 respectively, since diseaseinduced mortality is always in effect. The remaining MLE parameter values for the virulence switching curve are listed in Fig. 7b. Again we note that the MLE value Vir_fnl=1 represents a boundary solution. A plot of the three switching functions associated with the fits depicted in Fig. 7 are provided in Fig. 8.
Phase 4 of the Israeli COVID19 outbreak, starting around early to midJuly, exhibited considerably more oscillations in daily incidence and less directionality in growth (phases 1 and 3) or decline (phase 2) associated with it (Fig. 4) than the first three phases. Thus we speculate that phase 4 represents a mixture of different intensities of social distancing and social relaxation at different times in different parts of Israel, as various categories of workers and groups of individuals change behaviour in response to social policies and individuals’ perceptions of risk. Thus, we decided to accept the MLE parameters up to day 125 (July 4), as fitted to the first 135 days of incidence and mortality data (Fig. 6) and to carryout MCMC fits of the incidence data from day 128 to 166 (as shown in Fig. 9) with respect to constant social distancing and relaxation rates, as described in Appendix C.3 ( Additional file 1). More precisely, we carried out an MCMC fit of SocDist_const and SocRel_const (cf. bottom row of sliders in Fig. 3) on the incidence data interval [125,166], with all other parameters fixed at the values associated with the fits depicted in Fig. 7.
The distribution of the parameters obtained from these MCMC fits are provided in Appendix C ( Additional file 1). The actual forecasts are illustrated in Fig. 9. The plotted standard deviations are based on 100 runs. The mean values SocDist_const=0.1316 and SocRel_const=0.00487 obtained from the MCMC procedure respectively represent 103% and 27% of the values of the socialdistancing and socialrelaxation switching functions on day \(t=125\) (Fig. 8), which are: SocDist(125)=0.127 and SocRel(125)=0.018. The MCMC estimates of these two constants are highly correlated (the cross correlation is 0.984; Appendix C.3, Additional file 1). Thus, essentially, it appears that a fourfold reduction in the socialrelaxation levels at the beginning of July have confined incidence to the relatively high levels of 1100 to 1700 cases per day throughout September to November. It will require an additional fivefold reduction in the socialrelaxation level of early July to bring the epidemic down the point where the number of new cases per day September to November is below 200 (see Fig. D.2 in Appendix D Additional file 1, SOM, for deterministic projects that verify these ballpark figures).
COVID19 in South Africa
The first case of COVID19 was recorded in South Africa on March 5. A week later only 1 of the 17 recorded cases appeared to involve a local transmission event (https://www.voanews.com/sciencehealth/coronavirusoutbreak/southafricaseesfirstlocalcoronavirustransmission): most new cases during the first three weeks of March 2019 were associated with individuals returning from trips to Europe. The local outbreak only started to pick up the last week of March. This local importation effect is evident in the new cases plotted in Fig 10a (see region around the last week of March). Thus we decided to only start fitting the incidence data from Apri 1 onwards. As with the Israeli study, we fitted our model to a 7day lagged moving averages (Fig 10a, b), rather than the raw data themselves.
Using the stepwise approach described in Section 2.3 and illustrated more fully in the Israeli case study, we conducted a four basic SCLAIV parameter MLE fit of the incidence data from April 1 to June 30 (91 points) and projected 4 weeks beyond this to provide convincing visual evidence (Fig. 10c) that social distancing had started to play a key role in flattening the incidence curve some weeks before. We thus conducted a 4SCLAIV plus 4 socialdistancing parameters MLE fit of the first 130 incidence data points, obtaining the relatively poor fit depicted in (Fig. 10d). This fit dramatically improved when 3 surveillance parameters were added to the MLE optimisation (Fig. 10e). An additional improvement was obtained when including 4 socialrelaxation parameters in the MLE optimisation (Fig. 10f). Although Fig. 10e looks like a better fit than Fig. 10f it is not in terms of MLE (the errors associated the fits depicted in Figs. 10e and f respectively are 15643 and 5453: see Figs. D.4 & D.5 in SOM) because poorer fits in the early stages, when cases are few, are penalised more than poor fits in the later stages when cases are many. The reason for this is that the value of loglikelihood function (Eq. C.2 in Appendix C, SOM) is dependent on proportional rather than absolute deviations because computations are based on the Poisson probability of particular values arising. Also, although social relaxation switches on earlier than social distancing, this early onset has no effect until individuals begin to accumulate in the social distancing class \(\hbox {S}_\text{r}\).
COVID19 in England
The first two confirmed cases of COVID19 in England were identified on January 29 in the city of York https://metro.co.uk/2020/04/19/firstcasecoronavirusukCOVID19diagnosis12578061/. During the month of March another 56 cases in England were recorded (https://coronavirus.data.gov.uk/). Our analysis starts at this point in fitting our model to the 7day lagged moving average of new case in England, starting on March 1 and ending on April 30 (Fig. 11c, d & e) or August 10 (Fig. 11f, g).
Our first fit of our model to COVID19 incidence in England over the period March 1 to April 30 involved MLEs of the 4SCLAIV plus 4 socialdistancing switching function parameters. This reasonably fit was notably improved (the absolute loglikelhood error value dropping from 3360 to 1812) by adding 3 surveillance switching function parameters (Fig. 11d). Further improvement was obtained (loglikelhood error value now dropping to 831) by adding 4 socialrelaxation switching function parameters to the MLE fit. This 15parameter MLE fit was then extended to the full 163 point time series (i.e., up to August 10) to obtain the fit depicted in Fig. 11f (for more details on Figs. 11cf see Figures D.710, Additional file 1). Rather than accepting this fit to incidence, we carried out simultaneous fit of incidence and mortality with the inclusion of the virulence switching function parameters and setting Wt:Incidence/Deaths=0.5. Specifically, we added 3 virulence switching parameters to the 15 used to fit the incidence alone in Fig. 11f to obtain the fit to incidence depicted in Fig. 11g1 and the fit to mortality depicted in Fig. 11g2. The forms of the switching curves obtained from this MLE fit are provided in Fig. 11g3 (see Fig. D.10, Additional file 1, for more details and parameter values).
The switching functions depicted in Fig. 11g3 suggest the following. First, surveillance started out around 0.3, but rapidly doubled during the first month (March) to the asymptotic value of 0.6. Social distancing appears to only have started in earnest around the end of March raising fourfold in value through April and May. Social relaxation also started in March (the actual rate has no effect until individuals start to accumulate in the risk reduction class \(\hbox {S}_\text{r}\) through the action of social distancing), rising steadily in through May, June and July as a partial counter to the effects of the social distancing process. This social relaxation counter to social distancing remained below a quarter of the percapita social distancing level (percapita S for social distancing, percapita \(\hbox {S}_\text{r}\) for social relaxation) through most of this time, which allowed social distancing to dominate and keep the epidemic decline going throughout all of May and June. In July, however, the effect of social relaxation reversed this trend, and it remains to be seen which will dominate from mid August onwards as social behaviour adapts over time.
Discussion
Comparisons and insights
The three epidemics that we examined represents a range that includes: one of the most serious epidemics worldwide, which in late August appeared to be well passed its peak (South Africa); one of the most severe epidemics in Europe that now has been brought under control, but could well break out again if vigilance is lost (England); and a relatively large outbreak for a smaller country that exhibited a second wave considerably more severe than first, and that is now heading into a phase where the epidemic could well fester for the rest of 2020 (Israel). In all of these, our analyses uncovered putative periods of time when different driving forces were dominating: periods when social distancing provided the necessary driving force to flatten and even reverse the exponential growth phase, followed by periods when relaxation of social distancing threatened or allowed a second wave, an including periods of change in surveillance or treatment efficacy. Although statistical modelling is required to link values for these drivers to various activities, their quantification in the context of specific cases allows relative assessments to be made for each of those cases. Thus, we are able to make statements such as: the Israeli epidemic will continue to produce an average of around 1500 new case per day throughout August to November, unless the efficacy of social distancing measures rise to at least 3/4 of where they were throughout March.
With hindsight obtained during the final revision of this paper, our MCMC projections from July 7 to the end of November (Figs 9 and 12) captured very well the dip and then slight rise in the trajectory of the Israeli incidence curve for the 7 week period from July 7 to the end of August. At the end of August, however, social distancing behaviour must have greatly relaxed because an exceptionally strong third wave broke out with incidence peaking at around 5800 per day at the end of September compared with 1600 cases per day around the second peak in midJuly (Fig. 12). The occurrence of such third peaks illustrates how predictions can go wrong when behavioural drivers are limited to onoff switching. Only multiple switching of behavioural drivers can account for the type of third peak behaviour observed in the Israeli epidemic. Predicting when these switches occur, however, requires that various socioeconomic factors such as holiday periods and social distancing fatigue be taken into account.
Our SCLAIV formulation can be extended to include drivers with multiple switches. More feasible from a parameter estimation point of view, though, is to fit our SCLAIVresponse model to say a second or third wave of data, using a starting condition that corresponds to the state of the epidemic at the end of the first or second wave. The dynamics of the first, second and third waves can then be compared, thereby providing some additional insights into the way populations respond to the unfolding of local epidemics.
Most current dynamical systems models of epidemics (i.e., SEIRbased systems of difference or differential equation models) do not have the kinds of structures in place that facilitate analyses of behavioural drivers of the type included in our SCLAIVresponse formulation. In particular, our SCLAIVresponse model provides an opportunity to obtain insights that come from looking at the various fractions of individuals in various SCLAIVresponse classes over time. In addition, we expect these fractions to be more robust than estimated values of the driver parameters themselves because of colinearity issues associated with fitting models with many parameters to incidence and mortality data (e.g., in fitting the social distancing and social relaxation drivers, it is the net rate at which behavioural changes occur rather than the independent timevarying rates of the drivers themselves).
An examination of plots of the curveflattening index \(c_\text{flatten}(t)\) introduced in the Methods section (Eq. 1) allows as to compare the intensity to which behavioural factors were operating to suppress the epidemic outbreaks in Israel, South African and England over the period March to July, 2020 (Fig. 13). These plots indicate that an earlier and stronger behavioural shutdown response occurred in Israel than in England or South Africa, while behavioural suppression gradually increased in South Africa compared with moderate steady decreases in Israel and England over the period in question. The curve flattening index in Israel was clearly released for some reason during September 2020 to allow incidence to rise so dramatically during September, which was a major holiday month that included celebrations of the Jewish New Year (which occurred on September 18–20).
Strengths and weaknesses
At the end of 2020, web apps available for aiding the kinds of analyses presented in this paper are limited. The most flexible of these is the https://www.covid19sim.org/, developed by a consortium that includes the Massachusetts General Hospital, Harvard Medical School, Georgia Tech, and Boston Medical Center. The COVID19 Simulator provides “... a tool designed to help policymakers decide how to respond to the novel coronavirus.” The tool can be used to explore the impact of socialdistancing interventions by selecting one of four intensity levels applied at a selected time. The simulator does not allow the user to upload his or her own data and limits analyses to US National and State levels. Other web sites, such as https://www.idmod.org/documentation (Institute of Diseas Modeling) EMOD or Covasim, or the platform https://www.epimodel.org/index.html require users to have some coding or epidemiological modelling experience.
Strengths of the http://covidwebapp.numerusinc.com/ web app are that it allows users to input their own data, fit model parameters to data using maximumlikelihood methods, and undertake scenario and forecasting studies with the ability to manipulate an array (8 in total; see Fig. 1) of policyrelevant drivers. Additionally, the South African, English and Israeli COVID19 case studies provide clear exemplars on how the NMBDASA Web App can be used to identify which drivers dominate during different phases of an epidemic. If other healthcare and social media infrastructural data (i.e., beyond incidence and mortality rate time series) can be used to independently specify or estimate surveillance [23, 24], social distancing and relaxation [25], quarantining [4] and treatment advances, then further analyses can be undertaken to verify results. In particular, proportions of individuals in the immune class predicted by our model can be tested if appropriately collected serology data are available [26].
Although our exemplar indicates that NMBDASA can be used to perform analyses of disease outbreaks caused by directly transmissible pathogens for which incidence data alone are available, much deeper analyses can be undertaken. First, spatial structure can be taken into account [16, 27,28,29]. Second, links between model output and data may be sought that pertain to individual and societal factors influencing transmission. This can be done by making statistical links between model parameters putative factors [30, 31]. This would require the dynamic analyses of the types demonstrated here augmented with statistical models that linked dynamic measures (such as new cases growth rates over initial and later phases of the outbreak) to key factors of interest.
Critics of our SCLAIV+D+response approach to modeling COVID19 could say that: 1.) our model has too many parameters for fits to be credible; 2.) the focus is on point estimates to obtain fits of the model to incidence and mortality data, since MCMC fits are currently external to the app; 3.) many of these point estimates are either not well known or possibly not accurate; or, 4.) the results we obtain have not been adequately validated or even their robustness confirmed using sensitivity analysis [32] or other assessment techniques.
In addressing these criticisms, we note Einstein’s dictum that “Everything should be made as simple as possible, but not simpler” speaks to two ideas: the idea of Occam’s razor that the most simple of all formulations needed to capture a particular process should be used; and the idea that if a model is too simple it omits a key process altogether. SEIR models themselves conform to Occam’s razor in ignoring heterogeneities in the relative succeptibility and infectivity of individuals, and in invoking the assumption of a wellmixed population that obviates the need for considerations of spatial structure. Heterogeneity in infectivity is of importance when considering the questions of, say, the role of superspreaders [33], susceptibility and morbidity with regard to age [34], or policies related to particular subgroups in the population, such as opening schools [35]. Spatial structure is important, for example, when considering the impact of restricting travel [36] on managing COVID19 epidemics. Just as with any SEIR model, the web app can be used to focus on subgroups or spatial structure, although assumptions about links between these groups and the population at large will need to be made.
Second, since the purpose of our web app is to provide a tool for shedding light on the aggregated effects of several different behavioural and mitigating drivers as they ramp up or down over time, we need to include all drivers of interest in the context of making the model adequate to address the questions at hand [37]. In addition, we cannot identify when these drivers may be ramping up or down if we do not characterise them as switching functions. This requires a proliferation of parameters, but these parameters are not all involved in fitting the model at various stages of the outbreak. This is the reason for trying to fit the basic SCLAIV parameters that cannot be independently obtained to the initial outbreak phase and then identifying other phases where the parameters of particular drivers can be estimated. It is also why it is useful (though not necessary) to be able to fit changes in virulence to the mortality data alone once fits to the incidence data have taken place.
Third, not all parameters need to be accurately known (though the more accurate the better), if some are to be specified and others fitted to the data. For example, the initial phases of an epidemic are characterised by its growth rate per unit serial interval time. This characterising value is represented by the quantity \(R_0\), which we defined in the introduction as the average number of individuals an infected individual can expect to infect at the initial stage of an outbreak. Depending on the complexity of the model, estimation of \(R_0\) involves contact rates and infectiousness (force of infection), periods of time spent in disease classes, and even diseaseinduced mortality rates [38]. Thus, if one of these parameters is not accurately known, our experience has been [29] that the estimation process will compensate by adjusting the values of other parameters involved in the computation of \(R_0\). This compensatory process can be seen quite clearly in the context of the MCMC forecast undertaken for the fourth phase of the Israel outbreak, where we see that that correlation between the social distancing and social relaxation constants being estimated exceeds 98% (Fig. C.2, Appendix C, Additional file 1). Additionally, the question of when and where to carry out Bayesian MCMC rather than MLE model fitting of parameters is one that requires a much more extensive discussion than can be undertaken here. We will skirt around this by saying that MCMC is really important when it comes to using forecasts to mitigate risk—that is, when it is important to have a sense of how bad things might get. Maximumlikelihood estimation, however, is much easier and faster to implement and, because of its relative simplicity, may be more useful when trying to identify different phases of an outbreak and making comparative assessments on the efficacy of implementing particular mitigating drivers.
Fourth, we agree that sensitivity analyses are useful for evaluating the robustness of results and should be undertaken in studies that probe more deeply than presented here. Additionally, our SCLAIV model provides a number of auxiliary predictions, such as the proportion of individuals that are immune (i.e., the value of the variable V(t)/N(t) as it changes over time) that can be evaluated against serological data obtained through a statistically valid sampling method [39]. Deeper incountry studies, involving local experts and a wide array of auxiliary data (i.e., beyond incidence and mortality rate time series) can thus also be used to either further support or refute results obtained.
Conclusion
In summary, the NMBDASA web app is based on a model that is both relevant and appropriate [40] for carrying out the types of forensic analyses on social and mitigating drivers of epidemics illustrated in our three COVID19 case studies and, thereby, provides another tool in the epidemiologist tool box for managing outbreaks. Although additional statistical modelling is needed to relate diseaseclass structure aspects of our epidemic driver analyses, such as the proportion of susceptibles in the social distancing class \(\hbox {S}_\text{r}\) compared with the nonsocial distancing class S, to other more difficult to come by measures of social behaviour, NMBDASA provides a way to uncover diseaseclass structures that are critical to managing epidemics and mitigating the level of economic damage that has been wrought by the COVID19 pandemic [41]. In the spirit of appropriate complexity modelling [16], even though our S versus \(\hbox {S}_\text{r}\) view is only a binary representation of what is, in reality, a spectrum of social distancing behaviour, it has considerable value in comparing social distancing behaviour at different points in time within the same epidemic or different epidemics at comparable points in time. Further, NMBDASA allows other critical timevarying drivers to be identified, including surveillance that appears to be particularly salient in fitting our SCLAIV response model to the English incidence profile, and reductions in percase mortality rates that occur in all three of our illustrative studies.
COVID19 itself is not an anomaly, but one event in series of expected future events that have a past history in SARS, MERS, Ebola, not to mention avian influenza and other highly contagious emerging infectious diseases of zoonotic origin [42,43,44]. Our current experience with COVID19 will help facilitate our response to these future outbreaks and potential pandemics. The availability of computational tools, such as http://covidwebapp.numerusinc.com/, will enable policy makers and healthcare administrators to be caught less flatfooted at the start of the next outbreak than has been the case for the COVID19 pandemic.
Availability of data and materials
Data for the Israeli outbreak are available at the NMBDASA website and the authors can be contact if other data are needed.
Abbreviations
 \(c_{{\text{flattening}}}(t)\) :

Timedependent curve flattening index
 COVID19:

Corona viral disease, 2019
 CSV:

Commaseparated values
 IDM:

Institute of Disease Modeling
 MCMC:

Markov chain Monte Carlo
 MLE:

Maximumlikelihood estimation
 NMBDASA:

Numerus Model Builder Data and Simulation Analysis
 Pcadc:

Percapita applicablediseaseclass
 SM:

Supplementary Material
 SARSCoV2:

Severe acute respiratory syndrome covid virus 2
 SCLAIV+D:

Susceptible, Contact, Latent, Asymptomatic infectious, Infectious, Vaccinated, Dead disease classes
 \(\hbox {S}_\text{r}\), \(\hbox {C}_\text{r}\), \(\hbox {L}_\text{r}\), \(\hbox {A}_\text{r}\), \(\hbox {I}_\text{r}\), \(\hbox {V}_\text{r}\)::

Susceptible, Contact, Latent, Asymptomatic infectious, Infectious, Vaccinated response classes, with actual numbers in each class at time t being the italicised version, viz. S(t) and \(S_\text{r}(t)\) etc.
 SEIR:

Susceptible, Exposed, Infectious, Recovered
References
 1.
Zhang J, Litvinova M, Liang Y, Wang Y, Wang W, Zhao S, Wu Q, Merler S, Viboud C, Vespignani A, et al. Changes in contact patterns shape the dynamics of the covid19 outbreak in china. Science. 2020.
 2.
WilderSmith A, Freedman DO. Isolation, quarantine, social distancing and community containment: pivotal role for oldstyle public health measures in the novel coronavirus (2019ncov) outbreak. J Travel Med. 2020;27(2):020.
 3.
Bi Q, Wu Y, Mei S, Ye C, Zou X, Zhang Z, Liu X, Wei L, Truelove SA, Zhang T, et al. Epidemiology and transmission of covid19 in 391 cases and 1286 of their close contacts in shenzhen, china: a retrospective cohort study. The Lancet Infectious Diseases. 2020.
 4.
Tang B, Xia F, Tang S, Bragazzi NL, Li Q, Sun X, Liang J, Xiao Y, Wu J. The effectiveness of quarantine and isolation determine the trend of the covid19 epidemics in the final phase of the current outbreak in china. International Journal of Infectious Diseases. 2020.
 5.
Park SW, Cornforth DM, Dushoff J, Weitz JS. The time scale of asymptomatic transmission affects estimates of epidemic potential in the covid19 outbreak. Epidemics. 2020;100392.
 6.
Furukawa NW, Brooks JT, Sobel J. Evidence supporting transmission of severe acute respiratory syndrome coronavirus 2 while presymptomatic or asymptomatic. Emerging infectious diseases. 2020;26(7).
 7.
Ferguson N, Laydon D, Nedjati Gilani G, Imai N, Ainslie K, Baguelin M, Bhatia S, Boonyasiri A, Cucunuba Perez Z, CuomoDannenburg G, et al. Report 9: Impact of nonpharmaceutical interventions (npis) to reduce covid19 mortality and healthcare demand. Technology and Medicine: Imperial College of Science; 2020.
 8.
Li R, Pei S, Chen B, Song Y, Zhang T, Yang W, Shaman J. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (sarscov2). Science. 2020;368(6490):489–93.
 9.
Eikenberry SE, Mancuso M, Iboi E, Phan T, Eikenberry K, Kuang Y, Kostelich E, Gumel AB To mask or not to mask: Modeling the potential for face mask use by the general public to curtail the covid19 pandemic. Infectious Disease Modelling. 2020.
 10.
Lauer SA, Grantz KH, Bi Q, Jones FK, Zheng Q, Meredith HR, Azman AS, Reich NG, Lessler J. The incubation period of coronavirus disease 2019 (covid19) from publicly reported confirmed cases: estimation and application. Annals Internal Med. 2020;172(9):577–82.
 11.
Linton NM, Kobayashi T, Yang Y, Hayashi K, Akhmetzhanov AR, Jung SM, Yuan B, Kinoshita R, Nishiura H. Incubation period and other epidemiological characteristics of 2019 novel coronavirus infections with right truncation: a statistical analysis of publicly available case data. J Clin Med. 2020;9(2):538.
 12.
BarOn YM, Sender R, Flamholz AI, Phillips R, Milo R A quantitative compendium of covid19 epidemiology. arXiv preprint arXiv:2006.01283 2020.
 13.
Hethcote HW The basic epidemiology models: models, expressions for r0, parameter estimation, and applications. In: Mathematical Understanding of Infectious Disease Dynamics, pp. 1–61. World Scientific, 2009.
 14.
Van den Driessche P, Watmough J. Reproduction numbers and subthreshold endemic equilibria for compartmental models of disease transmission. Mathematical Biosci. 2002;180(1):29–48.
 15.
Sette A, Crotty S. Preexisting immunity to sarscov2: the knowns and unknowns. Nature Reviews Immunology. 2020;1–2.
 16.
Getz WM, Salter R, Muellerklein O, Yoon HS, Tallam K. Modeling epidemics: A primer and numerus model builder implementation. Epidemics. 2018;25:9–19.
 17.
Hamra G, MacLehose R, Richardson D. Markov chain monte carlo: an introduction for epidemiologists. Int J Epidemiol. 2013;42(2):627–34.
 18.
Roberts GO, Rosenthal JS, et al. General state space markov chains and mcmc algorithms. Probability Surveys. 2004;1:20–71.
 19.
RiconBecker I, Tarrasch R, Blinder P, BenEliyahu S A sevenday cycle in covid19 infection and mortality rates: Are intergenerational social interactions on the weekends killing susceptible people? medRxiv 2020.
 20.
Rossman H, Keshet A, Shilo S, Gavrieli A, Bauman T, Cohen O, Shelly E, Balicer R, Geiger B, Dor Y, et al. A framework for identifying regional outbreak and spread of covid19 from oneminute populationwide surveys. Nature Med. 2020;26(5):634–8.
 21.
Last M The first wave of covid19 in israelinitial analysis of publicly available data. medRxiv 2020.
 22.
Bodas M, Peleg K. Selfisolation compliance in the covid19 era influenced by compensation: Findings from a recent survey in israel: Public attitudes toward the covid19 outbreak and selfisolation: a cross sectional study of the adult population of israel. Health Affairs. 2020;39(6):936–41.
 23.
Yue M, Clapham HE, Cook AR. Estimating the size of a covid19 epidemic from surveillance systems. Epidemiology. 2020;31(4):567–9.
 24.
Silverman JD, Hupert N, Washburne AD. Using influenza surveillance networks to estimate statespecific prevalence of sarscov2 in the united states. Science translational medicine. 2020;12(554).
 25.
Yasaka TM, Lehrich BM, Sahyouni R. Peertopeer contact tracing: development of a privacypreserving smartphone app. JMIR mHealth uHealth. 2020;8(4):18936.
 26.
Bastos ML, Tavaziva G, Abidi SK, Campbell JR, Haraoui LP, Johnston JC, Lan Z, Law S, MacLean E, Trajman A, et al. Diagnostic accuracy of serological tests for covid19: systematic review and metaanalysis. bmj 2020;370.
 27.
Huang R, Liu M, Ding Y. Spatialtemporal distribution of covid19 in china and its prediction: A datadriven modeling analysis. J Infect Developing Countries. 2020;14(03):246–53.
 28.
Kramer AM, Pulliam JT, Alexander LW, Park AW, Rohani P, Drake JM. Spatial spread of the west africa ebola epidemic. Open Sci. 2016;3(8):160294.
 29.
Getz WM, Salter R, Mgbara W. Adequacy of seir models when epidemics have spatial structure: Ebola in sierra leone. Philosophical Transactions of the Royal Society B. 2019;374(1775):20180282.
 30.
Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, Curtis HJ, Mehrkar A, Evans D, Inglesby P, et al. Opensafely: factors associated with covid19 death in 17 million patients. Nature. 2020;1–11.
 31.
Lakshmi Priyadarsini S, Suresh M. Factors influencing the epidemiological characteristics of pandemic covid 19: A tism approach. Int J Healthcare Management. 2020;13(2):89–98.
 32.
Saltelli A, Tarantola S, Campolongo F, Ratto M Sensitivity Analysis in Practice: a Guide to Assessing Scientific Models vol. 1. Wiley Online Library, 2004.
 33.
LloydSmith JO, Schreiber SJ, Kopp PE, Getz WM. Superspreading and the effect of individual variation on disease emergence. Nature. 2005;438(7066):355.
 34.
Dowd JB, Andriano L, Brazel DM, Rotondi V, Block P, Ding X, Liu Y, Mills MC. Demographic science aids in understanding the spread and fatality rates of covid19. Proceedings of the National Academy of Sciences. 2020;117(18):9696–8.
 35.
Viner RM, Russell SJ, Croker H, Packer J, Ward J, Stansfield C, Mytton O, Bonell C, Booy R School closure and management practices during coronavirus outbreaks including covid19: a rapid systematic review. The Lancet Child & Adolescent Health 2020.
 36.
Chinazzi M, Davis JT, Ajelli M, Gioannini C, Litvinova M, Merler S, y Piontti AP, Mu K, Rossi L, Sun K, et al. The effect of travel restrictions on the spread of the 2019 novel coronavirus (covid19) outbreak. Science. 2020;368(6489):395–400.
 37.
Getz WM, Marshall CR, Carlson CJ, Giuggioli L, Ryan SJ, Romañach SS, Boettiger C, Chamberlain SD, Larsen L, D’Odorico P, et al. Making ecological models adequate. Ecology letters. 2018;21(2):153–66.
 38.
Heesterbeek JAP. A brief history of r 0 and a recipe for its calculation. Acta Biotheoretica. 2002;50(3):189–204.
 39.
Pollán M, PérezGómez B, PastorBarriuso R, Oteo J, Hernán MA, PérezOlmeda M, Sanmartín JL, FernándezGarcía A, Cruz I, de Larrea NF, et al. Prevalence of sarscov2 in spain (enecovid): a nationwide, populationbased seroepidemiological study. The Lancet. 2020.
 40.
Larsen LG, Eppinga MB, Passalacqua P, Getz WM, Rose KA, Liang M. Appropriate complexity landscape modeling. Earth Sci Rev. 2016;160:111–30.
 41.
Nicola M, Alsafi Z, Sohrabi C, Kerwan A, AlJabir A, Iosifidis C, Agha M, Agha R. The socioeconomic implications of the coronavirus and covid19 pandemic: a review. International Journal of Surgery. 2020.
 42.
Jones KE, Patel NG, Levy MA, Storeygard A, Balk D, Gittleman JL, Daszak P. Global trends in emerging infectious diseases. Nature. 2008;451(7181):990–3.
 43.
Evans TS, Shi Z, Boots M, Liu W, Olival KJ, Xiao X, Vandewoude S, Brown H, Chen JL, Civitello DJ, et al. Synergistic chinaus ecological research is essential for global emerging infectious disease preparedness. EcoHealth. 2020;1–14.
 44.
Reperant LA, Osterhaus AD Aids, avian flu, sars, mers, ebola, zik... what next? Vaccine 35. 2017;(35), 4470–4474.
 45.
Tian H, Liu Y, Li Y, Wu CH, Chen B, Kraemer MU, Li B, Cai J, Xu B, Yang Q, et al. An investigation of transmission control measures during the first 50 days of the covid19 epidemic in china. Science. 2020;368(6491):638–42.
 46.
McKinley TJ, Ross JV, Deardon R, Cook AR. Simulationbased bayesian inference for epidemic models. Computational Statistics Data Analysis. 2014;71:434–47.
 47.
Dehning J, Zierenberg J, Spitzner FP, Wibral M, Neto JP, Wilczek M, Priesemann V. Inferring change points in the spread of covid19 reveals the effectiveness of interventions. Science. 2020.
 48.
Kissler SM, Tedijanto C, Goldstein E, Grad YH, Lipsitch M. Projecting the transmission dynamics of sarscov2 through the postpandemic period. Science. 2020;368(6493):860–8.
Acknowledgements
Ludovica Luisa Vissat thanks Michalis Michaelides and Sally Paganin for providing useful guidance for the MCMC procedure.
Funding
This research was funded by NSF Grant 2032264.
Author information
Affiliations
Contributions
WMG, conceived the study, formulated the model and wrote the manuscript. Richard Salter developed the web site and the Numerus Modeling Builder software platform. RS and LLV were responsible for the MCMC simulations and the material on this in the Additional file 1. NH scrapped data from the web. All authors read and edited the final version of the paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
All authors have read the ms and agree to its publication in BMC Translational Medicine.
Competing interests
Wayne M. Getz and Richard Salter are two of three owners of Numerus Inc., which is responsible for developing and maintaining the Numerus Model Builder software platform.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Wayne M Getz and Richard Salter Cofirst authors
Supplementary Information
Additional file 1:
A Additional file is provided containing: Appendix A, details of a continuoustime version of our SCLAIV model; Appendix B, our discretetime implementation of this model; Appendix C, parameter estimation and simulation procedures, including details of our MCMC computation; and Appendix D, additional casestudy figures.
Additional file 2:
Three training videos are available with links provided by selecting the instructional material button at the http://covidwebapp.numerusinc.com/ Home page. Direct links to these videos are: Training video 1, https://www.youtube.com/watch?v=iK4VSdiMOC4; Training video 2, https://www.youtube.com/watch?v=ZBdwZaknyj4&t=604s; Traning video 3, https://www.youtube.com/watch?v=NtwcCGDog_o.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Getz, W.M., Salter, R., Luisa Vissat, L. et al. A versatile web app for identifying the drivers of COVID19 epidemics. J Transl Med 19, 109 (2021). https://doi.org/10.1186/s12967021027362
Received:
Accepted:
Published:
Keywords
 Numerus Model Builder
 SARSCoV2
 Israel
 South Africa
 England
 SEIR models
 Curveflattening/epidemicsuppression index