But a Vox analysis suggests that most states haven’t made the preparations needed to contain outbreaks — putting themselves at risk for a rise in Covid-19 cases and deaths should they continue to reopen. Some states have already had to backtrack on reopening measures.
Experts told me states need three things to be safe to open. State leaders, from the governor to the legislature to health departments, need to ensure the SARS-CoV-2 virus is no longer spreading unabated. They need the testing capacity to track and isolate the sick and their contacts. And they need the hospital capacity to handle a potential surge in Covid-19 cases.
More specifically, states should meet at least five basic criteria. They should see a two-week drop in coronavirus cases, indicating that the virus is actually abating. They should have fewer than four daily new cases per 100,000 people per day — to show that cases aren’t just dropping but are also below dangerous levels. They need at least 150 new tests per 100,000 people per day, letting them quickly track and contain outbreaks. They need an overall positive rate for tests below 5 percent — another critical indicator for testing capacity. And states should have at least 40 percent of their ICU beds free to actually treat an influx of people stricken with Covid-19 should it be necessary.
These metrics line up with a range of expert recommendations, as well as the various policy plans put out by both independent groups and government officials to deal with the coronavirus.
Meeting these metrics doesn’t mean that a state is ready to safely reopen its economy — a process that describes a wide range of local and state actions. And failing them doesn’t mean a state is in immediate danger of a coronavirus outbreak if it starts to reopen; with Covid-19, there’s always an element of luck and other factors.
But with these metrics, states can gauge if they have repressed the coronavirus while building the capacity to contain future outbreaks should they come. In other words, the benchmarks show how ready states are for the next phase of the fight.
So far, most states are not there. Just four states — Colorado, Connecticut, New Jersey, and New York — met four or five of the goals, which demonstrates strong progress. Twenty-five states and Washington, DC, hit two or three of the benchmarks. The remaining 19 achieved zero or one. (Alabama and Florida are excluded due to recent issues with test reporting.)
Even the states that have made the most progress aren’t safe to fully reopen. Without a vaccine or similar treatment, the threat of the coronavirus is still out there. Especially in states that suffered big outbreaks, such as Arizona and New York, even a lot of progress or some progress doesn’t mean all the underlying problems that led to an epidemic are gone.
Nor do the metrics cover everything that states should do before they can safely reopen. They don’t show, for example, if states have the capacity to do contact tracing, in which people who came into contact with someone who’s sick with Covid-19 are tracked down by “disease detectives” and quarantined. Contact tracing is key to containing an epidemic, but states don’t track how many contact tracers they’ve hired in a standardized, readily available way.
States also don’t have ready data for health care workers’ access to personal protective equipment, such as masks and gloves — a critical measure of the health care system’s readiness that’s difficult to track.
But the map gives an idea of how much progress states have made toward containing the coronavirus and keeping it contained.
States will have to follow these kinds of metrics as they reopen. If the numbers — especially coronavirus cases — go in the wrong direction again, experts said governments should be ready to bring back restrictions. If states move too quickly to reopen or respond too slowly to a turn for the worse, they could see a renewed surge in Covid-19 cases.
“Planning for reclosing is part of planning for reopening,” Mark McClellan, a health policy expert at Duke, told me. “There will be outbreaks, and there will be needs for pauses and going back — hopefully not too much if we do this carefully.”
So this will be a work in progress, at least until we get a Covid-19 vaccine or the pandemic otherwise ends, whether by natural or human means. But the metrics can at least help give states an idea of how far along they are in the fight against the coronavirus.
Goal 1: A sustained two-week drop in coronavirus cases
What’s the goal? A 10 percent drop in daily new coronavirus cases compared to two weeks ago and a 5 percent drop in cases compared to one week ago, based on data from the New York Times.
Which states meet the goal? Arizona, California, Colorado, Georgia, Mississippi, Nevada, Oregon, Texas, and Wyoming — a total of nine states.
Why is this important? Guidance from the White House and several independent groups emphasize that states need to see coronavirus cases drop consistently over two weeks before they can say they’re ready to begin reopening. After all, nothing shows you’re out of an outbreak like a sustained reduction in infections.
“The first and foremost [metric] is you want to have a continued decrease in cases,” Saskia Popescu, an infectious disease epidemiologist, told me. “It’s a huge piece.”
A simple reduction in cases compared to two weeks prior isn’t enough; it has to be a significant drop, and it has to be sustained over the two weeks. So for Vox’s map, states need at least a 10 percent drop in daily new cases compared to two weeks prior and at least a 5 percent drop compared to one week prior.
Reported cases can be a reflection of testing capacity: More testing will pick up more cases, and less testing will pick up fewer. So it’s important that the decrease occur while testing is either growing or already sufficient. And since states have recently boosted their testing abilities, increases in Covid-19 cases can also reflect improvements in testing.
Even after meeting this benchmark, continued caution is warranted. If a state meets the goal of a reduction in cases compared to one and two weeks ago but cases seemed to go up in recent days, then perhaps it’s not time to reopen just yet. And if cases have dropped but only from a very high baseline of cases, then that’s less comforting than a drop from a lower baseline.
“You have to use common sense,” Cyrus Shahpar, a director at the public health policy group Resolve to Save Lives, told me.
Goal 2: A low number of daily new Covid-19 cases
Which states meet the goal? Connecticut, Maine, New Hampshire, New Jersey, New York, and Vermont — just six states.
Why is this important? One of the best ways to know you’re getting away from a disease outbreak is to no longer see a high number of daily new infections. While there’s no universally accepted number, experts said that four daily new coronavirus cases per 100,000 people is a reasonable ceiling.
“If I go from one to two to three [coronavirus cases a day], it’s different than going from 1,000 to 2,000 to 3,000, even though the percent difference is the same,” Shahpar said. “That’s why you have to take into account the overall level, too.”
To put it another way, it’s not enough for daily new Covid-19 cases to drop, even for weeks. Cases also should fall below a certain level before a state can be deemed truly safe.
For example, Arizona has seen its daily new cases drop over the past two weeks. But its daily new cases are still, after controlling for population, the third-highest in the country. That indicates an epidemic that remains out of control.
At the same time, if your state is now below four daily new cases per 100,000 but it’s seen a recent uptick in cases, that’s a reason for caution. Even the worst-hit states, after all, began with a handful of cases before they saw an exponential surge.
But if your state is below the threshold, it’s in a pretty solid place relative to most states.
Goal 3: High coronavirus testing capacity
Which states meet the goal? Alaska, Arkansas, California, Colorado, Connecticut, Delaware, Georgia, Hawaii, Illinois, Indiana, Iowa, Kentucky, Louisiana, Maine, Maryland, Massachusetts, Michigan, Minnesota, Missouri, Montana, Nebraska, New Jersey, New Mexico, New York, North Carolina, North Dakota, Ohio, Oklahoma, Rhode Island, South Dakota, Tennessee, Texas, Utah, Vermont, Virginia, Washington, and West Virginia — 37 states. Washington, DC, did as well. (Alabama and Florida are excluded due to recent issues with test reporting.)
Why is this important? Since the beginning of the coronavirus pandemic, experts have argued that the US needs the capacity for at least 500,000 Covid-19 tests a day. Controlling for population, that adds up to about 150 new tests per 100,000 people per day.
Testing is crucial to getting the coronavirus outbreak under control. When paired with contact tracing, testing lets officials track the scale of the outbreak, isolate the sick, quarantine those the sick came into contact with, and deploy community-wide efforts as necessary. Testing and tracing are how other countries, like South Korea and Germany, have managed to control their outbreaks and started to reopen their economies.
The idea, experts said, is to have enough surveillance to detect embers before they turn into full wildfires.
“States should be shoring up their testing capacity not just for what it looks like right now while everyone’s in their homes, but as people start to move more,” Jen Kates, the director of global health and HIV policy at the Kaiser Family Foundation, told me. “As people start doing more movement, you’ll have to test more, because people are going to come into contact with each other more.”
The 500,000-a-day goal is the minimum. Some experts have recommended as many as millions of tests nationwide each day. But 500,000 is the most often-cited goal, and it’s, at the very least, a good start.
It’s preferable if states report this number by how many people they’ve tested, not just the total number of tests. For containing an outbreak, it’s generally more useful to test 500,000 people one time than to test one person 500,000 times. But some states report the figures for total tests, not the number of tested individuals — counting tests for a single person multiple times. That could skew the numbers.
This goal is also supposed to be for diagnostic tests, not antibody tests. Diagnostic tests gauge whether a person has the virus in their system and is, therefore, sick right at the moment of the test. Antibody tests check if someone ever developed antibodies to the virus to see if they had ever been sick in the past. Since diagnostic tests give a more recent gauge of the level of infection, they’re seen as much more reliable for evaluating the current state of the Covid-19 outbreak in a state.
But some states have mixed up numbers for diagnostic and antibody tests, which could skew the data collected by the Covid Tracking Project.
“The virus isn’t going to care whether they were manipulating the numbers or not in order to look more favorable; it’s going to continue to spread,” Crystal Watson, a senior scholar at the Johns Hopkins Center for Health Security, told me. “It’s better to really understand what’s going on and report that accurately.”
For states honestly reporting these numbers, though, they’re a critical measure of their ability to detect, control, and contain coronavirus outbreaks.
Goal 4: A low test positive rate
What’s the goal? Below 5 percent of coronavirus tests coming back positive over the past week, based on data from the Covid Tracking Project.
Which states meet the goal? Alaska, California, Colorado, Connecticut, Delaware, Illinois, Louisiana, Maine, Maryland, Massachusetts, Michigan, New Hampshire, New Jersey, New Mexico, New York, Ohio, Oregon, Pennsylvania, Rhode Island, Vermont, Washington, West Virginia, and Wyoming — 23 states. Washington, DC, did as well. (Alabama and Florida are excluded due to recent issues with test reporting.)
Why is this important? The positive or positivity rate, which tracks how many tests come back positive for Covid-19, is another way to measure testing capacity.
Generally, a higher positive rate suggests there’s not enough testing happening. An area with adequate testing should be testing lots and lots of people, many of whom don’t have the disease or don’t show severe symptoms. The positive testing rate in South Korea, for example, is below 1 percent. High positive rates indicate only people with obvious symptoms are getting tested, so there’s not quite enough testing to match the scope of an outbreak.
Previously, the World Health Organization (WHO) recommended a maximum positive rate of 10 percent. But the WHO more recently recommended 5 percent, which is in line with the rate for countries that have managed to better control their outbreaks, like Germany, New Zealand, and South Korea. “Even lower is better,” Shahpar said.
The positive rate data is subject to the same limitations as the overall testing data from the Covid Tracking Project. So if a state includes antibody tests in its test count, it could skew the positive rate to look better than it is. States only risk hurting themselves if they do this.
Goal 5: Availability of ICU beds
What’s the goal? Below 60 percent occupancy of ICU beds in hospitals, based on data from the US Department of Health and Human Services.
Which states meet the goal? Alaska, Colorado, Connecticut, Idaho, Illinois, Iowa, Massachusetts, Nebraska, New Hampshire, New Jersey, New Mexico, New York, North Dakota, South Dakota, Utah, Wisconsin, and Wyoming — 17 states.
Why is this important? If a pandemic hits, the health care system needs to be ready to treat the most severe cases and potentially save lives. That’s the key goal of “flattening the curve” and “raising the line,” in which social distancing helps reduce the spread of the disease so the health care system can maintain and grow its capacity to treat an influx of Covid-19 patients.
“There’s this idea that in six weeks we can open more things,” Amesh Adalja, a senior scholar at the Johns Hopkins Center for Health Security, told me. “But the virus is still there. It’s all about making sure that the case count isn’t too immense for our hospital system to deal with.”
The aim is to avoid the nightmare scenario that Italy went through when it had more Covid-19 cases than its health care system could handle, leading to hospitals turning away even dangerously ill patients.
To gauge this, experts recommended looking at ICU capacity, with states aiming to have at most 60 percent occupancy in their ICUs.
Hitting the benchmarks is the beginning, not the end
Vox’s map is just one way of tracking success against the coronavirus. Other groups have come up with their own measures, including Covid Act Now, Covid Exit Strategy, and Test and Trace. Vox’s model uses more up-to-date data than some of these other examples, while focusing not just on the state of the pandemic but also on states’ readiness to contain Covid-19 outbreaks in the future.
Very few states hit all the marks recommended by experts. But even those that do shouldn’t consider the pandemic over. They should continue to improve — for example, getting the positive rate below 1 percent, as in New Zealand — and look at even more granular metrics, such as at the city or county level.
Meeting the benchmarks, however, indicates a state is better equipped to contain future coronavirus outbreaks as it eases previous restrictions.
Experts emphasized that states have to keep hitting all these goals week after week and day after day — Covid-19 cases must remain low, testing ability needs to stay high, and hospital capacity should be good enough for an influx of patients — until the pandemic is truly over, whether thanks to a vaccine or other means. Otherwise, a future wave of coronavirus cases, as seen in past pandemics, could kill many more people.
“You need to have all the metrics met,” Popescu said. “This needs to be a very incremental, slow process to ensure success.”
And if the numbers do start trending in the wrong direction, states should be ready to shut down at least some parts of the economy again. Maybe not as much as before, as we learn which places are truly at risk of increasing spread. But experts caution that future shutdowns will likely be necessary to some extent.
“I do worry we’re going to see surges of cases and hot spots,” Watson said. “We do need to keep pushing on building those capacities. … Otherwise, we’re just rolling the dice on the spread of the virus. It’s better if we have more control of the spread.”
That’s another reason these metrics, along with broader coronavirus surveillance, are so important: They not only help show how far along states are in dealing with their current Covid-19 outbreaks, but will help track progress to stop and prevent future crises as well.
Will you become our 20,000th supporter? When the economy took a downturn in the spring and we started asking readers for financial contributions, we weren’t sure how it would go. Today, we’re humbled to say that nearly 20,000 people have chipped in. The reason is both lovely and surprising: Readers told us that they contribute both because they value explanation and because they value that other people can access it, too. We have always believed that explanatory journalism is vital for a functioning democracy. That’s never been more important than today, during a public health crisis, racial justice protests, a recession, and a presidential election. But our distinctive explanatory journalism is expensive, and advertising alone won’t let us keep creating it at the quality and volume this moment requires. Your financial contribution will not constitute a donation, but it will help keep Vox free for all. Contribute today from as little as $3.