Researchers Develop Model to Estimate False-Negative Rate for COVID-19 Tests

As of June 2020, the Food and Drug Administration (FDA) had granted emergency use authorization for more than 85 different viral DNA test kits — or assays — each with widely varying degrees of sensitivity and unknown rates of accuracy. However, with no existing gold standard test for the novel coronavirus, there’s little data on which to judge these various tests’ usefulness to municipalities’ efforts to safely re-open for business.

A team of researchers at Beth Israel Deaconess Medical Center (BIDMC) has developed a mathematical means of assessing tests’ false-negative rate. The team’s methodology, which allows an apples-to-apples comparison of the various assays’ clinical sensitivity, is published in the journal Clinical Infectious Diseases.

“For getting back to business as usual, we all agree we’ve got to massively ramp up testing to figure out who’s negative and who’s infectious — but that’s only going to work optimally if you can catch all the positive cases,” said co-corresponding author James E. Kirby, MD, director of the clinical microbiology laboratories at BIDMC. “We found that clinical sensitivities vary widely, which has clear implications for patient care, epidemiology and the social and economic management of the ongoing pandemic.”

“These results are especially important as we transition from testing mostly symptomatic individuals to more regular screening across the community,” said co-corresponding author Ramy Arnaout, MD, DPhil, associate director of the clinical microbiology laboratories at BIDMC. “How many people will be missed—the false negative rate—depends on which test is used. With our model, we are better informed to ask how likely these people are to be infectious.”

COVID test results are usually reported as simply positive or negative. However, positive individuals can harbor radically different amounts of virus, or viral load, depending on how long they’ve been infected or how severe their symptoms are. In fact, viral load can vary as much as a hundred million-fold among individuals, said Kirby.

Using data from more than 27,000 tests for COVID-19 performed at Beth Israel Lahey Health hospital sites from March 26 to May 2, 2020, Kirby, Arnaout, and colleagues first demonstrated that viral loads can be dependably reported. “This helps distinguish potential superspreaders, at one extreme, from convalescent people, with almost no virus, and therefore low likelihood of spreading the infection,” Arnaout said.

Next, the researchers estimated the clinical sensitivity and the false-negative rate first for the in-house test — which was among the first to be implemented nationwide and considered among the best in class. Analyzing repeat test results for the nearly 5,000 patients who tested positive allowed the researchers to determine that the in-house test provided a false negative in about 10 percent of cases, giving the assay a clinical sensitivity of about 90 percent.

To estimate the accuracy of other assays, the team based their calculations on each tests’ limit of detection, or LoD, defined as the smallest amount of viral DNA detectable that a test will catch 95 percent or more of the time.

Arnaout, Kirby, and colleagues demonstrated that the limit of detection can be used as a proxy to estimate a given assay’s clinical sensitivity. By the team’s calculations, an assay with a limit of detection of 1,000 copies viral DNA per mL is expected to detect just 75 percent of patients with COVID-19, providing one out of every four people with a false-negative. The team also showed that one test available today misses as many as one in three infected individuals, while another may miss up to 60 percent of positive cases.

While not every COVID positive patient missed by sensitive PCR and antigen detection tests will be infectious to others, some will, the researchers note.

“These misses will undermine public health efforts and put patients and their contacts at risk,” said Arnaout. “This must give us pause, and we really need to benchmark each new test even in our rush to increase testing capacity to understand how well they support our testing goals.”

Co-authors included Rose A. Lee, Christina F. Yen, Kenneth P. Smith, Cody Callahan, Ghee Rye Lee, and Rohit Arora, all of BIDMC.

This work was supported in part by a grant from the National Institute of Allergy and Infectious Diseases, NIH (F32 AI124590). Dr. Arnaout is principal investigator on clinical study sponsored by Abbott molecular, MitoLab, and E25Bio, unrelated to the current work. All other authors report no potential conflicts of interest.

Source: Beth Israel Deaconess Medical Center

12 Comments on "Researchers Develop Model to Estimate False-Negative Rate for COVID-19 Tests"

  1. I?ve been exploring for a little bit for any high-quality articles or blog posts on this sort of space . Exploring in Yahoo I finally stumbled upon this website. Studying this information So i?m satisfied to convey that I’ve a very good uncanny feeling I found out just what I needed. I so much certainly will make sure to don?t omit this web site and provides it a look regularly.

  2. These days of austerity and also relative anxiety about getting debt, most people balk up against the idea of using a credit card in order to make purchase of merchandise or maybe pay for a vacation, preferring, instead to rely on the actual tried along with trusted approach to making repayment – hard cash. However, if you’ve got the cash available to make the purchase completely, then, paradoxically, that is the best time to use the card for several factors.

  3. Wow! This could be one particular of the most useful blogs We have ever arrive across on this subject. Actually Wonderful. I am also a specialist in this topic so I can understand your effort.

  4. I?ve read some good stuff here. Definitely worth bookmarking for revisiting. I surprise how much effort you put to create such a fantastic informative website.

  5. Great blog post. What I would like to bring up is that personal computer memory has to be purchased if your computer still cannot cope with what you do with it. One can install two RAM memory boards having 1GB each, by way of example, but not one of 1GB and one having 2GB. One should always check the maker’s documentation for own PC to ensure what type of storage is required.

  6. Out of my research, shopping for electronic devices online can for sure be expensive, nonetheless there are some guidelines that you can use to obtain the best products. There are always ways to come across discount offers that could make one to have the best gadgets products at the smallest prices. Thanks for your blog post.

  7. One thing is that often one of the most typical incentives for applying your credit card is a cash-back or even rebate present. Generally, you’re going to get 1-5 back with various buying. Depending on the card, you may get 1 returning on most expenditures, and 5 back on expenses made from convenience stores, gasoline stations, grocery stores plus ‘member merchants’.

  8. I loved as much as you’ll receive carried out right here. The sketch is attractive, your authored material stylish. nonetheless, you command get bought an shakiness over that you wish be delivering the following. unwell unquestionably come more formerly again as exactly the same nearly very often inside case you shield this increase.

  9. Do you mind if I quote a few of your posts as long as I provide credit and sources back to your site? My blog is in the very same area of interest as yours and my users would truly benefit from some of the information you present here. Please let me know if this alright with you. Thanks a lot!

  10. Greetings! This is my first comment here so I just wanted to give a quick shout out and say I truly enjoy reading your posts. Can you recommend any other blogs/websites/forums that go over the same subjects? Thank you!

  11. Hello my loved one! I wish to say that this post is awesome, great written and come with almost all vital infos. I?d like to look extra posts like this .

  12. Wow! This blog looks just like my old one! It’s on a completely different topic but it has pretty much the same page layout and design. Superb choice of colors!

Leave a comment

Your email address will not be published.


*