Evaluation of seven SARS-CoV-2 rapid IgM/IgG tests
RESUMEN
Introducción:

A finales de 2019, se detectó un nuevo coronavirus en China que provocó una enfermedad respiratoria aguda conocida como COVID-2019.

Objetivo:

Evaluar siete sistemas comerciales para la detección rápida de anticuerpos para determinar su sensibilidad, especificidad y robustez en nuestras condiciones para ser utilizados por el Sistema Nacional de Salud.

Métodos:

Se evaluaron siete sistemas para la detección de anticuerpos IgM/IgG. Se conformó un panel de evaluación con muestras de individuos negativos, sueros de otras afecciones previas a la pandemia y de pacientes positivos con la enfermedad.

Resultados:

Las cifras de sensibilidad general oscilan entre el 25 % y el 88 %, siendo los sistemas Realy Tech y Deep Blue los que mostraron los mejores resultados. La especificidad para ambos fue del 100 %. La tasa de IgM positiva según Realy Tech o Deep Blue aumentó a 94,1 % o 81,8 % en la etapa tardía de la enfermedad.

Conclusiones:

Los sistemas Realy Tech y Deep Blue detectaron IgM/IgG en suero y en sangre total con adecuada sensibilidad y especificidad. La reactividad cruzada no parece ser un problema. La serología en el caso de COVID-19 no puede utilizarse como diagnóstico pero permite a la vigilancia epidemiológica conocer el estado inmunológico de las poblaciones. Es fundamental analizar la respuesta inmune frente a la infección para realizar la caracterización epidemiológica y potencialmente informar el riesgo individual de futuras enfermedades y el estudio de posibles vacunas.

ABSTRACT
Introduction:

In late 2019, a new coronavirus was detected in China causing an acute respiratory illness known as COVID-2019.

Objective:

Evaluate seven commercial systems for the rapid detection of antibodies to determine their sensitivity, specificity and robustness in our conditions to be used by the National Health System.

Methods:

Seven systems were evaluated for the detection of IgM/IgG antibodies. Evaluation panel with samples from negative individuals, sera from other pathologies prior to the pandemic and from positive patients with the disease were conformed.

Results:

General sensitivity figures range between 25 and 88%, with the Realy Tech and Deep Blue systems showed the best results. The specificity for both was 100%. The IgM positive rate according to Realy Tech or Deep Blue increased to 94.1 or 81.8% in the late stage of the disease.

Conclusions:

Realy Tech and Deep Blue systems detected IgM/IgG in serum and in whole blood with adequate sensitivity and specificity. Cross-reactivity does not seem to be a problem. Serology in the case of COVID-19 cannot be used as a diagnostic but it allows epidemiological surveillance to know the immune status of populations. It’s essential to analyze the immune response against the infection to carry out epidemiological characterization and potentially inform individual risk of future disease and the study of potential vaccines.

Keywords:
    • COVID‐19;
    • lateral flow immunoassay;
    • point‐of‐care testing;
    • rapid IgM/IgG;
    • SARS-CoV-2.
Palabras clave:
    • COVID‐19;
    • inmunoensayo de flujo lateral;
    • pruebas rápidas;
    • IgM/IgG;
    • SARS‐CoV‐2.

Introduction

In December 2019, a new coronavirus emerged in China and caused an acute respiratory disease known as coronavirus disease 2019 (COVID-19).1 The etiological agent of COVID-19, the SARS-CoV-2 rapidly spread to others countries producing the most devastating pandemic of recent times. As of June 14, 2020, the virus had infected 7 759 691 persons in 185 countries, 5,3% of whom had died.

Because of the rapid increase in number of cases and uncontrolled and vast spread worldwide, the World Health Organization (WHO) declared SARS-CoV-2 a pandemic.2 Rapid identification of the etiology and sharing of the genetic sequence of the virus, followed by international collaborative efforts initiated because of emergence of SARS-CoV-2, led to rapid availability of real-time reverse transcription quantitative PCR (RT-PCR) diagnostic to confirm the viral infection.3

As in many other transmissible diseases, serological techniques to detect IgM and IgG antibodies could be of importance for serological diagnostic and seroprevalence studies. Many serological commercial kits have been developed and used in testing patient specimens for COVID‐19 by Chinese CDC, US CDC, and other private companies. Some of them are already certified by accredited international organizations

Today, there is an urgent need for a rapid, simple to use, sensitive, and accurate serological tests to quickly identify infected patients of SARS‐CoV‐2 to prevent virus transmission and to assure timely treatment of patients. Additionally, test for massive screening and probably for travelers testing are also needs. We show the results of a fast evaluation of seven SARS-CoV-2 rapid IgM/IgG tests for the detection of IgG/IgM to SARS-CoV-2 both in serum and whole blood.4,5,6,7

The fundamental objective of this work is to evaluate seven commercial systems for the rapid detection of antibodies to determine their sensitivity, specificity and robustness in our conditions for use by the National Health System.

Methods

Diagnostic tests. Seven lateral flow chromatographic immunoassays (Wondfo, Lungene, Deangel, Realy Tech, Deep Blue, Orient Gene and Assut Europe) for the qualitative detection of IgM/IgG antibodies to SARS-CoV-2 were evaluated at the Institute of Tropical Medicine “Pedro Kourí” (IPK) of Havana, Cuba. Manufacturer instructions were followed in each case. Table 1 shows the main characteristics of the evaluated tests.

All tests were performed on an immunochromatographic strip contained in a cassette on which the sample is discharged and then a buffer is added. The evaluated systems have a control line for validity. Positivity is reflected with a different line for each immunoglobulin (IgM and IgG), except in the Wondfo system that detects both in a single one line. In each kit evaluation at list two observers validate the diagnostic.

General characteristics of the lateral flow chromatographic immunoassays for IgM/IgG to Coronavirus/COVID-19 evaluated

*Detect IgM/IgG antibodies in one line.

** Except this test all the rest were developed in China.

Samples

Negative control samples include

a) Whole blood obtained by venipuncture (N= 100); from healthy volunteers work at the general areas of IPK without contact relation with patients at the hospital or samples at the laboratories of the institution.

b) 25 serum samples from IPK archives received through the national laboratory viral surveillance previous to 2020, with a confirmed diagnostic of measles, dengue, hepatitis and other respiratory viruses (Influenza A and seasonal coronavirus HKU1).

Positive samples

Positive control panel includes samples (N= 44) collected from patients symptomatic and asymptomatic hospitalized at IPK with a confirmed diagnostic of COVID-19 by RT-PCR in nasopharyngeal swabs (Modular Wuhan CoV E and RdRP genes, Roche).

Ethical issues

The study was conducted in compliance with the Declaration of Helsinki and using Good Laboratory Practices. Informed consents were obtained from patients and volunteers. The specimens tested from IPK serum archives were residual samples received through the national surveillance of viral infectious diseases in Cuba before 2020. The study maintained always the anonymity and integrity of the patient and volunteers.

Statistical analysis

The test data were collected and analyzed. Sensitivity, Specificity, Concordance, predictive value of a positive result (PPV) and predictive value of a negative result (NPV) and Kappa coefficient were calculated for each kit evaluated using an android application for viral diagnosis.8 Sensitivity was defined as the proportion of patients correctly identified as having SARS-CoV-2 infections, as initially diagnosed using nucleic acid detection of SARS-CoV-2 in respiratory samples. Specificity was defined as the proportion of SARS-CoV-2 immune naïve study participants accurately identified as negative for SARS-CoV-2.

Results

Evaluation of the seven rapid test for detection of SARS-CoV-2 IgM or/and IgG

We evaluated seven rapid tests for IgM or/and IgG detection, to determine their analytical performance and its utility in the current epidemiological Cuban situation. Of the serum samples from IPK archives with a confirmed diagnostic of measles, dengue, hepatitis and other respiratory viruses (Influenza A and seasonal coronavirus), none of them were positive in the rapid tests evaluated.

The rapid tests were evaluated using serum and whole blood samples collected from RT-PCR-positive cases with SARS-CoV-2 and for control. Table 2 shows the overall Sensitivity, Specificity, NPV and PPV, Concordance and Kappa coefficient of the seven rapid tests compared with the RT PCR in case of positive samples. In case of Lungene test is shown the results for IgG detection, as the IgM was detected only in the 21.7% of the samples tested. Figure 1 summarizes the sensitivity and specificity of the total antibodies detected by the seven rapid test.

Analytical performance of seven rapid tests for IgM or/and IgG anti- SARS CoV-2 infection

*Detect total Abs.

**The system did not detect any IgM in positive cases (serum or whole blood).

Overall sensitivity figures ranges from 25 to 88%, showing Realy Tech and Deep Blue rapid tests the better results. Similarly, overall specificity figures were almost 100% in all tests with the exception of Deangel Biological and deep Blue rapid test (96%). Wondfo, Realy Tech and Deep Blue rapid tests showed the highest concordance with SARS-CoV-2 RT-PCR (over 90%).

Realy Tech and Deep Blue tests showed the higher overall sensitivity (82 and 88% respectively) in whole blood with a good specificity and concordance while Wondfo and Deangel tests showed a lower sensitivity (43 and 59% respectively). Realy Tech and Deep Blue tests also showed in whole blood a sensitivity of 77 and 84% respectively for IgM detection exclusively but a low sensitivity for IgG detection in case of Really Tech (36%). In whole blood Deep Blue test had the better results in IgM and IgG detection than the other four tests.

In serum, Realy Tech and Deep Blue tests followed by Wondfo test showed the highest figures of overall sensitivity (75, 78 and 71% respectively). In general, the highest sensitivity of Realy Tech and Deep Blue tests both in serum and whole blood was mainly based on IgM detection. Taken IgM and IgG results together, these tests showed the higher sensitivity.

Finally, as a measure of agreement between the two techniques, we found almost perfect agreement (0.81-1.00) again in Realy Tech and Deep Blue rapid tests.

Sensitivity and specificity of IgG and IgM antibodies in seven rapid test for IgM or/and IgG anti-SARS-CoV-2 infection.

Antibody detection relative to the stages of the disease

As the proportion of patients with positive virus specific IgG and/or IgM reached 90% approximately 14 days after symptoms onset (DASO), we analyze the positivity of Realy Tech and Deep Blue tests in serum samples collected in patients at early, intermediate and at late stage of the disease. Table 3 displays the results.

Positivity (in percent) of Realy Tech and Deep Blue rapid tests in serum collected from patients according to days after symptoms onset

The IgM positive rate according Realy Tech or Deep Blue was rising from 50% in early stage to 71.4 or 100% in intermediate stage and to 94.1 or 81.8% in late stage of the disease respectively. The IgG positive rate in the confirmed patients was 25% in early, to 42.8% in intermediate stage and increasing to 76.4% in late stage according to Realy Tech test; on the contrary in case of Deep Blue test the IgG positivity did not increase over time. Combining both parameters the overall positivity remains similar to IgM detection.

Antibody detection relative to the clinical picture of the patients

To investigate whether rapid tests could help to identify infected SARS-CoV-2 individuals without symptoms, we assessed the positivity of the Realy Tech rapid test in serum collected from asymptomatic infected individuals and symptomatic patients (Fig. 2). The rapid test was positive in the 81.8 and 82.1% of asymptomatic individuals and symptomatic patients respectively included in the study. Higher figures of IgM rather than IgG antibody detection were observed.

Positivity of the Realy Tech rapid test in serum and whole blood according to the type of infection: asymptomatic and symptomatic.

Discussion

More than ever, countries need supporting diagnostic tools for the diagnostic and surveillance with adequate figures of sensitivity, specificity, rapidity as well as low cost. Antibody IgM/IgG detection, a routine diagnostic practice for many illnesses, has become a challenge for COVID-19. From one side countries need of a serological tool for a rapid and early detection of infected individuals, on the other side, there is not sufficient information on the kinetic of the humoral immune response. Consequently, rapid serological tests need to be careful evaluated.9,10

In the evaluation of immunochromatographic systems, the Realy Tech and Deep Blue tests showed the best sensitivity and specificity figures. While specificity was not a problem in kit analysis, sensitivity was below 80% in many of the systems. Although we recognize that one of the limitations of our study may be in the low number of samples analyzed. The results obtained suggest that the tests corresponding to the Realy Tech and Deep Blue systems are capable of detecting IgM both in serum and in whole blood with adequate sensitivity and specificity. It was observed that cross-reactivity to related diseases does not seem to be a problem, including other seasonal coronavirus that were discriminated by the systems, although it is necessary to see other diseases than in evaluations carried out in other studies, such as malaria or leptospirosis, they cause false positives as well as collagen diseases that, especially in the detection of IgM, can also give positivity.

Normally, when a virus invades the body, the IgM response occurs first against the virus; and with the progression of the disease, IgG antibodies begin to be produced and gradually become detectable. In the case of SARS CoV-2 infection, data have shown that positive IgM and/or IgG rates are extremely low in the first five days after the initial onset of symptoms, because antibodies are not produced in the most patients in this early stage, and they increase rapidly as the disease progresses.11,12,13,14

Unfortunately the number of samples analyzed in this study in relation to each of the stages of infection does not allow a more in-depth comparative study on the kinetics of antibodies; even more so this does not was the goal of the study in the first place. However, our results will allow a better interpretation of the rapid tests used.

Although serology in the case of COVID-19 cannot be used as a diagnostic technique because have limited utility in the diagnosis of acute covid-19 it allows epidemiological surveillance, to know the immune status of populations and in certain populations to carry out with a more economically accessible test, a screening where the disease is suspected and before a notable increase in IgM positive cases, assumes recent circulation and then apply diagnostic techniques such as PCR or antigen detection.

Even with limitations in the evaluations, or to identify acute cases and for the identification of asymptomatic and pre-symptomatic patients. Serological tests are essential to analyze the immune response against the infection to carry out their epidemiological characterization, of SARS-CoV-2 and potentially inform individual risk of future disease and the study of potential vaccines.

Acknowledgment

  • The authors thank the department of health, safety and hospital epidemiology for their contribution to this work, as well as all the volunteers who participated in it.

Bibliographic references
  • 1 . Zhonghua Liu, Xing Bing, Xue Za Zhi. Novel Coronavirus Pneumonia Emergency Response Epidemiology. The epidemiological characteristics of an outbreak of 2019 novel coronavirus diseases (COVID-19) in China. Chinese Medical Association. 2020;41:145-51. DOI: https://doi.org/10.3760/cma.j.issn.0254-6450.2020.02.003
  • 2 . WHO. Coronavirus (COVID-19) Dashboard. [acceso: 01/01/2021]. Disponible en: Disponible en: https://covid19.who.int/
  • 3. Lin Ch, Ding Y, Xie B, Sun Z, Li X, Chen Z, et al. Asymptomatic novel coronavirus pneumonia patient outside Wuhan: The value of CT images in the course of the disease. Clinical Imaging. 2020;63:7-9.
  • 4 . Sethuraman N, Stanleyraj S, Ryo A. Interpreting Diagnostic Tests for SARS-CoV-2. JAMA. 9 June 2020;323(22):2249-51. DOI: https://doi.org/10.1001/jama.2020.8259
  • 5 . Wang W, Xu Y, Gao R. Detection of SARS-CoV-2 in different types of clinical specimens. JAMA. 11 March 2020;323(18):1843-44. DOI: https://doi.org/10.1001/jama.2020.3786
  • 6. Zhang W, Du RH, Li B. Molecular and serological investigation of 2019-nCoV infected patients: implication of multiple shedding routes. Emerg Microbes Infect. 2020;9:386-9.
  • 7. Meyer B, Drosten C, Muller MA. Serological assays for emerging coronaviruses: challenges and pitfalls. Virus Res. 2014;194:175-83.
  • 8 . Guadis Salazar E, Rodriguez LL, Montalvo Villalba M, Bello Corredor M, López Hernandez D. Android applications for viral hepatitis diagnosis, research and training. J Intern AIDS Soc. 2018;21(S3):44:e25093
  • 9. Winter AK, Hegde ST. The important role of serology for COVID-19 control. Lancet Infect Dis. 2020 Jul;20(7):758-9. DOI: https://doi.org/10.1016/S1473­3099(20)30322­4
  • 10 . Chen Z, Sun K, Pan W, Zhan Z, Chen L, Ye F. Development and Clinical Application of A Rapid IgM-IgG Combined Antibody Test for SARS-CoV-2 Infection Diagnosis. J Med Virol. 27 Feb 2020 [acceso: 01/01/2021];92:1518-24. Disponible en: https://onlinelibrary.wiley.com/doi/epdf/10.1002/jmv.25727
  • 11 . Long Q, Liu B, Deng H. Antibody responses to SARS-CoV-2 in patients with COVID-19. Nat Med. June 2020;26:845-8. DOI: https://doi.org/10.1038/s41591-020-0897-1
  • 12 . Liu L, Liu W, Zheng Y, Jiang X, Kou G, Ding J, et al. A preliminary study on serological assay for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in 238 admitted hospital patients. Microbes Infect. May-Jun 2020;22(4-5):206-11. DOI: https://doi.org/10.1016/j.micinf.2020.05.008
  • 13. Lisboa M, Tavaziva G, Kunal Abidi S, Campbell JR, Haraoui LP, Johnston JC, et al. Diagnostic accuracy of serological tests for covid-19: systematic review and meta-analysis. BMJ. 2020;370:2516. DOI: https://doi.org/10.1136/bmj.m2516
  • 14. Mercado M, Malagón-Rojas J, Delgado G, Rubio VV, Muñoz Galindo L, Parra Barrera EL, et al. Evaluation of nine serological rapid tests for the detection of SARS-CoV-2. Rev Panam Salud Publica. 2020;44:e149. DOI: https://doi.org/10.26633/RPSP.2020.149
History:
  • » Received: 01/02/2021
  • » Accepted: 20/05/2021
  • » Publicado : 01/12/2021

Enlaces refback

  • No hay ningún enlace refback.




Copyright (c) 2022 José Luis Pelegrino Martínez, Licel de los Angeles Rodriguez Lay, Yahisel Tejero Suarez, Odalys Valdes, Sonia Resik Aguirre, Odalys Calderon Fuentes, Yaumara Ugarte Perez, Juan Carlos de Leon González, Darling Danay Morales Verdecia, María Guadalupe Guzmán Tirado

Licencia de Creative Commons
Esta obra está bajo una licencia de Creative Commons Reconocimiento-NoComercial 4.0 Internacional.