Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
Scientific Reports volume 14, Article number: 13978 (2024 ) Cite this article Coronavirus Test Kit Wholeblood
Rapid and sensitive detection of pathogens is critical in interrupting the transmission chain of infectious diseases. Currently, real-time (RT-)PCR represents the gold standard for the detection of SARS-CoV-2. RNase HII-assisted amplification (RHAM) is a promising technology, enabling reliable point-of-care (PoC) testing; however, its diagnostic accuracy has not yet been investigated. The present study compared the Pluslife Mini Dock (RHAM technology), with Abbott ID Now and Cepheid GeneXpert IV. The positive percent agreement (PPA) and negative percent agreement (NPA) were determined in 100 SARS-CoV-2 positive and 210 SARS-CoV-2 negative samples. Further, the reliability of the Pluslife Mini Dock was investigated in different SARS-CoV-2 variants (Delta and Omicron subvariants). The PPA was 99.00% for Pluslife, 100.00% for Abbott ID Now, and 99.00% for Cepheid GeneXpert, with an NPA of 100.00%, 98.90%, and 93.72%, respectively. Abbott ID Now demonstrated the highest rate of invalid results. All SARS-CoV-2 analysed variants were detected by the Pluslife device. Altogether, the Pluslife Mini Dock demonstrated a PPA of 99.16% (235/237) for CT < 36 and an NPA of 100.00% (313/313), respectively. In conclusion, the Pluslife Mini Dock demonstrated better analytical performance than Abbott ID Now and Cepheid GeneXpert IV, representing a highly accurate and rapid PoC alternative to RT-PCR.
Since the initial outbreak of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in December 2019, the virus has spread rapidly, resulting in a global pandemic1,2. The highly transmissible RNA virus causes a respiratory disease termed Coronavirus disease 2019 (COVID-19), with a clinical spectrum ranging from asymptomatic and mild symptoms to severe respiratory infection, pneumonia, and even death1,3,4. As of August 2023, more than 765 million confirmed cases of COVID-19 and almost 7 million deaths have been reported to the World Health Organization (WHO)5.
In May 2023, WHO declared an end to the COVID-19 global emergency5. In retrospect, there are numerous lessons that have been learned from this recent pandemic. Undoubtedly, rapid antigen tests (RATs) were a game changer in fighting the spread of infections due to early detection. However, RATs demonstrate reduced sensitivity and are often unable to detect the pathogen early after exposure, particularly in the absence of symptoms. Further, rapid testing devices are most accurate in people with signs or symptoms of COVID-19. Real-time PCR (RT-PCR) has emerged as the gold standard for the detection of SARS-CoV-2 infection, with high precision and sensitivity6,7. However, during the pandemic’s early stages, laboratories worldwide quickly reached their limits in terms of testing capacity. Consequently, results were often available several days after sampling. Additionally, RT-PCR requires special laboratory infrastructural conditions and facilities, cost-intensive equipment, and specially trained personnel, which may not be available in some regions8. Accordingly, a simple and rapid assay with comparable test accuracy to RT-PCR would more effectively help to manage any future pandemics.
Various studies have demonstrated loop-mediated isothermal amplification (LAMP) to be a promising alternative method to classical RT-PCR. The LAMP technology enables efficient and specific amplification of DNA and RNA (RT-LAMP) without an additional nucleic acid extraction under isothermal conditions in under 60 min9,10. LAMP-based assays have been developed successfully for the diagnosis of several disease-causing infectious agents, such as Plasmodium spp. (malaria)11,12, Zika virus13, Mycobacterium tuberculosis14,15, and SARS-CoV-216,17,18. However, non-specific amplification remains a problem in many LAMP-based assays, and the false negative rate compared to RT-PCR is significantly higher17. A new isothermal amplification method termed RHAM (RNase HII-assisted Amplification) was described recently, as an alternative rapid and easily adaptable molecular diagnostic platform. It is comprised of LAMP-mediated exponential amplification, employing an RNase HII reporter for signal visualisation in a single reaction19. RHAM can detect positive samples in as little as 20 min without the need for a laboratory-based environment and facilities. However, the test accuracy of this technology in clinical samples has not yet been determined.
The present study describes the first independent evaluation study of the RHAM technology using SARS-CoV-2 as a model pathogen. To better understand the differences between RHAM and other PoC testing devices (POCT), the RHAM-technology based Pluslife Mini Dock test was compared to Abbott ID Now™ (NEAR technology) and Cepheid GeneXpert® (RT-PCR). Additionally, the clinical accuracy of the RHAM technology towards the accurate detection of SARS-CoV-2 subvariants was investigated.
This retrospective study involved two independent study sites. A comparative study using the Pluslife Mini Dock (Guangzhou Pluslife Biotech, Guangzhou, China), Abbott ID Now™ (Abbott Diagnostics, Wiesbaden, Germany), and Cepheid GeneXpert® IV (Cepheid, Krefeld, Germany) was conducted at the Pfützner Science & Health Institute in co-operation with the Institute of Internal Medicine and Laboratory Medicine of the University for Digital Technologies in Medicine and Dentistry, Wiltz, Luxembourg (Mainz, Germany; study site 1). The second study site was DHS—Diagnostic HealthCare Solutions GmbH, Berlin, Germany, in co-operation with the Institute of Transfusion Medicine, Charité Universitätsmedizin Berlin, Germany.
For the comparative study at study site 1, 319 residual nasopharyngeal swab samples (100 RT-PCR positive samples with CT < 36, nine samples with a CT of > 36, and 210 RT-PCR negative samples) were analysed. Samples had been stored in 1 mL Universal Transport Medium (Copan UTM™, Brescia, Italy) at − 80 °C for less than 6 months. The swab samples used in this study were residual samples (stored at − 80 °C) collected during a previous clinical performance evaluation study (NAL-CoV-002), which had been approved by the responsible IRB (Ethikkommission der Landesärztekammer Rheinland-Pfalz—Application No. 2022–16,548). All participating subjects had signed a written informed consent for this study (also approved by the IRB), where they explicitly approved the storage of their residual sample material and future use for laboratory evaluation projects in an anonymous fashion.
At study site 2, 137 SARS-CoV-2 RT-PCR confirmed positive and 104 negative samples were analysed. All positive samples were previously subtyped for the major SARS-CoV-2 variants. Samples included in the study were residual samples from diagnostic testing that were used in anonymised form and stored for a maximum of 2.5 years at − 80 °C. Clinical remnant samples do not require informed consent from the subject regulating the further use of the specimens.
As residual samples in anonymised form were used, ethics approval was not required. All methods were performed in accordance with relevant guidelines and regulations.
PBS (Carl Roth, Karlsruhe Germany) was used as a transport medium for nasopharyngeal and/or oropharyngeal swabs at study site 2. Samples of the Delta variant and several BA.1 (8/20) subtyped samples were stored in virus-inactivating transport medium (VTM; Biocomma, Guangdong, China). Unfortunately, VTM is incompatible with the enzyme used by Pluslife in the RHAM technology (data not shown). Accordingly, 10 µL of eluates were added to 490 µL of the lysis buffer provided by the Pluslife test kits.
For RNA extraction, the QuickExtract RNA extraction kit (Lucigen, Wisconsin, USA) using a one-tube approach was applied by study site 1. At study site 2, RNA extraction was performed using the NEOS-32 XT extractor (Linear, Barcelona, Spain) in combination with the NukEx Mag RNA/DNA extraction kit (Gerbion, Kornwestheim, Germany). All extractions and PCRs were performed according to the manufacturer´s instructions.
Study site 1 performed RT-PCR using the EURO RealTime SARS-CoV-2 PCR kit (Euroimmun Medizinische Labordiagnostika AG, Luebeck, Germany) on the Quant Studio 5 (Thermo Fisher, Waltham, Massachusetts, USA). A CT < 36 of the combined target genes ORF1ab and N was determined as SARS-CoV-2 positive. Study site 2 performed RT-PCR using the virellaSARS-CoV-2 s 2.0 real time PCR kit (Gerbion) for detection of the RdRp + S and E genes or the respiraScreen 1 RT PCR kit (Gerbion) for the simultaneous detection of SARS-CoV-2 (RdRp + E), Influenza A/B, and respiratory syncytial virus (RSV). PCR was performed using the LightCycler® 480 II (Roche, Mannheim, Germany) or MIC-IVD (BMS—Bio Molecular Systems, Upper Coomera, Queensland, Australia).
SARS-CoV-2 subvariant determination was performed using the GenXPro VoXcreen assays (GenXPro GmbH, Frankfurt am Main, Germany) for Delta/Omicron, Omicron BA.1/2, Omicron BA.2/4/5, or Omicron/XBB differentiation, and/or the virellaSARS-CoV-2 Mutant 3 real time PCR kit. PCR was performed using the Roche LightCycler® 480 II or MIC-IVD.
The following PoC devices were compared: Pluslife Mini Dock using the SARS-CoV-2 Nucleic Acid Testing Card (both from Guangzhou Pluslife Biotech), Abbott ID NOW™ system using the ID NOW™ COVID-19 test (both from Abbott), and Cepheid GeneXpert® IV using the Xpert® Xpress SARS-CoV-2 test kit (both from Cepheid). All PoC testing were performed according to the manufacturer´s instructions, with the exception of the sample material. All manufacturers describe the addition of the collected nasopharyngeal swab to the corresponding supplied lysis buffer. In the present study, swabs were dissolved initially in UTM or PBS, which was added subsequently to the lysis buffer of the test kit. For the Xpert® Xpress SARS-CoV-2 assay, 300 µL UTM was used. In contrast, for the two remaining assays, 200 µL UTM was used per sample and added to the respective lysis buffer provided.
At study site 2, 250 µL of the PBS sample supernatant was mixed with 250 µL of lysis buffer, which was subsequently added in the appropriate volume to the test cassette (~ 440 µL). As described above, extracted nucleic acid was used in some cases, with samples diluted 1:50.
The positive percent agreement (PPA), negative percent agreement (NPA), positive and negative predictive values (PPV and NPV, respectively) including 95% confidence intervals of the PoC tests were calculated in comparison to the reference method (RT-PCR) using an open-source online tool: https://www.medcalc.org/calc/diagnostic_test.php. To assess the agreement between the reference PCR and the PoC test results, the following parameters were calculated: Positive precent agreement (PPA, sensitivity) was calculated by evaluating the number of positive PCR samples, which are correctly detected as “positive” also by the study test. Negative percent agreement (NPA, specificity) was calculated by evaluating the number of negative PCR samples, which are correctly detected as “negative” by the study test. The total accuracy was calculated by determining the number of samples where both tests (PoC test and reference method) demonstrated valid results. The overall agreement demonstrates correct results by the POC tests in relation to the total amount of samples tested. Statistical analysis and scientific plots were performed using GraphPad Prism V9 for Windows, (GraphPad Software, Boston, Massachusetts USA). Populations were tested for normal distribution using the D´Agostino-Pearson omnibus normality test. Variant analysis was performed for non-parametric cohorts using the Kruskal–Wallis test. Pearson correlation was calculated for populations that were normally distributed. A P value < 0.05 was considered statistically significant.
The PPA, NPA, and accuracy were determined for all three POCTs (Table 1). Identical samples were used in a paired approach. Overall, 319 samples were investigated. Among the 100 RT-PCR confirmed positive samples, the Pluslife Mini Dock demonstrated a PPA of 99.00% (95% CI, 94.55–99.97%). There was one invalid result using the Abbott PoC device (ID 018 with a CT of 33.27). All other valid positive samples (n = 99) were correctly detected as positive, revealing a PPA of 100.00% (95% CI, 96.34–100.00%). There was one invalid sample using the Cepheid PoC device in addition to one false negative result (ID 018), revealing a PPA of 98.99% (95% CI, 94.50–99.97%). The positive predictive value (PPV) was 100.00% (95% CI, 96.34–100.00%) for Pluslife, 98.02% (95% CI, 92.58–99.49%) for Abbott ID Now™, and 88.29% (95% CI, 81.64–92.74%) for Cepheid GeneXpert®.
Of the 210 RT-PCR confirmed negative samples, the Pluslife Mini Dock demonstrated one invalid result but confirmed all 209 samples as negative (100% NPA). Abbott ID Now™ demonstrated invalid results for 30 samples. From the remaining 180 samples, there were two false positive results, revealing an NPA of 98.90%. In contrast, there were three invalid results using the Cepheid GeneXpert® IV. From the remaining 207 negative samples, 13 samples were false positive, demonstrating an NPA of 94.09%. The negative predictive value (NPV) was 99.52% (95% CI, 96.75–99.93%) for Pluslife, 100% (95% CI, 97.97–100.00%) for Abbott ID Now™, and 99.52% (95% CI, 96.71–99.93%) for Cepheid GeneXpert®.
The overall accuracy was found to be 99.68% for Pluslife (95% CI, 98.21–99.99%), 99.29% for Abbott (95% CI, 97.45–99.91%), and 95.42% for Cepheid (95% CI, 92.75–97.58%). Among all 310 samples, evaluable and correct results (overall agreement) were found in 99.35% of samples by Pluslife (308/310), 89.35% by Abbott (277/310), and 94.19% by Cepheid (292/310). Overall, with 31 samples (both positive and negative), the highest number of invalid results were observed with the Abbott ID Now™, followed by Cepheid GeneXpert® IV with four samples, and the Pluslife Mini Dock with only one sample.
Samples with a CT value < 36 were termed as positive, whereas those with a CT value > 36 were termed as negative; however, the results were considered as representing a “grey zone” for the POC test evaluation. Accordingly, nine samples with a CT > 36 (36.27–37.73) were excluded from statistical analysis, as it was not possible to definitively conclude whether these samples were negative or positive for SARS-CoV-2.
In the direct comparison of this sample subset, the Pluslife Mini Dock demonstrated valid negative results in all nine cases. Abbott ID Now™ demonstrated one invalid, two positive, and six negative results. Using the Cepheid GeneXpert® IV, three SARS-CoV-2 positive results and six negative results were determined.
The CT values of the SARS-CoV-2 positive samples of the variants Delta (n = 20), BA.1 (n = 20), BA.2 (n = 20), BA.4 (n = 17), BA.5 (n = 20), and XBB (n = 40) are depicted in Fig. 1. With the exception of one XBB sample that was found to be false negative (CT > 31.79), all remaining 136 analysed samples were detected as positive. The PPA was 99.27% (95% CI, 96.00–99.98%) and the NPA 100% (104/104; 95% CI, 96.52–100.00%). With an accuracy of 99.59% (95% CI, 97.71–99.99%), the results of study site 1 were reproduced and confirmed by study site 2.
Clinical accuracy of the identification of SARS-CoV-2 subvariants using the Pluslife Mini Dock based on the RHAM technology. (A) Distribution of CT values across SARS-CoV-2 variants. There were no significant differences in CT values, which ranged from 15.29–32.53 (mean, 23.5 ± 4.5; One-Way ANOVA, P = 0.9123). (B) Time-to-results across the SARS-CoV-2 variants. Dilutions of 1:50 of the eluates of the Delta (100%) and BA.1 (50%) typed samples were performed as virus-inactivating transport medium is not compatible with the enzyme reaction present in the Pluslife test card. Accordingly, RNA eluates were detected earlier. Samples of the BA.2 to XBB variants were PBS supernatants. Compared to the other variants, samples of the XBB variant had a time-to-result (> 20 min). (C) Correlation between CT values obtained by the SARS-CoV-2 screening PCR and different PCR-based variant analysis kits used. Overall, CT values were highly reproducible (Pearson r = 0.8177, P < 0.0001, n = 137). (D) Correlation of CT values with the time-to-positive result. There was no correlation between the virus load and the time-to-positive results (Pearson r = 0.014, P = 0.8695, n = 135). In conclusion, 76.3% of the samples were positive within 20 min, 92.6% of the samples were positive within 25 min, and only 7.4% were positive after more than 25 min (max. 32 min). Two samples with a relatively low viral load (CT of 31.79 and 32.20) demonstrated negative results.
The mean CT values and time-to-results for the analysed SARS-CoV-2 variants are depicted in Table 2. There was no significant difference in regard to the CT values between the various SARS-CoV-2 variants (One-way ANOVA, P > 0.05). However, there was a significant variation in the time-to-positive results across the different SARS-CoV-2 variants (P < 0.0001).
In the primary setting, 20 samples of the XBB variant were initially analysed. The mean test duration of 22.89 ± 5.67 min for XBB was significantly higher compared to all other variants, which demonstrated a mean of only 17.69 ± 3.23 min (n = 97) (p < 0.0001). Therefore, we analysed an additional 20 samples of the XBB variant to exclude a statistical variance. All additional samples were confirmed as positive, with a mean time-to-result of 18.44 ± 2.89 min that demonstrate no statistically significant difference to the other variants (p = 0.3411). The mean time-of-duration for all 39 XBB positive samples was now found to be 20.66 ± 4.98 min, which is more comparable with the other variants analysed. Renewed statistical analysis with the increased number of SARS-CoV-2 positive samples of the XBB variant showed that the mean test duration was still significantly higher compared to some other variants (Mann Whitney U test, Delta P < 0.0001, BA.1 P = 0.0055, BA.2 P = 0.9210, BA.4 P = 0.1566, BA.5 P = 0.0083).
A longer measuring time may represent a sign of suboptimal target amplification efficiency. Therefore, we consulted Pluslife regarding the potential impact of mutations on their isothermal amplification efficiency. They declared no false negative results for the following variants: Alpha (B.1.1.7/Q7), Beta (B.1.351/B1.351.2/B1.351.3), Gamma (P.1/P.1.1/P.1.2 ), Delta (B1.617.2/AY.1/AY.2/AY.3/AY.3.1/AY.4/AY.4.2/AY.5/AY.5.1/AY.5.2/AY.6 AY.7/AY. 8/AY.9/AY.10/AY.25/AY.27/AY.30/AY.70/AY.74/AY.88/AY.107) and Omicron (B.1.1.529/BA.1/BA.1.1/BA.2 /BA.2.2/BA.2.75/BA.2.75.2/BA.2.12/BA.2.12.1/BA.3/BA.4 /BA.5/BA.52/XE/BQ1.1/BQ1/XBB.1.5 and the WHO variants of interest labeled variants Eta (B.1.525), Theta (P.3) Iota-(B.1.526), Kappa (B.1.617.1), Lambda (C.37), Mu (B.1.621/B.1.621.1), and the variants Epsilon (B. 1.427/B.1.429), Zeta (P.2) XD, and XF.
Additionally, the PoC test cards from Pluslife used in the present study were recently reported to demonstrate no cross-reactivity with synthesised nucleic acids of other respiratory pathogens, such as coronavirus (HKU1, OC43, NL63, 229E), SARS coronavirus (SARS-1), MERS coronavirus, influenza A virus (H1N1, H5N1, H7N9 and H9N2), influenza B virus, respiratory syncytial virus types A and B, human parainfluenza virus type II, adenovirus types 3 and 7, enterovirus EV71, Mycoplasma pneumoniae, EB virus, human cytomegalovirus, and Mycobacterium tuberculosis19,20.
Compared to RT-PCR, POCT usually do not usually provide CT values, which also applies to the RHAM technology applied in this study. As the reaction stops when the fluorescence signal reaches the threshold, we assumed that the duration of the reaction may correlate with the CT value of a positive sample.
A significant correlation can be observed between the CT values obtained by the screening PCR primarily using the Gerbion virellaSARS-CoV-2 PCR kit and those of the GenXpro variant kits (Fig. 1c; Pearson r = 0.8177, P < 0.0001, n = 137). This correlation also represents sample stability and reproducibility. However, there was no correlation between CT value and time-to-positive results (Pearson r = 0.01427, P = 0.8695). This implies that, despite CT values spanning from 15 to 32, positive results were obtained within 20 min (76.3%) in the majority of cases. In 92.6% of the samples, a positive test result was obtained within 25 min.
Due to its high sensitivity and specificity, RT-PCR is considered the gold standard for the detection of SARS-CoV-26,7. However, to maintain these very good performance qualities, this technology requires a sound laboratory infrastructure, trained professionals, and expensive equipment and facilities, which limits the accessibility to PCR testing, particularly in developing countries8,19. From this aspect, LAMP appears to be a promising alternative to PCR, as it can be implemented as a PoC method, with equipment costs much lower compared to PCR8,10,17,20. However, an improvement of the diagnostic sensitivity and specificity is required to be comparable with RT-PCR.
In an emergency diagnostic situation, as observed in the recent SARS-CoV-2 pandemic, a short sample-to-result time is essential for successful epidemiological disease management. As RT-PCR approaches usually take between 3–6 h for analysis (excluding transport time, pre-analytics, and reporting), one of the main advantages of POCT is that results are provided within minutes compared to several hours or days (see Table 3).
Although isothermal nucleic acid amplification and LAMP are comparable to RAT in terms of simplicity, convenience, and rapidity, their sensitivity and specificity are far more superior19,21,22. Based on our experience and according to various studies, false negative RAT results have been observed in samples with a low viral load, particularly in samples with a CT > 2523,24,25. In a pandemic setting, this may represent a burden as contact persons desire rapid results to exclude potential infection. The application of RATs at a very early stage after contact may reveal false negative results. Therefore, the is a high demand for more sensitive rapid diagnostic tests. A relatively high number of different isothermal nucleic acid amplification techniques have been developed and described, including but not limited to exponential amplification reactions (EXPAR), exponential rolling circle amplification (E-RCA), exponential strand displacement amplification (E-SDA), helicase-dependent amplification (HDA), nucleic acid sequence-based amplification (NASBA), and recombinase polymerase amplification (RPA)9,26,27,28,29,30. However, these techniques still have several shortcomings, with non-specific amplifications representing the largest hindrance for their rapid implementation in routine use as discussed elsewhere19,31,32. New LAMP-PoC devices are under continuous development and require clinical evaluation. The diagnostic accuracy of the recently described RHAM technology19, which uses an RNase HII reporter for signal visualisation, had not yet been investigated.
The present study is the first to report on the diagnostic sensitivity and accuracy of the RHAM technology in a PoC device (Pluslife Mini Dock) in a direct comparison to two well-established POC platforms (Abbott ID Now™ and Cepheid GeneXpert® IV), and additional performance characteristics of the Pluslife Mini Dock for the detection of SARS-CoV-2 variants. For this study, previously collected nasopharyngeal and oropharyngeal swab samples stored in UTM or PBS at -80 °C were used, which is, however, not in accordance with the original instructions for sample collection by the manufacturers for all three tests. The foreseen sample for these kits is freshly collected dry swab samples. For example, the instructions for Abbott ID Now™ COVID-19 state “direct test performance without elution into a VTM”, whereas the Cepheid Xpert® Xpress SARS-CoV-2 assay also accepts samples stored in VTM (3 mL, Copan or similar) for a maximum 8 h at RT or a maximum of 7 days at 2–8 °C in NaCl solutions. Yet, 98.7% of the samples used in the comparative accuracy study (study site 1) demonstrated valid results. This enables the acquisition of information regarding their diagnostic accuracy. With only one invalid result, the Pluslife Mini Dock was observed to be most stable in terms of specimen variability, with 99.7% of samples examined at study site 1 demonstrating valid test results. In contrast, Abbott ID Now™ showed a total of 31 invalid results, whereas Cepheid Xpert® Xpress had four invalid results. It cannot be excluded that the use of VTM may lead to reduced test accuracy in Abbott ID Now™. However, a previously published comparison between the collection method and sample type using Abbott ID Now™ COVID-19 and Cepheid Xpert® Xpress showed that approximately one-third of the samples that tested positive by the Cepheid Xpert® Xpress were negative using Abbott ID Now™ when using nasopharyngeal swabs in VTM compared to 45% when using dry nasal swabs33. This may indicate that Abbott ID Now™ is more prone to invalid results, regardless of the sample type used. The use of retrospective samples in this evaluation study, however, represents a limitation.
This may also be represented by the fact that all three PoC devices applied in this study demonstrate a very good diagnostic PPA of ≥ 99.00%. Interestingly, sample ID 018 (CT of 33.27) demonstrated ambiguous results upon measurement in all three devices. False negative results were observed with this sample using the Pluslife and Cepheid devices and an invalid result was observed with Abbott ID Now™, suggesting the presence of interfering substances in this particular sample. Of note, the sample was not excluded due to the uncertainty of this discrepancy and was retained in statistical analyses.
Despite the observation of 10% invalid results with Abbott ID Now™ (primarily in the negative cohort), the determined PPA of 100% is not in accordance to the literature. Sensitivities of 89.9% or even 79% (in comparison to 99% for Cepheid GeneXpert) were reported elsewhere34,35. However, different comparative studies regarding the PoC detection of SARS-CoV-2 show highly variable results. The PPA for Abbott ID Now™ range between 48 and 96% and for Cepheid GeneXpert® between 95 and 100%, with the studies demonstrating variable study designs and sample types20,35. In the present study, the PPA for the Pluslife Mini Dock was found to be 99.00%, for Abbott ID Now™ 100.00%, and for Cepheid GeneXpert® 98.99%, with a NPA of 100.00%, 98.90% and 94.09%, respectively.
Notable differences in the NPA were observed between the three PoC devices examined. Using 219 confirmed RT-PCR negative samples, the NPA was 100.00% for Pluslife. Abbott ID Now™ demonstrated an NPA of 98.90%, with two false positive cases. With 13 false positive cases, Cepheid GeneXpert® IV demonstrated the lowest NPA (93.72%) among all three PoC devices. The best analytical accuracy was observed for the Pluslife Mini Dock RHAM-based technology (99.68%), followed by Abbott ID Now™ (99.29%), and Cepheid GeneXpert® IV (95.42%).
One aspect that may reduce test accuracy regardless of RT-PCR or LAMP-based technologies are mutations in the target primer or probe-binding site. SARS-CoV-2 is highly susceptible to mutations in its RNA genome, with different subvariants emerging since its discovery in 201936,37. To further investigate the clinical accuracy of the Pluslife PoC device in identifying SARS-CoV-2 variants, 137 SARS-CoV-2 positive samples with known variants were investigated. With a mean time-to-positive result of 15–20 min, the Pluslife test demonstrated a sound PPA for all SARS-CoV-2 variants, ranging from Delta/Omicron (BA.1) in early 2022 to the current predominant variant XBB.1. There was only one false negative sample amongst the 40 XBB.1 samples analysed, with a relatively low CT value (CT = 31.79). With a PPA of 99.27% (136/137) and an NPA of 100.00% (104/104), the diagnostic accuracy for Pluslife determined by study site 1 was reproduced and confirmed by study site 2, representing two independent clinical evaluation studies.
Although there was no significant difference in the CT values across all SARS-CoV-2 variants (One-way ANOVA, P > 0.05), we observed a significant variation in the time-to-positive result across the SARS-CoV-2 variants (P < 0.0001). The mean test duration of XBB was significantly higher compared to most other variants (Mann Whitney U test; Delta, P < 0.0001; BA.1, P = 0.0055; BA.2, P = 0.9210; BA.4, P = 0.1566; BA.5, P = 0.0083), suggesting that the reaction for XBB.1 detection is somewhat slower. The cause of this deviation remains unclear. According to the manufacturer (Pluslife), in-silico analyses confirmed test accuracy, whereby the primers used were aligned to target regions to the different variants of concern (including XBB), suggesting that the test performance of the Pluslife Mini Dock for SARS-CoV-2 is not impaired by any known mutations in the SARS-CoV-2 variants. This observation underlines the importance of post-market surveillance for continued monitoring of clinical accuracy in viral diagnostics.
CT values are a valuable diagnostic tool for monitoring the course of an infection and can be correlated with the viral load, providing a semi-quantitative measure of the degree of infection, early onset of infection in asymptomatic contact persons, and for monitoring recovery progress in severe, hospitalised patients during the SARS-CoV-2 pandemic7,38,39. A similar “quantitative measure” quality would be appreciated from a POCT. As the reaction stops when the fluorescence signal exceeds the threshold, a correlation between time-to-result and viral load may exist. Therefore, we investigated whether a correlation existed between the time-to-result of the Pluslife Mini Dock and the CT value. However, no correlation was found (Pearson r = 0.01427, P = 0.8695, n = 135). Thus, the RHAM technology only indicated accurately the presence or absence of a viral infection but did not facilitate any significant (semi-) quantitative measurements.
In conclusion, the RHAM technology applied by the Pluslife Mini Dock PoC device demonstrated very good analytical PPA, NPA, and accuracy in identifying SARS-CoV-2 variants compared to RT-PCR results. The major advantage of PoC devices is that special laboratory facilities and trained personnel are not required. This facilitates the decentralised, reliable detection of pathogens of interest directly in a PoC setting. A POCT may be a preferred and better option for many developing countries that lack the necessary infrastructure and facilities. The RHAM technology is an emerging method poised to become of increasing relevance and application in preventing and controlling not only SARS-CoV-2 infections, but also future outbreaks of infectious diseases.
Original data for the comparative study is archived at Pfützner Science and Health Institute, Mainz, Germany. Data for the variant analysis is stored at DHS—Diagnostic HealthCare Services, Berlin, Germany. The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.
Wu, F. et al. A new coronavirus associated with human respiratory disease in China. Nature 579, 265–269. https://doi.org/10.1038/s41586-020-2008-3 (2020).
Article ADS CAS PubMed PubMed Central Google Scholar
Coronaviridae study group of the international committee on taxonomy of, V. The species severe acute respiratory syndrome-related coronavirus: Classifying 2019-nCoV and naming it SARS-CoV-2. Nat Microbiol 5, 536–544, https://doi.org/10.1038/s41564-020-0695-z (2020).
Huang, C. et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan China. Lancet 395, 497–506. https://doi.org/10.1016/S0140-6736(20)30183-5 (2020).
Article CAS PubMed PubMed Central Google Scholar
Chen, N. et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: A descriptive study. Lancet 395, 507–513. https://doi.org/10.1016/S0140-6736(20)30211-7 (2020).
Article CAS PubMed PubMed Central Google Scholar
Wise, J. Covid-19: WHO declares end of global health emergency. BMJ 381, p1041. https://doi.org/10.1136/bmj.p1041 (2023).
Corman, V. M. et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. EuroSurveill 25, 2000045. https://doi.org/10.2807/1560-7917.ES.2020.25.3.2000045 (2020).
Walsh, K. A. et al. SARS-CoV-2 detection, viral load and infectivity over the course of an infection. J. Infect. 81, 357–371. https://doi.org/10.1016/j.jinf.2020.06.067 (2020).
Article CAS PubMed PubMed Central Google Scholar
Perez-Lopez, B. & Mir, M. Commercialized diagnostic technologies to combat SARS-CoV2: Advantages and disadvantages. Talanta 225, 121898. https://doi.org/10.1016/j.talanta.2020.121898 (2021).
Article CAS PubMed Google Scholar
Notomi, T. et al. Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 28, E63. https://doi.org/10.1093/nar/28.12.e63 (2000).
Article CAS PubMed PubMed Central Google Scholar
Notomi, T., Mori, Y., Tomita, N. & Kanda, H. Loop-mediated isothermal amplification (LAMP): Principle, features, and future prospects. J. Microbiol. 53, 1–5. https://doi.org/10.1007/s12275-015-4656-9 (2015).
Article CAS PubMed Google Scholar
Lucchi, N. W. et al. Evaluation of the illumigene malaria LAMP: A robust molecular diagnostic tool for malaria parasites. Sci. Rep. 6, 36808. https://doi.org/10.1038/srep36808 (2016).
Article ADS CAS PubMed PubMed Central Google Scholar
Sirichaisinthop, J. et al. Evaluation of loop-mediated isothermal amplification (LAMP) for malaria diagnosis in a field setting. Am. J. Trop. Med. Hyg. 85, 594–596. https://doi.org/10.4269/ajtmh.2011.10-0676 (2011).
Article CAS PubMed PubMed Central Google Scholar
Priye, A. et al. A smartphone-based diagnostic platform for rapid detection of Zika, chikungunya, and dengue viruses. Sci. Rep. 7, 44778. https://doi.org/10.1038/srep44778 (2017).
Article ADS CAS PubMed PubMed Central Google Scholar
Nliwasa, M. et al. The sensitivity and specificity of loop-mediated isothermal amplification (LAMP) assay for tuberculosis diagnosis in adults with chronic cough in Malawi. PLoS One 11, e0155101. https://doi.org/10.1371/journal.pone.0155101 (2016).
Article CAS PubMed PubMed Central Google Scholar
Boehme, C. C. et al. Operational feasibility of using loop-mediated isothermal amplification for diagnosis of pulmonary tuberculosis in microscopy centers of developing countries. J. Clin. Microbiol. 45, 1936–1940. https://doi.org/10.1128/JCM.02352-06 (2007).
Article CAS PubMed PubMed Central Google Scholar
Thompson, D. & Lei, Y. Mini review: Recent progress in RT-LAMP enabled COVID-19 detection. Sens. Actuators Rep. 2, 100017. https://doi.org/10.1016/j.snr.2020.100017 (2020).
Article PubMed PubMed Central Google Scholar
Pu, R. et al. The screening value of RT-LAMP and RT-PCR in the diagnosis of COVID-19: Systematic review and meta-analysis. J. Virol. Methods 300, 114392. https://doi.org/10.1016/j.jviromet.2021.114392 (2022).
Article CAS PubMed Google Scholar
Yan, C. et al. Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin. Microbiol. Infect. 26, 773–779. https://doi.org/10.1016/j.cmi.2020.04.001 (2020).
Article CAS PubMed PubMed Central Google Scholar
Xiao, Z. L., X. Kang, X. Feng, Y. Zheng, L. Chen, C. (ed Ltd Pluslife Biotech Co.) (Submitted to Research Square, 2023).
Bruijns, B., Folkertsma, L. & Tiggelaar, R. FDA authorized molecular point-of-care SARS-CoV-2 tests: A critical review on principles, systems and clinical performances. Biosens. Bioelectron. X 11, 100158. https://doi.org/10.1016/j.biosx.2022.100158 (2022).
Article CAS PubMed PubMed Central Google Scholar
Cao, G. et al. A diagnostic accuracy study comparing RNA LAMP, direct LAMP, and rapid antigen testing from nasopharyngeal swabs. Front. Microbiol. 13, 1063414. https://doi.org/10.3389/fmicb.2022.1063414 (2022).
Article PubMed PubMed Central Google Scholar
Nagura-Ikeda, M. et al. Clinical evaluation of self-collected saliva by quantitative reverse transcription-PCR (RT-qPCR), direct RT-qPCR, reverse transcription-loop-mediated isothermal amplification, and a rapid antigen test to diagnose COVID-19. J. Clin. Microbiol. 58, 10–1128. https://doi.org/10.1128/JCM.01438-20 (2020).
Scheiblauer, H. et al. Comparative sensitivity evaluation for 122 CE-marked rapid diagnostic tests for SARS-CoV-2 antigen, Germany, September 2020 to April 2021. EuroSurveill 26, 2100441. https://doi.org/10.2807/1560-7917.Es.2021.26.44.2100441 (2021).
Sabat, J. et al. A comparison of SARS-CoV-2 rapid antigen testing with realtime RT-PCR among symptomatic and asymptomatic individuals. BMC Infect. Dis. 23, 87. https://doi.org/10.1186/s12879-022-07969-0 (2023).
Article CAS PubMed PubMed Central Google Scholar
Weitzel, T. et al. Head-to-head comparison of four antigen-based rapid detection tests for the diagnosis of SARS-CoV-2 in respiratory samples. bioRxiv, 2020.2005.2027.119255, https://doi.org/10.1101/2020.05.27.119255 (2020).
Malek, L., Sooknanan, R. & Compton, J. Nucleic acid sequence-based amplification (NASBA). Methods Mol. Biol. 28, 253–260. https://doi.org/10.1385/0-89603-254-x:253 (1994).
Article CAS PubMed Google Scholar
Walker, G. T., Little, M. C., Nadeau, J. G. & Shank, D. D. Isothermal in vitro amplification of DNA by a restriction enzyme/DNA polymerase system. Proc. Natl. Acad. Sci. USA 89, 392–396. https://doi.org/10.1073/pnas.89.1.392 (1992).
Article ADS CAS PubMed PubMed Central Google Scholar
Daubendiek, S. L., Ryan, K. & Kool, E. T. Rolling-circle RNA synthesis: Circular oligonucleotides as efficient substrates for T7 RNA polymerase. J. Am. Chem. Soc. 117, 7818–7819. https://doi.org/10.1021/ja00134a032 (1995).
Article CAS PubMed PubMed Central Google Scholar
Vincent, M., Xu, Y. & Kong, H. Helicase-dependent isothermal DNA amplification. EMBO Rep. 5, 795–800. https://doi.org/10.1038/sj.embor.7400200 (2004).
Article CAS PubMed PubMed Central Google Scholar
Piepenburg, O., Williams, C. H., Stemple, D. L. & Armes, N. A. DNA detection using recombination proteins. PLoS Biol. 4, e204. https://doi.org/10.1371/journal.pbio.0040204 (2006).
Article CAS PubMed PubMed Central Google Scholar
He, S. et al. Isothermal amplification based on specific signal extraction and output for fluorescence and colorimetric detection of nucleic acids. Talanta 252, 123823. https://doi.org/10.1016/j.talanta.2022.123823 (2023).
Article CAS PubMed Google Scholar
Zhao, Y., Chen, F., Li, Q., Wang, L. & Fan, C. Isothermal amplification of nucleic acids. Chem. Rev. 115, 12491–12545. https://doi.org/10.1021/acs.chemrev.5b00428 (2015).
Article CAS PubMed Google Scholar
Basu, A. et al. Performance of Abbott ID Now COVID-19 rapid nucleic acid amplification test using nasopharyngeal swabs transported in viral transport media and Dry Nasal Swabs in a New York City Academic Institution. J. Clin. Microbiol. 58, 10–1128. https://doi.org/10.1128/jcm.01136-01120 (2020).
Barker, K. R., Small, L. N., Thai, D. V., Sohn, K. Y. & Rosella, L. C. Evaluating the Ability to ID (COVID-19) NOW: A large real-world prospective evaluation of the Abbott ID NOW COVID-19 assay. Microbiol. Spectr. 10, e0051322. https://doi.org/10.1128/spectrum.00513-22 (2022).
Article CAS PubMed Google Scholar
Lee, J. & Song, J. U. Diagnostic accuracy of the Cepheid Xpert Xpress and the Abbott ID NOW assay for rapid detection of SARS-CoV-2: A systematic review and meta-analysis. J. Med. Virol. 93, 4523–4531. https://doi.org/10.1002/jmv.26994 (2021).
Article CAS PubMed PubMed Central Google Scholar
Cosar, B. et al. SARS-CoV-2 mutations and their viral variants. Cytokine Growth Factor Rev. 63, 10–22. https://doi.org/10.1016/j.cytogfr.2021.06.001 (2022).
Article CAS PubMed Google Scholar
Markov, P. V. et al. The evolution of SARS-CoV-2. Nat. Rev. Microbiol. 21, 361–379. https://doi.org/10.1038/s41579-023-00878-2 (2023).
Article CAS PubMed Google Scholar
Kissler, S. M. et al. Viral dynamics of acute SARS-CoV-2 infection and applications to diagnostic and public health strategies. PLoS Biol. 19, e3001333. https://doi.org/10.1371/journal.pbio.3001333 (2021).
Article CAS PubMed PubMed Central Google Scholar
Yu, X. et al. SARS-CoV-2 viral load in sputum correlates with risk of COVID-19 progression. Crit. Care 24, 170. https://doi.org/10.1186/s13054-020-02893-8 (2020).
Article PubMed PubMed Central Google Scholar
Open Access funding enabled and organized by Projekt DEAL.
These authors contributed equally: Julian Kamhieh-Milz and Andreas Pfützner.
DHS – Diagnostic HealthCare Solutions, Berlin, Germany
Laura Herrmann, Tuan Ngo Duc, Fatemeh Ghazaani, Sundrela Kamhieh-Milz & Julian Kamhieh-Milz
Juliana Breuer & Nicole Thomé
Pfützner Science and Health Institute, Mainz, Germany
Juliana Breuer, Nicole Thomé & Andreas Pfützner
Institute of Transfusion Medicine, Charité – Universitätsmedizin Berlin, Robert-Koch Platz 4, 10117, Berlin, Germany
Institute for Internal Medicine and Laboratory Medicine, University for Digital Technologies in Medicine and Dentistry, Wiltz, Luxembourg
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
Site 1: JB and NT performed laboratory measurements and contributed to the planning, analysis, and report of the comparative study results. APF planned and supervised the experiments, performed statistical analysis, wrote the study report for study site 1, and reviewed and contributed to the publication manuscript. Site 2: LH performed experiments and co-wrote the initial draft; TND and FG performed experiments; SKM performed experiments, and critically revised and edited the manuscript; JKM performed study conceptualisation and design, data analysis, and co-wrote the initial draft. All authors read and approved the final version of the manuscript.
The authors report no conflicts of interest. The comparative study at study site 1 was sponsored by Nal von Minden GmbH (Moers, Germany). Devices and SARS-CoV-2 test kits were provided complimentary by Guangzhou Pluslife Biotechnology Co., Ltd. to study site 2. The present study was performed independently from the device manufacturers or distributors (Nal von Minden, Pluslife, Abbott, or Cepheid).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Herrmann, L., Breuer, J., Duc, T.N. et al. Comparison of the diagnostic accuracy of the Pluslife Mini Dock RHAM technology with Abbott ID Now and Cepheid GenXpert: A retrospective evaluation study. Sci Rep 14, 13978 (2024). https://doi.org/10.1038/s41598-024-64406-9
DOI: https://doi.org/10.1038/s41598-024-64406-9
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
Scientific Reports (Sci Rep) ISSN 2045-2322 (online)
Test Kits For Wuhan Coronavirus Sign up for the Nature Briefing: Translational Research newsletter — top stories in biotechnology, drug discovery and pharma.