TY - JOUR
T1 - SPOT/Dx Pilot Reanalysis and College of American Pathologists Proficiency Testing for KRAS and NRAS Demonstrate Excellent Laboratory Performance
AU - Zehir, Ahmet
AU - Nardi, Valentina
AU - Konnick, Eric Q.
AU - Lockwood, Christina M.
AU - Long, Thomas A.
AU - Sidiropoulos, Nikoletta
AU - Souers, Rhona J.
AU - Vasalos, Patricia
AU - Lindeman, Neal I.
AU - Moncur, Joel T.
N1 - Publisher Copyright:
© 2024 College of American Pathologists. All rights reserved.
PY - 2024/2
Y1 - 2024/2
N2 - Context.—The Sustainable Predictive Oncology Therapeutics and Diagnostics quality assurance pilot study (SPOT/ Dx pilot) on molecular oncology next-generation sequencing (NGS) reportedly demonstrated performance limitations of NGS laboratory-developed tests, including discrepancies with a US Food and Drug Administration–approved companion diagnostic. The SPOT/Dx pilot methods differ from those used in proficiency testing (PT) programs. Objective.—To reanalyze SPOT/Dx pilot data using PT program methods and compare to PT program data. Design.—The College of American Pathologists (CAP) Molecular Oncology Committee reanalyzed SPOT/Dx pilot data applying PT program methods, adjusting for confounding conditions, and compared them to CAP NGS PT program performance (2019–2022). Results.—Overall detection rates of KRAS and NRAS single-nucleotide variants (SNVs) and multinucleotide variants (MNVs) by SPOT/Dx pilot laboratories were 96.8% (716 of 740) and 81.1% (129 of 159), respectively. In CAP PT programs, the overall detection rates for the same SNVs and MNVs were 97.2% (2671 of 2748) and 91.8% (1853 of 2019), respectively. In 2022, the overall detection rate for 5 KRAS and NRAS MNVs in CAP PT programs was 97.3% (1161 of 1193). Conclusions.—CAP PT program data demonstrate that laboratories consistently have high detection rates for KRAS and NRAS variants. The SPOT/Dx pilot has multiple design and analytic differences with established PT programs. Reanalyzed pilot data that adjust for confounding conditions demonstrate that laboratories proficiently detect SNVs and less successfully detect rare to never-observed MNVs. The SPOT/Dx pilot results are not generalizable to all molecular oncology testing and should not be used to market products or change policy affecting all molecular oncology testing.
AB - Context.—The Sustainable Predictive Oncology Therapeutics and Diagnostics quality assurance pilot study (SPOT/ Dx pilot) on molecular oncology next-generation sequencing (NGS) reportedly demonstrated performance limitations of NGS laboratory-developed tests, including discrepancies with a US Food and Drug Administration–approved companion diagnostic. The SPOT/Dx pilot methods differ from those used in proficiency testing (PT) programs. Objective.—To reanalyze SPOT/Dx pilot data using PT program methods and compare to PT program data. Design.—The College of American Pathologists (CAP) Molecular Oncology Committee reanalyzed SPOT/Dx pilot data applying PT program methods, adjusting for confounding conditions, and compared them to CAP NGS PT program performance (2019–2022). Results.—Overall detection rates of KRAS and NRAS single-nucleotide variants (SNVs) and multinucleotide variants (MNVs) by SPOT/Dx pilot laboratories were 96.8% (716 of 740) and 81.1% (129 of 159), respectively. In CAP PT programs, the overall detection rates for the same SNVs and MNVs were 97.2% (2671 of 2748) and 91.8% (1853 of 2019), respectively. In 2022, the overall detection rate for 5 KRAS and NRAS MNVs in CAP PT programs was 97.3% (1161 of 1193). Conclusions.—CAP PT program data demonstrate that laboratories consistently have high detection rates for KRAS and NRAS variants. The SPOT/Dx pilot has multiple design and analytic differences with established PT programs. Reanalyzed pilot data that adjust for confounding conditions demonstrate that laboratories proficiently detect SNVs and less successfully detect rare to never-observed MNVs. The SPOT/Dx pilot results are not generalizable to all molecular oncology testing and should not be used to market products or change policy affecting all molecular oncology testing.
UR - http://www.scopus.com/inward/record.url?scp=85184345525&partnerID=8YFLogxK
U2 - 10.5858/arpa.2023-0322-CP
DO - 10.5858/arpa.2023-0322-CP
M3 - Article
C2 - 37776255
AN - SCOPUS:85184345525
SN - 0003-9985
VL - 148
SP - 139
EP - 148
JO - Archives of Pathology and Laboratory Medicine
JF - Archives of Pathology and Laboratory Medicine
IS - 2
ER -