Setting clinical performance specifications to develop and evaluate biomarkers for clinical use
St John, A
Monaghan, Phillip J
AffiliationSchool of Medicine, University of Notre Dame, Darlinghurst, New South Wales, Australia
MetadataShow full item record
AbstractBACKGROUND: Biomarker discovery studies often claim 'promising' findings, motivating further studies and marketing as medical tests. Unfortunately, the patient benefits promised are often inadequately explained to guide further evaluation, and few biomarkers have translated to improved patient care. We present a practical guide for setting minimum clinical performance specifications to strengthen clinical performance study design and interpretation. METHODS: We developed a step-by-step approach using test evaluation and decision-analytic frameworks and present with illustrative examples. RESULTS: We define clinical performance specifications as a set of criteria that quantify the clinical performance a new test must attain to allow better health outcomes than current practice. We classify the proposed patient benefits of a new test into three broad groups and describe how to set minimum clinical performance at the level where the potential harm of false-positive and false-negative results does not outweigh the benefits. (1) For add-on tests proposed to improve disease outcomes by improving detection, define an acceptable trade-off for false-positive versus true-positive results; (2) for triage tests proposed to reduce unnecessary tests and treatment by ruling out disease, define an acceptable risk of false-negatives as a safety threshold; (3) for replacement tests proposed to provide other benefits, or reduce costs, without compromising accuracy, use existing tests to benchmark minimum accuracy levels. CONCLUSIONS: Researchers can follow these guidelines to focus their study objectives and to define statistical hypotheses and sample size requirements. This way, clinical performance studies will allow conclusions about whether test performance is sufficient for intended use. KEYWORDS: Test evaluation; biomarker; clinical accuracy; clinical performance; medical tests; research methods
CitationLord SJ, St John A, Bossuyt PM, Sandberg S, Monaghan PJ, O'Kane M, et al. Setting clinical performance specifications to develop and evaluate biomarkers for clinical use. Ann Clin Biochem. 2019 Apr 16:4563219842265.
JournalAnnals of Clinical Biochemistry
- Medical Diagnostic Tests: A Review of Test Anatomy, Phases, and Statistical Treatment of Data.
- Authors: Bolboacă SD
- Issue date: 2019
- High-value dermatology: 5 Laboratory tests to reconsider.
- Authors: Ogbechie-Godec OA, Wang JF, Feng H, Orlow SJ
- Issue date: 2018 Jun
- Evaluation of diagnostic tests: dengue.
- Authors: Peeling RW, Artsob H, Pelegrino JL, Buchy P, Cardosa MJ, Devi S, Enria DA, Farrar J, Gubler DJ, Guzman MG, Halstead SB, Hunsperger E, Kliks S, Margolis HS, Nathanson CM, Nguyen VC, Rizzo N, Vázquez S, Yoksan S
- Issue date: 2010 Dec
- Assessing Clinical Microbiology Practice Guidelines: American Society for Microbiology <i>Ad Hoc</i> Committee on Evidence-Based Laboratory Medicine Practice Guidelines Assessment.
- Authors: Nachamkin I, Kirn TJ, Westblade LF, Humphries R
- Issue date: 2017 Nov
- Feedback of performance and diagnostic testing: lessons from Maastricht.
- Authors: Tierney WM
- Issue date: 1996 Oct-Dec