Test set performance indicators correlate well with clinical audit

Test set performance indicators correlate well with clinical audit
Some performance indicators for mammography test sets are associated with aspects of clinical audit parameters, according to a study published in the August issue of the Journal of Medical Imaging and Radiation Oncology.

(HealthDay)—Some performance indicators for mammography test sets are associated with aspects of clinical audit parameters, according to a study published in the August issue of the Journal of Medical Imaging and Radiation Oncology.

BaoLin Pauline Soh, Ph.D., from Singapore General Hospital, and colleagues generated clinical audit data for each of 20 radiologists over a two-year period. The test set comprised 60 mammographic examinations, consisting of 40 normal and 20 cancer cases. Any identifiable cancer was located and levels of confidence were scored from 2 to 5, with 3 and above considered a recall rating. The authors calculated Jackknifing free response operating characteristic (JAFROC) figure-of-merit (FOM), location , and specificity for individual readers.

The researchers observed significant correlations for JAFROC FOM with recall rate at first round of screening, rate of small invasive cancers per 10,000 reads, percentage of cancer reads that were not recalled, and sensitivity (all P = 0.002). Significant correlations were seen for location sensitivity with rate of small invasive cancers per 10,000 reads (P = 0.04), rate of ductal carcinoma in situ (DCIS) per 10,000 reads (P = 0.05), detection rate of all invasive cancers and DCIS per 10,000 reads (P = 0.01), percentage of all cancers not recalled (P = 0.009), and sensitivity (P = 0.009). There were no other significant correlations noted.

"Performance indicators from test set demonstrate significant correlations with specific aspects of clinical performance, although caution needs to be exercised when generalizing test set specificity to the clinical situation," the authors write.

One author is employed by Ziltron; Hologic and Sectra facilitated the workshop and provided the equipment necessary for the sessions.


Explore further

Benefit of surgery for ductal carcinoma in-situ investigated

More information: Abstract
Full Text (subscription or payment may be required)

Copyright © 2015 HealthDay. All rights reserved.

Citation: Test set performance indicators correlate well with clinical audit (2015, August 1) retrieved 17 May 2021 from https://medicalxpress.com/news/2015-08-indicators-clinical.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
23 shares

Feedback to editors

User comments