ROC Analysis in the Evaluation of Intelligent Medical Systems

Abstract : A large number of intelligent medical systems exist, but few are in routine clinical use. This is due, in part, to a lack of a robust objective method to quantify the performance of such systems. Potentially, ROC analysis could form a basis for a robust and objective evaluation of intelligent medical systems, but existing methods of ROC analysis require large sample sizes to be statistically valid. However, evaluation of intelligent medical systems often involve a small number of cases (because of time and cost of collecting 'gold standards') and so confidence bounds are required for ROC indices of performance. In this paper we present a new method for generating the probability density functions (pdfs) and confidence bounds for ROC points which is robust and accurate for any sample size. The method is generic and is particularly suited for evaluating the performance of systems where sample sizes are small. We illustrate the use of the method by applying it to assess the performance of two medical systems taken from the literature. The method has been implemented in C and in MATLAB.
Type de document :
Communication dans un congrès
1st European Workshop on the Assessment of Diagnostic Performance (EWADP2004), Jul 2004, Milan, Italy. 5 p., 2004
Liste complète des métadonnées

Littérature citée [7 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00442360
Contributeur : Brahim Hamadicharef <>
Soumis le : lundi 21 décembre 2009 - 09:10:57
Dernière modification le : lundi 21 mars 2016 - 11:32:53
Document(s) archivé(s) le : jeudi 17 juin 2010 - 23:58:53

Fichier

BHC-ROC-EWADP-2004.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00442360, version 1

Collections

Citation

Emmanuel Ifeachor, Hamadicharef Brahim. ROC Analysis in the Evaluation of Intelligent Medical Systems. 1st European Workshop on the Assessment of Diagnostic Performance (EWADP2004), Jul 2004, Milan, Italy. 5 p., 2004. 〈inria-00442360〉

Partager

Métriques

Consultations de la notice

112

Téléchargements de fichiers

62