Frequentist versus Bayesian approaches for AUC Confidence Interval Bounds

Abstract : In this paper we first present two approaches, Frequen-tist and Bayesian, to calculate the Confidence Interval (CI) of Area Under the Curve (AUC). The goal of this studyis to compare both approaches and find out if they reveal significant differences along the sample size. We first generate a large number of hypothetical cases, based on True Negative (TN), True Positive (TP), False Positive (FP) and False Negative (FN), that lead to specific AUC values (90, 85, 80, 75,etc.). We then use both Frequentist and Bayesian approach to calculate the AUC CI bounds, AUCL and AUCH, and plot them for visual comparison. Results indicate that 1) for one sample size value the Bayesian approach can have multiple AUC CI bounds values, while the Frequentist has unique set of bounds, 2) for all sample size, the AUCL and AUCU values using the Frequentist approach are consistently under-estimated compared to the Bayesian ones, and 3) for very large sample size both approaches converge toward same values.
Type de document :
Communication dans un congrès
10th International Conference on Information Science, Signal Processing and their Applications, May 2010, Kuala Lumpur, Malaysia. pp.341-344, 2010
Liste complète des métadonnées

Littérature citée [11 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00511188
Contributeur : Brahim Hamadicharef <>
Soumis le : samedi 23 octobre 2010 - 20:30:01
Dernière modification le : dimanche 24 octobre 2010 - 07:35:44
Document(s) archivé(s) le : lundi 24 janvier 2011 - 02:21:12

Fichier

BHC-AUC-ISSPA.2010.pdf
Accord explicite pour ce dépôt

Identifiants

  • HAL Id : inria-00511188, version 1

Collections

Citation

Brahim Hamadicharef. Frequentist versus Bayesian approaches for AUC Confidence Interval Bounds. 10th International Conference on Information Science, Signal Processing and their Applications, May 2010, Kuala Lumpur, Malaysia. pp.341-344, 2010. 〈inria-00511188〉

Partager

Métriques

Consultations de la notice

137

Téléchargements de fichiers

201