The BRaliBase dent - a tale of benchmark design and interpretation.

Benedikt Löwes 1 Cedric Chauve 2 Yann Ponty 3, 4 Robert Giegerich 1
3 AMIB - Algorithms and Models for Integrative Biology
CNRS - Centre National de la Recherche Scientifique : UMR8623, Polytechnique - X, Inria Saclay - Ile de France, UP11 - Université Paris-Sud - Paris 11, LRI - Laboratoire de Recherche en Informatique, LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau]
Abstract : BRaliBase is a widely used benchmark for assessing the accuracy of RNA secondary structure alignment methods. In most case studies based on the BRaliBase benchmark, one can observe a puzzling drop in accuracy in the 40-60% sequence identity range, the so-called 'BRaliBase Dent'. In this article, we show this dent is owing to a bias in the composition of the BRaliBase benchmark, namely the inclusion of a disproportionate number of transfer RNAs, which exhibit a conserved secondary structure. Our analysis, aside of its interest regarding the specific case of the BRaliBase benchmark, also raises important questions regarding the design and use of benchmarks in computational biology.
Type de document :
Article dans une revue
Briefings in Bioinformatics, Oxford University Press (OUP), 2017, 18 (2), pp.306--311. 〈10.1093/bib/bbw022〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01273406
Contributeur : Yann Ponty <>
Soumis le : vendredi 12 février 2016 - 13:48:35
Dernière modification le : jeudi 11 janvier 2018 - 06:23:08

Identifiants

Citation

Benedikt Löwes, Cedric Chauve, Yann Ponty, Robert Giegerich. The BRaliBase dent - a tale of benchmark design and interpretation.. Briefings in Bioinformatics, Oxford University Press (OUP), 2017, 18 (2), pp.306--311. 〈10.1093/bib/bbw022〉. 〈hal-01273406〉

Partager

Métriques

Consultations de la notice

221