Testing bibliometric indicators by their prediction of scientists promotions

Pablo Jensen; Jean-Baptiste Rouquier; Yves Croissant

ensl-00336140, version 1

Testing bibliometric indicators by their prediction of scientists promotions

Pablo Jensen ^1, 2, 3, Jean-Baptiste Rouquier ^3, 4, Yves Croissant ¹

Scientometrics 78, 3 (2008) 0

Résumé : We have developed a method to obtain robust quantitative bibliometric indicators for several thousand scientists. This allows us to study the dependence of bibliometric indicators (such as number of publications, number of citations, Hirsch index...) on the age, position, etc. of CNRS scientists. Our data suggests that the normalized h index (h divided by the career length) is not constant for scientists with the same productivity but differents ages. We also compare the predictions of several bibliometric indicators on the promotions of about 600 CNRS researchers. Contrary to previous publications, our study encompasses most disciplines, and shows that no single indicator is the best predictor for all disciplines. Overall, however, the Hirsch index h provides the least bad correlations, followed by the number of papers published. It is important to realize however that even h is able to recover only half of the actual promotions. The number of citations or the mean number of citations per paper are definitely not good predictors of promotion.

1 : Laboratoire d'économie des transports (LET)
CNRS : UMR5593 – École Nationale des Travaux Publics de l'État [ENTPE] – Université Lumière - Lyon II
2 : Laboratoire de Physique de l'ENS Lyon (Phys-ENS)
CNRS : UMR5672 – École Normale Supérieure - Lyon
3 : Institut Rhône-Alpin des systèmes complexes (IXXI)
INRIA – École Normale Supérieure - Lyon – Institut National des Sciences Appliquées (INSA) : - LYON – Université Claude Bernard - Lyon I – Ecole Normale Supérieure Lettres et Sciences Humaines – Université Joseph Fourier - Grenoble I – CNRS – Institut de recherche pour le développement [IRD]
4 : Laboratoire de l'Informatique du Parallélisme (LIP)
Université de Lyon – CNRS : UMR5668 – INRIA – École Normale Supérieure - Lyon – Université Claude Bernard - Lyon I

ensl-00336140, version 1
http://hal-ens-lyon.archives-ouvertes.fr/ensl-00336140
oai:hal-ens-lyon.archives-ouvertes.fr:ensl-00336140
Contributeur : Jean-Baptiste Rouquier <>
Soumis le : Dimanche 2 Novembre 2008, 00:14:25
Dernière modification le : Lundi 3 Novembre 2008, 09:11:42

Voir la fiche détaillée

Documents associés

PS :

PDF :

arXiv : 0811.0237

DOI : 10.1007/s11192-007-2014-3

Exporter

Bibtex EndNote TEI RefWorks

%% ensl-00336140, version 1
%% http://hal-ens-lyon.archives-ouvertes.fr/ensl-00336140
@article{jensen:ensl-00336140,
    hal_id = {ensl-00336140},
    url = {http://hal-ens-lyon.archives-ouvertes.fr/ensl-00336140},
    title = {{Testing bibliometric indicators by their prediction of scientists promotions}},
    author = {Jensen, Pablo and Rouquier, Jean-Baptiste and Croissant, Yves},
    abstract = {{We have developed a method to obtain robust quantitative bibliometric indicators for several thousand scientists. This allows us to study the dependence of bibliometric indicators (such as number of publications, number of citations, Hirsch index...) on the age, position, etc. of CNRS scientists. Our data suggests that the normalized h index (h divided by the career length) is not constant for scientists with the same productivity but differents ages. We also compare the predictions of several bibliometric indicators on the promotions of about 600 CNRS researchers. Contrary to previous publications, our study encompasses most disciplines, and shows that no single indicator is the best predictor for all disciplines. Overall, however, the Hirsch index h provides the least bad correlations, followed by the number of papers published. It is important to realize however that even h is able to recover only half of the actual promotions. The number of citations or the mean number of citations per paper are definitely not good predictors of promotion.}},
    keywords = {bibliometric indicators;h-index;Hirsch index;career;scientific career; academic career;promotion;citations},
    language = {Anglais},
    affiliation = {Laboratoire d'{\'e}conomie des transports - LET , Laboratoire de Physique de l'ENS Lyon - Phys-ENS , Institut Rh{\^o}ne-Alpin des syst{\`e}mes complexes - IXXI , Laboratoire de l'Informatique du Parall{\'e}lisme - LIP},
    journal = {Scientometrics},
    volume = {78},
    number = {3 },
    audience = {internationale },
    doi = {10.1007/s11192-007-2014-3 },
    year = {2008},
    pdf = {http://hal-ens-lyon.archives-ouvertes.fr/ensl-00336140/PDF/main.pdf},
}

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="article"><head>Articles dans des revues avec comité de lecture</head>
<biblStruct type="article" xml:id="ensl-00336140"><analytic>
<author><persName><forename>Pablo</forename><surname>Jensen</surname></persName>
<affiliation>
<orgName type="laboratory">LET</orgName>
<orgName type="team">Laboratoire d'économie des transports</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5593</orgName>
<orgName type="institution">École Nationale des Travaux Publics de l'État [ENTPE]</orgName>
<orgName type="institution">Université Lumière - Lyon II</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">Phys-ENS</orgName>
<orgName type="team">Laboratoire de Physique de l'ENS Lyon</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5672</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">IXXI</orgName>
<orgName type="team">Institut Rhône-Alpin des systèmes complexes</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - LYON</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
<orgName type="institution">Ecole Normale Supérieure Lettres et Sciences Humaines</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">CNRS</orgName>
<orgName type="institution">Institut de recherche pour le développement [IRD]</orgName>
</affiliation>
</author>
<author><persName><forename>Jean-Baptiste</forename><surname>Rouquier</surname></persName>
<affiliation>
<orgName type="laboratory">IXXI</orgName>
<orgName type="team">Institut Rhône-Alpin des systèmes complexes</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Institut National des Sciences Appliquées (INSA) : - LYON</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
<orgName type="institution">Ecole Normale Supérieure Lettres et Sciences Humaines</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">CNRS</orgName>
<orgName type="institution">Institut de recherche pour le développement [IRD]</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">LIP</orgName>
<orgName type="team">Laboratoire de l'Informatique du Parallélisme</orgName>
<country>FR</country>
<orgName type="institution">Université de Lyon</orgName>
<orgName type="institution">CNRS : UMR5668</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">École Normale Supérieure - Lyon</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
</affiliation>
</author>
<author><persName><forename>Yves</forename><surname>Croissant</surname></persName>
<affiliation>
<orgName type="laboratory">LET</orgName>
<orgName type="team">Laboratoire d'économie des transports</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5593</orgName>
<orgName type="institution">École Nationale des Travaux Publics de l'État [ENTPE]</orgName>
<orgName type="institution">Université Lumière - Lyon II</orgName>
</affiliation>
</author>
<title type="main" level="a">Testing bibliometric indicators by their prediction of scientists promotions</title></analytic><monogr><title level="j" type="main">Scientometrics</title><imprint><biblScope type="publicationDate">2008-00-00</biblScope><biblScope type="vol">78</biblScope><biblScope type="issue">3</biblScope></imprint></monogr><idno type="doi">10.1007/s11192-007-2014-3</idno><idno type="HALid">http://hal-ens-lyon.archives-ouvertes.fr/ensl-00336140</idno><idno type="HALFile">http://hal-ens-lyon.archives-ouvertes.fr/ensl-00336140/PDF/main.pdf</idno></biblStruct>
</listBibl>
</listBibl>