HAL - INRIA :: [inserm-00607794, version 1] Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge.

inserm-00607794, version 1

Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge.

Keelin Murphy ¹, Bram Van Ginneken ( Author to contact preferably ) ¹, Joseph M. Reinhardt ², Sven Kabus ³, Kai Ding ², Xiang Deng ⁴, Kunlin Cao ^2, 5, Kaifang Du ², Gary E. Christensen ², Vincent Garcia ⁶, Tom Vercauteren ⁷, Nicholas Ayache ⁸, Olivier Commowick ⁹, Grégoire Malandain () ⁸, Ben Glocker ¹⁰, Nikolaos Paragios ^11, 12, Nassir Navab ¹⁰, Vladlena Gorbunova ¹³, Jon Sporring ¹³, Marleen De Bruijne ^13, 14, Xiao Han ¹⁵, Mattias P. Heinrich ^16, 17, Julia A. Schnabel ¹⁶, Mark Jenkinson ¹⁷, Cristian Lorenz ³, Marc Modat ¹⁸, Jamie R. Mcclelland ¹⁸, Sébastien Ourselin ¹⁸, Sacha Ea Muenzing ¹, Max A. Viergever ¹, Dante De Nigris ¹⁹, Louis D. Collins ^20, 21, Tal Arbel ¹⁹, Marta Peroni ²², Rui Li ²², Gregory C. Sharp ²², Alexander Schmidt-Richberg ²³, Jan Ehrhardt ²³, René Werner ²³, Dirk Smeets ²⁴, Dirk Loeckx ²⁴, Gang Song ²⁵, Nicholas Tustison ²⁶, Brian Avants ²⁵, James C. Gee ²⁵, Marius Staring ²⁷, Stefan Klein ¹⁴, Berend C. Stoel ²⁷, Martin Urschler ²⁸, Manuel Werlberger ²⁸, Jef Vandemeulebroucke ²⁹, Simon Rit ³⁰, David Sarrut ²⁹, Josien Pw Pluim ¹

IEEE Transactions on Medical Imaging (2011) epub ahead of print

Abstract: EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intra-patient thoracic CT image pairs. Evaluation of non-rigid registration techniques is a non trivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This article details the organisation of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.

1: Image sciences institute - University of Utrecht (ISI)
University Medical Center Utrecht
2: Department of Electrical and Computer Engineering [Iowa]
University of Iowa
3: Philips Research [Germany]
Philips Research
4: Siemens [Beijing]
China Corporate Technology
5: State Key Laboratory of Chemical Engineering (Polymerization Division)
Zhejiang University
6: Institut des Nanosciences de Paris (INSP)
CNRS : UMR7588 – Université Paris VI - Pierre et Marie Curie
7: Mauna Kea Technologies
Mauna Kea Technologies
8: ASCLEPIOS (INRIA Sophia Antipolis)
INRIA
9: VISAGES : Vision Action et Gestion d'Informations en Santé (VISAGES)
INSERM : U746 – CNRS : UMR6074 – INRIA – Université de Rennes 1
10: Computer Aided Medical Procedures & Augmented Reality (CAMPAR)
Technische Universität München (TUM)
11: GALEN (INRIA Saclay - Ile de France)
INRIA – Ecole Centrale Paris
12: Mathématiques Appliquées aux Systèmes - EA 4037 (MAS)
Ecole Centrale Paris
13: Department of computer Science [Copenhagen] (DIKU)
University of Copenhagen
14: Biomedical Imaging Group [Rotterdam] (BIG)
Erasmus MC – University Medical Center Rotterdam
15: CMS Software
Elekta Inc.
16: Institute of Biomedical Engineering [Oxford]
Department of Engineering Science – University of Oxford
17: Department of Clinical Neurology [Oxford]
FMRIB Centre – University of Oxford – John Radcliffe Hospital
18: Centre for Medical Image Computing (CMIC)
University College of London (UCL)
19: Centre for Intelligent Machines (CIM)
McGill University
20: Montreal Neurological Institute
McGill University
21: McConnell Brain Imaging Centre (MNI)
Montreal Neurological Institute – McGill University
22: Massachusetts General Hospital (MGH)
Massachusetts General Hospital
23: Institute of Medical Informatics [Lübeck]
University of Lübeck
24: Medical imaging research center [Leuven]
K.U. LEUVEN – Faculty of Engineering
25: Penn Image Computing & Science Lab (PICSL)
University of Pennsylvania
26: Department of radiology and medical imaging [Charlottesville]
University of Virginia
27: Division of image processing [Leiden]
Department of Radiology – Leiden University Medical Center (LUMC)
28: Institute for Computer Graphics and Vision [Graz] (ICG)
Graz University of Technology
29: Centre de recherche en applications et traitement de l'image pour la santé (CREATIS)
INSA - Institut National des Sciences Appliquées – CNRS : UMR5220 – Université Claude Bernard - Lyon I – INSERM : U1044 – Hospices Civils de Lyon
30: Laboratoire d'InfoRmatique en Images et Systèmes d'Information (LIRIS)
CNRS : UMR5205 – Université Claude Bernard - Lyon I – Université Lumière - Lyon II – Institut National des Sciences Appliquées de Lyon – Ecole Centrale de Lyon

inserm-00607794, version 1
http://www.hal.inserm.fr/inserm-00607794
oai:www.hal.inserm.fr:inserm-00607794
From: Olivier Commowick <>
Submitted on: Monday, 11 July 2011 12:46:19
Updated on: Tuesday, 19 July 2011 15:58:26

See detailed view

Associated documents

PubMed: 21632295

DOI: 10.1109/TMI.2011.2158349

Export

Bibtex EndNote TEI RefWorks

%% inserm-00607794, version 1
%% http://www.hal.inserm.fr/inserm-00607794
@article{murphy:inserm-00607794,
    hal_id = {inserm-00607794},
    url = {http://www.hal.inserm.fr/inserm-00607794},
    title = {{Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge.}},
    author = {Murphy, Keelin and Van Ginneken, Bram and Reinhardt, M., Joseph and Kabus, Sven and Ding, Kai and Deng, Xiang and Cao, Kunlin and Du, Kaifang and Christensen, E., Gary and Garcia, Vincent and Vercauteren, Tom and Ayache, Nicholas and Commowick, Olivier and Malandain, Gr{\'e}goire and Glocker, Ben and Paragios, Nikolaos and Navab, Nassir and Gorbunova, Vladlena and Sporring, Jon and De Bruijne, Marleen and Han, Xiao and Heinrich, P., Mattias and Schnabel, A., Julia and Jenkinson, Mark and Lorenz, Cristian and Modat, Marc and Mcclelland, R., Jamie and Ourselin, S{\'e}bastien and Muenzing, Ea, Sacha and Viergever, A., Max and De Nigris, Dante and Collins, D., Louis and Arbel, Tal and Peroni, Marta and Li, Rui and Sharp, C., Gregory and Schmidt-Richberg, Alexander and Ehrhardt, Jan and Werner, Ren{\'e} and Smeets, Dirk and Loeckx, Dirk and Song, Gang and Tustison, Nicholas and Avants, Brian and Gee, C., James and Staring, Marius and Klein, Stefan and Stoel, C., Berend and Urschler, Martin and Werlberger, Manuel and Vandemeulebroucke, Jef and Rit, Simon and Sarrut, David and Pluim, Pw, Josien},
    abstract = {{EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intra-patient thoracic CT image pairs. Evaluation of non-rigid registration techniques is a non trivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This article details the organisation of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.}},
    keywords = {Registration ; Chest ; Computed Tomography ; Evaluation},
    language = {English},
    affiliation = {Image sciences institute - University of Utrecht - ISI , Department of Electrical and Computer Engineering [Iowa] , Philips Research [Germany] , Siemens [Beijing] , State Key Laboratory of Chemical Engineering (Polymerization Division) , Institut des Nanosciences de Paris - INSP , Mauna Kea Technologies , ASCLEPIOS - INRIA Sophia Antipolis , VISAGES : Vision Action et Gestion d'Informations en Sant{\'e} - VISAGES , Computer Aided Medical Procedures \& Augmented Reality - CAMPAR , GALEN - INRIA Saclay - Ile de France , Math{\'e}matiques Appliqu{\'e}es aux Syst{\`e}mes - EA 4037 - MAS , Department of computer Science [Copenhagen] - DIKU , Biomedical Imaging Group [Rotterdam] - BIG , CMS Software , Institute of Biomedical Engineering [Oxford] , Department of Clinical Neurology [Oxford] , Centre for Medical Image Computing - CMIC , Centre for Intelligent Machines - CIM , Montreal Neurological Institute , McConnell Brain Imaging Centre - MNI , Massachusetts General Hospital - MGH , Institute of Medical Informatics [L{\"u}beck] , Medical imaging research center [Leuven] , Penn Image Computing \& Science Lab - PICSL , Department of radiology and medical imaging [Charlottesville] , Division of image processing [Leiden] , Institute for Computer Graphics and Vision [Graz] - ICG , Centre de recherche en applications et traitement de l'image pour la sant{\'e} - CREATIS , Laboratoire d'InfoRmatique en Images et Syst{\`e}mes d'Information - LIRIS},
    pages = {epub ahead of print},
    journal = {IEEE Transactions on Medical Imaging},
    audience = {international },
    issn = {1558-0062 },
    doi = {10.1109/TMI.2011.2158349 },
    year = {2011},
    month = May,
}

%F inserm-00607794, version 1
%0 Journal Article
%U http://www.hal.inserm.fr/inserm-00607794
%T Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge.
%A Murphy, Keelin
%A Van Ginneken, Bram
%A Reinhardt, Joseph
%A Kabus, Sven
%A Ding, Kai
%A Deng, Xiang
%A Cao, Kunlin
%A Du, Kaifang
%A Christensen, Gary
%A Garcia, Vincent
%A Vercauteren, Tom
%A Ayache, Nicholas
%A Commowick, Olivier
%A Malandain, Grégoire
%A Glocker, Ben
%A Paragios, Nikolaos
%A Navab, Nassir
%A Gorbunova, Vladlena
%A Sporring, Jon
%A De Bruijne, Marleen
%A Han, Xiao
%A Heinrich, Mattias
%A Schnabel, Julia
%A Jenkinson, Mark
%A Lorenz, Cristian
%A Modat, Marc
%A Mcclelland, Jamie
%A Ourselin, Sébastien
%A Muenzing, Sacha
%A Viergever, Max
%A De Nigris, Dante
%A Collins, Louis
%A Arbel, Tal
%A Peroni, Marta
%A Li, Rui
%A Sharp, Gregory
%A Schmidt-Richberg, Alexander
%A Ehrhardt, Jan
%A Werner, René
%A Smeets, Dirk
%A Loeckx, Dirk
%A Song, Gang
%A Tustison, Nicholas
%A Avants, Brian
%A Gee, James
%A Staring, Marius
%A Klein, Stefan
%A Stoel, Berend
%A Urschler, Martin
%A Werlberger, Manuel
%A Vandemeulebroucke, Jef
%A Rit, Simon
%A Sarrut, David
%A Pluim, Josien
%+ Image sciences institute - University of Utrecht - ISI , Department of Electrical and Computer Engineering [Iowa] , Philips Research [Germany] , Siemens [Beijing] , State Key Laboratory of Chemical Engineering (Polymerization Division) , Institut des Nanosciences de Paris - INSP , Mauna Kea Technologies , ASCLEPIOS - INRIA Sophia Antipolis , VISAGES : Vision Action et Gestion d'Informations en Santé - VISAGES , Computer Aided Medical Procedures & Augmented Reality - CAMPAR , GALEN - INRIA Saclay - Ile de France , Mathématiques Appliquées aux Systèmes - EA 4037 - MAS , Department of computer Science [Copenhagen] - DIKU , Biomedical Imaging Group [Rotterdam] - BIG , CMS Software , Institute of Biomedical Engineering [Oxford] , Department of Clinical Neurology [Oxford] , Centre for Medical Image Computing - CMIC , Centre for Intelligent Machines - CIM , Montreal Neurological Institute , McConnell Brain Imaging Centre - MNI , Massachusetts General Hospital - MGH , Institute of Medical Informatics [Lübeck] , Medical imaging research center [Leuven] , Penn Image Computing & Science Lab - PICSL , Department of radiology and medical imaging [Charlottesville] , Division of image processing [Leiden] , Institute for Computer Graphics and Vision [Graz] - ICG , Centre de recherche en applications et traitement de l'image pour la santé - CREATIS , Laboratoire d'InfoRmatique en Images et Systèmes d'Information - LIRIS
%X EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intra-patient thoracic CT image pairs. Evaluation of non-rigid registration techniques is a non trivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This article details the organisation of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.
%2 SDV:IB;INFO:INFO_IM
%G English
%@ 1558-0062
%R 10.1109/TMI.2011.2158349
%J IEEE Transactions on Medical Imaging
%2 international
%8 2011-05-31
%2 2011-05-31
%P epub ahead of print
%K Registration ; Chest ; Computed Tomography ; Evaluation

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="article"><head>Articles in peer-reviewed journal</head>
<biblStruct type="article" xml:id="inserm-00607794"><analytic>
<author><persName><forename>Keelin</forename><surname>Murphy</surname></persName>
<affiliation>
<orgName type="laboratory">ISI</orgName>
<orgName type="team">Image sciences institute - University of Utrecht</orgName>
<country>NL</country>
<orgName type="institution">University Medical Center Utrecht</orgName>
</affiliation>
</author>
<author><persName><forename>Bram</forename><surname>Van Ginneken</surname></persName>
<affiliation>
<orgName type="laboratory">ISI</orgName>
<orgName type="team">Image sciences institute - University of Utrecht</orgName>
<country>NL</country>
<orgName type="institution">University Medical Center Utrecht</orgName>
</affiliation>
</author>
<author><persName><forename>Joseph</forename><surname>Reinhardt</surname></persName>
<affiliation>
<orgName type="team">Department of Electrical and Computer Engineering [Iowa]</orgName>
<country>US</country>
<orgName type="institution">University of Iowa</orgName>
</affiliation>
</author>
<author><persName><forename>Sven</forename><surname>Kabus</surname></persName>
<affiliation>
<orgName type="team">Philips Research [Germany]</orgName>
<country>DE</country>
<orgName type="institution">Philips Research</orgName>
</affiliation>
</author>
<author><persName><forename>Kai</forename><surname>Ding</surname></persName>
<affiliation>
<orgName type="team">Department of Electrical and Computer Engineering [Iowa]</orgName>
<country>US</country>
<orgName type="institution">University of Iowa</orgName>
</affiliation>
</author>
<author><persName><forename>Xiang</forename><surname>Deng</surname></persName>
<affiliation>
<orgName type="team">Siemens [Beijing]</orgName>
<country>CN</country>
<orgName type="institution">China Corporate Technology</orgName>
</affiliation>
</author>
<author><persName><forename>Kunlin</forename><surname>Cao</surname></persName>
<affiliation>
<orgName type="team">Department of Electrical and Computer Engineering [Iowa]</orgName>
<country>US</country>
<orgName type="institution">University of Iowa</orgName>
</affiliation>
<affiliation>
<orgName type="team">State Key Laboratory of Chemical Engineering (Polymerization Division)</orgName>
<country>CN</country>
<orgName type="institution">Zhejiang University</orgName>
</affiliation>
</author>
<author><persName><forename>Kaifang</forename><surname>Du</surname></persName>
<affiliation>
<orgName type="team">Department of Electrical and Computer Engineering [Iowa]</orgName>
<country>US</country>
<orgName type="institution">University of Iowa</orgName>
</affiliation>
</author>
<author><persName><forename>Gary</forename><surname>Christensen</surname></persName>
<affiliation>
<orgName type="team">Department of Electrical and Computer Engineering [Iowa]</orgName>
<country>US</country>
<orgName type="institution">University of Iowa</orgName>
</affiliation>
</author>
<author><persName><forename>Vincent</forename><surname>Garcia</surname></persName>
<affiliation>
<orgName type="laboratory">INSP</orgName>
<orgName type="team">Institut des Nanosciences de Paris</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR7588</orgName>
<orgName type="institution">Université Paris VI - Pierre et Marie Curie</orgName>
</affiliation>
</author>
<author><persName><forename>Tom</forename><surname>Vercauteren</surname></persName>
<affiliation>
<orgName type="team">Mauna Kea Technologies</orgName>
<country>FR</country>
<orgName type="institution">Mauna Kea Technologies</orgName>
</affiliation>
</author>
<author><persName><forename>Nicholas</forename><surname>Ayache</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Sophia Antipolis</orgName>
<orgName type="team">ASCLEPIOS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
</affiliation>
</author>
<author><persName><forename>Olivier</forename><surname>Commowick</surname></persName>
<affiliation>
<orgName type="laboratory">VISAGES</orgName>
<orgName type="team">VISAGES : Vision Action et Gestion d'Informations en Santé</orgName>
<country>FR</country>
<orgName type="institution">INSERM : U746</orgName>
<orgName type="institution">CNRS : UMR6074</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
</affiliation>
</author>
<author><persName><forename>Grégoire</forename><surname>Malandain</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Sophia Antipolis</orgName>
<orgName type="team">ASCLEPIOS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
</affiliation>
</author>
<author><persName><forename>Ben</forename><surname>Glocker</surname></persName>
<affiliation>
<orgName type="laboratory">CAMPAR</orgName>
<orgName type="team">Computer Aided Medical Procedures & Augmented Reality</orgName>
<country>DE</country>
<orgName type="institution">Technische Universität München (TUM)</orgName>
</affiliation>
</author>
<author><persName><forename>Nikolaos</forename><surname>Paragios</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Saclay - Ile de France</orgName>
<orgName type="team">GALEN</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Ecole Centrale Paris</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">MAS</orgName>
<orgName type="team">Mathématiques Appliquées aux Systèmes - EA 4037</orgName>
<country>FR</country>
<orgName type="institution">Ecole Centrale Paris</orgName>
</affiliation>
</author>
<author><persName><forename>Nassir</forename><surname>Navab</surname></persName>
<affiliation>
<orgName type="laboratory">CAMPAR</orgName>
<orgName type="team">Computer Aided Medical Procedures & Augmented Reality</orgName>
<country>DE</country>
<orgName type="institution">Technische Universität München (TUM)</orgName>
</affiliation>
</author>
<author><persName><forename>Vladlena</forename><surname>Gorbunova</surname></persName>
<affiliation>
<orgName type="laboratory">DIKU</orgName>
<orgName type="team">Department of computer Science [Copenhagen]</orgName>
<country>DK</country>
<orgName type="institution">University of Copenhagen</orgName>
</affiliation>
</author>
<author><persName><forename>Jon</forename><surname>Sporring</surname></persName>
<affiliation>
<orgName type="laboratory">DIKU</orgName>
<orgName type="team">Department of computer Science [Copenhagen]</orgName>
<country>DK</country>
<orgName type="institution">University of Copenhagen</orgName>
</affiliation>
</author>
<author><persName><forename>Marleen</forename><surname>De Bruijne</surname></persName>
<affiliation>
<orgName type="laboratory">DIKU</orgName>
<orgName type="team">Department of computer Science [Copenhagen]</orgName>
<country>DK</country>
<orgName type="institution">University of Copenhagen</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">BIG</orgName>
<orgName type="team">Biomedical Imaging Group [Rotterdam]</orgName>
<country>NL</country>
<orgName type="institution">Erasmus MC</orgName>
<orgName type="institution">University Medical Center Rotterdam</orgName>
</affiliation>
</author>
<author><persName><forename>Xiao</forename><surname>Han</surname></persName>
<affiliation>
<orgName type="team">CMS Software</orgName>
<country>US</country>
<orgName type="institution">Elekta Inc.</orgName>
</affiliation>
</author>
<author><persName><forename>Mattias</forename><surname>Heinrich</surname></persName>
<affiliation>
<orgName type="team">Institute of Biomedical Engineering [Oxford]</orgName>
<country>GB</country>
<orgName type="institution">Department of Engineering Science</orgName>
<orgName type="institution">University of Oxford</orgName>
</affiliation>
<affiliation>
<orgName type="team">Department of Clinical Neurology [Oxford]</orgName>
<country>GB</country>
<orgName type="institution">FMRIB Centre</orgName>
<orgName type="institution">University of Oxford</orgName>
<orgName type="institution">John Radcliffe Hospital</orgName>
</affiliation>
</author>
<author><persName><forename>Julia</forename><surname>Schnabel</surname></persName>
<affiliation>
<orgName type="team">Institute of Biomedical Engineering [Oxford]</orgName>
<country>GB</country>
<orgName type="institution">Department of Engineering Science</orgName>
<orgName type="institution">University of Oxford</orgName>
</affiliation>
</author>
<author><persName><forename>Mark</forename><surname>Jenkinson</surname></persName>
<affiliation>
<orgName type="team">Department of Clinical Neurology [Oxford]</orgName>
<country>GB</country>
<orgName type="institution">FMRIB Centre</orgName>
<orgName type="institution">University of Oxford</orgName>
<orgName type="institution">John Radcliffe Hospital</orgName>
</affiliation>
</author>
<author><persName><forename>Cristian</forename><surname>Lorenz</surname></persName>
<affiliation>
<orgName type="team">Philips Research [Germany]</orgName>
<country>DE</country>
<orgName type="institution">Philips Research</orgName>
</affiliation>
</author>
<author><persName><forename>Marc</forename><surname>Modat</surname></persName>
<affiliation>
<orgName type="laboratory">CMIC</orgName>
<orgName type="team">Centre for Medical Image Computing</orgName>
<country>GB</country>
<orgName type="institution">University College of London (UCL)</orgName>
</affiliation>
</author>
<author><persName><forename>Jamie</forename><surname>Mcclelland</surname></persName>
<affiliation>
<orgName type="laboratory">CMIC</orgName>
<orgName type="team">Centre for Medical Image Computing</orgName>
<country>GB</country>
<orgName type="institution">University College of London (UCL)</orgName>
</affiliation>
</author>
<author><persName><forename>Sébastien</forename><surname>Ourselin</surname></persName>
<affiliation>
<orgName type="laboratory">CMIC</orgName>
<orgName type="team">Centre for Medical Image Computing</orgName>
<country>GB</country>
<orgName type="institution">University College of London (UCL)</orgName>
</affiliation>
</author>
<author><persName><forename>Sacha</forename><surname>Muenzing</surname></persName>
<affiliation>
<orgName type="laboratory">ISI</orgName>
<orgName type="team">Image sciences institute - University of Utrecht</orgName>
<country>NL</country>
<orgName type="institution">University Medical Center Utrecht</orgName>
</affiliation>
</author>
<author><persName><forename>Max</forename><surname>Viergever</surname></persName>
<affiliation>
<orgName type="laboratory">ISI</orgName>
<orgName type="team">Image sciences institute - University of Utrecht</orgName>
<country>NL</country>
<orgName type="institution">University Medical Center Utrecht</orgName>
</affiliation>
</author>
<author><persName><forename>Dante</forename><surname>De Nigris</surname></persName>
<affiliation>
<orgName type="laboratory">CIM</orgName>
<orgName type="team">Centre for Intelligent Machines</orgName>
<country>CA</country>
<orgName type="institution">McGill University</orgName>
</affiliation>
</author>
<author><persName><forename>Louis</forename><surname>Collins</surname></persName>
<affiliation>
<orgName type="team">Montreal Neurological Institute</orgName>
<country>CA</country>
<orgName type="institution">McGill University</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">MNI</orgName>
<orgName type="team">McConnell Brain Imaging Centre</orgName>
<country>CA</country>
<orgName type="institution">Montreal Neurological Institute</orgName>
<orgName type="institution">McGill University</orgName>
</affiliation>
</author>
<author><persName><forename>Tal</forename><surname>Arbel</surname></persName>
<affiliation>
<orgName type="laboratory">CIM</orgName>
<orgName type="team">Centre for Intelligent Machines</orgName>
<country>CA</country>
<orgName type="institution">McGill University</orgName>
</affiliation>
</author>
<author><persName><forename>Marta</forename><surname>Peroni</surname></persName>
<affiliation>
<orgName type="laboratory">MGH</orgName>
<orgName type="team">Massachusetts General Hospital</orgName>
<country>US</country>
<orgName type="institution">Massachusetts General Hospital</orgName>
</affiliation>
</author>
<author><persName><forename>Rui</forename><surname>Li</surname></persName>
<affiliation>
<orgName type="laboratory">MGH</orgName>
<orgName type="team">Massachusetts General Hospital</orgName>
<country>US</country>
<orgName type="institution">Massachusetts General Hospital</orgName>
</affiliation>
</author>
<author><persName><forename>Gregory</forename><surname>Sharp</surname></persName>
<affiliation>
<orgName type="laboratory">MGH</orgName>
<orgName type="team">Massachusetts General Hospital</orgName>
<country>US</country>
<orgName type="institution">Massachusetts General Hospital</orgName>
</affiliation>
</author>
<author><persName><forename>Alexander</forename><surname>Schmidt-Richberg</surname></persName>
<affiliation>
<orgName type="team">Institute of Medical Informatics [Lübeck]</orgName>
<country>DE</country>
<orgName type="institution">University of Lübeck</orgName>
</affiliation>
</author>
<author><persName><forename>Jan</forename><surname>Ehrhardt</surname></persName>
<affiliation>
<orgName type="team">Institute of Medical Informatics [Lübeck]</orgName>
<country>DE</country>
<orgName type="institution">University of Lübeck</orgName>
</affiliation>
</author>
<author><persName><forename>René</forename><surname>Werner</surname></persName>
<affiliation>
<orgName type="team">Institute of Medical Informatics [Lübeck]</orgName>
<country>DE</country>
<orgName type="institution">University of Lübeck</orgName>
</affiliation>
</author>
<author><persName><forename>Dirk</forename><surname>Smeets</surname></persName>
<affiliation>
<orgName type="team">Medical imaging research center [Leuven]</orgName>
<country>BE</country>
<orgName type="institution">K.U. LEUVEN</orgName>
<orgName type="institution">Faculty of Engineering</orgName>
</affiliation>
</author>
<author><persName><forename>Dirk</forename><surname>Loeckx</surname></persName>
<affiliation>
<orgName type="team">Medical imaging research center [Leuven]</orgName>
<country>BE</country>
<orgName type="institution">K.U. LEUVEN</orgName>
<orgName type="institution">Faculty of Engineering</orgName>
</affiliation>
</author>
<author><persName><forename>Gang</forename><surname>Song</surname></persName>
<affiliation>
<orgName type="laboratory">PICSL</orgName>
<orgName type="team">Penn Image Computing & Science Lab</orgName>
<country>US</country>
<orgName type="institution">University of Pennsylvania</orgName>
</affiliation>
</author>
<author><persName><forename>Nicholas</forename><surname>Tustison</surname></persName>
<affiliation>
<orgName type="team">Department of radiology and medical imaging [Charlottesville]</orgName>
<country>US</country>
<orgName type="institution">University of Virginia</orgName>
</affiliation>
</author>
<author><persName><forename>Brian</forename><surname>Avants</surname></persName>
<affiliation>
<orgName type="laboratory">PICSL</orgName>
<orgName type="team">Penn Image Computing & Science Lab</orgName>
<country>US</country>
<orgName type="institution">University of Pennsylvania</orgName>
</affiliation>
</author>
<author><persName><forename>James</forename><surname>Gee</surname></persName>
<affiliation>
<orgName type="laboratory">PICSL</orgName>
<orgName type="team">Penn Image Computing & Science Lab</orgName>
<country>US</country>
<orgName type="institution">University of Pennsylvania</orgName>
</affiliation>
</author>
<author><persName><forename>Marius</forename><surname>Staring</surname></persName>
<affiliation>
<orgName type="team">Division of image processing [Leiden]</orgName>
<country>NL</country>
<orgName type="institution">Department of Radiology</orgName>
<orgName type="institution">Leiden University Medical Center (LUMC)</orgName>
</affiliation>
</author>
<author><persName><forename>Stefan</forename><surname>Klein</surname></persName>
<affiliation>
<orgName type="laboratory">BIG</orgName>
<orgName type="team">Biomedical Imaging Group [Rotterdam]</orgName>
<country>NL</country>
<orgName type="institution">Erasmus MC</orgName>
<orgName type="institution">University Medical Center Rotterdam</orgName>
</affiliation>
</author>
<author><persName><forename>Berend</forename><surname>Stoel</surname></persName>
<affiliation>
<orgName type="team">Division of image processing [Leiden]</orgName>
<country>NL</country>
<orgName type="institution">Department of Radiology</orgName>
<orgName type="institution">Leiden University Medical Center (LUMC)</orgName>
</affiliation>
</author>
<author><persName><forename>Martin</forename><surname>Urschler</surname></persName>
<affiliation>
<orgName type="laboratory">ICG</orgName>
<orgName type="team">Institute for Computer Graphics and Vision [Graz]</orgName>
<country>AT</country>
<orgName type="institution">Graz University of Technology</orgName>
</affiliation>
</author>
<author><persName><forename>Manuel</forename><surname>Werlberger</surname></persName>
<affiliation>
<orgName type="laboratory">ICG</orgName>
<orgName type="team">Institute for Computer Graphics and Vision [Graz]</orgName>
<country>AT</country>
<orgName type="institution">Graz University of Technology</orgName>
</affiliation>
</author>
<author><persName><forename>Jef</forename><surname>Vandemeulebroucke</surname></persName>
<affiliation>
<orgName type="laboratory">CREATIS</orgName>
<orgName type="team">Centre de recherche en applications et traitement de l'image pour la santé</orgName>
<country>FR</country>
<orgName type="institution">INSA - Institut National des Sciences Appliquées</orgName>
<orgName type="institution">CNRS : UMR5220</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
<orgName type="institution">INSERM : U1044</orgName>
<orgName type="institution">Hospices Civils de Lyon</orgName>
</affiliation>
</author>
<author><persName><forename>Simon</forename><surname>Rit</surname></persName>
<affiliation>
<orgName type="laboratory">LIRIS</orgName>
<orgName type="team">Laboratoire d'InfoRmatique en Images et Systèmes d'Information</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5205</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
<orgName type="institution">Université Lumière - Lyon II</orgName>
<orgName type="institution">Institut National des Sciences Appliquées de Lyon</orgName>
<orgName type="institution">Ecole Centrale de Lyon</orgName>
</affiliation>
</author>
<author><persName><forename>David</forename><surname>Sarrut</surname></persName>
<affiliation>
<orgName type="laboratory">CREATIS</orgName>
<orgName type="team">Centre de recherche en applications et traitement de l'image pour la santé</orgName>
<country>FR</country>
<orgName type="institution">INSA - Institut National des Sciences Appliquées</orgName>
<orgName type="institution">CNRS : UMR5220</orgName>
<orgName type="institution">Université Claude Bernard - Lyon I</orgName>
<orgName type="institution">INSERM : U1044</orgName>
<orgName type="institution">Hospices Civils de Lyon</orgName>
</affiliation>
</author>
<author><persName><forename>Josien</forename><surname>Pluim</surname></persName>
<affiliation>
<orgName type="laboratory">ISI</orgName>
<orgName type="team">Image sciences institute - University of Utrecht</orgName>
<country>NL</country>
<orgName type="institution">University Medical Center Utrecht</orgName>
</affiliation>
</author>
<title type="main" level="a">Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge.</title></analytic><monogr><title level="j" type="main">IEEE Transactions on Medical Imaging</title><imprint><biblScope type="publicationDate">2011-05-31</biblScope><biblScope type="pp">epub ahead of print</biblScope></imprint></monogr><idno type="doi">10.1109/TMI.2011.2158349</idno><idno type="HALid">http://www.hal.inserm.fr/inserm-00607794</idno></biblStruct>
</listBibl>
</listBibl>