MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Preprints, Working Papers, ... Year : 2023

MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision

Jianning Li (1) , Zongwei Zhou (2) , Jiancheng Yang (3) , Antonio Pepe (1) , Christina Gsaxner (1) , Gijs Luijten (1) , Chongyu Qu (2) , Tiezheng Zhang (2) , Xiaoxi Chen (4) , Wenxuan Li (2) , Marek Wodzinski (5) , Paul Friedrich (6) , Kangxian Xie (7) , Yuan Jin (1) , Narmada Ambigapathy (8) , Enrico Nasca (8) , Naida Solak (1) , Gian Marco Melito (1) , Viet Duc Vu (9) , Afaque R. Memon (10) , Christopher Schlachta (11) , Sandrine de Ribaupierre (11) , Rajnikant Patel (11) , Roy Eagleson (11) , Xiaojun Chen (4) , Heinrich Mächler (12) , Jan Stefan Kirschke (13) , Ezequiel de la Rosa (14) , Patrick Ferdinand Christ (15) , Hongwei Bran Li (15) , David G. Ellis (16) , Michele R. Aizenberg (16) , Sergios Gatidis (17) , Thomas Küstner (17) , Nadya Shusharina (18) , Nicholas Heller (19) , Vincent Andrearczyk (20) , Adrien Depeursinge (20) , Mathieu Hatt (21) , Anjany Sekuboyina (14) , Maximilian Löffler (14) , Hans Liebl (22) , Reuben Dorent (23) , Tom Vercauteren (23) , Jonathan Shapey (23) , Aaron Kujawa (23) , Stefan Cornelissen (24) , Patrick Langenhuizen (24) , Achraf Ben-Hamadou (25, 26) , Ahmed Rekik (25, 26) , Sergi Pujades (27) , Edmond Boyer (27) , Federico Bolelli (28) , Costantino Grana (28) , Luca Lumetti (28) , Hamidreza Salehi (29) , Jun Ma (30) , Yao Zhang (31) , Ramtin Gharleghi (32) , Susann Beier (32) , Arcot Sowmya (33) , Eduardo A. Garza-Villarreal (34) , Thania Balducci (34) , Diego Angeles-Valdez (34) , Roberto Souza (35) , Leticia Rittner (36) , Richard Frayne (35) , Yuanfeng Ji (37) , Vincenzo Ferrari (38) , Soumick Chatterjee (39) , Florian Dubost (40) , Stefanie Schreiber (41) , Hendrik Mattern (41) , Oliver Speck (41) , Daniel Haehn (42) , Christoph John (43) , Andreas Nürnberger (43) , João Pedrosa (44) , Carlos Ferreira (44) , Guilherme Aresta (45) , António Cunha (44) , Aurélio Campilho (44) , Yannick Suter (46) , Jose Garcia (47) , Alain Lalande (48) , Vicky Vandenbossche (49) , Aline van Oevelen (49) , Kate Duquesne (49) , Hamza Mekhzoum (49) , Jef Vandemeulebroucke (49) , Emmanuel Audenaert (49) , Claudia Krebs (50) , Timo van Leeuwen (51) , Evie Vereecke , Hauke Heidemeyer , Rainer Röhrig , Frank Hölzle , Vahid Badeli , Kathrin Krieger , Matthias Gunzer , Jianxu Chen , Timo van Meegdenburg , Amin Dada , Miriam Balzer , Jana Fragemann , Frederic Jonske , Moritz Rempe , Stanislav Malorodov , Fin H. Bahnsen , Constantin Seibold , Alexander Jaus , Zdravko Marinov , Paul F. Jaeger , Rainer Stiefelhagen , Ana Sofia Santos , Mariana Lindo , André Ferreira , Victor Alves , Michael Kamp , Amr Abourayya , Felix Nensa , Fabian Hörst , Alexander Brehmer , Lukas Heine , Yannik Hanusrichter , Martin Weßling , Marcel Dudda , Lars E. Podleska , Matthias A. Fink , Julius Keyl , Konstantinos Tserpes , Moon-Sung Kim , Shireen Elhabian , Hans Lamecker , Dženan Zukić , Beatriz Paniagua , Christian Wachinger , Martin Urschler , Luc Duong , Jakob Wasserthal , Peter F. Hoyer , Oliver Basu , Thomas Maal , Max J. H. Witjes , Gregor Schiele , Ti-Chiun Chang , Seyed-Ahmad Ahmadi , Ping Luo , Bjoern Menze , Mauricio Reyes , Thomas M. Deserno , Christos Davatzikos , Behrus Puladi , Pascal Fua , Alan L. Yuille , Jens Kleesiek , Jan Egger
1 TU Graz - Graz University of Technology [Graz]
2 JHU - Johns Hopkins University
3 EPFL - Ecole Polytechnique Fédérale de Lausanne
4 Shanghai Jiao Tong University [Shanghai]
5 University of Applied Sciences of Western Switzerland
6 Unibas - Université de Bâle = University of Basel = Basel Universität
7 Khoury College of Computer Sciences [Boston]
8 AöR - University Hospital Essen
9 JLU - Justus-Liebig-Universität Gießen = Justus Liebig University
10 Mehran University of Engineering and Technology [Jamshoro]
11 CSTAR - Canadian Surgical Technologies & Advanced Robotics
12 Medical University Graz
13 TUM - Technische Universität Munchen - Technical University Munich - Université Technique de Munich
14 University of Applied Sciences [Munich]
15 UZH - Universität Zürich [Zürich] = University of Zurich
16 University of Nebraska Medical Center
17 Universitätsklinikum Tübingen - University Hospital of Tübingen
18 HMS - Harvard Medical School [Boston]
19 UMN - University of Minnesota [Twin Cities]
20 HES-SO - University of Applied Sciences and Arts of Western Switzerland
21 LaTIM - Laboratoire de Traitement de l'Information Medicale
22 MRI TUM - Klinikum rechts der Isar
23 King‘s College London
24 ETZ - St. Elisabeth-TweeSteden Hospital
25 CRNS - Centre de Recherche en Numérique de Sfax
26 Udini [Aix-En-Provence]
27 MORPHEO - Capture and Analysis of Shapes in Motion
28 UNIMORE - Università degli Studi di Modena e Reggio Emilia = University of Modena and Reggio Emilia
29 IUMS - Iran University of Medical Sciences [Tehran, Iran]
30 University of Toronto
31 Shanghai University
32 School of Mechanical and Manufacturing Engineering [Sydney]
33 School of Computer Science and Software Engineering [Australia]
34 UNAM - Universidad Nacional Autónoma de México = National Autonomous University of Mexico
35 University of Calgary
36 UNICAMP - Universidade Estadual de Campinas = University of Campinas
37 HKU - The University of Hong Kong
38 University of Pisa - Università di Pisa
39 OVGU - Otto-von-Guericke-Universität Magdeburg = Otto-von-Guericke University [Magdeburg]
40 Google LLC
41 CBBS - Center for Behavioral Brain Sciences [Magdeburg]
42 UMASS - University of Massachusetts System
43 Ecubed Solutions [Bensheim]
44 Universidade do Porto = University of Porto
45 Medizinische Universität Wien = Medical University of Vienna
46 ARTORG - Center for Biomedical Engineering Research
47 CBICA - Center for Biomedical Image Computing & Analytics [Philadelphia]
48 ICMUB - Institut de Chimie Moléculaire de l'Université de Bourgogne [Dijon]
49 UGENT - Universiteit Gent = Ghent University
50 University of British Columbia [Vancouver]
51 KU Leuven - Technologie campus Gent - KU Leuven
Sergi Pujades
Edmond Boyer
Jun Ma
  • Function : Author
Yao Zhang
  • Function : Author
Florian Dubost
  • Function : Author
Evie Vereecke
  • Function : Author
Hauke Heidemeyer
  • Function : Author
Rainer Röhrig
  • Function : Author
Frank Hölzle
  • Function : Author
Vahid Badeli
  • Function : Author
Kathrin Krieger
  • Function : Author
Matthias Gunzer
  • Function : Author
Jianxu Chen
  • Function : Author
Timo van Meegdenburg
  • Function : Author
Amin Dada
  • Function : Author
Miriam Balzer
  • Function : Author
Jana Fragemann
  • Function : Author
Frederic Jonske
  • Function : Author
Moritz Rempe
  • Function : Author
Stanislav Malorodov
  • Function : Author
Fin H. Bahnsen
  • Function : Author
Constantin Seibold
  • Function : Author
Alexander Jaus
  • Function : Author
Zdravko Marinov
  • Function : Author
Paul F. Jaeger
  • Function : Author
Rainer Stiefelhagen
  • Function : Author
Ana Sofia Santos
  • Function : Author
Mariana Lindo
  • Function : Author
André Ferreira
  • Function : Author
Victor Alves
  • Function : Author
Michael Kamp
  • Function : Author
Amr Abourayya
  • Function : Author
Felix Nensa
  • Function : Author
Fabian Hörst
  • Function : Author
Alexander Brehmer
  • Function : Author
Lukas Heine
  • Function : Author
Yannik Hanusrichter
  • Function : Author
Martin Weßling
  • Function : Author
Marcel Dudda
  • Function : Author
Lars E. Podleska
  • Function : Author
Matthias A. Fink
  • Function : Author
Julius Keyl
  • Function : Author
Konstantinos Tserpes
  • Function : Author
Moon-Sung Kim
  • Function : Author
Shireen Elhabian
  • Function : Author
Hans Lamecker
  • Function : Author
Dženan Zukić
  • Function : Author
Beatriz Paniagua
  • Function : Author
Christian Wachinger
  • Function : Author
Martin Urschler
  • Function : Author
Luc Duong
  • Function : Author
Jakob Wasserthal
  • Function : Author
Peter F. Hoyer
  • Function : Author
Oliver Basu
  • Function : Author
Thomas Maal
  • Function : Author
Max J. H. Witjes
  • Function : Author
Gregor Schiele
  • Function : Author
Ti-Chiun Chang
  • Function : Author
Seyed-Ahmad Ahmadi
  • Function : Author
Ping Luo
  • Function : Author
Bjoern Menze
  • Function : Author
Mauricio Reyes
  • Function : Author
Thomas M. Deserno
  • Function : Author
Christos Davatzikos
  • Function : Author
Behrus Puladi
  • Function : Author
Pascal Fua
  • Function : Author
Alan L. Yuille
  • Function : Author
Jens Kleesiek
  • Function : Author
Jan Egger
  • Function : Author

Abstract

Prior to the deep learning era, shape was commonly used to describe the objects. Nowadays, state-of-the-art (SOTA) algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from numerous shape-related publications in premier vision conferences as well as the growing popularity of ShapeNet (about 51,300 models) and Princeton ModelNet (127,915 models). For the medical domain, we present a large collection of anatomical shapes (e.g., bones, organs, vessels) and 3D models of surgical instrument, called MedShapeNet, created to facilitate the translation of data-driven vision algorithms to medical applications and to adapt SOTA vision algorithms to medical problems. As a unique feature, we directly model the majority of shapes on the imaging data of real patients. As of today, MedShapeNet includes 23 dataset with more than 100,000 shapes that are paired with annotations (ground truth). Our data is freely accessible via a web interface and a Python application programming interface (API) and can be used for discriminative, reconstructive, and variational benchmarks as well as various applications in virtual, augmented, or mixed reality, and 3D printing. Exemplary, we present use cases in the fields of classification of brain tumors, facial and skull reconstructions, multi-class anatomy completion, education, and 3D printing. In future, we will extend the data and improve the interfaces. The project pages are: https://medshapenet.ikim.nrw/ and https://github.com/Jianningli/medshapenet-feedback

Dates and versions

hal-04397470 , version 1 (16-01-2024)

Licence

Attribution - NonCommercial - ShareAlike

Identifiers

Cite

Jianning Li, Zongwei Zhou, Jiancheng Yang, Antonio Pepe, Christina Gsaxner, et al.. MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision. 2023. ⟨hal-04397470⟩
48 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More