Our team is collaborating with the University Hospital of Strasbourg, IHU Strasbourg and IRCAD to build datasets for various medical recognition tasks.
Cholec80 Dataset
The Cholec80 dataset contains 80 videos of cholecystectomy surgeries performed by 13 surgeons. The videos are captured at 25 fps. The dataset is labeled with the phase (at 25 fps) and tool presence annotations (at 1 fps). The phases have been defined by a senior surgeon in our partner hospital. Since the tools are sometimes hardly visible in the images and thus difficult to be recognized visually, we define a tool as present in an image if at least half of the tool tip is visible.
This dataset has been released. If you wish to have access to this dataset, please kindly fill the request form.
This dataset is associated with the publication [Twinanda:TMI2016]. If you use this data, you are kindly requested to cite the work that led to the generation of this dataset:
A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), to appear (arXiv preprint), doi:10.1109/TMI.2016.2593957, 2016
M2CAI 2016 Challenge Datasets
These datasets were generated for the M2CAI challenges, a satellite event of MICCAI 2016 in Athens. Two datasets are available for two different challenges: m2cai16-workflow for the surgical workflow challenge and m2cai16-tool for the surgical tool detection challenge. Some of the videos are taken from the Cholec80 dataset. We invite the reader to go to the M2CAI challenge page for more details regarding the dataset and the results of the past challenges. In order to maintain the ranking of the methods evaluated on these datasets, please kindly send us your quantitative results along with the corresponding technical report to: m2cai2016@gmail.com.
m2cai16-workflow dataset. This dataset is the result of collaborations with the University Hospital of Strasbourg and with the Hospital Klinikum Rechts der Isar in Munich. It contains 41 laparoscopic videos of cholecystectomy procedures. To gain access to the dataset, please kindly fill the following form: m2cai16-workflow request. To see the results of various methods, please visit the following web page: m2cai16-workflow results. If you use this dataset, you are kindly requested to cite both of the following publications that led to the generation of the dataset:
- A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), to appear (arXiv preprint), doi:10.1109/TMI.2016.2593957, 2016
- R. Stauder, D. Ostler, M. Kranzfelder, S. Koller, H. Feußner, N. Navab. The TUM LapChole dataset for the M2CAI 2016 workflow challenge. CoRR, vol. abs/1610.09278, 2016.
m2cai16-tool dataset. This dataset was generated through a collaboration with the University Hospital of Strasbourg. It contains 15 laparoscopic videos of cholecystectomy procedures. To gain access to the dataset, please kindly fill the following form: m2cai16-tool request. To see the results of various methods, please visit the following web page: m2cai16-tool results. If you use this dataset, you are kindly requested to cite the work that led to the generation of the dataset:
- A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), to appear (arXiv preprint), doi:10.1109/TMI.2016.2593957, 2016
xawAR16 Dataset
This is a multi-RGBD camera dataset, generated inside an operating room (IHU Strasbourg), which was designed to evaluate tracking/relocalization of a hand-held moving camera. Three RGBD cameras (Asus Xtion Pro Live) were used to record such a dataset. Two of them are rigidly mounted to the ceiling in a configuration allowing them to capture views from each side of the operating table. A third one is fixed to a display, which is held by a user who moves around the room. A reflective passive marker is attached to the moving camera and its ground-truth pose is obtained with a real-time optical 3D measurement system (infiniTrack system from Atracsys).
The dataset is composed of 16 sequences of time-synchronized color and depth images in full sensor resolution (640×480) recorded at 25 fps, along with the ground-truth poses of the moving camera measured by the tracking device at 30 Hz. Each sequence shows different scene configurations and camera motion, including occlusions, motion in the scene and abrupt viewpoint changes.
More information and an evaluation of our camera relocalization approach on this dataset can be found in the following paper:
N. Loy Rodas, F. Barrera, N. Padoy, See It With Your Own Eyes: Marker-less Mobile Augmented Reality for Radiation Awareness in the Hybrid Room, IEEE Transactions on Biomedical Engineering (TBME), to appear (online version), doi:10.1109/TBME.2016.2560761, 2016
xawAR dataset will be released soon. If you wish to be notified when the data is available, please kindly send an email with your name and affiliation to nloyrodas@unistra.fr.