Our team is collaborating with the University Hospital of Strasbourg, IHU Strasbourg and IRCAD to build datasets for various medical recognition tasks.
MVOR Dataset
To foster the development of human pose estimation methods and their applications in the Operating Room (OR), we are in the process of releasing the Multi-View Operating Room (MVOR) dataset, the first public dataset recorded during real clinical interventions. It consists of synchronized multi-view frames recorded by three RGB-D cameras in a hybrid OR. It also includes the visual challenges present in such environments, such as occlusions and clutter. We provide camera calibration parameters, color and depth frames, human bounding boxes, and 2D/3D pose annotations. The dataset is planned to be released in July 2018: stay tuned!
Cholec80 Dataset
The Cholec80 dataset contains 80 videos of cholecystectomy surgeries performed by 13 surgeons. The videos are captured at 25 fps. The dataset is labeled with the phase (at 25 fps) and tool presence annotations (at 1 fps). The phases have been defined by a senior surgeon in our partner hospital. Since the tools are sometimes hardly visible in the images and thus difficult to be recognized visually, we define a tool as present in an image if at least half of the tool tip is visible.
This dataset has been released. If you wish to have access to this dataset, please kindly fill the request form.
This dataset is associated with the publication [Twinanda:TMI2016]. If you use this data, you are kindly requested to cite the work that led to the generation of this dataset:
A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, 2017
M2CAI 2016 Challenge Datasets
These datasets were generated for the M2CAI challenges, a satellite event of MICCAI 2016 in Athens. Two datasets are available for two different challenges: m2cai16-workflow for the surgical workflow challenge and m2cai16-tool for the surgical tool detection challenge. Some of the videos are taken from the Cholec80 dataset. We invite the reader to go to the M2CAI challenge page for more details regarding the dataset and the results of the past challenges. In order to maintain the ranking of the methods evaluated on these datasets, please kindly send us your quantitative results along with the corresponding technical report to: m2cai2016@gmail.com.
m2cai16-workflow dataset. This dataset is the result of collaborations with the University Hospital of Strasbourg and with the Hospital Klinikum Rechts der Isar in Munich. It contains 41 laparoscopic videos of cholecystectomy procedures. To gain access to the dataset, please kindly fill the following form: m2cai16-workflow request. To see the results of various methods, please visit the following web page: m2cai16-workflow results. If you use this dataset, you are kindly requested to cite both of the following publications that led to the generation of the dataset:
- A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, 2017
- R. Stauder, D. Ostler, M. Kranzfelder, S. Koller, H. Feußner, N. Navab. The TUM LapChole dataset for the M2CAI 2016 workflow challenge. CoRR, vol. abs/1610.09278, 2016.
m2cai16-tool dataset. This dataset was generated through a collaboration with the University Hospital of Strasbourg. It contains 15 laparoscopic videos of cholecystectomy procedures. To gain access to the dataset, please kindly fill the following form: m2cai16-tool request. To see the results of various methods, please visit the following web page: m2cai16-tool results. If you use this dataset, you are kindly requested to cite the work that led to the generation of the dataset:
- A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, 2017
xawAR16 Dataset
This is a multi-RGBD camera dataset, generated inside an operating room (IHU Strasbourg), which was designed to evaluate tracking/relocalization of a hand-held moving camera. Three RGBD cameras (Asus Xtion Pro Live) were used to record such a dataset. Two of them are rigidly mounted to the ceiling in a configuration allowing them to capture views from each side of the operating table. A third one is fixed to a display, which is held by a user who moves around the room. A reflective passive marker is attached to the moving camera and its ground-truth pose is obtained with a real-time optical 3D measurement system (infiniTrack system from Atracsys).
The dataset is composed of 16 sequences of time-synchronized color and depth images in full sensor resolution (640×480) recorded at 25 fps, along with the ground-truth poses of the moving camera measured by the tracking device at 30 Hz. Each sequence shows different scene configurations and camera motion, including occlusions, motion in the scene and abrupt viewpoint changes.
More information and instructions on how to gain access to this dataset can be found here.