Rules
Please contact us when unsure about compliance with the rules stated below.
Data usage
Participants agree that the data provided to them shall be used solely for the purpose of participating in the open CLUST15 challenge (CLUST15 dataset) and shall not be used, disclosed or distributed to any other person under any circumstance.
The tracking performance will be evaluated by the organizers after submission of the tracking results.
Only this evaluation provides the official CLUST tracking performance and shall be reported in any publication to allow comparison. Reviewers shall not accepted any publications outside the CLUST challenge. We comment on such publications on our Publications web-page.
When publishing the results based on the challenge data, participants shall cite the challenge and the references listed at the bottom of this page.
Method's parameters
To avoid unrealistic adjustment of the method's parameters per sequence, parameters should either be automatically determined or should be fixed for at least all sequences per ultrasound scanner type and task.
It should be clear from the description of the method that this rule was followed by either specifying the automatic procedure or by stating the values of the fixed parameters.
Submission
Participants shall submit results and a description of the method, following the instructions listed in Submission.
The description will serve the organizers to identify and discriminate between methods, and to verify that the rules regarding method's parameters were fulfilled.
The description will only be released as informal submission (see below) after explicit request from the participant.
The tracking performance for the CLUST test data will be evaluated by the organizers after submission of the tracking results.
Method training and optimization (including any ablation study) has to be done before submission using the provided CLUST training data.
Only one submission of tracking results for the CLUST test data is permitted per proposed method to avoid any optimization on the CLUST test data.
By submitting their results, participants agree that these will be included on the online leaderboard webpage.
There are three result categories:
- Anonymous informal submission without releasing the provided description, to support anonymous manuscript submission for at most 12 months
- Non-anonymous informal submission with releasing the provided description, to support method descriptions not intended for publication
- Official submission, linked to an already published method or to an informal submission, being now accepted for publication
Anonymous submissions, which have not progressed to the other two categories within 12 months after submission, will be removed from the leaderboard.
Results should only be compared to official submissions.
Participants shall notify the challenge organizers about any publication which is (partly) based on CLUST data.
CLUST 2014 and 2015 References
De Luca, V., Banerjee, J., Hallack, A., Kondo, S., Makhinya, M., Nouri, D., Royer, L., Cifor, A., Dardenne, G., Goksel, O., Gooding, M.J., Klink, C., Krupa, A., Le Bras, A., Marchal, M., Moelker, A., Niessen, W.J., Papiez, B.W., Rothberg, A., Schnabel, J., van Walsum, T., Harris, E., Lediju Bell, M.A., Tanner, C.:
Evaluation of 2D and 3D ultrasound tracking algorithms and impact on ultrasound‐guided liver radiotherapy margins. Medical Physics, (2018)
De Luca, V., Benz, T., Kondo, S., König, L., Lübke, D., Rothlübbers, S., Somphone, O., Allaire, S., Lediju Bell, M.A., Chung, D.Y.F., Cifor, A., Grozea, C., Günther, M., Jenne, J., Kipshagen, T., Kowarschik, M., Navab, N., Rühaak, J., Schwaab, J., Tanner, C.:
The 2014 liver ultrasound tracking benchmark. Physics in Medicine and Biology 60(14), 5571 (2015)
Ultrasound Data References
De Luca, V., Tschannen, M., Szekely, G., Tanner, C.: A Learning-Based Approach for Fast and Robust Vessel Tracking in Long Ultrasound Sequences.
In: Medical Image Computing and Computer-Assisted Intervention - MICCAI 2013, Lecture Notes in Computer Science, vol. 8149, pp. 518–525 (2013)
Preiswerk, F., De Luca, V., Arnold, P., Celicanin, Z., Petrusca, L., Tanner, C., Bieri, O., Salomir, R., Cattin, P. C.: Model-guided respiratory organ motion prediction of the liver from 2D ultrasound.
Medical Image Analysis 18(5), 740-751 (2014)
Lediju, M.A., Byram, B.C., Harris, E.J., Evans, P.M, Bamber, J.C.: 3D
Liver tracking using a matrix array: Implications for ultrasonic guidance of
IMRT. In: IEEE Ultrasonics Symposium - IUS 2010. pp. 1628–1631 (Oct
2010)
Lediju Bell, M.A., Byram, B.C., Harris, E.J., Evans, P.M., Bamber, J.C.:
In vivo liver tracking with a high volume rate 4D ultrasound scanner and a
2D matrix array probe. Physics in Medicine and Biology 57(5), 1359 (2012)
Vijayan, S., Klein, S., Hofstad, E., Lindseth, F., Ystgaard, B., Lango, T.:
Validation of a non-rigid registration method for motion compensation in 4D
ultrasound of the liver. In: IEEE 10th International Symposium on Biomedical Imaging - ISBI 2013. pp. 792–795 (April 2013)
Banerjee, J., Klink, C., Peters, E.D., Niessen, W.J., Moelker, A., van Walsum, T.: 4D Liver Ultrasound Registration. In: Biomedical Image Registration, Lecture Notes in Computer Science, vol. 8545, pp 194-202 (2014).
