Publication
Title
A geometry and dose-volume based performance monitoring of artificial intelligence models in radiotherapy treatment planning for prostate cancer
Author
Abstract
Background and Purpose: Clinical Artificial Intelligence (AI) implementations lack ground-truth when applied on real-world data. This study investigated how combined geometrical and dose-volume metrics can be used as performance monitoring tools to detect clinically relevant candidates for model retraining.Materials and Methods: Fifty patients were analyzed for both AI-segmentation and planning. For AI-segmentation, geometrical (Standard Surface Dice 3 mm and Local Surface Dice 3 mm) and dose-volume based parameters were calculated for two organs (bladder and anorectum) to compare AI output against the clinically corrected structure. A Local Surface Dice was introduced to detect geometrical changes in the vicinity of the target volumes, while an Absolute Dose Difference (ADD) evaluation increased focus on dose-volume related changes. AI -planning performance was evaluated using clinical goal analysis in combination with volume and target overlap metrics.Results: The Local Surface Dice reported equal or lower values compared to the Standard Surface Dice (anorectum: (0.93 +/- 0.11) vs (0.98 +/- 0.04); bladder: (0.97 +/- 0.06) vs (0.98 +/- 0.04)). The ADD metric showed a difference of (0.9 +/- 0.8)Gy for the anorectum D1cm3. The bladder D5cm3 reported a difference of (0.7 +/- 1.5)Gy. Mandatory clinical goals were fulfilled in 90 % of the DLP plans.Conclusions: Combining dose-volume and geometrical metrics allowed detection of clinically relevant changes, applied to both auto-segmentation and auto-planning output and the Local Surface Dice was more sensitive to local changes compared to the Standard Surface Dice. This monitoring is able to evaluate AI behavior in clinical practice and allows candidate selection for active learning.
Language
English
Source (journal)
Physics and Imaging in Radiation Oncology / European Society of Radiotherapy & Oncology
Publication
Elsevier , 2023
ISSN
2405-6316
DOI
10.1016/J.PHRO.2023.100494
Volume/pages
28 (2023) , p. 1-7
Article Reference
100494
ISI
001086910000001
Pubmed ID
37809056
Full text (Publisher's DOI)
Full text (open access)
UAntwerpen
Faculty/Department
Research group
Publication type
Subject
Affiliation
Publications with a UAntwerp address
External links
Web of Science
Record
Identifier
Creation 04.12.2023
Last edited 08.12.2023
To cite this reference