Improving Observed Decisions Quality using Inverse Optimization: A Radiation Therapy Treatment Planning Application

Farzin Ahmadi,Todd R. McNutt,Kimia Ghobadi

2024-07-20

Abstract:In many applied optimization settings, parameters that define the constraints may not guarantee the best possible solution, and superior solutions might exist that are infeasible for the given parameter values. Removing such constraints, re-optimizing, and evaluating the new solution may be insufficient, as the optimizer's preferences in selecting the existing solutions might be lost. To address this issue, we present an inverse optimization-based model that takes an observed solution as input and aims to improve upon it by projecting onto desired hyperplanes or expanding the feasible set while balancing the distance to the observed decision to preserve the optimizer's preferences. We demonstrate the applicability of the model in the context of radiation therapy treatment planning, an essential component of cancer treatment. Radiation therapy treatment planning is typically guided by expert-driven guidelines that define the optimization problem but remain mostly general. Our model provides an automated framework that learns new plans from available plans based on given clinical criteria, optimizing the desired effect without compromising the remaining constraints. The proposed approach is applied to a cohort of four prostate cancer patients, and the results demonstrate improvements in dose-volume histograms while maintaining comparable target coverage to clinically acceptable plans. By optimizing the parameters of the treatment planning problem and exploring the Pareto frontier, our methodology uncovers previously unattainable solutions that enhance organ-at-risk sparing without sacrificing target coverage. The framework's ability to handle multiple organs-at-risk and various dose-volume constraints highlights its flexibility and potential for application to diverse radiation therapy treatment planning scenarios.

Optimization and Control

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to improve the quality of observed decisions through inverse optimization methods in radiotherapy planning. Specifically, the paper focuses on the fact that under given parameter values, existing solutions may not be optimal, and there may even be better but infeasible solutions. Therefore, the paper proposes an inverse - optimization - based model. This model takes the observed solutions as input and improves these solutions by projecting onto the desired hyperplane or expanding the feasible set while maintaining the distance from the observed decisions to preserve the optimizer's preferences.

### Background and Problem Description of the Paper

1. **Challenges in Radiotherapy**
- Radiotherapy is a widely used method in cancer treatment. Approximately 50% of cancer patients receive radiotherapy, and 30% of cancer survivors have undergone this treatment.
- However, optimizing radiotherapy plans is a major challenge because it is necessary to apply high - dose radiation to the target structure while minimizing the exposure of healthy tissues to prevent potential normal tissue damage and reduce long - term side effects.

2. **Limitations of Clinical Goals**
- Current radiotherapy plans are usually defined by expert - driven guidelines, which are more general and lack personalization.
- Plan improvements usually rely on multiple manual adjustments by experts, which are not only time - consuming but also result in large differences in plan quality among different experts.

3. **Deficiencies of Existing Methods**
- Simply removing certain constraint conditions, re - optimizing, and evaluating new schemes may not be sufficient to preserve the optimizer's preference for choosing the existing solution.
- Currently, data - driven models mainly focus on recovering or generating personalized goals from existing data, and there is less research on automatically improving existing plans.

### Main Contributions of the Paper

1. **Inverse Optimization Model**
- Developed an inverse - optimization - based model that can learn from observed plans and generate new, improved radiotherapy plans while preserving the optimizer's preferences.
- This model improves existing plans by projecting onto the desired hyperplane or expanding the feasible set while balancing the distance from the observed decisions.

2. **Application Examples**
- Verified the effectiveness of this model in prostate cancer radiotherapy planning. The results show an improvement in the dose - volume histogram while maintaining a target coverage comparable to clinically acceptable plans.

3. **Exploration of Multi - objective Optimization**
- Explored the impact of this method on the Pareto frontier of the treatment plan optimization problem with multi - objective representation, showing the change in the Pareto frontier after improving a single dose limit.
- By optimizing the parameters of the treatment plan problem, explored previously unachievable solutions, improving the protection effect of organs at risk without sacrificing target coverage.

### Method Overview

1. **Basic Form of Inverse Optimization**
- Defined a general - form optimization problem \( \text{FO}(u, \theta)=\{ \max_x f(x, u, \theta)\mid x\in\Omega(u, \theta)\} \), where \( x \) is the decision variable, \( f \) is the objective function, and \( \Omega(u, \theta) \) is the feasible set.
- Inverse optimization aims to recover the unknown parameter \( u \) when the solution of the problem is observed.

2. **Explicit Formula for Linear Optimization**
- For the linear optimization problem \( \text{FO}(c, A, b)=\{ \max_x c^T x\mid Ax\leq b, x\in\mathbb{R}^n\} \), proposed an explicit inverse optimization model \( \text{IL}(X_0, A, b) \).
- This model finds an optimal solution \( x \) by minimizing the loss function \( D(x, X_0) \) such that \( x \) is feasible and optimal under the recovered parameter \( c \).

3. **Improving Observed Decisions**
- Proposed an improved inverse optimization model \( \text{IL}_g \) that not only recovers the cost vector \( c \) but also improves some of the constraints.