Dose-volume-based IMRT fluence optimization: A fast least-squares approach with differentiability

AbstractIn intensity-modulated radiation therapy (IMRT) for cancer treatment, the most commonly used metric for treatment prescriptions and evaluations is the so-called dose-volume constraint (DVC). These DVCs induce much needed flexibility but also non-convexity into the fluence optimization problem, which is an important step in the IMRT treatment planning. Currently, the models of choice for fluence optimization in clinical practice are weighted least-squares models. When DVCs are directly incorporated into the objective functions of least-squares models, these objective functions become not only non-convex but also non-differentiable. This non-differentiability is a problem when software packages designed for minimizing smooth functions are routinely applied to these non-smooth models in commercial IMRT planning systems. In this paper, we formulate and study a new least-squares model that allows a monotone and differentiable objective function. We devise a greedy approach for approximately solving the resulting optimization problem. We report numerical results on several clinical cases showing that, compared to a widely used existing model, the new approach is capable of generating clinically relevant plans at a much faster speed. This improvement can be more than one-order of magnitude for some large-scale problems

Parallel Implementation of a Recursive Least Squares Neural Network Training Method on the Intel IPSC/2

An algorithm based on the Marquardt-Levenberg least-square optimization method has been shown by S. Kollias and D. Anastassiou (IEEE Trans. on Circuits Syst. vol.36, no.8, p.1092-101, Aug. 1989) to be a much more efficient training method than gradient descent, when applied to some small feedforward neural networks. Yet, for many applications, the increase in computational complexity of the method outweighs any gain in learning rate obtained over current training methods. However, the least-squares method can be more efficiently implemented on parallel architectures than standard methods. This is demonstrated by comparing computation times and learning rates for the least-squares method implemented on 1, 2, 4, 8, and 16 processors on an Intel iPSC/2 multicomputer. Two applications which demonstrate the faster real-time learning rate of the last-squares method over than of gradient descent are give

Fast Nonlinear Least Squares Optimization of Large-Scale Semi-Sparse Problems

Many problems in computer graphics and vision can be formulated as a nonlinear least squares optimization problem, for which numerous off-the-shelf solvers are readily available. Depending on the structure of the problem, however, existing solvers may be more or less suitable, and in some cases the solution comes at the cost of lengthy convergence times. One such case is semi-sparse optimization problems, emerging for example in localized facial performance reconstruction, where the nonlinear least squares problem can be composed of hundreds of thousands of cost functions, each one involving many of the optimization parameters. While such problems can be solved with existing solvers, the computation time can severely hinder the applicability of these methods. We introduce a novel iterative solver for nonlinear least squares optimization of large-scale semi-sparse problems. We use the nonlinear Levenberg-Marquardt method to locally linearize the problem in parallel, based on its firstorder approximation. Then, we decompose the linear problem in small blocks, using the local Schur complement, leading to a more compact linear system without loss of information. The resulting system is dense but its size is small enough to be solved using a parallel direct method in a short amount of time. The main benefit we get by using such an approach is that the overall optimization process is entirely parallel and scalable, making it suitable to be mapped onto graphics hardware (GPU). By using our minimizer, results are obtained up to one order of magnitude faster than other existing solvers, without sacrificing the generality and the accuracy of the model. We provide a detailed analysis of our approach and validate our results with the application of performance-based facial capture using a recently-proposed anatomical local face deformation model