5 research outputs found
Federated Cross Learning for Medical Image Segmentation
Federated learning (FL) can collaboratively train deep learning models using
isolated patient data owned by different hospitals for various clinical
applications, including medical image segmentation. However, a major problem of
FL is its performance degradation when dealing with the data that are not
independently and identically distributed (non-iid), which is often the case in
medical images. In this paper, we first conduct a theoretical analysis on the
FL algorithm to reveal the problem of model aggregation during training on
non-iid data. With the insights gained through the analysis, we propose a
simple and yet effective method, federated cross learning (FedCross), to tackle
this challenging problem. Unlike the conventional FL methods that combine
multiple individually trained local models on a server node, our FedCross
sequentially trains the global model across different clients in a round-robin
manner, and thus the entire training procedure does not involve any model
aggregation steps. To further improve its performance to be comparable with the
centralized learning method, we combine the FedCross with an ensemble learning
mechanism to compose a federated cross ensemble learning (FedCrossEns) method.
Finally, we conduct extensive experiments using a set of public datasets. The
experimental results show that the proposed FedCross training strategy
outperforms the mainstream FL methods on non-iid data. In addition to improving
the segmentation performance, our FedCrossEns can further provide a
quantitative estimation of the model uncertainty, demonstrating the
effectiveness and clinical significance of our designs. Source code will be
made publicly available after paper publication.Comment: 10 pages, 4 figure
Soft-tissue Driven Craniomaxillofacial Surgical Planning
In CMF surgery, the planning of bony movement to achieve a desired facial
outcome is a challenging task. Current bone driven approaches focus on
normalizing the bone with the expectation that the facial appearance will be
corrected accordingly. However, due to the complex non-linear relationship
between bony structure and facial soft-tissue, such bone-driven methods are
insufficient to correct facial deformities. Despite efforts to simulate facial
changes resulting from bony movement, surgical planning still relies on
iterative revisions and educated guesses. To address these issues, we propose a
soft-tissue driven framework that can automatically create and verify surgical
plans. Our framework consists of a bony planner network that estimates the bony
movements required to achieve the desired facial outcome and a facial simulator
network that can simulate the possible facial changes resulting from the
estimated bony movement plans. By combining these two models, we can verify and
determine the final bony movement required for planning. The proposed framework
was evaluated using a clinical dataset, and our experimental results
demonstrate that the soft-tissue driven approach greatly improves the accuracy
and efficacy of surgical planning when compared to the conventional bone-driven
approach.Comment: Early accepted by MICCAI 202
Federated Multi-organ Segmentation with Partially Labeled Data
Federated learning is an emerging paradigm allowing large-scale decentralized
learning without sharing data across different data owners, which helps address
the concern of data privacy in medical image analysis. However, the requirement
for label consistency across clients by the existing methods largely narrows
its application scope. In practice, each clinical site may only annotate
certain organs of interest with partial or no overlap with other sites.
Incorporating such partially labeled data into a unified federation is an
unexplored problem with clinical significance and urgency. This work tackles
the challenge by using a novel federated multi-encoding U-Net (Fed-MENU) method
for multi-organ segmentation. In our method, a multi-encoding U-Net (MENU-Net)
is proposed to extract organ-specific features through different encoding
sub-networks. Each sub-network can be seen as an expert of a specific organ and
trained for that client. Moreover, to encourage the organ-specific features
extracted by different sub-networks to be informative and distinctive, we
regularize the training of the MENU-Net by designing an auxiliary generic
decoder (AGD). Extensive experiments on four public datasets show that our
Fed-MENU method can effectively obtain a federated learning model using the
partially labeled datasets with superior performance to other models trained by
either localized or centralized learning methods. Source code will be made
publicly available at the time of paper publication.Comment: 10 pages, 5 figure
OpenKBP-Opt: an international and reproducible evaluation of 76 knowledge-based planning pipelines
Objective: To establish an open framework for developing plan optimization models for knowledge-based planning (KBP).
Approach: Our framework includes radiotherapy treatment data (i.e. reference plans) for 100 patients with head-and-neck cancer who were treated with intensity-modulated radiotherapy. That data also includes high-quality dose predictions from 19 KBP models that were developed by different research groups using out-of-sample data during the OpenKBP Grand Challenge. The dose predictions were input to four fluence-based dose mimicking models to form 76 unique KBP pipelines that generated 7600 plans (76 pipelines Ă— 100 patients). The predictions and KBP-generated plans were compared to the reference plans via: the dose score, which is the average mean absolute voxel-by-voxel difference in dose; the deviation in dose-volume histogram (DVH) points; and the frequency of clinical planning criteria satisfaction. We also performed a theoretical investigation to justify our dose mimicking models.
Main results: The range in rank order correlation of the dose score between predictions and their KBP pipelines was 0.50-0.62, which indicates that the quality of the predictions was generally positively correlated with the quality of the plans. Additionally, compared to the input predictions, the KBP-generated plans performed significantly better (P\u3c 0.05; one-sided Wilcoxon test) on 18 of 23 DVH points. Similarly, each optimization model generated plans that satisfied a higher percentage of criteria than the reference plans, which satisfied 3.5% more criteria than the set of all dose predictions. Lastly, our theoretical investigation demonstrated that the dose mimicking models generated plans that are also optimal for an inverse planning model.
Significance: This was the largest international effort to date for evaluating the combination of KBP prediction and optimization models. We found that the best performing models significantly outperformed the reference dose and dose predictions. In the interest of reproducibility, our data and code is freely available