Privacy-preserving continual learning methods for medical image classification: a comparative analysis

BackgroundThe implementation of deep learning models for medical image classification poses significant challenges, including gradual performance degradation and limited adaptability to new diseases. However, frequent retraining of models is unfeasible and raises concerns about healthcare privacy due to the retention of prior patient data. To address these issues, this study investigated privacy-preserving continual learning methods as an alternative solution.MethodsWe evaluated twelve privacy-preserving non-storage continual learning algorithms based deep learning models for classifying retinal diseases from public optical coherence tomography (OCT) images, in a class-incremental learning scenario. The OCT dataset comprises 108,309 OCT images. Its classes include normal (47.21%), drusen (7.96%), choroidal neovascularization (CNV) (34.35%), and diabetic macular edema (DME) (10.48%). Each class consisted of 250 testing images. For continuous training, the first task involved CNV and normal classes, the second task focused on DME class, and the third task included drusen class. All selected algorithms were further experimented with different training sequence combinations. The final model's average class accuracy was measured. The performance of the joint model obtained through retraining and the original finetune model without continual learning algorithms were compared. Additionally, a publicly available medical dataset for colon cancer detection based on histology slides was selected as a proof of concept, while the CIFAR10 dataset was included as the continual learning benchmark.ResultsAmong the continual learning algorithms, Brain-inspired-replay (BIR) outperformed the others in the continual learning-based classification of retinal diseases from OCT images, achieving an accuracy of 62.00% (95% confidence interval: 59.36-64.64%), with consistent top performance observed in different training sequences. For colon cancer histology classification, Efficient Feature Transformations (EFT) attained the highest accuracy of 66.82% (95% confidence interval: 64.23-69.42%). In comparison, the joint model achieved accuracies of 90.76% and 89.28%, respectively. The finetune model demonstrated catastrophic forgetting in both datasets.ConclusionAlthough the joint retraining model exhibited superior performance, continual learning holds promise in mitigating catastrophic forgetting and facilitating continual model updates while preserving privacy in healthcare deep learning models. Thus, it presents a highly promising solution for the long-term clinical deployment of such models

Convolutional Neural Networks for Classification of T2DM Cognitive Impairment Based on Whole Brain Structural Features

PurposeCognitive impairment is generally found in individuals with type 2 diabetes mellitus (T2DM). Although they may not have visible symptoms of cognitive impairment in the early stages of the disorder, they are considered to be at high risk. Therefore, the classification of these patients is important for preventing the progression of cognitive impairment.MethodsIn this study, a convolutional neural network was used to construct a model for classifying 107 T2DM patients with and without cognitive impairment based on T1-weighted structural MRI. The Montreal cognitive assessment score served as an index of the cognitive status of the patients.ResultsThe classifier could identify T2DM-related cognitive decline with a classification accuracy of 84.85% and achieved an area under the curve of 92.65%.ConclusionsThe model can help clinicians analyze and predict cognitive impairment in patients and enable early treatment

Multifractal and entropy analysis of resting-state electroencephalography reveals spatial organization in local dynamic functional connectivity

Functional connectivity of the brain fluctuates even in resting-state condition. It has been reported recently that fluctuations of global functional network topology and those of individual connections between brain regions expressed multifractal scaling. To expand on these findings, in this study we investigated if multifractality was indeed an inherent property of dynamic functional connectivity (DFC) on the regional level as well. Furthermore, we explored if local DFC showed region-specific differences in its multifractal and entropy-related features. DFC analyses were performed on 62-channel, resting-state electroencephalography recordings of twelve young, healthy subjects. Surrogate data testing verified the true multifractal nature of regional DFC that could be attributed to the presumed nonlinear nature of the underlying processes. Moreover, we found a characteristic spatial distribution of local connectivity dynamics, in that frontal and occipital regions showed stronger long-range correlation and higher degree of multifractality, whereas the highest values of entropy were found over the central and temporal regions. The revealed topology reflected well the underlying resting-state network organization of the brain. The presented results and the proposed analysis framework could improve our understanding on how resting-state brain activity is spatio-temporally organized and may provide potential biomarkers for future clinical research

Day-Ahead Market Modeling for Strategic Wind Power Producers under Robust Market Clearing

In this paper, considering real time wind power uncertainties, the strategic behaviors of wind power producers adopting two different bidding modes in day-ahead electricity market is modeled and experimentally compared. These two different bidding modes only provide a wind power output plan and a bidding curve consisting of bidding price and power output, respectively. On the one hand, to significantly improve wind power accommodation, a robust market clearing model is employed for day-ahead market clearing implemented by an independent system operator. On the other hand, since the Least Squares Continuous Actor-Critic algorithm is demonstrated as an effective method in dealing with Markov decision-making problems with continuous state and action sets, we propose the Least Squares Continuous Actor-Critic-based approaches to model and simulate the dynamic bidding interaction processes of many wind power producers adopting two different bidding modes in the day-head electricity market under robust market clearing conditions, respectively. Simulations are implemented on the IEEE 30-bus test system with five strategic wind power producers, which verify the rationality of our proposed approaches. Moreover, the quantitative analysis and comparisons conducted in our simulations put forward some suggestions about leading wind power producers to reasonably bid in market and bidding mode selections

Application of Gradient Descent Continuous Actor-Critic Algorithm for Bilateral Spot Electricity Market Modeling Considering Renewable Power Penetration

The bilateral spot electricity market is very complicated because all generation units and demands must strategically bid in this market. Considering renewable resource penetration, the high variability and the non-dispatchable nature of these intermittent resources make it more difficult to model and simulate the dynamic bidding process and the equilibrium in the bilateral spot electricity market, which makes developing fast and reliable market modeling approaches a matter of urgency nowadays. In this paper, a Gradient Descent Continuous Actor-Critic algorithm is proposed for hour-ahead bilateral electricity market modeling in the presence of renewable resources because this algorithm can solve electricity market modeling problems with continuous state and action spaces without causing the “curse of dimensionality” and has low time complexity. In our simulation, the proposed approach is implemented on an IEEE 30-bus test system. The adequate performance of our proposed approach—such as reaching Nash Equilibrium results after enough iterations of training are tested and verified, and some conclusions about the relationship between increasing the renewable power output and participants’ bidding strategy, locational marginal prices, and social welfare—is also evaluated. Moreover, the comparison of our proposed approach with the fuzzy Q-learning-based electricity market approach implemented in this paper confirms the superiority of our proposed approach in terms of participants’ profits, social welfare, average locational marginal prices, etc

PEMDs in the OTC laser fields

This video shows a sequence of PEMDs in the OTC laser fields for varying relative phases

A Green and Efficient Method for the Preconcentration and Determination of Gallic Acid, Bergenin, Quercitrin, and Embelin from Ardisia japonica

A simple cloud point preconcentration method was developed and validated for the determination of gallic acid, bergenin, quercitrin, and embelin in Ardisia japonica by high-performance liquid chromatography (HPLC) using ultrasonic assisted micellar extraction. Nonionic surfactant Genapol X-080 was selected as the extraction solvent. The effects of various experimental conditions such as the type and concentration of surfactant and salt, temperature, and solution pH on the extraction of these components were studied to optimize the conditions of Ardisia japonica. The solution was incubated in a thermostatic water bath at 60°C for 10 min, and 35% NaH2PO4 (w/v) was added to the solution to promote the phase separation and increase the preconcentration factor. The intraday and interday precision (RSD) were both below 5.0% and the limits of detection (LOD) for the analytes were between 10 and 20 ng·mL−1. The proposed method provides a simple, efficient, and organic solvent-free method to analyze gallic acid, bergenin, quercitrin, and embelin for the quality control of Ardisia japonica