Safeguarding Data in Multimodal AI: A Differentially Private Approach to CLIP Training

The surge in multimodal AI's success has sparked concerns over data privacy in vision-and-language tasks. While CLIP has revolutionized multimodal learning through joint training on images and text, its potential to unintentionally disclose sensitive information necessitates the integration of privacy-preserving mechanisms. We introduce a differentially private adaptation of the Contrastive Language-Image Pretraining (CLIP) model that effectively addresses privacy concerns while retaining accuracy. Our proposed method, Dp-CLIP, is rigorously evaluated on benchmark datasets encompassing diverse vision-and-language tasks such as image classification and visual question answering. We demonstrate that our approach retains performance on par with the standard non-private CLIP model. Furthermore, we analyze our proposed algorithm under linear representation settings. We derive the convergence rate of our algorithm and show a trade-off between utility and privacy when gradients are clipped per-batch and the loss function does not satisfy smoothness conditions assumed in the literature for the analysis of DP-SGD

Differentiated Service Entanglement Routing for Quantum Networks

The entanglement distribution networks with various topologies are mainly implemented by active wavelength multiplexing routing strategies. However, designing an entanglement routing scheme, which achieves the maximized network connections and the optimal overall network efficiency simultaneously, remains a huge challenge for quantum networks. In this article, we propose a differentiated service entanglement routing (DSER) scheme, which firstly finds out the lowest loss paths and supported wavelength channels with the tensor-based path searching algorithm, and then allocates the paired channels with the differentiated routing strategies. The evaluation results show that the proposed DSER scheme can be performed for constructing various large scale quantum networks.Comment: 25 pages, 14 figure

Environmental contamination characteristics of heavy metals from abandoned lead–zinc mine tailings in China

China holds large-scale lead–zinc mineral resources; however, mining activities often cause severe contamination by heavy metals. This study systemically assessed contamination by eight heavy metals (Cu, Zn, Cd, Pb, Cr, Hg, Ni, and As) in mine tailings, soil, and groundwater from 27 contaminated sites across China. Regarding mine tailings, 1% of the mine tailing samples were hazardous waste and 20% were class II non-hazardous waste. Regarding soil, Zn and Pb showed the highest mean concentrations, at 5574.67 mg/kg and 2034.88 mg/kg, respectively. The indexes of geo-accumulation (Igeo) of eight heavy metals ranged from −3.62 to 7.67, while Zn, Pb, and Cd showed the highest environmental risk levels as the priority pollutants. The contamination levels of these heavy metals in groundwater were generally in the order of Zn>As>Pb>Ni>Cd>Cu>Hg>Cr. In this study, 20% of the soil and 10% of the groundwater samples exceeded the corresponding quality limits. The content of heavy metals in soil, groundwater, and mine tailing were positively correlated, demonstrating the main pollution source and transport paths. The pollution levels of heavy metals in soil and groundwater were listed in the foremost and moderate positions compared with similar sites from other countries, respectively. These results may help determine the pollution levels of lead–zinc mining regions and direct the remediation activities of target sites to support the environmental management of abandoned mining and tailing waste in China

GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation

We present MM-Navigator, a GPT-4V-based agent for the smartphone graphical user interface (GUI) navigation task. MM-Navigator can interact with a smartphone screen as human users, and determine subsequent actions to fulfill given instructions. Our findings demonstrate that large multimodal models (LMMs), specifically GPT-4V, excel in zero-shot GUI navigation through its advanced screen interpretation, action reasoning, and precise action localization capabilities. We first benchmark MM-Navigator on our collected iOS screen dataset. According to human assessments, the system exhibited a 91\% accuracy rate in generating reasonable action descriptions and a 75\% accuracy rate in executing the correct actions for single-step instructions on iOS. Additionally, we evaluate the model on a subset of an Android screen navigation dataset, where the model outperforms previous GUI navigators in a zero-shot fashion. Our benchmark and detailed analyses aim to lay a robust groundwork for future research into the GUI navigation task. The project page is at https://github.com/zzxslp/MM-Navigator.Comment: Work in progres

Effects of fermentation medium on cigar filler

The addition of medium during industrial fermentation can improve the quality of cigar tobacco leaves after agricultural fermentation. In this study, the cigar filler tobacco “Brazilian Frogstrips YA14” was used as the test material to determine the contents of main chemical components in cigar tobacco leaves after fermentations with the additions of water (control group) and a medium (test group), and the changes in the community structure and abundances of bacteria on tobacco leaves during the fermentation process were analyzed. The results of the study were as follows: 1) During the fermentation process, the protein content of tobacco leaves fluctuated slightly, basically stabilized at 19%–20%. 2) Under the impact of the medium, the total content of main amino acids in tobacco leaves showed a downward trend, and the difference of which between the control group and the test group was the most obvious on the fourth day of fermentation. 3) The change trend of the content of petroleum ether extract in cigar leaves for the control group was not obvious, and the content of petroleum ether extract in the tobacco leaves for the test group decreased by 12.4% under the impact of the medium. 4) After fermentation, the relative content of saturated fatty acids for the control group and the test group all increased, while the relative content of unsaturated fatty acids all decreased. 5) After the addition of the medium, the diversity of bacteria on tobacco leaves changed significantly, the number of OTUs in tobacco leaves increased, and the bacterial community structure changed. This research indicates that after adding the medium to ferment cigar filler, the changes of bacterial community and dominant bacterial group on cigar tobacco leaves have impacts on the contents of chemical components in tobacco leaves, and the fermentation with the addition of medium has a positive effect on improving the quality of tobacco leaves

Improvement of current crowding effect in VCSEL arrays with non-uniform oxidation aperture design

A compact electro-opto-thermal model of 2-D vertical cavity surface emitting laser (VCSEL) arrays considering the current crowding effect in each array cell is established to study the impact of oxidation aperture on the device performance. Simulated results shows that increasing oxidation aperture of array cell is helpful to improve the uniformity of current density distribution. With careful design of non-uniform oxidation aperture layout, both the uniformity of the temperature distribution and the current distribution is improved by 36.52% and 42.08%, respectively. Furthermore, 3×3 VCSEL arrays with uniform oxidation aperture (array-1) and non-uniform oxidation aperture (array-2) are fabricated and the L-I-V curves of two types of VCSEL arrays at different biases are also measured. The peak output optical power of array-2 is enhanced to 1.83mW with an improvement of 8.91% when compared with that of array-1. Moreover, the total optical output power of array-2 is always superior to that of array-1 over a wide bias current range

Functional Connectivity Density, Local Brain Spontaneous Activity, and Their Coupling Strengths in Patients With Borderline Personality Disorder

In this study, combining degree centrality (DC) and fractional amplitude of low frequency fluctuation (fALFF) analyses of resting state (rs)-functional magnetic resonance imaging (fMRI) data, we aimed to explore functional connectivity density, local brain spontaneous activity, and their coupling strengths in borderline personality disorder (BPD). Forty-three BPD patients and 39 demographically-matched controls underwent rs-fMRI after completing a series of psychological tests. Two-sample t-tests were performed to compare DC and fALFF between these two groups. Across-voxel correlation analysis was conducted to assess DC-fALFF coupling strengths in each group. Imaging parameters and psychological variables were correlated by Pearson correlation analysis in the BPD group. Altered DC and fALFF values in the BPD group, compared with the control group, were distributed mainly in default mode network (DMN), and DC-fALFF coupling strengths were decreased in the left middle temporal gyrus (MTG) and right precuneus in the BPD group. Additionally, insecure attachment scores correlated positively with left precuneus DC and negatively with fALFF of the right posterior cingulate cortex (PCC) in the BPD group. These altered DC and fALFF findings indicate that the BPD patients had disturbed functional connectivity density and local spontaneous activity in the DMN compared with control subjects. Their decreased connectivity-amplitude coupling suggests that the left MTG and right precuneus may be functional impairment hubs in BPD. Disturbed rs function in the left precuneus and right PCC might underlie insecure attachment in BPD

Improvement of thermally induced current bifurcation in VCSEL arrays with non-uniform series resistance design

Non-uniform series resistance design of VCSEL arrays is studied to improve thermally induced current bifurcation based on an electro-opto-thermal model of VCSEL arrays. Taking an 850nm VCSEL array with 4×4 cells for example, the impact of series resistance on current bifurcation is investigated. Increasmg series resistance is helpful to enhance the critical current values of current bifurcation point (Irc) and hence delay the current bifurcation phenomenon. For VCSEL array with non-uniform series resistance, Irc is increased by 28.6% and the total output optical power is enhanced by 14.3% when compared with that of VCSEL array with uniform series resistance. Therefore, non-uniform series resistance design is a better method for delaying the current bifurcation phenomenon and enhancuig the output optical power of VCSEL arrays