999 research outputs found
Automatic Detection of Out-of-body Frames in Surgical Videos for Privacy Protection Using Self-supervised Learning and Minimal Labels
Endoscopic video recordings are widely used in minimally invasive
robot-assisted surgery, but when the endoscope is outside the patient's body,
it can capture irrelevant segments that may contain sensitive information. To
address this, we propose a framework that accurately detects out-of-body frames
in surgical videos by leveraging self-supervision with minimal data labels. We
use a massive amount of unlabeled endoscopic images to learn meaningful
representations in a self-supervised manner. Our approach, which involves
pre-training on an auxiliary task and fine-tuning with limited supervision,
outperforms previous methods for detecting out-of-body frames in surgical
videos captured from da Vinci X and Xi surgical systems. The average F1 scores
range from 96.00 to 98.02. Remarkably, using only 5% of the training labels,
our approach still maintains an average F1 score performance above 97,
outperforming fully-supervised methods with 95% fewer labels. These results
demonstrate the potential of our framework to facilitate the safe handling of
surgical video recordings and enhance data privacy protection in minimally
invasive surgery.Comment: A 15-page journal article submitted to Journal of Medical Robotics
Research (JMRR
Space- and Computationally-Efficient Set Reconciliation via Parity Bitmap Sketch (PBS)
Set reconciliation is a fundamental algorithmic problem that arises in many
networking, system, and database applications. In this problem, two large sets
A and B of objects (bitcoins, files, records, etc.) are stored respectively at
two different network-connected hosts, which we name Alice and Bob
respectively. Alice and Bob communicate with each other to learn ,
the difference between A and B, and as a result the reconciled set .
Current set reconciliation schemes are based on either Invertible Bloom
Filters (IBF) or Error-Correction Codes (ECC). The former has a low
computational complexity of O(d), where d is the cardinality of ,
but has a high communication overhead that is several times larger than the
theoretical minimum. The latter has a low communication overhead close to the
theoretical minimum, but has a much higher computational complexity of
. In this work, we propose Parity Bitmap Sketch (PBS), an ECC- based
set reconciliation scheme that gets the better of both worlds: PBS has both a
low computational complexity of O(d) just like IBF-based solutions and a low
communication overhead of roughly twice the theoretical minimum. A separate
contribution of this work is a novel rigorous analytical framework that can be
used for the precise calculation of various performance metrics and for the
near-optimal parameter tuning of PBS
Epitaxial Growth of Ge on Si by Magnetron Sputtering
Epitaxial growth of Ge on Si has received considerable attention for its compatibility with Si process flow and the scarcity of Ge compared with Si. Applications that drive the efforts for integrating Ge with Si include high mobility channel in metal-oxide-semiconductor field-effect transistors, infrared photodetector in Si-based optical devices, and template for III-V growth to fabricate high-efficiency solar cells. Epitaxy Ge on Si can be used as a virtual Ge substrate for fabrication of III-V solar cells, which has advantages of superior mechanical properties and low cost over Ge wafers. This work investigates the epitaxial growth of Ge on Si using magnetron sputtering, which is an environment-friendly, inexpensive, high throughput, and simple deposition technique. The effects of substrate temperature on the properties of Ge are analyzed. A novel method to epitaxially grow Ge on Si by magnetron sputtering at low temperature is developed using one-step aluminum-assisted crystallization. By applying an in-situ low temperature (50–150°C) heat treatment in between Al and Ge sputter depositions, the epitaxial growth of Ge on Si is achieved. This method significantly lowers the required temperature for and therefore the cost of epitaxial growth of Ge on Si
CalibRCNN:Calibrating Camera and LiDAR by recurrent convolutional neural network and geometric constraints
Investigating the integrate and fire model as the limit of a random discharge model: a stochastic analysis perspective
In the mean field integrate-and-fire model, the dynamics of a typical neuron
within a large network is modeled as a diffusion-jump stochastic process whose
jump takes place once the voltage reaches a threshold. In this work, the main
goal is to establish the convergence relationship between the regularized
process and the original one where in the regularized process, the jump
mechanism is replaced by a Poisson dynamic, and jump intensity within the
classically forbidden domain goes to infinity as the regularization parameter
vanishes. On the macroscopic level, the Fokker-Planck equation for the process
with random discharges (i.e. Poisson jumps) are defined on the whole space,
while the equation for the limit process is on the half space. However, with
the iteration scheme, the difficulty due to the domain differences has been
greatly mitigated and the convergence for the stochastic process and the firing
rates can be established. Moreover, we find a polynomial-order convergence for
the distribution by a re-normalization argument in probability theory. Finally,
by numerical experiments, we quantitatively explore the rate and the asymptotic
behavior of the convergence for both linear and nonlinear models
BeautifulPrompt: Towards Automatic Prompt Engineering for Text-to-Image Synthesis
Recently, diffusion-based deep generative models (e.g., Stable Diffusion)
have shown impressive results in text-to-image synthesis. However, current
text-to-image models often require multiple passes of prompt engineering by
humans in order to produce satisfactory results for real-world applications. We
propose BeautifulPrompt, a deep generative model to produce high-quality
prompts from very simple raw descriptions, which enables diffusion-based models
to generate more beautiful images. In our work, we first fine-tuned the
BeautifulPrompt model over low-quality and high-quality collecting prompt
pairs. Then, to ensure that our generated prompts can generate more beautiful
images, we further propose a Reinforcement Learning with Visual AI Feedback
technique to fine-tune our model to maximize the reward values of the generated
prompts, where the reward values are calculated based on the PickScore and the
Aesthetic Scores. Our results demonstrate that learning from visual AI feedback
promises the potential to improve the quality of generated prompts and images
significantly. We further showcase the integration of BeautifulPrompt to a
cloud-native AI platform to provide better text-to-image generation service in
the cloud.Comment: emnlp 202
Cell-Free XL-MIMO Meets Multi-Agent Reinforcement Learning: Architectures, Challenges, and Future Directions
Cell-free massive multiple-input multiple-output (mMIMO) and extremely
large-scale MIMO (XL-MIMO) are regarded as promising innovations for the
forthcoming generation of wireless communication systems. Their significant
advantages in augmenting the number of degrees of freedom have garnered
considerable interest. In this article, we first review the essential
opportunities and challenges induced by XL-MIMO systems. We then propose the
enhanced paradigm of cell-free XL-MIMO, which incorporates multi-agent
reinforcement learning (MARL) to provide a distributed strategy for tackling
the problem of high-dimension signal processing and costly energy consumption.
Based on the unique near-field characteristics, we propose two categories of
the low-complexity design, i.e., antenna selection and power control, to adapt
to different cell-free XL-MIMO scenarios and achieve the maximum data rate. For
inspiration, several critical future research directions pertaining to green
cell-free XL-MIMO systems are presented
- …