LISA: Localized Image Stylization with Audio via Implicit Neural Representation

We present a novel framework, Localized Image Stylization with Audio (LISA) which performs audio-driven localized image stylization. Sound often provides information about the specific context of the scene and is closely related to a certain part of the scene or object. However, existing image stylization works have focused on stylizing the entire image using an image or text input. Stylizing a particular part of the image based on audio input is natural but challenging. In this work, we propose a framework that a user provides an audio input to localize the sound source in the input image and another for locally stylizing the target object or scene. LISA first produces a delicate localization map with an audio-visual localization network by leveraging CLIP embedding space. We then utilize implicit neural representation (INR) along with the predicted localization map to stylize the target object or scene based on sound information. The proposed INR can manipulate the localized pixel values to be semantically consistent with the provided audio input. Through a series of experiments, we show that the proposed framework outperforms the other audio-guided stylization methods. Moreover, LISA constructs concise localization maps and naturally manipulates the target object or scene in accordance with the given audio input

Sound-Guided Semantic Video Generation

The recent success in StyleGAN demonstrates that pre-trained StyleGAN latent space is useful for realistic video generation. However, the generated motion in the video is usually not semantically meaningful due to the difficulty of determining the direction and magnitude in the StyleGAN latent space. In this paper, we propose a framework to generate realistic videos by leveraging multimodal (sound-image-text) embedding space. As sound provides the temporal contexts of the scene, our framework learns to generate a video that is semantically consistent with sound. First, our sound inversion module maps the audio directly into the StyleGAN latent space. We then incorporate the CLIP-based multimodal embedding space to further provide the audio-visual relationships. Finally, the proposed frame generator learns to find the trajectory in the latent space which is coherent with the corresponding sound and generates a video in a hierarchical manner. We provide the new high-resolution landscape video dataset (audio-visual pair) for the sound-guided video generation task. The experiments show that our model outperforms the state-of-the-art methods in terms of video quality. We further show several applications including image and video editing to verify the effectiveness of our method

Direct and sustained intracellular delivery of exogenous molecules using acoustic-transfection with high frequency ultrasound

Controlling cell functions for research and therapeutic purposes may open new strategies for the treatment of many diseases. An efficient and safe introduction of membrane impermeable molecules into target cells will provide versatile means to modulate cell fate. We introduce a new transfection technique that utilizes high frequency ultrasound without any contrast agents such as microbubbles, bringing a single-cell level targeting and size-dependent intracellular delivery of macromolecules. The transfection apparatus consists of an ultrasonic transducer with the center frequency of over 150 MHz and an epi-fluorescence microscope, entitled acoustic-transfection system. Acoustic pulses, emitted from an ultrasonic transducer, perturb the lipid bilayer of the cell membrane of a targeted single-cell to induce intracellular delivery of exogenous molecules. Simultaneous live cell imaging using HeLa cells to investigate the intracellular concentration of Ca2+ and propidium iodide (PI) and the delivery of 3 kDa dextran labeled with Alexa 488 were demonstrated. Cytosolic delivery of 3 kDa dextran induced via acoustic-transfection was manifested by diffused fluorescence throughout whole cells. Short-term (6 hr) cell viability test and long-term (40 hr) cell tracking confirmed that the proposed approach has low cell cytotoxicity.1

Estimation of the mechanical properties of soft tissues using a laser-induced microbubble interrogated by acoustic radiation force

textThis dissertation introduces a new approach to measure the mechanical properties of soft tissues. A laser-induced microbubble, created by focusing a single nanosecond laser pulse with a custom-made objective lens, was created at desired locations inside a tissue sample. An acoustic radiation force was generated by a low frequency transducer to displace the microbubble. A custom-built high pulse repetition frequency (PRF) ultrasound system, consisting of two 25 MHz single element transducers, was used to track the dynamics of the microbubble. Reconstruction of the mechanical properties at the specific location in a tissue sample was performed using a theoretical model, which calculated the dynamics of a microbubble under an externally applied force in a viscoelastic medium. The theoretical model and the high PRF ultrasound system were successfully validated in both gelatin phantoms and ex vivo bovine crystalline lenses. Age-related sclerosis of the crystalline lenses from bovine was clearly detected, which might be linked to changes in the crystalline. Location-dependent variation explained that the outer cortex and the inner nucleus had different mechanical properties. In the old and young porcine vitreous humors, age-related changes were not found. However, local variations of the mechanical properties were discovered, which may coincide with the different distributions of the molecular compositions. The laser-induced microbubble approach shows potential for future research into the origin of physiological phenomena and the development of inherent disorders in the eye. I hope that further studies – in the development of a more suitable theoretical model for the microbubble dynamics, in extension to in vivo applications, and in defining the relationship of the mechanical properties to molecular components in the eye – may provide a plan for the therapeutic treatment of eye-related diseases.Mechanical Engineerin

Advertising Creativity in Korea: scale development and validation

The authors develop and validate a measure of advertising creativity that is intended for a collectivistic, holistic population. Scale-development procedures result in a four-factor correlated model comprising originality, considerateness, clarity, and product relevance. The second dimension, considerateness, appears to mirror the culturally unique propensity to value the collectivistic Confucian norms of the society and the contextual elements of the advertisement. Reliability and validity of the scale are examined

Advertising Creativity in Korea: Scale Development and Validation

The authors develop and validate a measure of advertising creativity that is intended for a collectivistic, holistic population. Scale-development procedures result in a four-factor correlated model comprising originality, considerateness, clarity, and product relevance. The second dimension, considerateness, appears to mirror the culturally unique propensity to value the collectivistic Confucian norms of the society and the contextual elements of the advertisement. Reliability and validity of the scale are examined

Quaternary ammonium-based mitochondria targeting anticancer agents with high water solubility

Triphenylphosphonium derivatives induce mitochondrial dysfunction by inhibiting the respiratory chain, membrane depolarization, and generation of reactive oxygen species. However, the clinical application has been limited due to low aqueous solubility. In this regard, a series of novel mitochondria targeting agents were designed by introducing quaternary ammonium that increases aqueous solubility. Among them, diquaternary ammonium containing triphenylphosphonium molecules specifically inhibited mitochondrial respiratory chain, disrupted mitochondrial proteostasis, and intra-mitochondrial protein in cancer cells, resulting in apoptosis induction. Overall, the high water-soluble mitochondria targeting agents would be a potential anticancer drug

Acoustic tweezers for studying intracellular calcium signaling in SKBR-3 human breast cancer cells

Extracellular matrix proteins such as fibronectin (FNT) play crucial roles in cell proliferation, adhesion, and migration. For better understanding of these associated cellular activities, various microscopic manipulation tools have been used to study their intracellular signaling pathways. Recently, it has appeared that acoustic tweezers may possess similar capabilities in the study. Therefore, we here demonstrate that our newly developed acoustic tweezers with a high-frequency lithium niobate ultrasonic transducer have potentials to study intracellular calcium signaling by FNT-binding to human breast cancer cells (SKBR-3). It is found that intracellular calcium elevations in SKBR-3 cells, initially occurring on the microbead-contacted spot and then eventually spreading over the entire cell, are elicited by attaching an acoustically trapped FNT-coated microbead. Interestingly, they are suppressed by either extracellular calcium elimination or phospholipase C (PLC) inhibition. Hence, this suggests that our acoustic tweezers may serve as an alternative tool in the study of intracellular signaling by FNT-binding activities.117sciescopu

Label-free analysis of the characteristics of a single cell trapped by acoustic tweezers

Abstract Single-cell analysis is essential to understand the physical and functional characteristics of cells. The basic knowledge of these characteristics is important to elucidate the unique features of various cells and causative factors of diseases and determine the most effective treatments for diseases. Recently, acoustic tweezers based on tightly focused ultrasound microbeam have attracted considerable attention owing to their capability to grab and separate a single cell from a heterogeneous cell sample and to measure its physical cell properties. However, the measurement cannot be performed while trapping the target cell, because the current method uses long ultrasound pulses for grabbing one cell and short pulses for interrogating the target cell. In this paper, we demonstrate that short ultrasound pulses can be used for generating acoustic trapping force comparable to that with long pulses by adjusting the pulse repetition frequency (PRF). This enables us to capture a single cell and measure its physical properties simultaneously. Furthermore, it is shown that short ultrasound pulses at a PRF of 167 kHz can trap and separate either one red blood cell or one prostate cancer cell and facilitate the simultaneous measurement of its integrated backscattering coefficient related to the cell size and mechanical properties