Vision Transformer Pruning Via Matrix Decomposition

This is a further development of Vision Transformer Pruning via matrix decomposition. The purpose of the Vision Transformer Pruning is to prune the dimension of the linear projection of the dataset by learning their associated importance score in order to reduce the storage, run-time memory, and computational demands. In this paper we further reduce dimension and complexity of the linear projection by implementing and comparing several matrix decomposition methods while preserving the generated important features. We end up selected the Singular Value Decomposition as the method to achieve our goal by comparing the original accuracy scores in the original Github repository and the accuracy scores of using those matrix decomposition methods, including Singular Value Decomposition, four versions of QR Decomposition, and LU factorization

Topological Interpretations of GPT-3

This is an experiential study of investigating a consistent method for deriving the correlation between sentence vector and semantic meaning of a sentence. We first used three state-of-the-art word/sentence embedding methods including GPT-3, Word2Vec, and Sentence-BERT, to embed plain text sentence strings into high dimensional spaces. Then we compute the pairwise distance between any possible combination of two sentence vectors in an embedding space and map them into a matrix. Based on each distance matrix, we compute the correlation of distances of a sentence vector with respect to the other sentence vectors in an embedding space. Then we compute the correlation of each pair of the distance matrices. We observed correlations of the same sentence in different embedding spaces and correlations of different sentences in the same embedding space. These observations are consistent with our hypothesis and take us to the next stage.Comment: 70 page

Rifabutin corneal deposits localized to the deep stroma using anterior segment optical coherence tomography.

Purpose:To demonstrate that rifabutin-related corneal deposits are localized to the deep stroma using anterior segment optical coherence tomography (OCT) and confocal microscopy. Observations:A 55-year-old male with a history of human immunodeficiency virus (HIV) and disseminated mycobacterium avium complex on rifabutin treatment for 3 years presented with bilateral corneal deposits. Confocal microscopy and anterior segment OCT confirm that rifabutin-related corneal deposits are located in the deep stroma, rather than in the endothelium. Conclusions:And Importance: Rifabutin deposits localize to the deep corneal stroma, and can be seen with both confocal microscopy and anterior segment OCT. Anterior segment OCT is a widely available and easily used diagnostic tool, and can provide utility in the diagnosis of corneal deposits

Simulation of the Aerodynamic Interaction between Rotor and Ground Obstacle Using Vortex Method

The mutual aerodynamic interaction between rotor wake and surrounding obstacles is complex, and generates high compensatory workload for pilots, degradation of the handling qualities, and performance, and unsteady force on the structure of the obstacles. The interaction also affects the minimum distance between rotorcrafts and obstacles to operate safely. A vortex-based approach is then employed to investigate the complex aerodynamic interaction between rotors and ground obstacle, and identify the distance where the interaction ends, and this is also the objective of the GARTEUR AG22 working group activities. In this approach, the aerodynamic loads of the rotor blades are described through a panel method, and the unsteady behaviour of the rotor wake is modelled using a vortex particle method. The effects of the ground plane and obstacle are accounted for via a viscous boundary model. The method is then applied to a “Large” and a “Wee” rotor near the ground and obstacle, and compared with the earlier experiments carried out at the University of Glasgow. The results show that predicted rotor induced inflow and flow field compare reasonably well with the experiments. Furthermore, at certain conditions, the tip vortices are pushed up and re-injected into the rotor wake due to the effect of the obstacle resulting in a recirculation. Moreover, contrary to without the obstacle case, peak and thickness of the radial outwash near the obstacle are smaller due to the barrier effect of the obstacle, and an upwash is observed. In addition, as the rotor closes to the obstacle, the rotor slipstreams impinge directly on the obstacle, and the upwash near the obstacle is faster, indicating a stronger interaction between the rotor wake and the obstacle. In addition, contrary to the case without the obstacle, the fluctuations of the rotor thrust, and rolling and pitching moments are obviously strengthened. When the distance between the rotor and the obstacle is larger than 3R, the effect of the obstacle is small

Nano-optics of Perforated Metallic Films

Thesis advisor: Krzysztof KempaThesis advisor: Zhifeng RenIn the past few decades, accompanied by the fascinating development of micro- and nano-fabrication techniques, the successful integration of subwavelength optics and multilayer structures has led to a number of remarkable discoveries. In this work, I present both experimental and theoretical investigations of the optics of thin metallic films with micro-/nano-scale perforations in the UV-VIS-IR ranges. Different fabrication techniques are employed, including nanosphere lithography, grain boundary lithography, crack templates, and sintered nanoparticles. The optical properties these films are studied, revealing important relation between optical response and the film geometry. This includes the evolution of plasmonic resonances in a series of periodic arrays of holes in a metallic film, with hole sizes increasing gradually until an array of islands is achieved. This evolution is an analog of the percolation problem, and critical phenomena are observed at the percolation threshold. Multilayer broad-band electromagnetic absorbers are also designed and fabricated based on the study of these perforated films. Parallel with these observations, an analytical coherence model is proposed to bridge the subwavelength and superwavelength limits. Such a model also provides an alternative way to handle thin random structures, avoiding large quantity of numerical computation. These studies can find applications in the design of sensors, ultrathin solar cells and transparent electrodes, as well as in applications where random structures are widely used.Thesis (PhD) — Boston College, 2014.Submitted to: Boston College. Graduate School of Arts and Sciences.Discipline: Physics