Localizing Active Objects from Egocentric Vision with Symbolic World Knowledge

The ability to actively ground task instructions from an egocentric view is crucial for AI agents to accomplish tasks or assist humans virtually. One important step towards this goal is to localize and track key active objects that undergo major state change as a consequence of human actions/interactions to the environment without being told exactly what/where to ground (e.g., localizing and tracking the `sponge` in video from the instruction "Dip the `sponge` into the bucket."). While existing works approach this problem from a pure vision perspective, we investigate to which extent the textual modality (i.e., task instructions) and their interaction with visual modality can be beneficial. Specifically, we propose to improve phrase grounding models' ability on localizing the active objects by: (1) learning the role of `objects undergoing change` and extracting them accurately from the instructions, (2) leveraging pre- and post-conditions of the objects during actions, and (3) recognizing the objects more robustly with descriptional knowledge. We leverage large language models (LLMs) to extract the aforementioned action-object knowledge, and design a per-object aggregation masking technique to effectively perform joint inference on object phrases and symbolic knowledge. We evaluate our framework on Ego4D and Epic-Kitchens datasets. Extensive experiments demonstrate the effectiveness of our proposed framework, which leads to>54% improvements in all standard metrics on the TREK-150-OPE-Det localization + tracking task, >7% improvements in all standard metrics on the TREK-150-OPE tracking task, and >3% improvements in average precision (AP) on the Ego4D SCOD task.Comment: In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP

Blind Source Separation of Hemodynamics from Magnetic Resonance Perfusion Brain Images Using Independent Factor Analysis

Perfusion magnetic resonance brain imaging induces temporal signal changes on brain tissues, manifesting distinct blood-supply patterns for the profound analysis of cerebral hemodynamics. We employed independent factor analysis to blindly separate such dynamic images into different maps, that is, artery, gray matter, white matter, vein and sinus, and choroid plexus, in conjunction with corresponding signal-time curves. The averaged signal-time curve on the segmented arterial area was further used to calculate the relative cerebral blood volume (rCBV), relative cerebral blood flow (rCBF), and mean transit time (MTT). The averaged ratios for rCBV, rCBF, and MTT between gray and white matters for normal subjects were congruent with those in the literature

On the Analysis of Product Appropriateness Principles

The purpose of this study is to explore appropriateness of the various products presented in the market and the application of appropriateness principles to the product design. To obtain appropriateness principles, this study compares and analyzes a variety of products available in the market. After obtaining preliminary principles, many times convergence and analysis are operated for getting more accurate principles. Then, AHP method is used for evaluating importance of every appropriateness principles and appropriateness principles are obtained. And, the appropriateness principles are used to construct the design process of appropriateness product. Finally, some design cases are operated and appropriateness principles are evaluated for the products of design cases. The results of this study are obtained 10 appropriateness principles: freedom, demand, environmental protection, effectiveness, intuition, compliance, simplicity, optimal performance, simplicity, fault tolerance. And, weights of appropriateness principles get in this paper

ANALYSIS OF GRIP FORCE DURING GOLF PUTTING AT DIFFERENT DISTANCES - PILOT STUDY

The purpose of this study was to explore the grip force performance at different distances during putting stroke. Four golfers (2 professionals and 2 novices) as accurately as possible executed a putt to reach 1, 2 and 3 m target distance, respectively. Putting motions were recorded by JVC video and grip pressure measurement sensor placed on two hands, allowing the force output of all regions of the hands to be measured. The grip force trace among 1 to 3 m distance was repeatable across putting strokes for each golfer but between golfers was inconsistent. Dominant forces appear to arise primarily from the left hand. In this study, the grip force and force distribution were preliminarily discovered during putting stroke at different distances. This research has suggested a potentially important influence of grip force on the golf putting performance in long distance

Pelvic skeletal metastasis of hepatocellular carcinoma with sarcomatous change: a case report

Sarcomatoid hepatocellular carcinoma (HCC) is a very rare histologic variant of HCC. The characteristic of skeletal metastatic sarcomatoid hepatocellular carcinoma has never been reported. We reported a patient with sarcomatoid hepatocellular carcinoma pelvic metastasis who presented with huge pelvic metastasis that had relatively small osteolytic lesion centrally located accompanied by huge bipeduncular invasive expansile lesions into surrounding soft tissue. The lesion showed almost non-isotope uptake in 99mTc-methylene diphosphonate bone scintigraphy study. He underwent radiotherapy and tumor excision but the tumor rapidly recurred. In addition, serum α-fetoprotein level was never elevated beyond normal limit (< 20 ng/mL) through the whole course of treatment. We considered sarcomatoid hepatocellular carcinoma bone metastasis a highly aggressive lesion with unusual metastatic pattern. Surgical treatment with adequate safe margin in such a huge tumor with hypervascularity and extensive invasion in the pelvis was difficult; and radiotherapy maybe refractory regarding the sarcomatous nature. Therefore, debulking operation with local symptoms control may provide a better quality of life. And the clinical course suggests sarcomatoid hepatocellular carcinoma is derived from the transition of an ordinary hepatocellular carcinoma