2 research outputs found
Towards Deeply Unified Depth-aware Panoptic Segmentation with Bi-directional Guidance Learning
Depth-aware panoptic segmentation is an emerging topic in computer vision
which combines semantic and geometric understanding for more robust scene
interpretation. Recent works pursue unified frameworks to tackle this challenge
but mostly still treat it as two individual learning tasks, which limits their
potential for exploring cross-domain information. We propose a deeply unified
framework for depth-aware panoptic segmentation, which performs joint
segmentation and depth estimation both in a per-segment manner with identical
object queries. To narrow the gap between the two tasks, we further design a
geometric query enhancement method, which is able to integrate scene geometry
into object queries using latent representations. In addition, we propose a
bi-directional guidance learning approach to facilitate cross-task feature
learning by taking advantage of their mutual relations. Our method sets the new
state of the art for depth-aware panoptic segmentation on both Cityscapes-DVPS
and SemKITTI-DVPS datasets. Moreover, our guidance learning approach is shown
to deliver performance improvement even under incomplete supervision labels.Comment: to be published in ICCV 202
TrauMAP - Integrating Anatomical and Physiological Simulation (Dissertation Proposal)
In trauma, many injuries impact anatomical structures, which may in turn affect physiological processes - not only those processes within the structure, but also ones occurring in physical proximity to them. Our goal with this research is to model mechanical interactions of different body systems and their impingement on underlying physiological processes. We are particularly concerned with pathological situations in which body system functions that normally do not interact become dependent as a result of mechanical behavior. Towards that end, the proposed TRAUMAP system (Trauma Modeling of Anatomy and Physiology) consists of three modules: (1) a hypothesis generator for suggesting possible structural changes that result from the direct injuries sustained; (2) an information source for responding to operator querying about anatomical structures, physiological processes, and pathophysiological processes; and (3) a continuous system simulator for simulating and illustrating anatomical and physiological changes in three dimensions. Models that can capture such changes may serve as an infrastructure for more detailed modeling and benefit surgical planning, surgical training, and general medical education, enabling students to visualize better, in an interactive environment, certain basic anatomical and physiological dependencies