ONeRF: Unsupervised 3D Object Segmentation from Multiple Views

We present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations. The segmented 3D objects are represented using separate Neural Radiance Fields (NeRFs) which allow for various 3D scene editing and novel view rendering. At the core of our method is an unsupervised approach using the iterative Expectation-Maximization algorithm, which effectively aggregates 2D visual features and the corresponding 3D cues from multi-views for joint 3D object segmentation and reconstruction. Unlike existing approaches that can only handle simple objects, our method produces segmented full 3D NeRFs of individual objects with complex shapes, topologies and appearance. The segmented ONeRfs enable a range of 3D scene editing, such as object transformation, insertion and deletion

Clinicopathological Analysis of 11 Cases of SMARCA4 (BRG1)-deficient Carcinoma

ObjectiveTo investigate the clinicopathological features, immunophenotype, diagnosis and treatment of SMARCA4 (BRG1)-deficient carcinoma. MethodsClinical data of 11 patients with SMARCA4 (BRG1)-deficient cancer were collected. The morphologic and immunohistochemical features of this tumour were summarized, and the relevant literature was reviewed. ResultsAmong the 11 cases of SMARCA4 (BRG1)-deficient carcinoma, eight were male and three were female, with median age of 60. Seven patients underwent radical resection, and four underwent traditional joint targeted chemotherapy and immunotherapy. Microscopically, the tumor cells were epithelioid, rhabdoid or spindle-shaped, with prominent eosinophilic nucleoli and frequent mitoses (>5/10 HPF). Multiple foci of necrosis were found in the tumor tissue, a large number of tumor emboli in the blood vessels and myxoid stromal degeneration. Among these cases, 11 cases showed loss of SMARCA4 (BRG1) expression, whereas the CK and Vim markers were expressed, SMARCB1 (INI1) expression was retained, and p53 mutation was detected. The tumor cells showed high proliferation activity (Ki-67>60%), and synaptophsin was moderately positive. Three cases were mismatch repair deficient and respectively showed the loss of MLH1/PMS2, PMS2 and MSH6 expression. ConclusionThe incidence of SMARCA4 (BRG1) -dificient carcinoma is low. It can be easily confused with other tumors and is difficult to be diagnosed before operation, which requires confirmation by immunohistochemistry

PMMTalk: Speech-Driven 3D Facial Animation from Complementary Pseudo Multi-modal Features

Speech-driven 3D facial animation has improved a lot recently while most related works only utilize acoustic modality and neglect the influence of visual and textual cues, leading to unsatisfactory results in terms of precision and coherence. We argue that visual and textual cues are not trivial information. Therefore, we present a novel framework, namely PMMTalk, using complementary Pseudo Multi-Modal features for improving the accuracy of facial animation. The framework entails three modules: PMMTalk encoder, cross-modal alignment module, and PMMTalk decoder. Specifically, the PMMTalk encoder employs the off-the-shelf talking head generation architecture and speech recognition technology to extract visual and textual information from speech, respectively. Subsequently, the cross-modal alignment module aligns the audio-image-text features at temporal and semantic levels. Then PMMTalk decoder is employed to predict lip-syncing facial blendshape coefficients. Contrary to prior methods, PMMTalk only requires an additional random reference face image but yields more accurate results. Additionally, it is artist-friendly as it seamlessly integrates into standard animation production workflows by introducing facial blendshape coefficients. Finally, given the scarcity of 3D talking face datasets, we introduce a large-scale 3D Chinese Audio-Visual Facial Animation (3D-CAVFA) dataset. Extensive experiments and user studies show that our approach outperforms the state of the art. We recommend watching the supplementary video

A Survey on Service Route and Time Prediction in Instant Delivery: Taxonomy, Progress, and Prospects

Instant delivery services, such as food delivery and package delivery, have achieved explosive growth in recent years by providing customers with daily-life convenience. An emerging research area within these services is service Route\&Time Prediction (RTP), which aims to estimate the future service route as well as the arrival time of a given worker. As one of the most crucial tasks in those service platforms, RTP stands central to enhancing user satisfaction and trimming operational expenditures on these platforms. Despite a plethora of algorithms developed to date, there is no systematic, comprehensive survey to guide researchers in this domain. To fill this gap, our work presents the first comprehensive survey that methodically categorizes recent advances in service route and time prediction. We start by defining the RTP challenge and then delve into the metrics that are often employed. Following that, we scrutinize the existing RTP methodologies, presenting a novel taxonomy of them. We categorize these methods based on three criteria: (i) type of task, subdivided into only-route prediction, only-time prediction, and joint route\&time prediction; (ii) model architecture, which encompasses sequence-based and graph-based models; and (iii) learning paradigm, including Supervised Learning (SL) and Deep Reinforcement Learning (DRL). Conclusively, we highlight the limitations of current research and suggest prospective avenues. We believe that the taxonomy, progress, and prospects introduced in this paper can significantly promote the development of this field

A program for optical observations of advanced LIGO early triggers in the southern hemisphere

In this poster we present a plan to follow-up optically early triggers from the Advanced LIGO gravitational wave detectors, which will start operating in scientific mode in the northern summer of 2015

How to become a generalist species? Individual niche variation across habitat transformation gradients

Species in transformed habitats, frequently labeled as environmental generalists, tend to show broader niches than species in natural habitats. However, how population niche expansion translates into changes in the niches of individual organisms remains unclear, particularly in the context of habitat transformation. Niche expansion could be a product of individuals having broader niches, greater distances among individuals’ niches, or a combination of both processes. This would challenge the traditional conceptions on niche dynamics, which emphasize the role played by individual specialization (IS). Here, using stable isotopes, we computed total niche width (TNW), its within- and between-individual components (WIC and BIC), and IS (the ratio WIC/TNW), in 13 populations of 6 bird species and 8 populations of 3 frog species in natural and transformed habitats. We confirmed that species had broader niche width in transformed than in natural habitats, yet population niche expansion across habitats was mainly a product of increased distance between individuals. Within each habitat type, increases in TNW were linked to increases in WIC for all habitat types, while relationships between TNW and BIC were found in transformed but not in natural habitats. Hence, both increased individual niche width and increased distance among individuals were apparent within habitats, particularly in transformed ones, where increases in WIC dominated. Neither across or within habitats was niche expansion associated with increasing IS. Therefore, our results overturn traditional conceptions associated with the niche variation hypothesis and illustrate that niche expansion is not invariably associated with increased IS, because the distance between individual’s niches (BIC) can increase, as well as the breadth of those niches (WIC)

Increased intraocular inflammation in retinal vein occlusion is independent of circulating immune mediators and is involved in retinal oedema

We aim to understand the link between systemic and intraocular levels of inflammatory mediators in treatment-naïve retinal vein occlusion (RVO) patients, and the relationship between inflammatory mediators and retinal pathologies. Twenty inflammatory mediators were measured in this study, including IL-17E, Flt-3 L, IL-3, IL-8, IL-33, MIP-3β, MIP-1α, GRO β, PD-L1, CD40L, IFN-β, G-CSF, Granzyme B, TRAIL, EGF, PDGF-AA, PDGF-AB/BB, TGF-α, VEGF, and FGFβ. RVO patients had significantly higher levels of Flt-3 L, IL-8, MIP-3β, GROβ, and VEGF, but lower levels of EGF in the aqueous humor than cataract controls. The levels of Flt-3 L, IL-3, IL-33, MIP-1α, PD-L1, CD40 L, G-CSF, TRAIL, PDGF-AB/BB, TGF-α, and VEGF were significantly higher in CRVO than in BRVO. KEGG pathway enrichment revealed that these mediators affected the PI3K-Akt, Ras, MAPK, and Jak/STAT signaling pathways. Protein–Protein Interaction (PPI) analysis showed that VEGF is the upstream cytokine that influences IL-8, G-CSF, and IL-33 in RVO. In the plasma, the level of GROβ was lower in RVO than in controls and no alterations were observed in other mediators. Retinal thickness [including central retinal thickness (CRT) and inner limiting membrane to inner plexiform layer (ILM-IPL)] positively correlated with the intraocular levels of Flt-3 L, IL-33, GROβ, PD-L1, G-CSF, and TGF-α. The size of the foveal avascular zone positively correlated with systemic factors, including the plasma levels of IL-17E, IL-33, INF-β, GROβ, Granzyme B, and FGFβ and circulating high/low-density lipids and total cholesterols. Our results suggest that intraocular inflammation in RVO is driven primarily by local factors but not circulating immune mediators. Intraocular inflammation may promote macular oedema through the PI3K-Akt, Ras, MAPK, and Jak/STAT signaling pathways in RVO. Systemic factors, including cytokines and lipid levels may be involved in retinal microvascular remodeling