3D-TOGO: Towards Text-Guided Cross-Category 3D Object Generation

Text-guided 3D object generation aims to generate 3D objects described by user-defined captions, which paves a flexible way to visualize what we imagined. Although some works have been devoted to solving this challenging task, these works either utilize some explicit 3D representations (e.g., mesh), which lack texture and require post-processing for rendering photo-realistic views; or require individual time-consuming optimization for every single case. Here, we make the first attempt to achieve generic text-guided cross-category 3D object generation via a new 3D-TOGO model, which integrates a text-to-views generation module and a views-to-3D generation module. The text-to-views generation module is designed to generate different views of the target 3D object given an input caption. prior-guidance, caption-guidance and view contrastive learning are proposed for achieving better view-consistency and caption similarity. Meanwhile, a pixelNeRF model is adopted for the views-to-3D generation module to obtain the implicit 3D neural representation from the previously-generated views. Our 3D-TOGO model generates 3D objects in the form of the neural radiance field with good texture and requires no time-cost optimization for every single caption. Besides, 3D-TOGO can control the category, color and shape of generated 3D objects with the input caption. Extensive experiments on the largest 3D object dataset (i.e., ABO) are conducted to verify that 3D-TOGO can better generate high-quality 3D objects according to the input captions across 98 different categories, in terms of PSNR, SSIM, LPIPS and CLIP-score, compared with text-NeRF and Dreamfields

Prospects for the sustainability of social-ecological systems (SES) on the Mongolian plateau: five critical issues

n/

Upscaling Wetland Methane Emissions From the FLUXNET-CH4 Eddy Covariance Network (UpCH4 v1.0): Model Development, Network Assessment, and Budget Comparison

Wetlands are responsible for 20%-31% of global methane (CH4) emissions and account for a large source of uncertainty in the global CH4 budget. Data-driven upscaling of CH4 fluxes from eddy covariance measurements can provide new and independent bottom-up estimates of wetland CH4 emissions. Here, we develop a six-predictor random forest upscaling model (UpCH4), trained on 119 site-years of eddy covariance CH4 flux data from 43 freshwater wetland sites in the FLUXNET-CH4 Community Product. Network patterns in site-level annual means and mean seasonal cycles of CH4 fluxes were reproduced accurately in tundra, boreal, and temperate regions (Nash-Sutcliffe Efficiency similar to 0.52-0.63 and 0.53). UpCH(4) estimated annual global wetland CH4 emissions of 146 +/- 43 TgCH4 y(-1) for 2001-2018 which agrees closely with current bottom-up land surface models (102-181 TgCH4 y(-1)) and overlaps with top-down atmospheric inversion models (155-200 TgCH4 y -1). However, UpCH4 diverged from both types of models in the spatial pattern and seasonal dynamics of tropical wetland emissions. We conclude that upscaling of eddy covariance CH4 fluxes has the potential to produce realistic extra-tropical wetland CH4 emissions estimates which will improve with more flux data. To reduce uncertainty in upscaled estimates, researchers could prioritize new wetland flux sites along humid-to-arid tropical climate gradients, from major rainforest basins (Congo, Amazon, and SE Asia), into monsoon (Bangladesh and India) and savannah regions (African Sahel) and be paired with improved knowledge of wetland extent seasonal dynamics in these regions. The monthly wetland methane products gridded at 0.25 degrees from UpCH4 are available via ORNL DAAC (https://doi.org/10.3334/ ORNLDAAC/2253).Plain Language Summary Wetlands account for a large share of global methane emissions to the atmosphere, but current estimates vary widely in magnitude (similar to 30% uncertainty on annual global emissions) and spatial distribution, with diverging predictions for tropical rice growing (e.g., Bengal basin), rainforest (e.g., Amazon basin), and floodplain savannah (e.g., Sudd) regions. Wetland methane model estimates could be improved by increased use of land surface methane flux data. Upscaling approaches use flux data collected across globally distributed measurement networks in a machine learning framework to extrapolate fluxes in space and time. Here, we train and evaluate a methane upscaling model (UpCH4) and use it to generate monthly, globally gridded wetland methane emissions estimates for 2001-2018. The UpCH4 model uses only six predictor variables among which temperature is dominant. Global annual methane emissions estimates and associated uncertainty ranges from upscaling fall within state-of-the-art model ensemble estimates from the Global Carbon Project (GCP) methane budget. In some tropical regions, the spatial pattern of UpCH4 emissions diverged from GCP predictions, however, inclusion of flux measurements from additional ground-based sites, together with refined maps of tropical wetlands extent, could reduce these prediction uncertainties

Upscaling Wetland Methane Emissions From the FLUXNET-CH4 Eddy Covariance Network (UpCH4 v1.0):Model Development, Network Assessment, and Budget Comparison

Wetlands are responsible for 20%–31% of global methane (CH4) emissions and account for a large source of uncertainty in the global CH4 budget. Data-driven upscaling of CH4 fluxes from eddy covariance measurements can provide new and independent bottom-up estimates of wetland CH4 emissions. Here, we develop a six-predictor random forest upscaling model (UpCH4), trained on 119 site-years of eddy covariance CH4 flux data from 43 freshwater wetland sites in the FLUXNET-CH4 Community Product. Network patterns in site-level annual means and mean seasonal cycles of CH4 fluxes were reproduced accurately in tundra, boreal, and temperate regions (Nash-Sutcliffe Efficiency ∼0.52–0.63 and 0.53). UpCH4 estimated annual global wetland CH4 emissions of 146 ± 43 TgCH4 y−1 for 2001–2018 which agrees closely with current bottom-up land surface models (102–181 TgCH4 y−1) and overlaps with top-down atmospheric inversion models (155–200 TgCH4 y−1). However, UpCH4 diverged from both types of models in the spatial pattern and seasonal dynamics of tropical wetland emissions. We conclude that upscaling of eddy covariance CH4 fluxes has the potential to produce realistic extra-tropical wetland CH4 emissions estimates which will improve with more flux data. To reduce uncertainty in upscaled estimates, researchers could prioritize new wetland flux sites along humid-to-arid tropical climate gradients, from major rainforest basins (Congo, Amazon, and SE Asia), into monsoon (Bangladesh and India) and savannah regions (African Sahel) and be paired with improved knowledge of wetland extent seasonal dynamics in these regions. The monthly wetland methane products gridded at 0.25° from UpCH4 are available via ORNL DAAC (https://doi.org/10.3334/ORNLDAAC/2253).</p

Identifying dominant environmental predictors of freshwater wetland methane fluxes across diurnal to seasonal time scales

While wetlands are the largest natural source of methane (CH4) to the atmosphere, they represent a large source of uncertainty in the global CH4 budget due to the complex biogeochemical controls on CH4 dynamics. Here we present, to our knowledge, the first multi-site synthesis of how predictors of CH4 fluxes (FCH4) in freshwater wetlands vary across wetland types at diel, multiday (synoptic), and seasonal time scales. We used several statistical approaches (correlation analysis, generalized additive modeling, mutual information, and random forests) in a wavelet-based multi-resolution framework to assess the importance of environmental predictors, nonlinearities and lags on FCH4 across 23 eddy covariance sites. Seasonally, soil and air temperature were dominant predictors of FCH4 at sites with smaller seasonal variation in water table depth (WTD). In contrast, WTD was the dominant predictor for wetlands with smaller variations in temperature (e.g., seasonal tropical/subtropical wetlands). Changes in seasonal FCH4 lagged fluctuations in WTD by similar to 17 +/- 11 days, and lagged air and soil temperature by median values of 8 +/- 16 and 5 +/- 15 days, respectively. Temperature and WTD were also dominant predictors at the multiday scale. Atmospheric pressure (PA) was another important multiday scale predictor for peat-dominated sites, with drops in PA coinciding with synchronous releases of CH4. At the diel scale, synchronous relationships with latent heat flux and vapor pressure deficit suggest that physical processes controlling evaporation and boundary layer mixing exert similar controls on CH4 volatilization, and suggest the influence of pressurized ventilation in aerenchymatous vegetation. In addition, 1- to 4-h lagged relationships with ecosystem photosynthesis indicate recent carbon substrates, such as root exudates, may also control FCH4. By addressing issues of scale, asynchrony, and nonlinearity, this work improves understanding of the predictors and timing of wetland FCH4 that can inform future studies and models, and help constrain wetland CH4 emissions.Peer reviewe

A Novel Multi-Sensor Environmental Perception Method Using Low-Rank Representation and a Particle Filter for Vehicle Reversing Safety

Environmental perception and information processing are two key steps of active safety for vehicle reversing. Single-sensor environmental perception cannot meet the need for vehicle reversing safety due to its low reliability. In this paper, we present a novel multi-sensor environmental perception method using low-rank representation and a particle filter for vehicle reversing safety. The proposed system consists of four main steps, namely multi-sensor environmental perception, information fusion, target recognition and tracking using low-rank representation and a particle filter, and vehicle reversing speed control modules. First of all, the multi-sensor environmental perception module, based on a binocular-camera system and ultrasonic range finders, obtains the distance data for obstacles behind the vehicle when the vehicle is reversing. Secondly, the information fusion algorithm using an adaptive Kalman filter is used to process the data obtained with the multi-sensor environmental perception module, which greatly improves the robustness of the sensors. Then the framework of a particle filter and low-rank representation is used to track the main obstacles. The low-rank representation is used to optimize an objective particle template that has the smallest L-1 norm. Finally, the electronic throttle opening and automatic braking is under control of the proposed vehicle reversing control strategy prior to any potential collisions, making the reversing control safer and more reliable. The final system simulation and practical testing results demonstrate the validity of the proposed multi-sensor environmental perception method using low-rank representation and a particle filter for vehicle reversing safety

Robust Palmprint Recognition Based on Directional Representations

Part 12: Pattern RecognitionInternational audienceIn this paper, we consider the common problem of automatically recognizing palmprint with varying illumination and image noise. Gabor wavelets can be well represented for biometric image for their similar characteristics to human visual system. However, these Gabor-based algorithms are not robust for image recognition under non-uniform illumination and noise corruption. To improve the recognition performance under the low quality conditions, we propose novel palmprint recognition approach using directional representations. Firstly, the directional representation for palmprint appearance is obtained by the anisotropy filter, which is robust to drastic illumination changes and preserves important discriminative information. Then, the PCA is employed to reduce the dimension of image feature. At last, based on a sparse representation on palmprint feature, the compressed sensing is used to distinguish palms from different hands. Experimental results on the PolyU palprint database show the proposed algorithm have better performance. And the proposed scheme is robust to varying illumination and noise corruption