Deceptive-Human: Prompt-to-NeRF 3D Human Generation with 3D-Consistent Synthetic Images

This paper presents Deceptive-Human, a novel Prompt-to-NeRF framework capitalizing state-of-the-art control diffusion models (e.g., ControlNet) to generate a high-quality controllable 3D human NeRF. Different from direct 3D generative approaches, e.g., DreamFusion and DreamHuman, Deceptive-Human employs a progressive refinement technique to elevate the reconstruction quality. This is achieved by utilizing high-quality synthetic human images generated through the ControlNet with view-consistent loss. Our method is versatile and readily extensible, accommodating multimodal inputs, including a text prompt and additional data such as 3D mesh, poses, and seed images. The resulting 3D human NeRF model empowers the synthesis of highly photorealistic novel views from 360-degree perspectives. The key to our Deceptive-Human for hallucinating multi-view consistent synthetic human images lies in our progressive finetuning strategy. This strategy involves iteratively enhancing views using the provided multimodal inputs at each intermediate step to improve the human NeRF model. Within this iterative refinement process, view-dependent appearances are systematically eliminated to prevent interference with the underlying density estimation. Extensive qualitative and quantitative experimental comparison shows that our deceptive human models achieve state-of-the-art application quality.Comment: Github project: https://github.com/DanielSHKao/DeceptiveHuma

Comparing the effects of visibility of different neighborhood greenery settings on the preference ratings and noise annoyance responses to road traffic noises

The impact of visual environment on human noise perceptions has always been under scrutiny. Two consecutive sets of laboratory experiments were performed for studying the effect of visual perceptions of different percentages of sea, greenery, and/or road views on noise-induced annoyance responses as well as preference ratings. Both experiments were carried out in a room purposely constructed inside an anechoic chamber to mimic the living room setting of a dwelling in Hong Kong. Video clips were projected consecutively onto the exterior window panel of the living room to simulate neighborhood views containing different percentages of sea, greenery and road. 82 and 58 participants were successfully administered in two experiments. Each participant was presented with 11 video clips and requested to respond to a series of questions regarding perceived noise annoyance and view preferences after presentation of individual clips. The responses collected from each experiment were employed to formulate ordered logit models to predict the probability of evoking a high annoyance response. Findings indicated that participants tended to prefer the presence of sea rather than that of either mountain or trees in views containing a trafficking road. Views containing sea would produce an attenuating effect on noise annoyance while views containing road would produce an aggravating effect. However, the size of the effects did not vary between 0% and 30% sea, or between 30% and 60% road contained in a view. Views containing dense greenery at a close distance would aggravate noise annoyance irrespective of form. However, when the percentage of greenery increased from 30% to 60%, the noise annoyance attenuating effect increased in the case of wooded mountain but decreased in the case of the more transparent tree clumps

Deceptive-NeRF: Enhancing NeRF Reconstruction using Pseudo-Observations from Diffusion Models

This paper introduces Deceptive-NeRF, a new method for enhancing the quality of reconstructed NeRF models using synthetically generated pseudo-observations, capable of handling sparse input and removing floater artifacts. Our proposed method involves three key steps: 1) reconstruct a coarse NeRF model from sparse inputs; 2) generate pseudo-observations based on the coarse model; 3) refine the NeRF model using pseudo-observations to produce a high-quality reconstruction. To generate photo-realistic pseudo-observations that faithfully preserve the identity of the reconstructed scene while remaining consistent with the sparse inputs, we develop a rectification latent diffusion model that generates images conditional on a coarse RGB image and depth map, which are derived from the coarse NeRF and latent text embedding from input images. Extensive experiments show that our method is effective and can generate perceptually high-quality NeRF even with very sparse inputs

Perception of urban park soundscape

A number of studies have been initiated to explore how to improve the soundscape quality in urban parks. However, good soundscape quality in parks cannot be provided without a thorough understanding of the complex relationships among sound, environment, and individuals. As acoustic comfort is considered to be an important outcome of soundscape quality, this study investigates the relative impacts of the factors influencing acoustic comfort evaluation by formulating a multivariate ordered logit model. This study also explores the inter-relationships among acoustic comfort evaluation, acceptability of the environment, and preference to stay in a park using a path model. A total of 595 valid responses were obtained from interview surveys administered in four parks in Hong Kong while objective sound measurements were carried out at the survey spots concurrently. The findings unveil that acoustic comfort evaluation, besides visual comfort evaluation of landscape, also plays an important role on users’ acceptability of the urban park environment. Compared with all the studied acoustic related factors, acoustic comfort evaluation serves as a better proxy for park users’ preference to stay in urban parks. Hearing the breeze will significantly increase the likelihood of individuals in giving high acoustic comfort evaluation. Conversely, hearing the sounds from heavy vehicles or sounds from bikes will significantly reduce the likelihood in giving a high acoustic evaluation.Department of Building Services EngineeringDepartment of Mechanical Engineerin

A directionally tunable but frequency-invariant beamformer on an acoustic velocity-sensor triad to enhance speech perception

Herein investigated are computationally simple microphone-array beamformers that are independent of the frequency-spectra of all signals, all interference, and all noises. These beamformers allow the listener to tune the desired azimuth-elevation “look direction.” No prior information is needed of the interference. These beamformers deploy a physically compact triad of three collocated but orthogonally oriented velocity sensors. These proposed schemes’ efficacy is verified by a jury test, using simulated data constructed with Mandarin Chinese (a.k.a. Putonghua) speech samples. For example, a desired speech signal, originally at a very adverse signal-to-interference-and-noise power ratio (SINR) of -30 dB, may be processed to become fully intelligible to the jury

On the study of the effects of sea views, greenery views and personal characteristics on noise annoyance perception at homes

Noise annoyance has caused significant adverse impacts on human beings and numerous efforts have been spent on mitigating annoyance problems. Natural greenery has been shown to be able to moderate annoyance problems at home but this conclusion was drawn without properly controlling the potential confounding factors. Furthermore, few have explored the moderation effect of a sea view. Accordingly, this study formulated a multivariate model to examine the impacts of natural views as well as personal characteristics on annoyance perception. A housing estate was selected in Hong Kong as the survey site for which some of the residents were exposed to greenery views, sea views, or both from their homes. Eight hundred and sixty-one responses were collected via questionnaire surveys and analyzed using an ordered logit model. The results suggest that both a greenery view and a sea view can moderate annoyance responses. Several individual’s personal characteristics are found to affect individuals’ annoyance perception. The duration of time spent daily at home is shown to have an influence on the moderation impact exerted by a greenery view, while the age of an individual is shown to have an influence on noise moderation effect exerted by a sea view.Department of Building Services Engineerin

Soundscape assessment : towards a validated translation of perceptual attributes in different languages

The recently published ISO/TS 12913-2:2018 standard aims to provide researchers and practitioners around the world with a reliable questionnaire for soundscape characterization. The ISO Technical Specifications report protocols and attributes grounded in the soundscape literature, but only includes an English version. The applicability and reliability of these attributes in non-English speaking regions remains an open question, as research investigating translations of soundscape attributes is limited. To address this gap, an international collaboration was initiated with soundscape researchers from all over the world. Translation into 15 different languages, obtained through focus groups and panels of experts in soundscape studies, are proposed. The main challenges and outcomes of this preliminary exercise are discussed. The long-term objective is to validate the proposed translations using standardized listening experiments in different languages and geographical regions as a way to promote a widespread use of the soundscape attributes, both in academia and practice, across locations, populations and languages

Integrated Micro/Nanoengineered Functional Biomaterials for Cell Mechanics and Mechanobiology: A Materials Perspective

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/106681/1/adma201304431.pd

In-situ measurement and prediction of traffic noise transmission loss across a residential flat unit façade installed with two plenum windows

In the present study, the traffic noise transmission loss across a residential flat unit façade installed with two plenum windows are measured in-situ in a 30-storey high-rise building located in an opened environment next to a very busy and noisy main trunk road. These plenum windows are intended to help reduce noise exposure of the residents and at the same time allow for a reasonable level of natural ventilation. Empirical scheme to predict these transmission losses is also developed. The results show that the traffic noise transmission losses of plenum windows adopted in this housing block are only weakly dependent on elevation from the trunk road. The corresponding predictions agree very well with site measurement results with a root-mean-square deviation of about 0.8 dBA

Sound insulation of plenum windows installed with rigid cylinder array

In this study, a 1:4 scale down model was established to investigate the acoustical performance of plenum window installed with a rigid cylinder array. A total of 6 rigid cylinders were vertically placed as a 2x3 array inside the central cavity of a plenum window. A linear loudspeaker array consisted of twenty-five 6 inch loudspeakers was used as the sound source. Results show that the placement of rigid cylinder array has an effect on the sound insulation of the plenum window. The traffic noise reduction of plenum window has been significantly enhanced by up to ~3 dB in some one-third octave bands. With the increase of frequency, noise reduction of the plenum window also increases. Installation of the 2x3 rigid cylinder array in the plenum window can enhance the sound insulation by ~1 dB