Memory-Constrained Policy Optimization

We introduce a new constrained optimization method for policy gradient reinforcement learning, which uses two trust regions to regulate each policy update. In addition to using the proximity of one single old policy as the first trust region as done by prior works, we propose to form a second trust region through the construction of another virtual policy that represents a wide range of past policies. We then enforce the new policy to stay closer to the virtual policy, which is beneficial in case the old policy performs badly. More importantly, we propose a mechanism to automatically build the virtual policy from a memory buffer of past policies, providing a new capability for dynamically selecting appropriate trust regions during the optimization process. Our proposed method, dubbed as Memory-Constrained Policy Optimization (MCPO), is examined on a diverse suite of environments including robotic locomotion control, navigation with sparse rewards and Atari games, consistently demonstrating competitive performance against recent on-policy constrained policy gradient methods.Comment: Preprint, 24 page

An identification of the tolerable time-interleaved analog-to-digital converter timing mismatch level in high-speed orthogonal frequency division multiplexing systems

High-speed Terahertz communication systems has recently employed orthogonal frequency division multiplexing approach as it provides high spectral efficiency and avoids inter-symbol interference caused by dispersive channels. Such high-speed systems require extremely high-sampling time-interleaved analog-to-digital converters at the receiver. However, timing mismatch of time-interleaved analog-to-digital converters significantly causes system performance degradation. In this paper, to avoid such performance degradation induced by timing mismatch, we theoretically determine maximum tolerable mismatch levels for orthogonal frequency division multiplexing communication systems. To obtain these levels, we first propose an analytical method to derive the bit error rate formula for quadrature and pulse amplitude modulations in Rayleigh fading channels, assuming binary reflected gray code (BRGC) mapping. Further, from the derived bit error rate (BER) expressions, we reveal a threshold of timing mismatch level for which error floors produced by the mismatch will be smaller than a given BER. Simulation results demonstrate that if we preserve mismatch level smaller than 25% of this obtained threshold, the BER performance degradation is smaller than 0.5 dB as compared to the case without timing mismatch

An efficient adaptive fuzzy hierarchical sliding mode control strategy for 6 degrees of freedom overhead crane

The paper proposes a new approach to efficiently control a three-dimensional overhead crane with 6 degrees of freedom (DoF). Most of the works proposing a control law for a gantry crane assume that it has five output variables, including three positions of the trolley, bridge, and pulley and two swing angles of the hoisting cable. In fact, the elasticity of the hoisting cable, which causes oscillation in the cable direction, is not fully incorporated into the model yet. Therefore, our work considers that six under-actuated outputs exist in a crane system. To design an efficient controller for the 6 DoF crane, it first employs the hierarchical sliding mode control approach, which not only guarantees stability but also minimizes the sway and oscillation of the overhead crane when it transports a payload to a desired location. Moreover, the unknown and uncertain parameters of the system caused by its actuator nonlinearity and external disturbances are adaptively estimated and inferred by utilizing the fuzzy inference rule mechanism, which results in efficient operations of the crane in real time. More importantly, stabilization of the crane controlled by the proposed algorithm is theoretically proved by the use of the Lyapunov function. The proposed control approach was implemented in a synthetic environment for the extensive evaluation, where the obtained results demonstrate its effectiveness. © 2022 by the authors. Licensee MDPI, Basel, Switzerland

Antibiotic Resistance Profile and Methicillin-Resistant Encoding Genes of Staphylococcus aureus Strains Isolated from Bloodstream Infection Patients in Northern Vietnam

Background:  Evaluating the antibiotic susceptibility and resistance genes is essential in the clinical management of bloodstream infections (BSIs). Nevertheless, there are still limited studies in Northern Vietnam. AIM: This study aimed to determine the antibiotic resistance profile and methicillin-resistant encoding genes of Staphylococcus aureus (S. aureus) causing BSIs in Northern Vietnam. METHODS: The cross-sectional study was done from December 2012 to June 2014 in two tertiary hospitals in Northern Vietnam. Tests performed at the lab of the hospital. RESULTS:  In 43 S. aureus strains isolating, 53.5 % were MRSA. Distribution of gene for overall, MRSA, and MSSA strains were following: mecA gene (58.1 %; 95.7%, and 15%), femA gene (48.8%, 47.8%, and 50%), femB gene (88.4%, 82.6%, and 95%). Antibiotic resistance was highest in penicillin (100%), followed by erythromycin (65.1%) and clindamycin (60.5%). Several antibiotics were susceptible (100%), including vancomycin, tigecycline, linezolid, quinupristin/dalfopristin. Quinolone group was highly sensitive, include ciprofloxacin (83.7%), levofloxacin (86%) and moxifloxacin (86%). CONCLUSION:  In S. aureus causing BSIs, antibiotic resistance was higher in penicillin, erythromycin, and clindamycin. All strains were utterly susceptible to vancomycin, tigecycline, linezolid, quinupristin/dalfopristin

Antibiotic Resistance Profile and Diversity of Subtypes Genes in Escherichia coli Causing Bloodstream Infection in Northern Vietnam

BACKGROUND: Evaluating the antibiotic susceptibility and resistance genes is essential in the clinical management of bloodstream infections (BSIs). But there are still limited studies in Northern Vietnam. AIM: The aim of the study was to determine the antibiotic resistance profile and characteristics of subtypes genes in Escherichia coli causing BSIs in Northern Vietnam. METHODS: The cross-sectional study was done in the period from December 2012 to June 2014 in two tertiary hospitals in Northern Vietnam. Tests were performed at the lab of the hospital. RESULTS: In 56 E. coli strains isolating 39.29 % produced ESBL. 100% of the isolates harbored blaTEM gene, but none of them had the blaPER gene. The prevalence of ESBL producers and ESBL non-producers in blaCTX-M gene was 81.82%, and 73.53%, in blaSHV gene was 18.18% and 35.29%. Sequencing results showed three blaTEM subtypes (blaTEM 1, 79, 82), four blaCTX-M subtypes (blaCTX-M-15, 73, 98, 161), and eight blaSHV subtypes (blaSHV 5, 7, 12, 15, 24, 33, 57, 77). Antibiotic resistance was higher in ampicillin (85.71%), trimethoprim/sulfamethoxazole (64.29%) and cephazolin (50%). Antibiotics were still highly susceptible including doripenem (96.43%), ertapenem (94.64%), amikacin (96.43%), and cefepime (89.29%). CONCLUSION: In Escherichia coli causing BSIs, antibiotic resistance was higher in ampicillin, trimethoprim/sulfamethoxazole and cephazolin. Antibiotics was highly susceptible including doripenem, ertapenem, amikacin, and cefepime

The impact of corporate social responsibility and risk management on financial performance: The case of Vietnamese textile firm

The objective of this study is to assess the impact of corporate social responsibility (CSR) and risk management (RM) on financial performance (FP), and evaluate the moderate role of firm size in the relationship between risk management and financial performance. The study was conducted on a re-search sample of 389 Vietnamese textile firms. The results show that corporate social responsibility (CSR) was an optimal measure to minimize risks and improves financial performance. The good CSR policy reduces corporate risk and improves financial performance. Other way, the bad CSR policy increases corporate risk and impacts negatively on financial performance. In addition, the moderate role of firm size in the relationship between risk management and financial performance is statistically significant

Analytical study of the sth-order perturbative corrections to the solution to a one-dimensional harmonic oscillator perturbed by a spatially power-law potential Vper(x) = λxα

In this work, we present a rigorous mathematical scheme for the derivation of the sth-order perturbative corrections to the solution to a one-dimensional harmonic oscillator perturbed by the potential V-per(x) = lambda x(alpha), where alpha is a positive integer, using the non-degenerate time-independent perturbation theory. To do so, we derive a generalized formula for the integral I = integral(+infinity)(-infinity)x(alpha)exp(-x(2))H-n(x)H-m(x)d(x), where H-n(x) denotes the Hermite polynomial of degree n, using the generating function of orthogonal polynomials. Finally, the analytical results with alpha = 3 and alpha = 4 are discussed in detail and compared with the numerical calculations obtained by the Lagrange-mesh method

On-chip ZnO nanofibers prepared by electrospinning method for NO2 gas detection

In the present study, on-chip ZnO nanofibers were fabricated by means of the electrospinning technique followed by a calcination process at 600 oC towards the gas sensor application. The morphology, composition, and crystalline structure of the as-spun and annealed ZnO nanofibers were investigated by field emission scanning electron microscopy (FESEM), energy dispersive X-ray (EDX), and X-ray diffraction (XRD), respectively. The findings show that spider-net like ZnO nanofibers with a diameter of 60 – 100 nm were successfully synthesized without any incorporation of impurities into the nanofibers. The FESEM images also reveal that each nanofiber is composed of many nanograins. The combination of experimental and calculated X-ray diffraction data indicate that ZnO nanofibers were crystallized in hexagonal wurtzite structure. For the gas sensing device application, the ZnO nanofibers-based sensors were tested with the nitrogen dioxide gas in the temperature range of 200 oC to 350 oC and concentrations from 2.5 ppm to 10 ppm. The sensing property results indicate that at the optimal working temperature of 300 oC, the ZnO nanofibers-based sensors exhibited a maximum response of 30 and 166 times on exposure of 2.5 and 10 ppm NO2 gas, respectively. The presence of nanograins within nanofibers, which results in further intensification of the resistance modulation, is responsible for such high gas response

Current status of fish-borne zoonotic trematode infections in Gia Vien district, Ninh Binh province, Vietnam

BACKGROUND: Ninh Binh province is known as an endemic area of fish-borne zoonotic trematode (FZT) transmission in Vietnam. A cross-sectional study was conducted in Gia Minh and Gia Thinh communes of Gia Vien district, Ninh Binh province to investigate the infections with different stages of FZT in various host species. METHODS: Faecal samples from 1,857 humans were examined for trematode eggs using the Kato-Katz method, while faecal samples from 104 dogs, 100 cats, and 100 pigs were examined using the Formalin-ethyl acetate concentration technique (FECT). A total of 483 specimens of freshwater fish, representing 9 species, were examined for metacercariae using the artificial digestion method. Three methods of cercarial detection (shedding, crushing and cutting) were applied for examination of 3,972 specimens of freshwater snails, representing 7 species. All relevant data e.g. location, sex, age group, animal species, and habitat were recorded for statistical analyses. RESULTS: Helminth eggs were found in 65.5% of the human faecal samples, including 20.5% of faecal samples containing small trematode eggs. Infection with small trematodes differed among communes, age groups and sexes. Eggs of small trematodes were found in 32.7% of faecal samples from dogs, 49.0% from cats and 13.0% from pigs. The difference in prevalences and intensities were significant among species of animals but did not differ between the two communes. All fish species were infected with FZT, with an average prevalence of 56.1% and a mean intensity of 33.245 metacercariae per gram. Prevalence and intensity in fish differed significantly among cummunes and fish groups. Six species of zoonotic trematodes were identified. Metacercariae of the small liver fluke, Clonorchis sinensis, was only found in Hemiculter leucisculus. A total of 9 specimens from two snail species, Melanoides tuberculata and Bithynia fuchsiana, were infected with trematodes and four cercarial types were detected in the study sites. CONCLUSIONS: We conclude that Gia Minh and Gia Thinh communes are continuing to be hot-spot endemic areas of FZT and other helminths infections where the habit of eating raw fish by the local people is still present