Bootstrapping Monte Carlo Tree Search with an Imperfect Heuristic

We consider the problem of using a heuristic policy to improve the value approximation by the Upper Confidence Bound applied in Trees (UCT) algorithm in non-adversarial settings such as planning with large-state space Markov Decision Processes. Current improvements to UCT focus on either changing the action selection formula at the internal nodes or the rollout policy at the leaf nodes of the search tree. In this work, we propose to add an auxiliary arm to each of the internal nodes, and always use the heuristic policy to roll out simulations at the auxiliary arms. The method aims to get fast convergence to optimal values at states where the heuristic policy is optimal, while retaining similar approximation as the original UCT in other states. We show that bootstrapping with the proposed method in the new algorithm, UCT-Aux, performs better compared to the original UCT algorithm and its variants in two benchmark experiment settings. We also examine conditions under which UCT-Aux works well.Comment: 16 pages, accepted for presentation at ECML'1

On the toughness of thermoplastic polymer nanocomposites as assessed by the essential work of fracture (EWF) approach

The essential work of fracture (EWF) approach is widely used to determine the plane stress fracture toughness of highly ductile polymers and related systems. To shed light on how the toughness is affected by nanofillers EWF-suited model polymers, viz. amorphous copolyester and polypropylene block copolymer were modified by multiwall carbon nanotube (MWCNT), graphene (GR), boehmite alumina (BA), and organoclay (MMT) in 1 wt% each. EWF tests were performed on deeply double-edge notched tensile-loaded specimens under quasistatic loading conditions. Data reduction occurred by energy partitioning between yielding and necking/tearing. The EWF prerequisites were not met with the nanocomposites containing MWCNT and GR by contrast to those with MMT and BA. Accordingly, the toughness of nanocomposites with homogeneously dispersed and low aspect ratio fillers may be properly determined using the EWF. Results indicated that incorporation of nanofillers may result in an adverse effect between the specific essential and non-essential EWF parameters

Distortion of Gravitational-Wave Packets Due to their Self-Gravity

When a source emits a gravity-wave (GW) pulse over a short period of time, the leading edge of the GW signal is redshifted more than the inner boundary of the pulse. The GW pulse is distorted by the gravitational effect of the self-energy residing in between these shells. We illustrate this distortion for GW pulses from the final plunge of black hole (BH) binaries, leading to the evolution of the GW profile as a function of the radial distance from the source. The distortion depends on the total GW energy released and the duration of the emission, scaled by the total binary mass, M. The effect should be relevant in finite box simulations where the waveforms are extracted within a radius of <~ 100M. For characteristic emission parameters at the final plunge between binary BHs of arbitrary spins, this effect could distort the simulated GW templates for LIGO and LISA by a fraction of 0.001. Accounting for the wave distortion would significantly decrease the waveform extraction errors in numerical simulations.Comment: accepted for publication in Physical Review

Intermediate mass black holes in AGN disks II. Model predictions & observational constraints

If intermediate mass black holes (IMBHs) grow efficiently in gas disks around supermassive black holes, their host active galactic nucleus (AGN) disks should exhibit myriad observational signatures. Gap-opening IMBHs in AGN disks can exhibit spectral features and variability analagous to gapped protoplanetary disks. A gap-opening IMBH in the innermost disk imprints ripples and oscillations on the broad Fe K$\alpha$ line which may be detectable with future X-ray missions. A non-gap-opening IMBH will accrete and produce a soft X-ray excess relative to continuum emission. An IMBH on a retrograde orbit in an AGN disk will not open a gap and will generate soft X-rays from a bow-shock 'headwind'. Accreting IMBH in a large cavity can generate ULX-like X-ray luminosities and LINER-like optical line ratios from local ionized gas. We propose that many LINERs house a weakly accreting MBH binary in a large central disk cavity and will be luminous sources of gravitational waves (GW). IMBHs in galactic nuclei may also be detected via intermittent observational signatures including: UV/X-ray flares due to tidal disruption events, asymmetric X-ray intensity distributions as revealed by AGN transits, quasi-periodic oscillations and underluminous Type Ia supernovae. GW emitted during IMBH inspiral and collisions may be detected with eLISA and LIGO, particularly from LINERs. We summarize observational signatures and compare to current data where possible or suggest future observations.Comment: 10 pages, 3 figures, MNRAS accepte

Feature-Guided Black-Box Safety Testing of Deep Neural Networks

Despite the improved accuracy of deep neural networks, the discovery of adversarial examples has raised serious safety concerns. Most existing approaches for crafting adversarial examples necessitate some knowledge (architecture, parameters, etc.) of the network at hand. In this paper, we focus on image classifiers and propose a feature-guided black-box approach to test the safety of deep neural networks that requires no such knowledge. Our algorithm employs object detection techniques such as SIFT (Scale Invariant Feature Transform) to extract features from an image. These features are converted into a mutable saliency distribution, where high probability is assigned to pixels that affect the composition of the image with respect to the human visual system. We formulate the crafting of adversarial examples as a two-player turn-based stochastic game, where the first player's objective is to minimise the distance to an adversarial example by manipulating the features, and the second player can be cooperative, adversarial, or random. We show that, theoretically, the two-player game can con- verge to the optimal strategy, and that the optimal strategy represents a globally minimal adversarial image. For Lipschitz networks, we also identify conditions that provide safety guarantees that no adversarial examples exist. Using Monte Carlo tree search we gradually explore the game state space to search for adversarial examples. Our experiments show that, despite the black-box setting, manipulations guided by a perception-based saliency distribution are competitive with state-of-the-art methods that rely on white-box saliency matrices or sophisticated optimization procedures. Finally, we show how our method can be used to evaluate robustness of neural networks in safety-critical applications such as traffic sign recognition in self-driving cars.Comment: 35 pages, 5 tables, 23 figure

"Ultralow" sliding wear polytetrafluoro ethylene nanocomposites with functionalized graphene

The dry friction and sliding wear behavior of sintered polytetrafluoro ethylene containing various amounts of functionalized graphene were studied in this work. Graphene was incorporated in 0, 0.25, 0.75, 1, 2 and 4 vol.%, respectively. Sliding wear tests were performed in ring(metal)-on-plate(polytetrafluoro ethylene) test rig under ambient temperature setting 1 m/s sliding speed and 1 MPa contact pressure. The dynamic coefficient of friction and specific wear rate (ws) data were determined. Very low coefficient of frictions (0.12–0.14) were measured for polytetrafluoro ethylene containing 2 or 4 vol.% graphene, which was attributed to the formation of a tribofilm on the countersurface. Specific wear rate went through a maximum (peaked at doubling that of the unmodified polytetrafluoro ethylene at about 0.75 vol.% graphene) as a function of graphene content. Ultralow wear rate data in the range of 10−6 mm3/(N.m) were measured for the polytetrafluoro ethylene nanocomposites with 2 and 4 vol.% graphene. This was reasoned by the formation of a robust tribofilm, the development of which was followed by scanning electron microscopy by inspecting the worn surface of polytetrafluoro ethylene nanocomposites and that of the steel ring of the ring(metal)-on-plate(polytetrafluoro ethylene) test rig. Fourier transform infrared spectroscopic results confirmed the formation of carboxyl groups in the tribofilm. They were supposed to react with the functional groups of graphene and to create complexes with the metal countersurface ensuring the tribofilm with high adhesion and cohesion strengths. </jats:p

EM counterparts of recoiling black holes: general relativistic simulations of non-Keplerian discs

We investigate the dynamics of a circumbinary disc that responds to the loss of mass and to the recoil velocity of the black hole produced by the merger of a binary system of supermassive black holes. We perform the first two-dimensional general relativistic hydrodynamics simulations of \textit{extended} non-Keplerian discs and employ a new technique to construct a "shock detector", thus determining the precise location of the shocks produced in the accreting disc by the recoiling black hole. In this way we can study how the properties of the system, such as the spin, mass and recoil velocity of the black hole, affect the mass accretion rate and are imprinted on the electromagnetic emission from these sources. We argue that the estimates of the bremsstrahlung luminosity computed without properly taking into account the radiation transfer yield cooling times that are unrealistically short. At the same time we show, through an approximation based on the relativistic isothermal evolution, that the luminosity produced can reach a peak value above $L \simeq 10^{43} \ {\rm erg/s}$ at about $\sim 30\,{\rm d}$ after the merger of a binary with total mass $M\simeq 10^6 M_\odot$ and persist for several days at values which are a factor of a few smaller. If confirmed by more sophisticated calculations such a signal could indeed lead to an electromagnetic counterpart of the merger of binary black-hole system.Comment: 17 pages, 11 figures, accepted by A&A, movies available at http://numrel.aei.mpg.de/Visualisations/Archive/BinaryBlackHoles/EMCounterparts/EMCounterparts.htm

Directional dichroism in the paramagnetic state of multiferroics: a case study of infrared light absorption in Sr2CoSi2O7 at high temperatures

The coexisting magnetic and ferroelectric orders in multiferroic materials give rise to a handful of novel magnetoelectric phenomena, such as the absorption difference for the opposite propagation directions of light called the non-reciprocal directional dichroism (NDD). Usually these effects are restricted to low temperature, where the multiferroic phase develops. In this paper we report the observation of NDD in the paramagnetic phase of Sr2CoSi2O7 up to temperatures more than ten times higher than its N\'eel temperature (7 K) and in fields up to 30 T. The magnetically induced polarization and NDD in the disordered paramagnetic phase is readily explained by the single-ion spin-dependent hybridization mechanism, which does not necessitate correlation effects between magnetic ions. The Sr2CoSi2O7 provides an ideal system for a theoretical case study, demonstrating the concept of magnetoelectric spin excitations in a paramagnet via analytical as well as numerical approaches. We applied exact diagonalization of a spin cluster to map out the temperature and field dependence of the spin excitations, as well as symmetry arguments of the single ion and lattice problem to get the spectrum and selection rules.Comment: 15 pages, 7 figure

Physical determinants of vesicle mobility and supply at a central synapse

Encoding continuous sensory variables requires sustained synaptic signalling. At several sensory synapses, rapid vesicle supply is achieved via highly mobile vesicles and specialized ribbon structures, but how this is achieved at central synapses without ribbons is unclear. Here we examine vesicle mobility at excitatory cerebellar mossy fibre synapses which sustain transmission over a broad frequency bandwidth. Fluorescent recovery after photobleaching in slices from VGLUT1Venus knock-in mice reveal 75% of VGLUT1-containing vesicles have a high mobility, comparable to that at ribbon synapses. Experimentally constrained models establish hydrodynamic interactions and vesicle collisions are major determinants of vesicle mobility in crowded presynaptic terminals. Moreover, models incorporating 3D reconstructions of vesicle clouds near active zones (AZs) predict the measured releasable pool size and replenishment rate from the reserve pool. They also show that while vesicle reloading at AZs is not diffusion-limited at the onset of release, diffusion limits vesicle reloading during sustained high-frequency signalling