Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model

Training deep networks requires various design decisions regarding for instance their architecture, data augmentation, or optimization. In this work, we find these training variations to result in networks learning unique feature sets from the data. Using public model libraries comprising thousands of models trained on canonical datasets like ImageNet, we observe that for arbitrary pairings of pretrained models, one model extracts significant data context unavailable in the other -- independent of overall performance. Given any arbitrary pairing of pretrained models and no external rankings (such as separate test sets, e.g. due to data privacy), we investigate if it is possible to transfer such "complementary" knowledge from one model to another without performance degradation -- a task made particularly difficult as additional knowledge can be contained in stronger, equiperformant or weaker models. Yet facilitating robust transfer in scenarios agnostic to pretrained model pairings would unlock auxiliary gains and knowledge fusion from any model repository without restrictions on model and problem specifics - including from weaker, lower-performance models. This work therefore provides an initial, in-depth exploration on the viability of such general-purpose knowledge transfer. Across large-scale experiments, we first reveal the shortcomings of standard knowledge distillation techniques, and then propose a much more general extension through data partitioning for successful transfer between nearly all pretrained models, which we show can also be done unsupervised. Finally, we assess both the scalability and impact of fundamental model properties on successful model-agnostic knowledge transfer

Dendritic molecular assemblies for singlet oxygen generation: meso-tetraphenylporphyrin-based biphotonic sensitizers with remarkable luminescence

International audienceFour new TPP-based chromophores (1-4) peripherally functionalized with dendrons contg. 2-fluorenyl groups were studied for their potential to serve in photodynamic therapy. Their linear and nonlinear optical properties were investigated. With significant TPA cross-sections at 790 nm, good singlet oxygen generation capabilities and relatively large intrinsic fluorescence, sensitizers such as 1 might become particularly appealing for theranostics

Light-assisted ion-neutral reactive processes in the cold regime: radiative molecule formation vs. charge exchange

We present a combined experimental and theoretical study of cold reactive collisions between laser-cooled Ca+ ions and Rb atoms in an ion-atom hybrid trap. We observe rich chemical dynamics which are interpreted in terms of non-adiabatic and radiative charge exchange as well as radiative molecule formation using high-level electronic structure calculations. We study the role of light-assisted processes and show that the efficiency of the dominant chemical pathways is considerably enhanced in excited reaction channels. Our results illustrate the importance of radiative and non-radiative processes for the cold chemistry occurring in ion-atom hybrid traps.Comment: 5 pages, 4 figure

A quantitative risk assessment for skin sensitizing plant protection products: Linking derived No-Effect levels (DNELs) with agricultural exposure models.

Chemical skin sensitizers produce allergic contact dermatitis, which is one of the most frequent occupational diseases associated with chemical exposures. Skin exposure is the major route of exposure when using plant protection products (PPPs). Therefore, skin sensitization is an important factor to be addressed during the regulatory risk assessment of PPPs. The main regulatory decision criterion considered when performing risk assessment for skin sensitizers is the dose applied. The equally important criteria "potency of the substance" is insufficiently considered by two potency categories as potency may vary up to five orders of magnitude. "Frequency of exposure" to the skin sensitizer is not considered at all. Consequently, an improved risk assessment methodology is essential to adequately assess health risks from skin sensitizers, especially for agricultural operators using PPPs. A quantitative risk assessment (QRA) approach for addressing PPPs sensitizing potential is proposed here. This QRA combines a methodology to derive a substance-specific threshold for skin sensitizers, a Derived No-Effect Level (DNEL), and an agricultural exposure model used for assessing chronic health risks of PPPs. The proposed QRA for skin sensitizing PPPs is a clear improvement over current risk assessment to ensure the safe use of skin sensitizers in an occupational context

Why people drink shampoo? Food imitating products are fooling brains and endangering consumers for marketing purposes

A Food Imitating Product (FIP) is a household cleaner or a personal care product that exhibits food attributes in order to enrich consumption experience. As revealed by many cases worldwide, such a marketing strategy led to unintentional self-poisonings and deaths. FIPs therefore constitute a very serious health and public policy issue. To understand why FIPs are a threat, we first conducted a qualitative analysis on real-life cases of household cleaners and personal care products-related phone calls at a poison control center followed by a behavioral experiment. Unintentional self-poisoning in the home following the accidental ingestion of a hygiene product by a healthy adult is very likely to result from these products being packaged like foodstuffs. Our hypothesis is that FIPs are non-verbal food metaphors that could fool the brain of consumers. We therefore conducted a subsequent functional neuroimaging (fMRI) experiment that revealed how visual processing of FIPs leads to cortical taste inferences. Considered in the grounded cognition perspective, the results of our studies reveal that healthy adults can unintentionally categorize a personal care product as something edible when a food-like package is employed to market nonedible and/or dangerous products. Our methodology combining field (qualitative) and laboratory (behavioral and functional neuroimaging) findings could be of particular relevance for policy makers, as it can help screening products prior to their market release – e.g. the way they are packaged and how they can potentially confuse the mind of consumers – and therefore save lives

Nonlinear optical properties of meso-Tetra(fluorenyl)porphyrins peripherally functionalized with one to four ruthenium alkynyl substituents

The synthesis of a series of four porphyrin derivatives based on a meso-tetrafluorenylporphyrin core functionalized with one to four trans-chlorobis(dppe)ruthenium alkynyl units (dppe = 1,2-bis(diphenylphosphino)ethane) at the periphery, together with cyclic voltammetry (CV) and UV–Vis absorption and emission spectroscopy studies, are reported. In these multipolar assemblies, the organoruthenium endgroups are potential electron-donors and the central porphyrin core is a potential electron-acceptor. The third-order nonlinear optical (NLO) responses have been assessed by Z-scan, revealing that these extended π-networks incorporating polarizable organometallic units behave as nonlinear absorbers in the near-IR range. The role of the peripheral transition metal centers on the third-order NLO properties is discussed

High-temperature piezoresistive C / SiOC sensors

Here we report on the high-temperature piezoresistivity of carbon-containing silicon oxycarbide nanocomposites (C / SiOC). Samples containing 13.5 vol% segregated carbon have been prepared from a polysilsesquioxane via thermal cross-linking, pyrolysis and subsequent hot-pressing. Their electrical resistance was assessed as a function of the mechanical load (1–10 MPa) and temperature (1000–1200 °C). The piezoresistive behavior of the C / SiOC nanocomposites relies on the presence of dispersed nanocrystalline graphite with a lateral size ≤ 2 nm and non-crystalline carbon domains, as revealed by Raman spectroscopy. In comparison to highly ordered carbon (graphene, HOPG), C / SiOC exhibits strongly enhanced k factor values, even upon operation at temperatures beyond 1000 °C. The measured k values of about 80 ± 20 at the highest temperature reading (T = 1200 °C) reveal that C / SiOC is a primary candidate for high-temperature piezoresistive sensors with high sensitivity

Phase 1 dose-escalation study of the antiplacental growth factor monoclonal antibody RO5323441 combined with bevacizumab in patients with recurrent glioblastoma

Background We conducted a phase 1 dose-escalation study of RO5323441, a novel antiplacental growth factor (PlGF) monoclonal antibody, to establish the recommended dose for use with bevacizumab and to investigate the pharmacokinetics, pharmacodynamics, safety/tolerability, and preliminary clinical efficacy of the combination. Methods Twenty-two participants with histologically confirmed glioblastoma in first relapse were treated every 2 weeks with RO5323441 (625 mg, 1250 mg, or 2500 mg) plus bevacizumab (10 mg/kg). A standard 3 + 3 dose-escalation trial design was used. Results RO5323441 combined with bevacizumab was generally well tolerated, and the maximum tolerated dose was not reached. Two participants experienced dose-limiting toxicities (grade 3 meningitis associated with spinal fluid leak [1250 mg] and grade 3 cerebral infarction [2500 mg]). Common adverse events included hypertension (14 participants, 64%), headache (12 participants, 55%), dysphonia (11 participants, 50%) and fatigue (6 participants, 27%). The pharmacokinetics of RO5323441 were linear, over-the-dose range, and bevacizumab exposure was unaffected by RO5323441 coadministration. Modulation of plasmatic angiogenic proteins, with increases in VEGFA and decreases in FLT4, was observed. Dynamic contrast-enhanced/diffusion-weighted MRI revealed large decreases in vascular parameters that were maintained through the dosing period. Combination therapy achieved an overall response rate of 22.7%, including one complete response, and median progression-free and overall survival of 3.5 and 8.5 months, respectively. Conclusion The toxicity profile of RO5323441 plus bevacizumab was acceptable and manageable. The observed clinical activity of the combination does not appear to improve on that obtained with single-agent bevacizumab in patients with recurrent glioblastom