Deep Classifier Mimicry without Data Access

Access to pre-trained models has recently emerged as a standard across numerous machine learning domains. Unfortunately, access to the original data the models were trained on may not equally be granted. This makes it tremendously challenging to fine-tune, compress models, adapt continually, or to do any other type of data-driven update. We posit that original data access may however not be required. Specifically, we propose Contrastive Abductive Knowledge Extraction (CAKE), a model-agnostic knowledge distillation procedure that mimics deep classifiers without access to the original data. To this end, CAKE generates pairs of noisy synthetic samples and diffuses them contrastively toward a model's decision boundary. We empirically corroborate CAKE's effectiveness using several benchmark datasets and various architectural choices, paving the way for broad application.Comment: 10 pages main, 4 figures, 2 tables, 2 pages appendi

A semifluorinated alkane (F4H5) as novel carrier for cyclosporine A: a promising therapeutic and prophylactic option for topical treatment of dry eye

Cyclosporine A (Cs) has been used as effective topical therapy for inflammatory dry eye disease since more than a decade. However, due to its lipophilic character, Cs is formulated as emulsions or oily solutions for topical application. This experimental study aimed to test if the use of semifluorinated alkanes (SFAs) as a preservative-free, well-tolerated non-stinging or burning vehicle maintains or even improves the benefits of Cs in the topical therapy of dry-eye disease. Desiccating stress was applied to C57BL/6 mice for 14 consecutive days to induce experimental dry-eye. Cs dissolved in SFA (perfluorobutylpentane = F4H5with 0.5% Ethanol), F4H5 with 0.5% ethanol only, 0.05% Cs (RestasisA (R)), and dexamethasone (MonodexA (R)) were applied three times daily beginning either at day 4 or day 11 of desiccating stress for up to 3 weeks after end of dry-eye induction. In comparison to other groups, Cs/F4H5 demonstrated high efficacy and earlier reduction of corneal staining. In this study, Cs/F4H5 had the ability to maintain conjunctival goblet cell density once applied on day 4. Flow cytometry analysis from cervical lymphnodes demonstrated a significantly lower CD4+ and CD8+ T-cells in the Cs/F4H5 group following 3 weeks of therapy than at baseline, but no difference in regulatory T cells from regional lymphnodes were seen. Overall, compared to a commercially available Cs formulation (RestasisA (R)) and dexamethasone, Cs/F4H5 was shown to be equally effective but with a significantly faster therapeutic response in reducing signs of dry-eye disease in an experimental mouse model

Passive Avoidance Training and Recall are Associated With Increased Glutamate Levels in the Intermediate Medial Hyperstriatum Ventrale of the Day-Old Chick

In the young chick, the intermediate medial hyperstriatum ventrale is involved in learning paradigms, including imprinting and passive avoidance learning. Biochemical changes in the intermediate medial hyperstriatum ventrale following learning include an up-regulation of amino-acid transmitter levels and receptor activity. To follow the changes of extracellular amino acid levels during passive avoidance training, we used an in vivo microdialysis technique. Probes were implanted in chicks before training the animals, either on a methyl- anthranylate-or water-coated bead. One hour later, recall was tested in both groups by presenting a similar bead. An increase of extra-cellular glutamate levels accompanied training and testing in both groups; during training, glutamate release was higher in methylanthranylate- trained than in water-trained chicks. When compared with the methylanthranylate-trained chicks during testing, the water-trained chicks showed enhanced extra-cellular glutamate levels. No other amino acid examined showed significant changes. After testing, the chicks were anesthetized and release- stimulated with an infusion of 50 mM potassium. Extra-cellular glutamate and taurine levels were significantly increased in both methylanthranylate-and water-trained chicks. The presentation of methylanthranylate as an. olfactory stimulus significantly enhanced glutamate levels, especially in methylanthranylate-trained chicks. The results suggest that such changes in extra-cellular glutamate levels in the intermediate medial hyperstriatum ventrale accompany pecking at either the water- or the methylanthranylate-bead. The taste of the aversant may be responsible for the greater increases found in methylanthranylate-trained birds

Více neznamená vždy lépe. Odpověď na článek “Kým a kde se produkuje česká politická věda”

Uvítali jsme článek “Kým a kde se produkuje česká politická věda. Personálně-institucionální analýza publikací v českých recenzovaných politologických časopisech” v Středoevropských politických studiích (číslo 2-3, ročník XI, jaro-léto 2009), protože otevírá debatu o české politologii. Ve své odpovědi Holzerovi a kol. zaprvé diskutujeme roli domácích odborných časopisů a argumentujeme, proč množství článků v nich publikovaných nemůže být použito pro měření kvality této disciplíny. Zadruhé představujeme výsledky vlastního miniprůzkumu, v němž sledujeme příspěvky v mezinárodních časopisech, abychom ukázali, že výsledek průzkumu s těmito parametry je velmi odlišný od průzkumu Holzera a kol. Zatřetí diskutujeme, jaké otázky by mohly být zodpovězeny za pomoci institucionální analýzy, kterou Holzer a kol. slibují, ale ve skutečnosti neprovádějí, a proč by opravdová institucionální analýza v české politické vědě mohla pomoci identifikovat problémy tohoto oboru

Predictive control of a smart grid: a distributed optimization algorithm with centralized performance properties

The authors recently proposed several model predictive control (MPC) approaches to manage residential level energy generation and storage, including centralized, distributed, and decentralized schemes. As expected, the distributed and decentralized schemes result in a loss of performance but are scalable and more flexible with regards to network topology. In this paper we present a distributed optimization approach which asymptotically recovers the performance of the centralized optimization problem performed in MPC at each time step. Simulations using data from an Australian electricity distribution company, Ausgrid, are provided showing the benefit of a variable step size in the algorithm and the impact of an increasing number of participating residential energy systems. Furthermore, when used in a receding horizon scheme, simulations indicate that terminating the iterative distributed optimization algorithm before convergence does not result in a significant loss of performance

A distributed optimization algorithm for the predictive control of smart grids

In this paper, we present a hierarchical, iterative distributed optimization algorithm and show that the algorithm converges to the global solution of a particular optimization problem. The motivation for the distributed optimization problem is the predictive control of a smart grid, in which the states of charge of a network of residential-scale batteries are optimally coordinated so as to minimize variability in the aggregated power supplied to/from the grid by the residential network. The distributed algorithm developed in this paper calls for communication between a central entity and an optimizing agent associated with each battery, but does not require communication between agents. The distributed algorithm is shown to achieve the performance of a large-scale centralized optimization algorithm, but with greatly reduced communication overhead and computational burden. A numerical case study using data from an Australian electricity distribution network is presented to demonstrate the performance of the distributed optimization algorithm