Deep Ranking Ensembles for Hyperparameter Optimization

Automatically optimizing the hyperparameters of Machine Learning algorithms is one of the primary open questions in AI. Existing work in Hyperparameter Optimization (HPO) trains surrogate models for approximating the response surface of hyperparameters as a regression task. In contrast, we hypothesize that the optimal strategy for training surrogates is to preserve the ranks of the performances of hyperparameter configurations as a Learning to Rank problem. As a result, we present a novel method that meta-learns neural network surrogates optimized for ranking the configurations' performances while modeling their uncertainty via ensembling. In a large-scale experimental protocol comprising 12 baselines, 16 HPO search spaces and 86 datasets/tasks, we demonstrate that our method achieves new state-of-the-art results in HPO.Comment: Published in ICLR 202

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How

With the ever-increasing number of pretrained models, machine learning practitioners are continuously faced with which pretrained model to use, and how to finetune it for a new dataset. In this paper, we propose a methodology that jointly searches for the optimal pretrained model and the hyperparameters for finetuning it. Our method transfers knowledge about the performance of many pretrained models with multiple hyperparameter configurations on a series of datasets. To this aim, we evaluated over 20k hyperparameter configurations for finetuning 24 pretrained image classification models on 87 datasets to generate a large-scale meta-dataset. We meta-learn a multi-fidelity performance predictor on the learning curves of this meta-dataset and use it for fast hyperparameter optimization on new datasets. We empirically demonstrate that our resulting approach can quickly select an accurate pretrained model for a new dataset together with its optimal hyperparameters

10Kin1day: A Bottom-Up Neuroimaging Initiative.

We organized 10Kin1day, a pop-up scientific event with the goal to bring together neuroimaging groups from around the world to jointly analyze 10,000+ existing MRI connectivity datasets during a 3-day workshop. In this report, we describe the motivation and principles of 10Kin1day, together with a public release of 8,000+ MRI connectome maps of the human brain

Confianza inversionista: inversión extranjera directa en Colombia. Sector minero-energético, seguros, comercio, restaurantes y turismo. Periodo 2002-2010

Es preciso destacar que el periodo comprendido entre 2002 y 2010 bajo el mandato del ex presidente Álvaro Uribe, consolida una serie de políticas de Estado; además de la creación y reestructuración de nuevos entes reguladores. Así mismo, muestra un ambiente y clima propicio para incentivar la Inversión Extranjera Directa (IED) y activar las locomotoras productivas del país.In President‟s Alvaro Uribe Vélez period comprehended between 2002 to 2010, the Government established the "Renewal Program for Public Administration",plus the creation and restructuring of new regulating organisms, made possible to achieve the proper environment to encourage Foreign Direct Investment and restart the engine of our country's productive locomotives

Homemade

Es el nuevo trabajo musical nacido del proyecto de extensión ALAC de la Facultad de artes ASAB.t is the new musical work born from the ALAC extension project of the ASAB Faculty of Arts

El interés público en América Latina: Reflexiones desde la educación legal clínica y el trabajo ProBono

El derecho se entiende hoy como una herramienta idónea para producir cambios sociales y atender las necesidades y desafíos modernos, lo cual era casi impensable hace algunos años. Así, las universidades han empezado a actualizar sus currículos y las formas de enseñar el derecho, implementando nuevos modelos pedagógicos que brindan a los futuros profesionales elementos necesarios para responder a las necesidades de su contexto social y del mundo entero. En este libro, profesores de América Latina y España reflexionan alrededor del trabajo ProBono, la educación legal clínica y el litigio estratégico como herramientas para la defensa del interés público y la transformación social