Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models

Transfer learning aims to leverage knowledge from pre-trained models to benefit the target task. Prior transfer learning work mainly transfers from a single model. However, with the emergence of deep models pre-trained from different resources, model hubs consisting of diverse models with various architectures, pre-trained datasets and learning paradigms are available. Directly applying single-model transfer learning methods to each model wastes the abundant knowledge of the model hub and suffers from high computational cost. In this paper, we propose a Hub-Pathway framework to enable knowledge transfer from a model hub. The framework generates data-dependent pathway weights, based on which we assign the pathway routes at the input level to decide which pre-trained models are activated and passed through, and then set the pathway aggregation at the output level to aggregate the knowledge from different models to make predictions. The proposed framework can be trained end-to-end with the target task-specific loss, where it learns to explore better pathway configurations and exploit the knowledge in pre-trained models for each target datum. We utilize a noisy pathway generator and design an exploration loss to further explore different pathways throughout the model hub. To fully exploit the knowledge in pre-trained models, each model is further trained by specific data that activate it, which ensures its performance and enhances knowledge transfer. Experiment results on computer vision and reinforcement learning tasks demonstrate that the proposed Hub-Pathway framework achieves the state-of-the-art performance for model hub transfer learning.Comment: Accepted by NeurIPS 202

Accelerating Reinforcement Learning with Prioritized Experience Replay for Maze Game

In this paper we implemented two ways of improving the performance of reinforcement learning algorithms. We proposed a new equation to prioritize transition samples to improve model accuracy, and by deploying a generalized solver of randomly-generated two-dimensional mazes on a distributed computing platform, our dual-network model is available to others for further research and development. Reinforcement Learning is concerned with identifying the optimal sequence of actions for an agent to take in order to reach an objective to achieve the highest score in the future. Complex situations can lead to computational challenges in terms of both finding the best answer and the training time required to do so. Our prioritization algorithm increased model accuracy by 7% versus a baseline model with no prioritization, and using five workers on the RAY platform using RLlib achieved a 4.5X acceleration in training time versus using one worker

Tribeless

Looking into the role of craft a vessel for cultural creation. Specifically focus on tattooing and printmaking as methods

Nevronale mekanismer for fryktatferd hos fisk

Fear, or threat-sensitive behaviour, is an emotionally guided response allowing animals to minimize exposure to potential danger. Stress is a set of physiological/behavioural responses to such exposure. Among other functions, stress responses prompt learning, and as a result, similar circumstances are later recognised and avoided (feared). In parallel with higher vertebrates, fish show a strong and consistent individual variation in behaviour exhibiting two primary types of personalities: proactive and reactive response patterns. The aim of this thesis is to study the neural basis of threat-sensitive behaviour in teleost fish, by focusing on brain monoaminergic activity and individual differences in threat-sensitive behaviour. Results indicate that fish with contrasting stress coping styles show clear differences in behavioural output when exposed to a fearful situation, with reactive individuals displaying a more fearful behaviour. Proactive individuals appear to respond less to changes in the environment; suggesting that their behaviour is to a larger degree guided by previously learned routines rather than environmental cues. When exposed to fear and/or stress-inducing stimuli, experimental fish showed regionally discrete changes in limbic monoamine neurotransmission, supporting the view that homologues to the mammalian hippocampus and amygdala control individual differences in behaviour and stimulus perception even in non-mammalian vertebrates.Frykt og fryktatferd er emosjonelt styrte responser, utviklet gjennom evolusjon hos dyr og mennesker for å unngå farer i omgivelsene. Fysiologiske og atferdsmessige stressresponser, eller stressmestestringsstrategier, er tett koblet til frykt, og disse responsene kan gjensidig forsterke hverandre. Opplevelse av akutt stress og frykt leder blant annet til en ekstraordinær innlæring av hendelsesforløpet, noe som fører til at tilsvarende omstendigheter senere gjennkjennes og unngås (fryktes). I likhet med hos pattedyr og mennesker vil en hos fisk og andre modelldyr gjenkjenne to grunnleggende forskjellige stressmestringsstrategier i slike situasjoner, proaktive (preget av aktiv respons) og reaktive (preget av passiv unngåelse). Denne avhandlingen har undersøkt underliggende nevrobiologiske mekanismer bak individuell variasjon i fryktatferd hos fisk, med fokus på de monoaminerge signalsystemene serotonin, dopamin og noradrenalin. Det ble observert at fisk med ulik stressmestringsstrategier også hadde ulik fryktatferd, der reaktive individer var mer fryktsomme. En proaktiv mestringsstrategi innebærer altså at individet reagerer mindre på endringer i miljøet, og opprettholder innlærte rutiner i større grad. Mikroddisseksjon av spesifikke områder i hjernen som antas tilsvare pattedyrenes limbiske system (inkludert hippocampus og amygdala), viste at ulikheter i disse hjernefunksjonene kan forklare utviklingen av ulike personlighetstyper også hos fisk

The Cardozo Memory Project: 9/11

To commemorate the 20th anniversary of September 11, we wanted to get an idea of what it was like at Cardozo Law on that particular day and the days and weeks that followed. Within this publication are the responses we received from our call for memories. There are 22 contributors. These contributors include members of the Classes of 2002, 2003, and 2004. There are faculty and staff members, some who were working at Cardozo at the time, and some who were employed elsewhere. These contributions have been very lightly edited for length and clarity and broken up to provide a narrative structure. In addition to the memories, we have a conversation between Dean Melanie Leslie and Professor Stew Sterk, who was Interim Dean on September 11, where they discuss what it is like to lead a law school during extraordinary times. Finally, to complete this memory capsule, we are including excerpts from the Spring 2002 issue of Cardozo Life. The first article includes the remarks from the memorial service for two members of the Cardozo community we lost that day: Barbara Bracher Olson ’89 and Andrew Zucker ’99. The second article highlights the ways Cardozo alumni helped during September 11 and the days, weeks, and months that followed. Thank you to our contributors: Enrique Elliot Adler, Class of 2002 Daniel Biene, Class of 2002 Lester Brickman, Professor of Law (Emeritus) Benjamin Charkow, Class of 2003 Waleed Diab, Class of 2004 Gary J. Galperin, Adjunct Professor of Law Jocelyn Getgen Kestenbaum, Clinical Associate Professor of Law; Director, Benjamin B. Ferencz Human Rights and Atrocity Prevention Clinic; Faculty Director, Cardozo Law Institute in Holocaust and Human Rights Jennifer Golden, Director, Office of International Services, Yeshiva University Peter Goodrich, Professor of Law; Director, Program in Law and Humanities Julie Interdonato, Adjunct Professor of Law Sarah Jones, Class of 2002 Randi (Szalavetz) Katz, Class of 2002 Barbara Kolsun, Professor of Practice; Director, Fashion, Arts, Media & Entertainment (FAME) Law Center; Class of 1982 Burton N. Lipshie, Professor of Practice and Director of Advocacy Skills Training Lela Love, Professor of Law; Director, Kukin Program for Conflict Resolution; Director, Cardozo Mediation Clinic Matthew Maron, Class of 2004 Rockwell Reid, Class of 2004 Gabor Rona, Professor of Practice David Rudenstine, Sheldon H. Solow Professor of Law Robbi Smith, Director of Externships & Field Clinics Sherri L. Toub, Class of 2003 Edward Zelinsky, Morris and Annie Trachman Professor of Lawhttps://larc.cardozo.yu.edu/cardozo-memory-project/1000/thumbnail.jp