16 research outputs found
Emotion in the Common Model of Cognition
Emotions play an important role in human cognition and therefore need to be present in the Common Model of Cognition. In this paper, the emotion working group focuses on functional aspects of emotions and describes what we believe are the points of interactions with the Common Model of Cognition. The present paper should not be viewed as a consensus of the group but rather as a first attempt to extract common and divergent aspects of different models of emotions and how they relate to the Common Model of Cognition
Reinforcement learning for adaptive theory of mind in the sigma cognitive architecture
One of the most common applications of human intelligence is social interaction, where people must make effective decisions despite uncertainty about the potential behavior of others around them. Reinforcement learning (RL) provides one method for agents to acquire knowledge about such interactions. We investigate different methods of multiagent reinforcement learning within the Sigma cognitive architecture. We leverage Sigmaâs architectural mechanism for gradient descent to realize four different approaches to multiagent learning: (1) with no explicit model of the other agent, (2) with a model of the other agent as following an unknown stationary policy, (3) with prior knowledge of the other agentâs possible reward functions, and (4) through inverse reinforcement learning (IRL) of the other agentâs reward function. While the first three variations re-create existing approaches from the literature, the fourth represents a novel combination of RL and IRL for social decision-making. We show how all four styles of adaptive Theory of Mind are realized through Sigmaâs same gradient descent algorithm, and we illustrate their behavior within an abstract negotiation task
Autobiography based prediction in a situated AGI agent
Abstract. The ability to predict the unfolding of future events is an important feature of any situated AGI system. The most widely used approach is to create a model of the world, initialize it with the desired start state and use it to simulate possible future scenarios. In this paper we propose an alternative approach where there is no explicit model building involved. The agent memorizes its personal autobiography in an unprocessed narrative form. When a prediction is needed, the agent aligns story-lines from the autobiography with the current story, extends them into the future, then interprets them in the terms of the current events. We describe the implementation of this approach in the Xapagy cognitive architecture and present some experiments illustrating its operation
Characterization of neuro-humoral pathways involved in delayed gastric emptying of liquids due to mechanical right atrial stretch in awake rats.
CoordenaĂĂo de AperfeiĂoamento de Pessoal de NĂvel SuperiorA distensĂo mecĂnica do Ătrio direito (DA) aumenta a motilidade gĂstrica em ratos anestesiados (Palheta et al., 2010). Resolvemos avaliar o efeito da DA sobre o esvaziamento gĂstrico (EG) de lĂquido em ratos acordados e as eventuais vias neuro-humorais relacionadas ao fenĂmeno. Utilizamos ratos albinos machos (n=361, 250-280g) que receberam um balĂo de silicone posicionado no Ătrio direito. Decorridos 24h, monitoramos a pressĂo venosa central (PVC), freqĂĂncia cardĂaca (FC) e a pressĂo arterial mĂdia (PAM) e apĂs os 20-min iniciais os animais foram aleatoriamente prĂ-tratados com: Salina (S, 0,1 ml/100g, i.v.), Atropina (A, 0,5 mg/kg, i.v.), Guanetidina (GT, 10 mg/kg, i.p.), HexametĂnio (H, 10mg/kg, i.v.), L-NAME (3mg/kg, i.v.), L-Arg (100mg/kg, i.v.) + L-NAME (3 mg/kg, i.v.), Azul de metileno (MB, 3 mg/kg, i.v.), Glibenclamida (GB, 1 mg/kg, i.p.) ou Glibenclamida + DiazĂxido (3mg/kg, i.v.) [GB + D], Dexametasona (DEX, 1mg/kg, i.p.), Anantin (ANT, 5 g, i.v.) ou Atosibana (AT, 40  g/kg/h, i.v.). AlĂm disto, em grupos separados realizamos 72h antes da DA Ă vagotomia (V), ou esplancnotomia+ gangliectomia celĂaca (SC) ou denervaĂĂo cardĂaca aferente com capsaicina (ACD). Em outro conjunto de animais realizamos aurilectomia direita uma semana antes da DA (AX). Em seguida ao tratamento farmacolĂgico realizamos protocolo de falsa DA (controle) ou DA com 50L do balĂo intra-atrial durante 5min. Decorridos 20 min. da DA, os ratos foram alimentados por via oral com soluĂĂo teste e, apĂs 10-min sacrificados para estudo do EG. AlĂm disto, determinamos os nĂveis plasmĂticos de ocitocina (OT), PeptĂdeo NatriurĂtico Atrial (ANP) e corticosterona (CORT). Para verificaĂĂo da atividade neuronal avaliamos a expressĂo da proteĂna Fos e OT nas regiĂes hipotalĂmicas do nĂcleo paraventricular (PVN) ou supra-Ăptico (SON). Comparado ao controle, a DA diminuiu o EG (p <0,05). AlĂm disso, a DA aumentou a PVC e a FC. A DA diminuiu o EG (p<0,05) nos grupos S, A, GT, L-arginina + L-NAME, MB e GB+D. JĂ o prĂ-tratamento com H, L-NAME, GB, DEX, ANT ou AT, bem como a SV, SC, ACD ou AX preveniu o efeito do DA sobre o EG. AlĂm disso, a DA aumentou os nĂveis plasmĂticos de OT e CORT, mas nĂo alterou o de ANP. Apesar da DA aumentar o nĂmero de neurĂnios imunorreativos para c-fos nas regiĂes parvocellular medial e posterior do PVN, nĂo observamos tal achado nas regiĂes magnocellular do PVN ou do SON, tambĂm nĂo houve diferenĂa significativa para o nĂmero de neurĂnios imunorreativos para Fos-OT apĂs DA. Portanto a diminuiĂĂo do EG de lĂquidos apĂs a DA em ratos acordados depende de uma via aferente cardĂaca mediada por receptores de baixa pressĂo, sendo que tanto neurĂnios simpĂticos como parassimpĂticos participam da cascata mediada pela OT, ANP e NO atravĂs de canais para K+-ATP dependentes.Right atrium mechanical stretch (AS) increases gastric motility in anesthetized rats. We aimed to study the effect of AS on gastric emptying (GE) in awake rats and the related neuro-humoral pathways ivolved. Male albino rats (N=361, 250-280g) had a silicone balloon inserted in the right atrium. After 24-h, the central venous pressure (CVP), heart rate (HR) and the mean arterial pressure (MAP) were monitored and after the initial 20-min, animals were randomly pre-treated with: saline (S, 0.1 ml/100g, i.v.), Atropine (A, 0.5mg/kg, i.v.), Guanethidine (GT, 10mg/kg, i.p.), hexamethonium (H, 10mg/kg, i.v.), L-NAME (3mg/kg, i.v.), L-Arginine (100mg/kg, i.v.)+L-NAME (3mg/kg, i.v.), Methylene Blue (MB, 3mg/kg, i.v.), Glibenclamide (GB, 1mg/kg, i.p) or Glibenclamide+Diazoxide (3mg/kg, i.v.) [GB+D], Dexamethazone (DEX, 1mg/kg, i.p.), Anantin (ANT, 5g, i.v.) or Atosiban (AT, 40g/kg/h, i.v.). Besides, in a separate group, we realized vagotomy (V), or splanchnotomy + celiac gangliectomy (SC) or afferent cardiac denervation with capsaicin (ACD) 72h before AS. In another set of animals, we realized right appendectomy (AX) one week before AS. Next, AS with saline zero (sham) or 50L was performed during 5min. In this group, rats were gavage fed with a test meal 20-min after AS and euthanized 10-min afterwards to study GE. Moreover we determined plasmatic levels of Ocytocin (OT), Atrial Natriuretic Peptide (ANP) and Corticosterone (CORT), and determined the neuronal activity in the paraventricular (PVN) or supraoptic (SON) hypothalamic regions by measuring expressed double-labeled c-fos-OT. Comparing to Sham, AS decreased GE (p<0.05). Besides, AS increased CVP and HR. AS decreased GE (p <0.05) in S, A, GT, L-Arginine+L-NAME, MB and GB+D groups. However pre-treatment with, H, L-NAME, GB, DEX, ANT or AT, as well as SV, SC, ACD or AX prevented the effect of AS on GE. AS increased OT and CORT plasmatic levels, but did not alter ANP. In spite of AS increasing the number of c-fos expressing neurons in the parvocellular region, we did not observe this finding in the magnocellular regions of PVN or SON. Besides, AS did not alter the number of fos-OT double-labeled neurons. Therefore the decrease of GE of fluids after AS in awake rats depends on an afferent pathway mediated by cardiac low pressure receptors, and both sympathetic and parasympathetic neurons participate in the cascade mediated by OT, ANP and NO through K +-ATP dependent channels