Avoiding Wireheading with Value Reinforcement Learning

How can we design good goals for arbitrarily intelligent agents? Reinforcement learning (RL) is a natural approach. Unfortunately, RL does not work well for generally intelligent agents, as RL agents are incentivised to shortcut the reward sensor for maximum reward -- the so-called wireheading problem. In this paper we suggest an alternative to RL called value reinforcement learning (VRL). In VRL, agents use the reward signal to learn a utility function. The VRL setup allows us to remove the incentive to wirehead by placing a constraint on the agent's actions. The constraint is defined in terms of the agent's belief distributions, and does not require an explicit specification of which actions constitute wireheading.Comment: Artificial General Intelligence (AGI) 201

Does reject inference really improve the performance of application scoring models?

The voter model on Zd is a particle system that serves as a rough model for changes of opinions among social agents or, alternatively, competition between biological species occupying space. When d≥3, the set of (extremal) stationary distributions is a family of measures μα, for α between 0 and 1. A configuration sampled from μα is a strongly correlated field of 0's and 1's on Zd in which the density of 1's is α. We consider such a configuration as a site percolation model on Zd. We prove that if d≥5, the probability of existence of an infinite percolation cluster of 1's exhibits a phase transition in α. If the voter model is allowed to have sufficiently spread-out interactions, we prove the same result for d≥3

Critical reading of a text through its electronic supplement

A by-product of new social media platforms is an abundant textual record of engagements – billions of words across the world-wide-web in, for example, discussion forums, blogs and wiki discussion tabs. Many of these engagements consist of commentary on a particular text and can thus be regarded as supplements to these texts. The larger purpose of this article is to flag the utility value of this electronic supplementarity for critical reading by highlighting how it can reveal particular meanings that the text being responded to can reasonably be said to marginalise and / or repress. Given the potentially very large size of social media textual product, knowing how to explore these supplements with electronic text analysis software is essential. To illustrate the above, I focus on how the content of online discussion forums, explored through electronic text analysis software, can be used to assist critical reading of the texts which initiate them. The paper takes its theoretical orientations from the textual intervention work of Rob Pope together with themes in the work of the philosopher, Jacques Derrida

TONI BLANK: A CASE STUDY OF THE LANGUAGE OF A SCHIZOPHRENE

Schizophrenia is one of the chronic mental disorders. Patients of schizophrenia cannot communicate with others properly. Also, they cannot produce good utterances syntactically and semantically. This is caused by their language dysfunction. In this research, I am interested in analyzing language dysfunction in schizophrenia. I choose Toni Blank‟s utterances in “Toni Blank Show Session One” as the object of my research. I focus on how schizophrenic‟s language dysfunctions are classified and how these dysfunctions are being analyzed using linguistic framework. To analyze the data, I used Thought, Language, and Communication (TLC) scale and cohesion coherence frameworks. The purpose of this study is to give linguistic analysis about phenomena of language dysfunctions uttered by Toni Blank in “Toni Blank Show Session One”. The data used in this research are utterances which contain language dysfunctions from three episodes in “Toni Blank Show Session One”, entitled “Valentine Day”, “Teroris”, and “Sehat Ala Mas Toni”. I used purposive sampling to collect the data. In analyzing the data, I used Padan and Agih methods by Sudaryanto (1993). To interpret the data, I used cohesion and coherence framework. In 26 utterances which contain schizophrenic‟s language dysfunctions in “Toni Blank Show Session One”, I find that the language dysfunctions which are uttered by Toni are poverty of content, tangentiality, loss of goal, circumstantiality, illogicality, incoherence (word salad), neologism, clanging, echolalia, and self-reference. Poverty of speech, pressure of speech, distractibility, derailment, stilted speech, perseveration, and blocking are not found in the data. Keywords: schizophrenia, language dysfunction, Toni Blan

Review of the law relating to self-defence: issues paper

This issues paper examines possible changes to the law of self-defence in Tasmania, and invites submissions from the public. Background In September 2011, the Director of Public Prosecutions wrote to the Attorney-General to raise concerns that the current Tasmanian law on self-defence, as contained in s 46 of the Criminal Code (Tas), was too lenient and was out of step with modern standards. In November 2012, the Attorney- General requested that the Tasmania Law Reform Institute conduct a far-reaching examination of the law in Tasmania relating to self-defence and provide advice as to whether the law should be amended. In relation to self-defence, this Issues Paper considers whether the current law of self-defence in Tasmania should be retained or whether any amendments should be made to the existing law. It considers the circumstances in which a person is lawfully entitled to use force (including lethal force) in defence of themselves or another person. In cases where the accused’s perception of the situation corresponds with the actual situation, this may appear a relatively intuitive and straightforward assessment. However, greater difficulties arise when there is a difference between the actual circumstances and the circumstances as the accused saw them. There is scope for considerable debate about the extent to which a person can rely on a mistaken belief for the purposes of self-defence, and whether the reason for the mistake has a role to play in making this assessment. This is the particular concern addressed in this Paper. It considers whether a person should be able to rely on: a mistake that results from a delusion arising from a mental illness; a mistake that was a result of psychological factors personal to the accused that meant that they were more sensitive to threats of danger than the normal person; or a mistake that arises from self-induced intoxication. The Paper also considers whether it is desirable to ensure consistency between the defence of selfdefence and other defences such as prevention of certain crimes and defence of dwelling-house. To this end, it examines issues that arise in relation to defence of property, and the special status the home enjoys as a place of sanctuary. It considers whether the defences of prevention of crime in s 39 and defence of dwelling-house in s 40 of the Criminal Code might more appropriately be dealt with in a consolidated defence provision or whether the defences involve unique considerations that warrant a stand-alone provision.   Submissions are invited from the public, find out more about making a submission here

Slashdot, open news and informated media: exploring the intersection of imagined futures and web publishing technology

"In this essay, my interest is in how imagined media futures are implicated in the work of producing novel web publishing technology. I explore the issue through an account of the emergence of Slashdot, the tech news and discussion site that by 1999 had implemented a number of recommendation features now associated with social media and web 2.0 platforms. Specifically, I aim to understand the connection between the development of Slashdot’s influential content-management system (CMS) - an elaborate publishing infrastructure called “Slash” that allowed editors to choose reader submissions for publication and automatically distributed the work of moderating the comments sections among trusted users - and two distinct visions of a web-enabled transformation of media production.