Rage Against the Machines: How Subjects Learn to Play Against Computers

We use an experiment to explore how subjects learn to play against computers which are programmed to follow one of a number of standard learning algorithms. The learning theories are (unbeknown to subjects) a best response process, fictitious play, imitation, reinforcement learning, and a trial & error process. We test whether subjects try to influence those algorithms to their advantage in a forward-looking way (strategic teaching). We find that strategic teaching occurs frequently and that all learning algorithms are subject to exploitation with the notable exception of imitation. The experiment was conducted, both, on the internet and in the usual laboratory setting. We find some systematic differences, which however can be traced to the different incentives structures rather than the experimental environment

The transnasal approach to the skull base. From sinus surgery to skull base surgery

The indications for endonasal endoscopic approaches to diseases of the skull base and its adjacent structures have expanded considerably during the last decades. This is not only due to improved technical possibilities such as intraoperative navigation, the development of specialized instruments, and the compilation of anatomical studies from the endoscopic perspective but also related to the accumulating experience with endoscopic procedures of the skull base by multidisciplinary centers. Endoscopic endonasal operations permit new approaches to deeply seated lesions and are characterized by a reduced manipulation of neurovascular structures and brain parenchyma while at the same time providing improved visualization. They reduce the trauma caused by the approach, avoid skin incisions and minimize the surgical morbidity. Transnasal endoscopic procedures for the closure of small and large skull base defects have proven to be reliable and more successful than operations with craniotomies. The development of new local and regional vascularized flaps like the Hadad-flap have contributed to this. These reconstructive techniques are furthermore effectively utilized in tumor surgery in this region. This review delineates the classification of expanded endonasal approaches in detail. They provide access to lesions of the anterior, middle and partly also to the posterior cranial fossa. Successful management of these complex procedures requires a close interdisciplinary collaboration as well as continuous education and training of all team members

Rage Against the Machines - How Subjects Learn to Play Against Computers

We use an experiment to explore how subjects learn to play against computers which are programmed to follow one of a number of standard learning algorithms. The learning theories are (unbeknown to subjects) a best response process, fictitious play, imitation, reinforcement learning, and a trial & error process. We test whether subjects try to influence those algorithms to their advantage in a forward-looking way (strategic teaching). We find that strategic teaching occurs frequently and that all learning algorithms are subject to exploitation with the notable exception of imitation. The experiment was conducted, both, on the internet and in the usual laboratory setting. We find some systematic differences, which however can be traced to the different incentives structures rather than the experimental environment.

Can You Guess the Game You're Playing?

Recently there has been much theoretical and experimental work on learning in games. However, learning usually means "learning about the strategic behavior of opponents" rather than "learning about the game" as such. In contrast, here we report on an experiment designed to test whether players learn a) the relevant features of the payoff structure of a 2x2 game (e.g. the best reply structure) and b) whether they play according to equilibrium predictions regardless of how question a) is being answered. Question a) is being tested by asking subjects to guess the payoff structure of their opponents in a repeated encounter and rewarding subjects for correct answers.Learning, Subjective Games, Experiments

Pure Saddle Points and Symmetric Relative Payoff Games

It is well known that the rock-paper-scissors game has no pure saddle point. We show that this holds more generally: A symmetric two-player zero-sum game has a pure saddle point if and only if it is not a generalized rock-paper-scissors game. Moreover, we show that every finite symmetric quasiconcave two-player zero-sum game has a pure saddle point. Further sufficient conditions for existence are provided. We apply our theory to a rich collection of examples by noting that the class of symmetric two-player zero-sum games coincides with the class of relative payoff games associated with symmetric two-player games. This allows us to derive results on the existence of a finite population evolutionary stable strategies

Once Beaten, Never Again: Imitation in Two-Player Potential Games

We show that in symmetric two-player exact potential games, the simple decision rule "imitate-if-better" cannot be beaten by any strategy in a repeated game by more than the maximal payoff difference of the one-period game. Our results apply to many interesting games including examples like 2x2 games, Cournot duopoly, price competition, public goods games, common pool resource games, and minimum effort coordination games

Optical Coherence Tomography Guided Laser Cochleostomy: Towards the Accuracy on Tens of Micrometer Scale

Lasers have been proven to be precise tools for bone ablation. Applying no mechanical stress to the patient, they are potentially very suitable for microsurgery on fragile structures such as the inner ear. However, it remains challenging to control the laser-bone ablation without injuring embedded soft tissue. In this work, we demonstrate a closed-loop control of a short-pulsed CO2 laser to perform laser cochleostomy under the monitoring of an optical coherence tomography (OCT) system. A foresighted detection of the bone-endosteum-perilymph boundary several hundred micrometers before its exposure has been realized. Position and duration of the laser pulses are planned based on the residual bone thickness distribution. OCT itself is also used as a highly accurate tracking system for motion compensation between the target area and the optics. During ex vivo experimental evaluation on fresh porcine cochleae, the ablation process terminated automatically when the thickness of the residual tissue layer uniformly reached a predefined value. The shape of the resulting channel bottom converged to the natural curvature of the endosteal layer without injuring the critical structure. Preliminary measurements in OCT scans indicated that the mean absolute accuracy of the shape approximation was only around 20 mu m