Intrinsic dimension of data representations in deep neural networks

Deep neural networks progressively transform their inputs across multiple processing layers. What are the geometrical properties of the representations learned by these networks? Here we study the intrinsic dimensionality (ID) of data-representations, i.e. the minimal number of parameters needed to describe a representation. We find that, in a trained network, the ID is orders of magnitude smaller than the number of units in each layer. Across layers, the ID first increases and then progressively decreases in the final layers. Remarkably, the ID of the last hidden layer predicts classification accuracy on the test set. These results can neither be found by linear dimensionality estimates (e.g., with principal component analysis), nor in representations that had been artificially linearized. They are neither found in untrained networks, nor in networks that are trained on randomized labels. This suggests that neural networks that can generalize are those that transform the data into low-dimensional, but not necessarily flat manifolds

Prospective motor control obeys to idiosyncratic strategies in autism

Disturbance of primary prospective motor control has been proposed to contribute to faults in higher mind functions of individuals with autism spectrum disorder, but little research has been conducted to characterize prospective control strategies in autism. In the current study, we applied pattern-classification analyses to kinematic features to verify whether children with autism spectrum disorder (ASD) and typically developing (TD) children altered their initial grasp in anticipation of self- and other-actions. Results indicate that children with autism adjusted their behavior to accommodate onward actions. The way they did so, however, varied idiosyncratically from one individual to another, which suggests that previous characterizations of general lack of prospective control strategies may be overly simplistic. These findings link abnormalities in anticipatory control with increased variability and offer insights into the difficulties that individuals with ASD may experience in social interaction

The Grasping Side of Odours

Background: Research on multisensory integration during natural tasks such as reach-to-grasp is still in its infancy. Crossmodal links between vision, proprioception and audition have been identified, but how olfaction contributes to plan and control reach-to-grasp movements has not been decisively shown. We used kinematics to explicitly test the influence of olfactory stimuli on reach-to-grasp movements. Methodology/Principal Findings: Subjects were requested to reach towards and grasp a small or a large visual target (i.e., precision grip, involving the opposition of index finger and thumb for a small size target and a power grip, involving the flexion of all digits around the object for a large target) in the absence or in the presence of an odour evoking either a small or a large object that if grasped would require a precision grip and a whole hand grasp, respectively. When the type of grasp evoked by the odour did not coincide with that for the visual target, interference effects were evident on the kinematics of hand shaping and the level of synergies amongst fingers decreased. When the visual target and the object evoked by the odour required the same type of grasp, facilitation emerged and the intrinsic relations amongst individual fingers were maintained. Conclusions/Significance: This study demonstrates that olfactory information contains highly detailed information able to elicit the planning for a reach-to-grasp movement suited to interact with the evoked object. The findings offer a substantia

Validation of a low-cost virtual reality system for training street-crossing. A comparative study in healthy, neglected and non-neglected stroke individuals

Unilateral spatial neglect is a common consequence of stroke that directly affects the performance of activities of daily living. This impairment is traditionally assessed with paper-and-pencil tests that can lack correspondence to real life and are easily compensated. Virtual reality can immerse patients in more ecological scenarios, thus providing therapists with new tools to assess and train the effects of this impairment in simulated real tasks. This paper presents the clinical validation and convergent validity of a low-cost virtual reality system for training street-crossing in stroke patients with and without neglect. The performance of neglect patients was significantly worse than the performance of non-neglect and healthy participants. In addition, several correlations between the scores in the system and in the traditional scales were detected.This study was funded in part by Ministerio de Educacion y Ciencia Spain, Projects Consolider-C (SEJ2006-14301/PSIC), "CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII" and the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educacion, 2008-157).Navarro, MD.; Llorens Rodríguez, R.; Noé, E.; Ferri, J.; Alcañiz Raya, ML. (2013). Validation of a low-cost virtual reality system for training street-crossing. A comparative study in healthy, neglected and non-neglected stroke individuals. Neuropsychological Rehabilitation. 23(4):597-618. https://doi.org/10.1080/09602011.2013.806269S597618234Allegri, R. F. (2000). Atención y negligencia: bases neurológicas, evaluación y trastornos. Revista de Neurología, 30(05), 491. doi:10.33588/rn.3005.99645Appelros, P., Karlsson, G. M., Seiger, Åke, & Nydevik, I. (2002). Neglect and Anosognosia After First-Ever Stroke: Incidence and Relationship to Disability. Journal of Rehabilitation Medicine, 34(5), 215-220. doi:10.1080/165019702760279206Baheux, K., Yoshizawa, M., & Yoshida, Y. (2007). Simulating hemispatial neglect with virtual reality. Journal of NeuroEngineering and Rehabilitation, 4(1). doi:10.1186/1743-0003-4-27Boian, R. F., Burdea, G. C., Deutsch, J. E. and Winter, S. H. Street crossing using a virtual environment mobility simulator.Paper presented at 3rd Annual International Workshop on Virtual Reality. Lausanne, Switzerland.Broeren, J., Samuelsson, H., Stibrant-Sunnerhagen, K., Blomstrand, C., & Rydmark, M. (2007). Neglect assessment as an application of virtual reality. Acta Neurologica Scandinavica, 116(3), 157-163. doi:10.1111/j.1600-0404.2007.00821.xBuxbaum, L. J., Ferraro, M. K., Veramonti, T., Farne, A., Whyte, J., Ladavas, E., … Coslett, H. B. (2004). Hemispatial neglect: Subtypes, neuroanatomy, and disability. Neurology, 62(5), 749-756. doi:10.1212/01.wnl.0000113730.73031.f4Buxbaum, L. J., Palermo, M. A., Mastrogiovanni, D., Read, M. S., Rosenberg-Pitonyak, E., Rizzo, A. A., & Coslett, H. B. (2008). Assessment of spatial attention and neglect with a virtual wheelchair navigation task. Journal of Clinical and Experimental Neuropsychology, 30(6), 650-660. doi:10.1080/13803390701625821Castiello, U., Lusher, D., Burton, C., Glover, S., & Disler, P. (2004). Improving left hemispatial neglect using virtual reality. Neurology, 62(11), 1958-1962. doi:10.1212/01.wnl.0000128183.63917.02Conners, C. K., Epstein, J. N., Angold, A., & Klaric, J. (2003). Journal of Abnormal Child Psychology, 31(5), 555-562. doi:10.1023/a:1025457300409Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). «Mini-mental state». Journal of Psychiatric Research, 12(3), 189-198. doi:10.1016/0022-3956(75)90026-6Fordell, H., Bodin, K., Bucht, G., & Malm, J. (2011). A virtual reality test battery for assessment and screening of spatial neglect. Acta Neurologica Scandinavica, 123(3), 167-174. doi:10.1111/j.1600-0404.2010.01390.xGupta, V., Knott, B. A., Kodgi, S., & Lathan, C. E. (2000). Using the «VREye» System for the Assessment of Unilateral Visual Neglect: Two Case Reports. Presence: Teleoperators and Virtual Environments, 9(3), 268-286. doi:10.1162/105474600566790Hartman-Maeir, A., & Katz, N. (1995). Validity of the Behavioral Inattention Test (BIT): Relationships With Functional Tasks. American Journal of Occupational Therapy, 49(6), 507-516. doi:10.5014/ajot.49.6.507Jannink, M. J. A., Aznar, M., de Kort, A. C., van de Vis, W., Veltink, P., & van der Kooij, H. (2009). Assessment of visuospatial neglect in stroke patients using virtual reality: a pilot study. International Journal of Rehabilitation Research, 32(4), 280-286. doi:10.1097/mrr.0b013e3283013b1cJehkonen, M., Laihosalo, M., & Kettunen, J. (2006). Anosognosia after stroke: assessment, occurrence, subtypes and impact on functional outcome reviewed. Acta Neurologica Scandinavica, 114(5), 293-306. doi:10.1111/j.1600-0404.2006.00723.xKatz, N., Ring, H., Naveh, Y., Kizony, R., Feintuch, U., & Weiss, P. L. (2005). Interactive virtual environment training for safe street crossing of right hemisphere stroke patients with Unilateral Spatial Neglect. Disability and Rehabilitation, 27(20), 1235-1244. doi:10.1080/09638280500076079Kim, D. Y., Ku, J., Chang, W. H., Park, T. H., Lim, J. Y., Han, K., … Kim, S. I. (2010). Assessment of post-stroke extrapersonal neglect using a three-dimensional immersive virtual street crossing program. Acta Neurologica Scandinavica, 121(3), 171-177. doi:10.1111/j.1600-0404.2009.01194.xKim, J., Kim, K., Kim, D. Y., Chang, W. H., Park, C.-I., Ohn, S. H., … Kim, S. I. (2007). Virtual Environment Training System for Rehabilitation of Stroke Patients with Unilateral Neglect: Crossing the Virtual Street. CyberPsychology & Behavior, 10(1), 7-15. doi:10.1089/cpb.2006.9998Kim, K., Kim, J., Ku, J., Kim, D. Y., Chang, W. H., Shin, D. I., … Kim, S. I. (2004). A Virtual Reality Assessment and Training System for Unilateral Neglect. CyberPsychology & Behavior, 7(6), 742-749. doi:10.1089/cpb.2004.7.742Kim, Y. M., Chun, M. H., Yun, G. J., Song, Y. J., & Young, H. E. (2011). The Effect of Virtual Reality Training on Unilateral Spatial Neglect in Stroke Patients. Annals of Rehabilitation Medicine, 35(3), 309. doi:10.5535/arm.2011.35.3.309Krakauer, J. W. (2006). Motor learning: its relevance to stroke recovery and neurorehabilitation. Current Opinion in Neurology, 19(1), 84-90. doi:10.1097/01.wco.0000200544.29915.ccMcComas, J., MacKay, M., & Pivik, J. (2002). Effectiveness of Virtual Reality for Teaching Pedestrian Safety. CyberPsychology & Behavior, 5(3), 185-190. doi:10.1089/109493102760147150Myers, R. L., & Bierig, T. A. (2000). Virtual Reality and Left Hemineglect: A Technology for Assessment and Therapy. CyberPsychology & Behavior, 3(3), 465-468. doi:10.1089/10949310050078922Peskine, A., Rosso, C., Box, N., Galland, A., Caron, E., Rautureau, G., … Pradat-Diehl, P. (2010). Virtual reality assessment for visuospatial neglect: importance of a dynamic task. Journal of Neurology, Neurosurgery & Psychiatry, 82(12), 1407-1409. doi:10.1136/jnnp.2010.217513Romero, M., Sánchez, A., Marín, C., Navarro, M. D., Ferri, J., & Noé, E. (2012). Utilidad clínica de la versión en castellano del Mississippi Aphasia Screening Test (MASTsp): validación en pacientes con ictus. Neurología, 27(4), 216-224. doi:10.1016/j.nrl.2011.06.006Rose, F. D., Brooks, B. M., & Rizzo, A. A. (2005). Virtual Reality in Brain Damage Rehabilitation: Review. CyberPsychology & Behavior, 8(3), 241-262. doi:10.1089/cpb.2005.8.241Schwebel, D. C., & McClure, L. A. (2010). Using virtual reality to train children in safe street-crossing skills. Injury Prevention, 16(1), e1-e1. doi:10.1136/ip.2009.025288Simpson, G., Johnston, L., & Richardson, M. (2003). An investigation of road crossing in a virtual environment. Accident Analysis & Prevention, 35(5), 787-796. doi:10.1016/s0001-4575(02)00081-7Smith, J., Hebert, D., & Reid, D. (2007). Exploring the effects of virtual reality on unilateral neglect caused by stroke: Four case studies. Technology and Disability, 19(1), 29-40. doi:10.3233/tad-2007-19104Sugarman, H., Weisel-Eichler, A., Burstin, A. and Brown, R.Use of novel virtual reality system for the assessment and treatment of unilateral spatial neglect: A feasibility study. Paper presented at International Conference on Virtual Rehabilitation. Zürich.Tanaka, T., Sugihara, S., Nara, H., Ino, S., & Ifukube, T. (2005). Journal of NeuroEngineering and Rehabilitation, 2(1), 31. doi:10.1186/1743-0003-2-31Thomson, J. A., Tolmie, A. K., Foot, H. C., Whelan, K. M., Sarvary, P., & Morrison, S. (2005). Influence of Virtual Reality Training on the Roadside Crossing Judgments of Child Pedestrians. Journal of Experimental Psychology: Applied, 11(3), 175-186. doi:10.1037/1076-898x.11.3.175Weiss, P. L. (Tamar), Naveh, Y., & Katz, N. (2003). Design and testing of a virtual environment to train stroke patients with unilateral spatial neglect to cross a street safely. Occupational Therapy International, 10(1), 39-55. doi:10.1002/oti.176Witmer, B. G., & Singer, M. J. (1998). Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225-240. doi:10.1162/105474698565686Wu, H., Ashmead, D. H. and Bodenheimer, B.Using immersive virtual reality to evaluate pedestrian street crossing decisions at a roundabout. Paper presented at 6th Symposium on appied perception in Graphics and Visualization. Chania

Site directed biotinylation of filamentous phage structural proteins

Filamentous bacteriophages have been used in numerous applications for the display of antibodies and random peptide libraries. Here we describe the introduction of a 13 amino acid sequence LASIFEAQKIEWR (designated BT, which is biotinylated in vivo by E. coli) into the N termini of four of the five structural proteins of the filamentous bacteriophage fd (Proteins 3, 7, 8 and 9). The in vivo and in vitro biotinylation of the various phages were compared. The production of multifunctional phages and their application as affinity reagents are demonstrated

The cognitive neuroscience of prehension: recent developments

Prehension, the capacity to reach and grasp, is the key behavior that allows humans to change their environment. It continues to serve as a remarkable experimental test case for probing the cognitive architecture of goal-oriented action. This review focuses on recent experimental evidence that enhances or modifies how we might conceptualize the neural substrates of prehension. Emphasis is placed on studies that consider how precision grasps are selected and transformed into motor commands. Then, the mechanisms that extract action relevant information from vision and touch are considered. These include consideration of how parallel perceptual networks within parietal cortex, along with the ventral stream, are connected and share information to achieve common motor goals. On-line control of grasping action is discussed within a state estimation framework. The review ends with a consideration about how prehension fits within larger action repertoires that solve more complex goals and the possible cortical architectures needed to organize these actions

When gaze opens the channel for communication: Integrative role of IFG and MPFC

Recent advances in the field of cognitive neuroscience have revealed that direct gaze modulates activity in cortical and subcortical key regions of the 'social brain network', including the inferior frontal gyrus (IFG) and the anterior rostral medial prefrontal cortex (arMPFC). However, very little is known about how direct gaze is processed during live interaction with a real partner. Here, for the first time we used an experimental setup allowing the participant inside an MRI scanner to interact face-to-face with a partner located in the scanner room. Depending on condition, the participant and the partner were instructed either to look at each other in the eyes or to direct their gaze away from the other. As control conditions, participants gazed at their own eyes, reflected in a mirror, or gazed at a picture of the partner's eyes. Results revealed that direct gaze by the partner was associated with activity in areas involved in production and comprehension of language and action, including the IFG, the premotor cortex (PM), and the supplementary motor area (SMA). Activations in these areas were observed regardless of the participant's gaze behavior. In contrast, increased activity in arMPFC, an area involved in inference of other mental states during social interaction and communication, was only observed when the participant reciprocated the partner's direct gaze so as to establish mutual gaze. Psychophysiological interaction (PPI) analysis revealed effective connectivity between the IFG and the arMPFC during mutual gaze. This suggests that, within a larger network concerned with the processing of social gaze, mutual gaze with a real partner is established by an increased coupling between areas involved in the detection of communicative intentions, language, and social interaction. © 2015 The Authors