Improved Feature Distillation via Projector Ensemble

In knowledge distillation, previous feature distillation methods mainly focus on the design of loss functions and the selection of the distilled layers, while the effect of the feature projector between the student and the teacher remains under-explored. In this paper, we first discuss a plausible mechanism of the projector with empirical evidence and then propose a new feature distillation method based on a projector ensemble for further performance improvement. We observe that the student network benefits from a projector even if the feature dimensions of the student and the teacher are the same. Training a student backbone without a projector can be considered as a multi-task learning process, namely achieving discriminative feature extraction for classification and feature matching between the student and the teacher for distillation at the same time. We hypothesize and empirically verify that without a projector, the student network tends to overfit the teacher's feature distributions despite having different architecture and weights initialization. This leads to degradation on the quality of the student's deep features that are eventually used in classification. Adding a projector, on the other hand, disentangles the two learning tasks and helps the student network to focus better on the main feature extraction task while still being able to utilize teacher features as a guidance through the projector. Motivated by the positive effect of the projector in feature distillation, we propose an ensemble of projectors to further improve the quality of student features. Experimental results on different datasets with a series of teacher-student pairs illustrate the effectiveness of the proposed method

Defining determinism

The article puts forward a branching - style framework for the analysis of determinism and indeterminism of scientific theories, starting from the core idea that an indeterministic system is one whose present allows for more than one alternative possible future. We describe how a definition of determinism stated in terms of branching models supplements and improves current treatments of determinism of theories of physics. In these treatments, we identify three main approaches: one based on the study of (differential) equations, one based on mappings between temporal realizations, and one based on branching models. We first give an overview of these approaches and show that current orthodoxy advocates a combination of the mapping- and the equations - based approaches. After giving a detailed formal explication of a branching - based definition of determinism, we consider three concrete applications and end with a formal comparison of the branching- and the mapping-based approach. We conclude that the branching - based definition of determinism most usefully combines formal clarity, connection with an underlying philosophical notion of determinism, and relevance for the practical assessment of theories

Fooling Polarization-based Vision using Locally Controllable Polarizing Projection

Polarization is a fundamental property of light that encodes abundant information regarding surface shape, material, illumination and viewing geometry. The computer vision community has witnessed a blossom of polarization-based vision applications, such as reflection removal, shape-from-polarization, transparent object segmentation and color constancy, partially due to the emergence of single-chip mono/color polarization sensors that make polarization data acquisition easier than ever. However, is polarization-based vision vulnerable to adversarial attacks? If so, is that possible to realize these adversarial attacks in the physical world, without being perceived by human eyes? In this paper, we warn the community of the vulnerability of polarization-based vision, which can be more serious than RGB-based vision. By adapting a commercial LCD projector, we achieve locally controllable polarizing projection, which is successfully utilized to fool state-of-the-art polarization-based vision algorithms for glass segmentation and color constancy. Compared with existing physical attacks on RGB-based vision, which always suffer from the trade-off between attack efficacy and eye conceivability, the adversarial attackers based on polarizing projection are contact-free and visually imperceptible, since naked human eyes can rarely perceive the difference of viciously manipulated polarizing light and ordinary illumination. This poses unprecedented risks on polarization-based vision, both in the monochromatic and trichromatic domain, for which due attentions should be paid and counter measures be considered

HyperCell

This research believes that understanding the relationship between Interactive Architecture and the principles of biology will become a mainstream research area in future architectural design. Aiming towards achieving the goal of “making architecture as organic bodies”, almost all the current digital techniques in architectural design are executed using computational simulation: digital fabrication technologies and physical computing. Based on its’ main biological inspirations, Evolutionary Development Biology (Evo-Devo), this research intends to propose a novel bio-inspired design thinking wherein architecture should become analogs to the growing process of living organisms (Figure 6.1). Instead of being born from static optimization results most of the architecture seems content at aiming for nowadays, this research is looking towards designing dynamic architectural bodies which can adapt to the constantly changing environments and are thus seeking optimization in real-time. In other words, architecture should come “alive” as a living creature in order to actively optimize itself with respect to dynamic environmental conditions and user behavior’ requirements in real-time. Following the notion of “architecture as organic bodies”, six major topics were derived from the publication of “New Wombs: Electric Bodies and Architectural Disorders” (Palumbo, 2000). These topics are aimed at initiating critical discussions between body and space, which, are used here to re-interpret six main traits of being an interactive architecture: Dis-measurement, Uprooting, Fluidity, Visceral Nature, Virtuality, and Sensitivity. These six topics merge diverse key points from aforementioned chapters including outlining the vision of active interacting architecture, the transformation of human bodies under digital culture, the profound biological inspiration from Evo-Devo and the fundamental componential notion of swarm, which leads to the ultimate notion of embodying organic body-like interactive Bio-architecture. Dis-measurement: Acknowledging the premise of “architecture (technology) as an extension of human bodies” proposed by Marshall McLuhan (McLuhan, Understanding Media: The Extensions of Man, 1964), it is, still difficult to explicitly define the boundary of a space, especially in the context of a borderless cyberspace (the Internet). Space in such a context expands more than ever before and thus makes traditional measurements techniques unfeasible. With cyberspace, people can be virtually present in different places at the same time, thus breaking existing physical boundaries of a space. From another point of view, space as an extension of our bodies constantly adapting to environmental conditions and user demands, creates an intimate linkage between physical bodies and spatial bodies. Interaction in such instances can be seen from a micro-scale: between biological cells and intelligent architectural components to the macro-scale: between physical organic bodies and spatial bodies/architectural space. Uprooting: Apart from further extending the “Dis-measurement” idea by directly plugging into cyberspace (the Internet), “Uprooting” is also interpreted as adaptation devoid of any site/location constraints. In other words, the idea of “Uprooting” implies, generating an architecture that can adjust/modify in accordance with its existing surroundings by interactions between its smallest intelligent components like cells in a body searching for dynamic equilibrium. In this case, architecture has no particular reason to be designed as “rooted” on sites. Fluidity: With the neural system inside the body, most of the messages can be transmitted, received and sent within less than a millionth of a second. To envision architecture as an information processor, which has abilities to react to dynamic environmental conditions and user demands, efficient information protocols must be built into such an organic architectural body to create seamless exterior/interior transformations. Visceral Nature: Visceral can be interpreted in the form of an embodied organ. This implies envisioning architecture in the form of a living-entity. It is no longer the case of mimicking a natural form and thus claiming a building to be organic, but rather instigates one to look deeper into the principles of a natural form’s morphogenesis and apply these to generate a truly organic space. Through the study of Evo-Devo, several principles will be applied to generate an interactive organic Bio-architecture. It is thus not an organic looking shape that matters, but the principles behind the shape, which matter. For instance, principles of self-organization, self-assembly, and self-adaptation, providing possibilities of making body-like architectures with multi-directional and multi-modal communications both inside out and outside in. An intelligent architecture, should “live” in the environment just as how the body lives with its’ Visceral Nature. Virtuality: It is impossible to talk about physical space without mentioning virtual space nowadays. From cyberspace, augmented reality to virtual reality, “Virtuality” is related to “interaction” since the beginning and has gradually become an inevitable aspect of our daily lives. In fact, virtual space has to still use constraints from the physical world to enhance experiential aspects. The ultimate goal of virtual reality here is not to end up with a VR helmet and keep constantly being stimulated by electronic messages, but to bring the physical to the virtual and in the process, attempt to search for a dynamic balance between the virtual and real by merging them together. With the assistance of virtual reality, novel unrealistic space can still be realized into creative tangible immersive and fascinating spaces, which, earlier was not possible. Sensitivity: The notion of “architecture is an extension of human bodies”, is crucial to embrace, if we consider enhancing the sensing abilities of the space as a body not only externally but also internally. In a digital space, active sensing can be achieved by attaching specific devices. In an interactive space, like an organic body, the sensing capabilities of the space have to be fast, accurate, intuitive, and predictive. The sensing system should thus not only work externally to sense the surrounding environment but also internally in order to fulfill the users’ demands in time. With such a connection between human bodies and spatial bodies, it should become relatively understandable for the space to know the requirements of the users by means of hand gestures instead of verbal cues. The sensitivity, in this case, should rely on local information distribution as a bottom-up system rather than a top-down centralized demanding structure