The Journey From Somewhere to Anywhere: The Interchange of Two Worldviews

This thesis discusses the worldview of conservative Somewhere People and open-minded Anywhere People put forward by David Goodhart in his book The Road to Somewhere: The New Tribes Shaping British Politics. It reveals that under the trend of globalization, Anywhere common-sense challenges the Somewhere worldview and partly replace it. Anywhere People\u27s mobility is the key to maximizing their benefits. By analyzing the living environment, educational background, and psychological activities of these two kinds of people in the first part, the thesis revealed the relatively higher social mobility helps Anywhere People better seek fortune and opportunities. The most significant difference between the two worldviews is mobility. Mobility brings not only a broader view but also more choices and a better lifestyle. In conclusion, the thesis points out that conflicts of these two worldviews could not be resolved. However, the divergence between cultures and living habits in the world is gradually diminishing. By standing on the perspective of Anywhere, people can embrace the difference and balance these two worldviews

The Journey From Somewhere To Anywhere: The Interchange Of Two Worldviews

This thesis discusses the worldview of conservative Somewhere People and open-minded Anywhere People put forward by David Goodhart in his book The Road to Somewhere: The New Tribes Shaping British Politics. It reveals that under the trend of globalization, Anywhere common-sense challenges the Somewhere worldview and partly replace it. Anywhere People\u27s mobility is the key to maximizing their benefits. By analyzing the living environment, educational background, and psychological activities of these two kinds of people in the first part, the thesis revealed the relatively higher social mobility helps Anywhere People better seek fortune and opportunities. The most significant difference between the two worldviews is mobility. Mobility brings not only a broader view but also more choices and a better lifestyle. In conclusion, the thesis points out that conflicts of these two worldviews could not be resolved. However, the divergence between cultures and living habits in the world is gradually diminishing. By standing on the perspective of Anywhere, people can embrace the difference and balance these two worldviews

Enabling Energy-Efficient Inference for Self-Attention Mechanisms in Neural Networks

The study of specialized accelerators tailored for neural networks is becoming a promising topic in recent years. Such existing neural network accelerators are usually designed for convolutional neural networks (CNNs) or recurrent neural networks have been (RNNs), however, less attention has been paid to the attention mechanisms, which is an emerging neural network primitive with the ability to identify the relations within input entities. The self-attention-oriented models such as Transformer have achieved great performance on natural language processing, computer vision and machine translation. However, the self-attention mechanism has intrinsically expensive computational workloads, which increase quadratically with the number of input entities. Therefore, in this work, we propose an software-hardware co-design solution for energy-efficient self-attention inference. A prediction-based approximate self-attention mechanism is introduced to substantially reduce the runtime as well as power consumption, and then a specialized hardware architecture is designed to further increase the speedup. The design is implemented on a Xilinx XC7Z035 FPGA, and the results show that the energy efficiency is improved by 5.7x with less than 1% accuracy loss

Skydiver: A Spiking Neural Network Accelerator Exploiting Spatio-Temporal Workload Balance

Spiking Neural Networks (SNNs) are developed as a promising alternative to Artificial Neural networks (ANNs) due to their more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatio-temporal sparsity; thus, they are useful to enable energy-efficient hardware inference. However, exploiting spatio-temporal sparsity of SNNs in hardware leads to unpredictable and unbalanced workloads, degrading the energy efficiency. In this work, we propose an FPGA-based convolutional SNN accelerator called Skydiver that exploits spatio-temporal workload balance. We propose the Approximate Proportional Relation Construction (APRC) method that can predict the relative workload channel-wisely and a Channel-Balanced Workload Schedule (CBWS) method to increase the hardware workload balance ratio to over 90%. Skydiver was implemented on a Xilinx XC7Z045 FPGA and verified on image segmentation and MNIST classification tasks. Results show improved throughput by 1.4X and 1.2X for the two tasks. Skydiver achieved 22.6 KFPS throughput, and 42.4 uJ/Image prediction energy on the classification task with 98.5% accuracy.Comment: Accepted to be published in the IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 202

Epilepsy Seizure Detection and Prediction using an Approximate Spiking Convolutional Transformer

Epilepsy is a common disease of the nervous system. Timely prediction of seizures and intervention treatment can significantly reduce the accidental injury of patients and protect the life and health of patients. This paper presents a neuromorphic Spiking Convolutional Transformer, named Spiking Conformer, to detect and predict epileptic seizure segments from scalped long-term electroencephalogram (EEG) recordings. We report evaluation results from the Spiking Conformer model using the Boston Children's Hospital-MIT (CHB-MIT) EEG dataset. By leveraging spike-based addition operations, the Spiking Conformer significantly reduces the classification computational cost compared to the non-spiking model. Additionally, we introduce an approximate spiking neuron layer to further reduce spike-triggered neuron updates by nearly 38% without sacrificing accuracy. Using raw EEG data as input, the proposed Spiking Conformer achieved an average sensitivity rate of 94.9% and a specificity rate of 99.3% for the seizure detection task, and 96.8%, 89.5% for the seizure prediction task, and needs >10x fewer operations compared to the non-spiking equivalent model.Comment: To be published at the 2024 IEEE International Symposium on Circuits and Systems (ISCAS), Singapor

3ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Network

This paper presents a sparse Change-Based Convolutional Long Short-Term Memory (CB-ConvLSTM) model for event-based eye tracking, key for next-generation wearable healthcare technology such as AR/VR headsets. We leverage the benefits of retina-inspired event cameras, namely their low-latency response and sparse output event stream, over traditional frame-based cameras. Our CB-ConvLSTM architecture efficiently extracts spatio-temporal features for pupil tracking from the event stream, outperforming conventional CNN structures. Utilizing a delta-encoded recurrent path enhancing activation sparsity, CB-ConvLSTM reduces arithmetic operations by approximately 4.7× without losing accuracy when tested on a v2e-generated event dataset of labeled pupils. This increase in efficiency makes it ideal for real-time eye tracking in resource-constrained devices. The project code and dataset are openly available at https://github.com/qinche106/cb-convlstm-eyetracking

FrameFire: Enabling Efficient Spiking Neural Network Inference for Video Segmentation

Fast video recognition is essential for real-time scenarios, e.g., autonomous driving. However, applying existing Deep Neural Networks (DNNs) to individual high-resolution images is expensive due to large model sizes. Spiking Neural Networks (SNNs) are developed as a promising alternative to DNNs due to their more realistic brain-inspired computing models. SNNs have sparse neuron firing over time, i.e., spatio-temporal sparsity; thus they are useful to enable energy-efficient computation. However, exploiting the spatio-temporal sparsity of SNNs in hardware leads to unpredictable and unbalanced workloads, degrading energy efficiency. In this work, we, therefore, propose an SNN accelerator called FrameFire for efficient video processing. We introduce a Keyframe-dominated Workload Balance Schedule (KWBS) method. It accelerates the image recognition network with sparse keyframes, then records and analyzes the current workload distribution on hardware to facilitate scheduling workloads in subsequent frames. FrameFire is implemented on a Xilinx XC7Z035 FPGA and verified by video segmentation tasks. The results show that the throughput is improved by 1.7× with the KWBS method. FrameFire achieved 1.04 KFPS throughput and 1.15 mJ/frame recognition energy