A Service Chain Discovery and Recommendation Scheme Using Complex Network Theory

Service chain discovery and recommendation are significant in services composition. A complex network module based algorithm using services invocable relations is proposed to search useful service chains on the network. Furthermore, a new scheme for discovering composite services processes automatically and recommending service chains by ranking their QoS is provided. Simulations are carried out and the results indicate that some useful service chains in the dataset provided by the WSC2009 can be found by the new algorithm

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks

As the size of large language models continue to scale, so does the computational resources required to run it. Spiking Neural Networks (SNNs) have emerged as an energy-efficient approach to deep learning that leverage sparse and event-driven activations to reduce the computational overhead associated with model inference. While they have become competitive with non-spiking models on many computer vision tasks, SNNs have also proven to be more challenging to train. As a result, their performance lags behind modern deep learning, and we are yet to see the effectiveness of SNNs in language generation. In this paper, inspired by the Receptance Weighted Key Value (RWKV) language model, we successfully implement `SpikeGPT', a generative language model with binary, event-driven spiking activation units. We train the proposed model on two model variants: 45M and 216M parameters. To the best of our knowledge, SpikeGPT is the largest backpropagation-trained SNN model to date, rendering it suitable for both the generation and comprehension of natural language. We achieve this by modifying the transformer block to replace multi-head self attention to reduce quadratic computational complexity O(N^2) to linear complexity O(N) with increasing sequence length. Input tokens are instead streamed in sequentially to our attention mechanism (as with typical SNNs). Our preliminary experiments show that SpikeGPT remains competitive with non-spiking models on tested benchmarks, while maintaining 20x fewer operations when processed on neuromorphic hardware that can leverage sparse, event-driven activations

Inherent Redundancy in Spiking Neural Networks

Spiking Neural Networks (SNNs) are well known as a promising energy-efficient alternative to conventional artificial neural networks. Subject to the preconceived impression that SNNs are sparse firing, the analysis and optimization of inherent redundancy in SNNs have been largely overlooked, thus the potential advantages of spike-based neuromorphic computing in accuracy and energy efficiency are interfered. In this work, we pose and focus on three key questions regarding the inherent redundancy in SNNs. We argue that the redundancy is induced by the spatio-temporal invariance of SNNs, which enhances the efficiency of parameter utilization but also invites lots of noise spikes. Further, we analyze the effect of spatio-temporal invariance on the spatio-temporal dynamics and spike firing of SNNs. Then, motivated by these analyses, we propose an Advance Spatial Attention (ASA) module to harness SNNs' redundancy, which can adaptively optimize their membrane potential distribution by a pair of individual spatial attention sub-modules. In this way, noise spike features are accurately regulated. Experimental results demonstrate that the proposed method can significantly drop the spike firing with better performance than state-of-the-art SNN baselines. Our code is available in \url{https://github.com/BICLab/ASA-SNN}.Comment: Accepted by ICCV202

Replacing fossil fuels wtih solar energy in an SME in UK and Kurdistan, Iraq: Kansas fried chicken case study

Energy management and analysis are more common in large companies since they have the resources and commitment to assign such tasks to employee compared to SMEs. Only a very small proportion of the overall business costs pertains to energy requirements and therefore SMEs pay little attention to energy analysis and management. Fossil fuels, which cause issues related to global warming, can viably be replaced with renewable energy sources such as solar energy. Trends in solar cell development are likely to yield a potential solution to problems generated by an over reliance on fossil fuels. Solar solutions are relatively simple to implement in SMEs than in large corporation and the combined impact small businesses is likely to be much greater. A micro-business has been utilized as a cases study for the purposes of illustration in the UK and Kurdistan-Iraq. Even though Kurdistan-Iraq is abundant in oil and gas, its climatic favour the implementation of solar cells which can replace the existing use of non-renewable fossil fuel. Our comparative study suggests that solar can replaced a reasonable amount of the energy needs even in the UK and a much higher amount in Kurdistan-Iraq. Using 20% efficient solar, can replace 23% and 70% of the energy requirements of the microbusiness in UK and Kurdistan-Iraq respectively