Exponential penalty function control of loss networks

We introduce penalty-function-based admission control policies to approximately maximize the expected reward rate in a loss network. These control policies are easy to implement and perform well both in the transient period as well as in steady state. A major advantage of the penalty approach is that it avoids solving the associated dynamic program. However, a disadvantage of this approach is that it requires the capacity requested by individual requests to be sufficiently small compared to total available capacity. We first solve a related deterministic linear program (LP) and then translate an optimal solution of the LP into an admission control policy for the loss network via an exponential penalty function. We show that the penalty policy is a target-tracking policy--it performs well because the optimal solution of the LP is a good target. We demonstrate that the penalty approach can be extended to track arbitrarily defined target sets. Results from preliminary simulation studies are included.Comment: Published at http://dx.doi.org/10.1214/105051604000000936 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org

Simulation and analysis of adaptive routing and flow control in wide area communication networks

This thesis presents the development of new simulation and analytic models for the performance analysis of wide area communication networks. The models are used to analyse adaptive routing and flow control in fully connected circuit switched and sparsely connected packet switched networks. In particular the performance of routing algorithms derived from the L(_R-I) linear learning automata model are assessed for both types of network. A novel architecture using the INMOS Transputer is constructed for simulation of both circuit and packet switched networks in a loosely coupled multi- microprocessor environment. The network topology is mapped onto an identically configured array of processing centres to overcome the processing bottleneck of conventional Von Neumann architecture machines. Previous analytic work in circuit switched work is extended to include both asymmetrical networks and adaptive routing policies. In the analysis of packet switched networks analytic models of adaptive routing and flow control are integrated to produce a powerful, integrated environment for performance analysis The work concludes that routing algorithms based on linear learning automata have significant potential in both fully connected circuit switched networks and sparsely connected packet switched networks

Dynamic routing in circuit-switched non-hierarchical networks

This thesis studies dynamic routing in circuit-switched non-hierarchical networks based on learning automata algorithms. The application of a mathematical model for a linear reward penalty algorithm is explained. Theoretical results for this scheme verified by simulations shows the accuracy of the model. Using simulation and analysis, learning automata algorithms are compared to several other strategies on different networks. The implemented test networks may be classified into two groups. The first group are designed for fixed routing and in such networks fixed routing performs better than any dynamic routing scheme. It will be shown that dynamic routing strategies perform as well as fixed routing when trunk reservation is employed. The second group of networks are designed for dynamic routing and trunk reservation deteriorates the performance. Comparison of different routing algorithms on small networks designed to force dynamic routing demonstrates the superiority of automata under both normal and failure conditions. The thesis also considers the instability problem in non-hierarchical circuit-switched networks when dynamic routing is implemented. It is shown that trunk reservation prevents instability and increases the carried load at overloads. Finally a set of experiments are performed on large networks with realistic capacity and traffic matrices. Simulation and analytic results show that dynamic routing outperforms fixed routing and trunk reservation deteriorates the performance at low values of overload. At high overloads, optimization of trunk reservation is necessary for this class of networks. Comparison results show the improved performance with automata schemes under both normal and abnormal traffic conditions. The thesis concludes with a discussion of proposed further work including expected developments in Integrated Service Digital Networks

Optimal admission policies for small star networks

In this thesis admission stationary policies for small Symmetric Star telecommunication networks in which there are two types of calls requesting access are considered. Arrivals form independent Poisson streams on each route. We consider the routing to be fixed. The holding times of the calls are exponentially distributed periods of time. Rewards are earned for carrying calls and future returns are discounted at a fixed rate. The operation of the network is viewed as a Markov Decision Process and we solve the optimality equation for this network model numerically for a range of small examples by using the policy improvement algorithm of Dynamic Programming. The optimal policies we study involve acceptance or rejection of traffic requests in order to maximise the Total Expected Discounted Reward. Our Star networks are in some respect the simplest networks more complex than single links in isolation but even so only very small examples can be treated numerically. From those examples we find evidence that suggests that despite their complexity, optimal policies have some interesting properties. Admission Price policies are also investigated in this thesis. These policies are not optimal but they are believed to be asymptotically optimal for large networks. In this thesis we investigate if such policies are any good for small networks; we suggest that they are. A reduced state-space model is also considered in which a call on a 2-link route, once accepted, is split into two independent calls on the links involved. This greatly reduces the size of the state-space. We present properties of the optimal policies and the Admission Price policies and conclude that they are very good for the examples considered. Finally we look at Asymmetric Star networks with different number of circuits per link and different exponential holding times. Properties of the optimal policies as well as Admission Price policies are investigated for such networks

Some aspects of traffic control and performance evaluation of ATM networks

The emerging high-speed Asynchronous Transfer Mode (ATM) networks are expected to integrate through statistical multiplexing large numbers of traffic sources having a broad range of statistical characteristics and different Quality of Service (QOS) requirements. To achieve high utilisation of network resources while maintaining the QOS, efficient traffic management strategies have to be developed. This thesis considers the problem of traffic control for ATM networks. The thesis studies the application of neural networks to various ATM traffic control issues such as feedback congestion control, traffic characterization, bandwidth estimation, and Call Admission Control (CAC). A novel adaptive congestion control approach based on a neural network that uses reinforcement learning is developed. It is shown that the neural controller is very effective in providing general QOS control. A Finite Impulse Response (FIR) neural network is proposed to adaptively predict the traffic arrival process by learning the relationship between the past and future traffic variations. On the basis of this prediction, a feedback flow control scheme at input access nodes of the network is presented. Simulation results demonstrate significant performance improvement over conventional control mechanisms. In addition, an accurate yet computationally efficient approach to effective bandwidth estimation for multiplexed connections is investigated. In this method, a feed forward neural network is employed to model the nonlinear relationship between the effective bandwidth and the traffic situations and a QOS measure. Applications of this approach to admission control, bandwidth allocation and dynamic routing are also discussed. A detailed investigation has indicated that CAC schemes based on effective bandwidth approximation can be very conservative and prevent optimal use of network resources. A modified effective bandwidth CAC approach is therefore proposed to overcome the drawback of conventional methods. Considering statistical multiplexing between traffic sources, we directly calculate the effective bandwidth of the aggregate traffic which is modelled by a two-state Markov modulated Poisson process via matching four important statistics. We use the theory of large deviations to provide a unified description of effective bandwidths for various traffic sources and the associated ATM multiplexer queueing performance approximations, illustrating their strengths and limitations. In addition, a more accurate estimation method for ATM QOS parameters based on the Bahadur-Rao theorem is proposed, which is a refinement of the original effective bandwidth approximation and can lead to higher link utilisation

Modelling adaptive routing in Wide Area Networks

Bibliography: leaves 132-138.This study investigates the modelling of adative routing algorithms with specific reference to the algorithm of an existing Wide Area Network (WAN). Packets in the network are routed at each node on the basis of routing tables which contain internal and external delays for each route from the node. The internal delay on a route represents the time that packets queued for transmission will have to wait before being transmitted, while the external delay on a route represents the delay to other nodes via that route. Several modelling methods are investigated and compared for the purpose of identifying the most appropriate and applicable technique. A model of routing in the WAN using an analytic technique is described. The hypothesis of this study is that dynamic routing can be modelled as a sequence of models exhibiting fixed routing. The modelling rationale is that a series of analytic models is run and solved. The routing algorithm of the WAN studied is such that, if viewed at any time instant, the network is one with static routing and no buffer overflow. This characteristic, together with a real time modelling requirement, influences the modelling technique which is applied. Each model represents a routing update interval and a multiclass open queueing network is used to solve the model during a particular interval. Descriptions of the design and implementation of X wan, an X Window based modelling system, are provided. A feature of the modelling system is that it provides a Graphical User Interface (GUI), allowing interactive network specification and the direct observation of network routing through the medium of this interface. Various applications of the modelling system are presented, and overall network behaviour is examined. Experimentation with the routing algorithm is conducted, and (tentative) recommendations are made on ways in which network performance could be improved. A different routing algorithm is also implemented, for the purpose of comparison and to demonstrate the ease with which this can be affected

Survey of Routing Algorithms for Computer Networks

This thesis gives a general discussion of routing for computer networks, followed by an overview of a number of typical routing algorithms used or reported in the past few years. Attention is mainly focused on distributed adaptive routing algorithms for packet switching (or message switching) networks. Algorithms for major commercial networks (or network architectures) are reviewed as well, for the convenience of comparison

Adaptive control of communication networks using learning automata.

This research investigates communications network routing procedures, based on distributed learning automata concepts for circuit and packet switched networks. For this application, the learning automaton is shown to be an ideal adaptive control mechanism, with simple feedback and updating strategies which allow extremely practical implementations and perform very close to the desired optimum. In this thesis, the nature of learning automata routing schemes are explored by analytical and computer simulation techniques, primarily developing an elementary understanding of the automata routing and adaption process. Using simple circuit and message switched networks the conditions for minimum blocking probability and average delay are established and compared with the equilibrium behaviour of learning automata operating under alternative reinforcement algorithms. Later, large scale simulations of real networks are used to demonstrate and relate the learning automata scheme to existing routing techniques. These experiments, which are performed on sophisticated simulation packages produced for this study, take as examples hierarchical and general structured telephone networks and packet switched communications networks configured with both virtual call and datagram protocols. In addition, studies under failure mode conditions, including link, node and focussed overloads, conclusively demonstrate the superior performance afforded by the learning automata routing approach

Dynamics in the European Air Transport Network, 2003-9 : an explanatory framework drawing on stochastic actor-based modeling

In this paper, we outline and test an explanatory framework drawing on stochastic actor-based modeling to understand changes in the outline of European air transport networks between 2003 and 2009. Stochastic actor-based models show their capabilities to estimate and test the effect of exogenous and endogenous drivers on network changes in this application to the air transport network. Our results reveal that endogenous structural effects, such as transitivity triads, indirect relations and betweenness effects impact the development of the European air transport network in the period under investigation. In addition, exogenous nodal and dyadic covariates also play a role, with above all the enlargement of the European Common Aviation Area having benefitted its new members to open more air routes between them. The emergence of major low-cost airline-focused airports also significantly contributed to these changes. We conclude by outlining some avenues for further research

Traffic flow reconstruction by solving indeterminacy on traffic distribution at junctions

Abstract The knowledge of the real time traffic flow status in each segment of a whole road network in a city or area is becoming fundamental for a large number of smart services such as: routing, planning, dynamic tuning services, healthy walk, etc. Rescue teams, police department, and ambulances need to know with high precision the status of the network in real time. On the other hand, the costs to obtain this information either with direct measures meant to add instruments on the whole network or acquiring data from international providers such as Google, TomTom, etc. is very high. The traditional modeling and computing approaches are not satisfactory since they are based on many assumptions that typically are doomed to change over time, as it occurs with traffic distribution at junctions; in short they cannot cover the whole network with the needed precision. In this paper, the above problem has been addressed providing a solution granting any traffic flow reconstruction with high precision and solving the indeterminacy of traffic distribution at junctions for large networks. The identified solution can be classified as a stochastic relaxation technique and resulted affordable on a parallel architecture based on GPU. The result has been obtained in the framework of the Sii-Mobility national project on smart city transport systems in Italy, a very large research project, and it is at present exploited in a number of cities/regions across Europe and by a number of research projects (Snap4City, TRAFAIR) of the European Commission