A Q-Learning Based Slice Admission Algorithm for Multi-Tier 5G Cellular Wireless Networks

Network slicing enables a 5G infrastructure provider (network infrastructure owner) to create multiple separate virtual networks, each tailored at a specific performance requirement, on a common physical network.  In this context, slice admission algorithms are required to process slice requests received by the infrastructure provider.  These algorithms are tailored to admit and allocate resources to network slices in a manner that results in the optimization of a given objective.  In this paper, a Q-learning slice admission algorithm, which maximizes the infrastructure provider’s revenue, is designed.  Results show that the designed algorithm learns from its environment, which enables it to acquire knowledge about the multi-tiered cellular network, thus allowing it make optimal slice admission decisions.  The results further show that the designed algorithm has superior performance in terms of revenue achieved when compared to algorithms that admit, a) to maximize immediate rewards and b) slices in a random manner.&nbsp

A Deep Reinforcement Learning Approach to Queue Management and Revenue Maximization in Multi-Tier 5G Wireless Networks

It is envisioned that 5G systems will increasingly leverage on the network slicing concept to meet the demand of diverse services, each tailored for specific user requirements.  In this context, slice admission algorithms that admit slices to the system, that optimize a given objective while ensuring the efficient allocation of resources, are required.  Reinforcement learning has been used successfully to implement optimal slice admission policies.  But as the 5G wireless network becomes more extensive and intricate, the state and action spaces become large.  The efficiency and convergence of reinforcement learning slice admission algorithms is negatively impacted in such a scenario.  To improve on this, deep reinforcement learning, a combination of reinforcement learning and deep learning, has been adopted.  In this paper, a Deep Q-Learning slice admission algorithm is designed; to this end a utility, was developed.  Results show that using the utility as a maximization objective enabled the designed algorithm to (i) optimize the infrastructure provider’s revenue while (ii) providing queue management, in terms of queue length and queue delay

Comparative Field Evaluation of Combinations of Long-Lasting Insecticide Treated Nets and Indoor Residual Spraying, Relative to Either Method Alone, for Malaria Prevention in an Area where the main Vector is Anopheles Arabiensis.

Long-lasting insecticidal nets (LLINs) and indoor residual spraying (IRS) are commonly used together in the same households to improve malaria control despite inconsistent evidence on whether such combinations actually offer better protection than nets alone or IRS alone. Comparative tests were conducted using experimental huts fitted with LLINs, untreated nets, IRS plus untreated nets, or combinations of LLINs and IRS, in an area where Anopheles arabiensis is the predominant malaria vector species. Three LLIN types, Olyset®, PermaNet 2.0® and Icon Life® nets and three IRS treatments, pirimiphos-methyl, DDT, and lambda cyhalothrin, were used singly or in combinations. We compared, number of mosquitoes entering huts, proportion and number killed, proportions prevented from blood-feeding, time when mosquitoes exited the huts, and proportions caught exiting. The tests were done for four months in dry season and another six months in wet season, each time using new intact nets. All the net types, used with or without IRS, prevented >99% of indoor mosquito bites. Adding PermaNet 2.0® and Icon Life®, but not Olyset® nets into huts with any IRS increased mortality of malaria vectors relative to IRS alone. However, of all IRS treatments, only pirimiphos-methyl significantly increased vector mortality relative to LLINs alone, though this increase was modest. Overall, median mortality of An. arabiensis caught in huts with any of the treatments did not exceed 29%. No treatment reduced entry of the vectors into huts, except for marginal reductions due to PermaNet 2.0® nets and DDT. More than 95% of all mosquitoes were caught in exit traps rather than inside huts. Where the main malaria vector is An. arabiensis, adding IRS into houses with intact pyrethroid LLINs does not enhance house-hold level protection except where the IRS employs non-pyrethroid insecticides such as pirimiphos-methyl, which can confer modest enhancements. In contrast, adding intact bednets onto IRS enhances protection by preventing mosquito blood-feeding (even if the nets are non-insecticidal) and by slightly increasing mosquito mortality (in case of LLINs). The primary mode of action of intact LLINs against An. arabiensis is clearly bite prevention rather than insecticidal activity. Therefore, where resources are limited, priority should be to ensure that everyone at risk consistently uses LLINs and that the nets are regularly replaced before being excessively torn. Measures that maximize bite prevention (e.g. proper net sizes to effectively cover sleeping spaces, stronger net fibres that resist tears and burns and net use practices that preserve net longevity), should be emphasized

Taxis assays measure directional movement of mosquitoes to olfactory cues.

BACKGROUND: Malaria control methods targeting indoor-biting mosquitoes have limited impact on vectors that feed and rest outdoors. Exploiting mosquito olfactory behaviour to reduce blood-feeding outdoors might be a sustainable approach to complement existing control strategies. Methodologies that can objectively quantify responses to odour under realistic field conditions and allow high-throughput screening of many compounds are required for development of effective odour-based control strategies. METHODS: The olfactory responses of laboratory-reared Anopheles gambiae in a semi-field tunnel and A. arabiensis females in an outdoor field setting to three stimuli, namely whole human odour, a synthetic blend of carboxylic acids plus carbon dioxide and CO(2) alone at four distances up to 100 metres were measured in two experiments using three-chambered taxis boxes that allow mosquito responses to natural or experimentally-introduced odour cues to be quantified. RESULTS: Taxis box assays could detect both activation of flight and directional mosquito movement. Significantly more (6-18%) A. arabiensis mosquitoes were attracted to natural human odour in the field up to 30 metres compared to controls, and blended synthetic human odours attracted 20% more A. gambiae in the semi-field tunnel up to 70 metres. Whereas CO(2) elicited no response in A. arabiensis in the open field, it was attractive to A. gambiae up to 50 metres (65% attraction compared to 36% in controls). CONCLUSIONS: We have developed a simple reproducible system to allow for the comparison of compounds that are active over medium- to long-ranges in semi-field or full-field environments. Knowing the natural range of attraction of anopheline mosquitoes to potential blood sources has substantial implications for the design of malaria control strategies, and adds to the understanding of olfactory behaviour in mosquitoes. This experimental strategy could also be extended from malaria vectors to other motile arthropods of medical, veterinary and agricultural significance

Attitudes and perceptions towards novel objective measures of ARV-based vaginal ring use: Results from a global stakeholder survey

<div><p>Results of recent microbicide and pre-exposure prophylaxis clinical trials have shown adherence to be a significant challenge with new HIV prevention technologies. As the vaginal ring containing dapivirine moves into two open label follow-on studies (HOPE/MTN-025 and DREAM) and other antiretroviral-based and multi-purpose prevention technology ring products advance through the development pipeline, there is a need for more accurate and reliable measures of adherence to microbicide ring products. We previously conducted a comprehensive landscape analysis to identify new technologies that could be applied to adherence measurement of vaginal rings containing antiretrovirals. To explore attitudes and perceptions towards the approaches that we identified, we conducted a survey of stakeholders with experience and expertise in microbicide and HIV prevention clinical trials. From May to July 2015 an electronic survey was distributed via email to 894 stakeholders; a total of 206 eligible individuals responded to at least one question and were included in the data analysis. Survey respondents were presented with various objective measures and asked about their perceived acceptability to trial participants, feasibility of implementation by study staff, usefulness for measuring adherence and ethical concerns. Methods that require no additional input from the participant and require no modifications to the existing ring product (i.e., measurement of residual drug or excipient, or a vaginal analyte that enters the ring) were viewed as being more acceptable to trial participants and more feasible to implement in the field. Respondents saw value in using objective measures to provide real-time feedback on adherence. However, approaches that involve unannounced home visits for sample collection or spot checks of ring use, which could provide significant value to adherence feedback efforts, were met with skepticism. Additional research on the acceptability of these methods to potential trial participants and trial staff is recommended.</p></div

Respondent characteristics.

<p>Respondent characteristics.</p

Measures identified as being less prone to being tricked or outsmarted (n = 126).

<p>Measures identified as being less prone to being tricked or outsmarted (n = 126).</p

Respondents’ views on acceptability of measures for trial participants.

<p>Respondents’ views on acceptability of measures for trial participants.</p