Cognitive Spectrum Management in Dynamic Cellular Environments: : A Case-Based Q-Learning Approach

This paper examines how novel cellular system architectures and intelligent spectrum management techniques can be used to play a key role in accommodating the exponentially increasing demand for mobile data capacity in the near future. A significant challenge faced by the artificial intelligence methods applied to such flexible wireless communication systems is their dynamic nature, e.g. network topologies that change over time. This paper proposes an intelligent case-based Q-learning method for dynamic spectrum access (DSA) which improves and stabilises the performance of cognitive cellular systems with dynamic topologies. The proposed approach is the combination of classical distributed Q-learning and a novel implementation of case-based reasoning which aims to facilitate a number of learning processes running in parallel. Large scale simulations of a stadium small cell network show that the proposed case-based Q-learning approach achieves a consistent improvement in the system quality of service (QoS) under dynamic and asymmetric network topology and traffic load conditions. Simulations of a secondary spectrum sharing scenario show that the cognitive cellular system that employs the proposed case-based Q-learning DSA scheme is able to accommodate a 28-fold increase in the total primary and secondary system throughput, but with no need for additional spectrum and with no degradation in the primary user QoS

Emulating opportunistic networks with KauNet Triggers

In opportunistic networks the availability of an end-to-end path is no longer required. Instead opportunistic networks may take advantage of temporary connectivity opportunities. Opportunistic networks present a demanding environment for network emulation as the traditional emulation setup, where application/transport endpoints only send and receive packets from the network following a black box approach, is no longer applicable. Opportunistic networking protocols and applications additionally need to react to the dynamics of the underlying network beyond what is conveyed through the exchange of packets. In order to support IP-level emulation evaluations of applications and protocols that react to lower layer events, we have proposed the use of emulation triggers. Emulation triggers can emulate arbitrary cross-layer feedback and can be synchronized with other emulation effects. After introducing the design and implementation of triggers in the KauNet emulator, we describe the integration of triggers with the DTN2 reference implementation and illustrate how the functionality can be used to emulate a classical DTN data-mule scenario

The ac stark shift and space-borne rubidium atomic clocks

open7sìDue to its small size, low weight, and low power consumption, the Rb atomic frequency standard (RAFS) is routinely the first choice for atomic timekeeping in space. Consequently, though the device has very good frequency stability (rivaling passive hydrogen masers), there is interest in uncovering the fundamental processes limiting its long-term performance, with the goal of improving the device for future space systems and missions. The ac Stark shift (i. e., light shift) is one of the more likely processes limiting the RAFS' long-term timekeeping ability, yet its manifestation in the RAFS remains poorly understood. In part, this comes from the fact that light-shift induced frequency fluctuations must be quantified in terms of the RAFS' light-shift coefficient and the output variations in the RAFS' rf-discharge lamp, which is a nonlinear inductively-couple plasma (ICP). Here, we analyze the light-shift effect for a family of 10 on-orbit Block-IIR GPS RAFS, examining decade-long records of their on-orbit frequency and rf-discharge lamp fluctuations. We find that the ICP's light intensity variations can take several forms: deterministic aging, jumps, ramps, and non-stationary noise, each of which affects the RAFS' frequency via the light shift. Correlating these light intensity changes with RAFS frequency changes, we estimate the light-shift coefficient, K-LS, for the family of RAFS: K-LS = -(1.9 +/- 0.3) x 10(-12) /%. The 16% family-wide variation in K-LS indicates that while each RAFS may have its own individual K-LS, the variance of K-LS among similarly designed RAFS can be relatively small. Combining K-LS with our estimate of the ICP light intensity's non-stationary noise, we find evidence that random-walk frequency noise in high-quality space-borne RAFS is strongly influenced by the RAFS' rf-discharge lamp via the light shift effect. Published by AIP Publishing.openFormichella, V.; Camparo, J.; Sesia, I.; Signorile, G.; Galleani, L.; Huang, M.; Tavella, P.Formichella, V.; Camparo, J.; Sesia, Ilaria; Signorile, Giovanna; Galleani, L.; Huang, M.; Tavella, Patrizi

Demonstrator of Time Services based on European GNSS signals: the H2020 DEMETRA Project

During 2015-2016, a European Consortium of 15 partners from 8 different countries, developed the DEMETRA (DEMonstrator of EGNSS services based on Time Reference Architecture), a project funded by the European Union in the frame of the Horizon 2020 program. This project aims at developing and experimenting time dissemination services dedicated to specific users like traffic control, energy distribution, finance, telecommunication, and scientific institutions. Nine services have been developed. These services provide time dissemination with accuracy levels from millisecond to the sub-ns, and also additional services like certification, calibration, or integrity. Five of these services are based on the European GNSS. After a development phase (see PTTI 2016 presentation) the full DEMETRA system has been working during six months for demonstration. The paper will report about the experimentation results, showing performances and limits of the proposed time dissemination services, aiming to foster the exploitation of the European GNSS for timing applications

Deep Brain Stimulation Reveals a Dissociation of Consummatory and Motivated Behaviour in the Medial and Lateral Nucleus Accumbens Shell of the Rat

Following the successful application of deep brain stimulation (DBS) in the treatment of Parkinson's disease and promising results in clinical trials for obsessive compulsive disorder and major depression, DBS is currently being tested in small patient-populations with eating disorders and addiction. However, in spite of its potential use in a broad spectrum of disorders, the mechanisms of action of DBS remain largely unclear and optimal neural targets for stimulation in several disorders have yet to be established. Thus, there is a great need to examine site-specific effects of DBS on a behavioural level and to understand how DBS may modulate pathological behaviour. In view of the possible application of DBS in the treatment of disorders characterized by impaired processing of reward and motivation, like addiction and eating disorders, we examined the effect of DBS of the nucleus accumbens (NAcc) on food-directed behavior. Rats were implanted with bilateral stimulation electrodes in one of three anatomically and functionally distinct sub-areas of the NAcc: the core, lateral shell (lShell) and medial shell (mShell). Subsequently, we studied the effects of DBS on food consumption, and the motivational and appetitive properties of food. The data revealed a functional dissociation between the lShell and mShell. DBS of the lShell reduced motivation to respond for sucrose under a progressive ratio schedule of reinforcement, mShell DBS, however, profoundly and selectively increased the intake of chow. DBS of the NAcc core did not alter any form of food-directed behavior studied. DBS of neither structure affected sucrose preference. These data indicate that the intake of chow and the motivation to work for palatable food can independently be modulated by DBS of subregions of the NAcc shell. As such, these findings provide important leads for the possible future application of DBS as a treatment for eating disorders such as anorexia nervosa

Implementing opportunistic spectrum access in LTE-Advanced

Long term evolution advanced (LTE-A) has emerged as a promising mobile broadband access technology aiming to cope with the increasing traffic demand in wireless networks. However, the enhanced spectral efficiency offered by LTE-A may become futile without a better management of scarce and overcrowded electromagnetic spectrum. In this sense, cognitive radio (CR) has been proposed as a potential solution to the problem of spectrum scarcity. Among all the mechanisms provided by CR, opportunistic spectrum access (OSA) aims at a dynamic and seamless use of certain licensed bands provided the licensee is not harmfully affected. This operation requires spectral awareness in order to avoid interferences with licensed systems. In spite of implementing some spectrum sensing mechanisms, LTE-A technology lacks other tools that are needed in order to improve the knowledge of the radio environment. This work studies the adoption of a Geo-located data base (Geo-DB) that cooperatively retrieves and maintains information regarding the location of unutilized portions of spectrum potentially available for OSA. Moreover, the potential benefit of this LTE-compliant OSA solution is evaluated using a calibrated simulation tool, by which numerical results allow us to optimally configure the system and show that the proposed opportunistic system is able to significantly improve its performance.The authors would like to thank the funding received from the Ministerio de Ciencia e Innovacion within the Project number TEC2011-27723-C02-02 and from the Ministerio de Industria, Turismo y Comercio TSI-020100-2011-266 funds. This article had been written in the framework of the CELTIC project CP08-001 COMMUNE. Study by X. Gelabert is funded by the BP-DGR 2010 scholarship (ref. 00192). The authors would like to acknowledge the contributions of their colleagues.Osa Ginés, V.; Herranz Claveras, C.; Monserrat Del Río, JF.; Gelabert, X. (2012). Implementing opportunistic spectrum access in LTE-Advanced. EURASIP Journal on Wireless Communications and Networking. 2012(99):1-17. https://doi.org/10.1186/1687-1499-2012-99S117201299Martín-Sacristán D, Monserrat JF, Cabrejas-Peñuelas J, Calabuig D, Garrigas S, Cardona N: On the way towards fourth-generation mobile: 3GPP LTE and LTE-Advanced. EURASIP J Wirel Commun Netw 2009, 2009: 1-10.Ratasuk R, Tolli D, Ghosh A: Carrier aggregation in LTE-Advanced. In IEEE 71st Vehicular Technology Conference (VTC 2010-Spring). Taipei; 2010:1-5.Wang H, Rosa C, Pedersen K: Performance of uplink carrier aggregation in LTE-advanced systems. In IEEE 72nd Vehicular Technology Conference Fall (VTC 2010-Fall). Ottawa; 2010:1-5.Tandra R, Sahai A, Mishra S: What is a spectrum hole and what does it take to recognize one? Proc IEEE 2009, 97(5):824-848.Mitola IJ, Maguire JGQ: Cognitive radio: making software radios more personal. IEEE Personal Commun 1999, 6(4):13-18. 10.1109/98.788210Haykin S: Cognitive radio: brain-empowered wireless communications. IEEE J Sel Areas Commun 2005, 23(2):201-220.IEEE 802.22 Working Group on Wireless Regional Area Networks. [ http://www.ieee802.org/22/ ]ITU-R BT1368: Planning criteria for digital terrestrial television services in the VHF/UHF bands.ITU-R BT1786: Criterion to assess the impact of interference to the terrestrial broadcasting service (BS).Kawade S, Nekovee M: Cognitive radio-based urban wireless broadband in unused TV bands. In 20th International Radioelektronika Conference. Brno; 2010:1-4.Modlic B, Sisul G, Cvitkovic M: Digital dividend--Opportunities for new mobile services. In International Symposium ELMAR 2009 (ELMAR'09). Zadar; 2009:1-8.Zhao X, Guo Z, Guo Q: A cognitive based spectrum sharing scheme for LTE advanced systems. In International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT). Moscow; 2010:965-969.Hussain S, Fernando X: Spectrum sensing in cognitive radio networks: Up-to-date techniques and future challenges. In IEEE Toronto International Conference on Science and Technology for Humanity (TIC-STH). Toronto; 2009:736-741.Xu Y, Sun Y, Li Y, Zhao Y, Zou H: Joint sensing period and transmission time optimization for energy-constrained cognitive radios. EURASIP J Wirel Commun Netw 2010, 2010: 1-16.Yucek T, Arslan H: A survey of spectrum sensing algorithms for cognitive radio applications. IEEE Commun Surv Tutor 2009, 11: 116-130.Cabric D, Mishra S, Brodersen R: Implementation issues in spectrum sensing for cognitive radios. In Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers. Volume 1. Pacific Grove; 2004:772-776.Zeng Y, Liang YC, Hoang A, Peh E: Reliability of spectrum sensing under noise and interference uncertainty. In IEEE International Conference on Communications Workshops, 2009. ICC Workshops. Dresden; 2009:1-5.Bixio L, Ottonello M, Raffetto M, Regazzoni CS: Comparison among cognitive radio architectures for spectrum sensing. EURASIP J Wirel Commun Netw 2011, 2011: 1-18.Mustonen M, Matinmikko M, Mammela A: Cooperative spectrum sensing using quantized soft decision combining. In 4th International Conference on Cognitive Radio Oriented Wireless Networks and Communications, 2009 (CROWNCOM'09). Hannover; 2009:1-5.Xiao L, Liu K, Ma L: A weighted cooperative spectrum sensing in cognitive radio networks. In International Conference on Information Networking and Automation (ICINA). Volume 2. Kunming; 2010:45-48.Pan Q, Chang Y, Zheng R, Zhang X, Wang Y, Yang D: Solution of information exchange for cooperative sensing in cognitive radios. In IEEE Wireless Communications and Networking Conference, 2009 (WCNC'2009). Budapest; 2009:1-4.Masri A, Chiasserini CF, Perotti A: Control information exchange through UWB in cognitive radio networks. In 5th IEEE International Symposium on Wireless Pervasive Computing (ISWPC). Modena; 2010:110-115.Celebi H, Arslan H: Utilization of location information in cognitive wireless networks. IEEE Wirel Commun 2007, 14(4):6-13.FCC: Notice of Proposed Rulemaking, in the Matter of Unlicensed Operation in the TV Broadcast Bands (ET Docket no. 04-186) and Additional Spectrum for Unlicensed.Marcus MJ, Kolodzy P, Lippman A: Reclaiming the vast wasteland: why unlicensed use of the white space in the TV bands will not cause interference to DTV viewers. New America Foundation: wireless future program, tech rep 2005.Nam H, Ghorbel M, Alouini M: Proc. of the Fifth International Conference on Cognitive Radio Oriented. In Proc of the Fifth International Conference on Cognitive Radio Oriented Wireless Networks Communications (CROWNCOM). Cannes; 2010:1-5.IEEE Std 80221-2008: IEEE Standard for Local and Metropolitan Area Networks-Part 21: Media Independent Handover. 2009.3GPP TS 36133: Evolved Universal Terrestrial Radio Access (E-UTRA); Requirements for support of radio resource management.Sesia S, Baker M, Toufik I: LTE, the UMTS long term evolution: from theory to practice. Wiley, New Haven; 2009.Digham FF, Alouini MS, Simon MK: On the energy detection of unknown signals over fading channels. In IEEE International Conference on Communications, 2003 (ICC'03). Volume 5. Anchorage; 2003:3575-3579.Ghasemi A, Sousa ES: Collaborative spectrum sensing for opportunistic access in fading environments. In First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks (DySPAN). Baltimore; 2005:131-136.Gelabert X, Akyildiz IF, Sallent O, Agustí R: Operating point selection for primary and secondary users in cognitive radio networks. Comput Netw 2009, 53(8):1158-1170. 10.1016/j.comnet.2009.02.009Taniuchi K, Ohba Y, Fajardo V, Das S, Tauil M, Cheng YH, Dutta A, Baker D, Yajnik M, Famolari D: IEEE 802.21: media independent handover: features, applicability, and realization. IEEE Commun Mag 2009, 47: 112-120.3GPP TS 36305: Evolved Universal Terrestrial Radio Access Network (E-UTRAN); Stage 2 functional specification of User Equipment (UE) positioning in E-UTRAN.3GPP TS 36355: Evolved Universal Terrestrial Radio Access; LTE Positioning Protocol (LPP).3GPP TS 36455: Evolved Universal Terrestrial Radio Access; LTE Positioning Protocol A (LPPa).Ren W, Zhao Q, Swami A: Power control in cognitive radio networks: how to cross a multi-lane highway. IEEE J Sel Areas Commun 2008, 27(7):1283-1296.3GPP R1-084424: Control Channel Design Issues for Carrier Aggregation in LTE-A.Dajie J, Haiming W, Malkamaki E, Tuomaala E: Principle and performance of semi-persistent scheduling for VoIP in LTE system. In International Conference on Wireless Communications, Networking and Mobile Computing, 2007 (WiCom 2007). Shanghai; 2007:2861-2864.Rajbanshi R, Wyglinski AM, Minden GJ: An efficient implementation of NC-OFDM transceivers for cognitive radios. In Proc of 1st Conf on Cognitive Radio Oriented Wireless Networks and Commun. Mykonos; 2006:1-5.Wellens M, Riihijarvi J, Mahonen P: Modeling primary system activity in dynamic spectrum access networks by aggregated ON/OFF-processes. In 6th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks Workshops, 2009. SECON Workshops'09. Rome; 2009:1-6.3GPP TS 36214: Physical layer; Measurements.Ofuji Y, Morimoto A, Abeta S, Sawahashi M: Comparison of packet scheduling algorithms focusing on user throughput in high speed downlink packet access. In 13th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications. Volume 3. Lis-boa; 2002:1462-1466.ITU-R ITU M2135: Guidelines for evaluation of radio interface technologies for IMT-Advanced 2008