Private Model Compression via Knowledge Distillation

The soaring demand for intelligent mobile applications calls for deploying powerful deep neural networks (DNNs) on mobile devices. However, the outstanding performance of DNNs notoriously relies on increasingly complex models, which in turn is associated with an increase in computational expense far surpassing mobile devices' capacity. What is worse, app service providers need to collect and utilize a large volume of users' data, which contain sensitive information, to build the sophisticated DNN models. Directly deploying these models on public mobile devices presents prohibitive privacy risk. To benefit from the on-device deep learning without the capacity and privacy concerns, we design a private model compression framework RONA. Following the knowledge distillation paradigm, we jointly use hint learning, distillation learning, and self learning to train a compact and fast neural network. The knowledge distilled from the cumbersome model is adaptively bounded and carefully perturbed to enforce differential privacy. We further propose an elegant query sample selection method to reduce the number of queries and control the privacy loss. A series of empirical evaluations as well as the implementation on an Android mobile device show that RONA can not only compress cumbersome models efficiently but also provide a strong privacy guarantee. For example, on SVHN, when a meaningful $(9.83,10^{-6})$-differential privacy is guaranteed, the compact model trained by RONA can obtain 20$\times$ compression ratio and 19$\times$ speed-up with merely 0.97% accuracy loss.Comment: Conference version accepted by AAAI'1

Smart Collaborative Mobile System for Taking Care of Disabled and Elderly People

Official statistics data show that in many countries the population is aging. In addition, there are several illnesses and disabilities that also affect a small sector of the population. In recent years, researchers and medical foundations are working in order to develop systems based on new technologies and enhance the quality of life of them. One of the cheapest ways is to take advantage of the features provided by the smartphones. Nowadays, the development of reduced size smartphones, but with high processing capacity, has increased dramatically. We can take profit of the sensors placed in smartphones in order to monitor disabled and elderly people. In this paper, we propose a smart collaborative system based on the sensors embedded in mobile devices, which permit us to monitor the status of a person based on what is happening in the environment, but comparing and taking decisions based on what is happening to its neighbors. The proposed protocol for the mobile ad hoc network and the smart system algorithm are described in detail. We provide some measurements showing the decisions taken for several common cases and we also show the performance of our proposal when there is a medium size group of disabled or elderly people. Our proposal can also be applied to take care of children in several situations.This work has been partially supported by the Instituto de Telecomunicacoes, Next Generation Networks and Applications Group (NetGNA), Portugal, and by National Funding from the FCT - Fundacao para a Ciencia e a Tecnologia through the PEst-OE/EEI/LA0008/2011 Project.Sendra Compte, S.; Granell Romero, E.; Lloret, J.; Rodrigues, JJPC. (2014). Smart Collaborative Mobile System for Taking Care of Disabled and Elderly People. Mobile Networks and Applications. 19(3):287-302. doi:10.1007/s11036-013-0445-zS287302193Cisco Systems Inc. “Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2010–2015.” White Paper, February 1, 2011Pereira O, Caldeira J, Rodrigues J (2011) Body sensor network mobile solutions for biofeedback monitoring. J Mob Netw Appl 16(6):713–732Google. Galaxy nexus (2012). Available: http://www.google.com/nexus/E. Commission. “Demography report 2010.” Eurostat, the Statistical Office of the European Union, 2010. At http://ec.europa.eu/social/BlobServlet?docId=6824&langId=enThomas KE, Stevens JA, Sarmiento K, Wald MM (2008) Fall-related traumatic brain injury deaths and hospitalizations among older adults—United States, 2005. J Saf Res 39(3):269–272Fortino G, Giannantonio R, Gravina R, Kuryloski P, Jafari R, (2013) Enabling effective programming and flexible management of efficient body sensor network applications. IEEE Trans Hum Mach Syst 43(1):115–133Bellifemine F, Fortino G, Giannantonio R, Gravina R, Guerrieri A, Sgroi M (2011) SPINE: a domain-specific framework for rapid prototyping of WBSN applications. Softw Pract Exper 41(3):237–265Macias E, Lloret J, Suarez A, Garcia M (2012) Architecture and protocol of a semantic system designed for video tagging with sensor data in mobile devices. Sensors 12(2):2062–2087Sendra S, Granell E, Lloret J, Rodrigues JJPC. Smart Collaborative System Using the Sensors of Mobile Devices for Monitoring Disabled and Elderly People, 3rd IEEE International Workshop on Smart Communications in Network Technologies, Ottawa, Canada, June 11, 2012Lane N, Miluzzo E, Lu H, Peebles D, Choudhury T, Campbell A (2010) A survey of mobile phone sensing. IEEE Commun Mag 48(9):140–150Muldoon C, OHare G, OGrady M (2006) Collaborative agent tuning: Performance enhancement on mobile devices Engineering Societies in the Agents World VI, Lecture Notes in Computer Science, Volume 3963/2006, pp 241–258Turner H, White J, Thompson C, Zienkiewicz K, Campbell S, Schmidt DC (2009) Building Mobile Sensor Networks Using Smartphones and Web Services: Ramifications and Development Challenges, Handbook of Research on Mobility and Computing, Hershey, PA. Available: http://lsrg.cs.wustl.edu/~schmidt/PDF/new-ww-mobile-computing.pdfKansal A, Goraczko M, Zhao F. Building a sensor network of mobile phones, 6th International Conference on Information Processing in Sensor Networks. Cambridge, Massachusetts, USA, April 24–27, 2007 pp 547–548Plaza I, Martín L, Martin S, Medrano C (2011) Mobile applications in an aging society: status and trends. J Syst Softw 84(11):1977–1988Camarinha-Matos L, Afsarmanesh H. Telecare: Collaborative virtual elderly support communities, 1st Workshop on Tele-Care and Collaborative Virtual Communities in Elderly Care, Porto, Portugal, 13 April, 2004Chen B, Pompili D (2011) Transmission of patient vital signs using wireless body area networks. J Mob Netw Appl 16(6):663–682Dai J, Bai X, Yang Z, Shen Z, Xuan D (2010) Mobile phone-based pervasive fall detection. Pers Ubiquit Comput 14(7):633–643Martin P, Sánchez MA, Álvarez L, Alonso V, Bajo J. Multiagent system for detecting elderly people falls through mobile devices, International Symposium on Ambient Intelligence (ISAmI’11), Salamanca (Spain) 6–8 April 2011Fahmi PN, Viet V, Deok-Jai C. “Semi-supervised fall detection algorithm using fall indicators in smartphone.” Proceedings of the 6th International Conference on Ubiquitous Information Management and Communication, 2012, pp 122Sánchez M, Martín P, Álvarez L, Alonso V, Zato C, Pedrero A, Bajo J (2011) A New Adaptive Algorithm for Detecting Falls through Mobile Devices, Trends in Practical Applications of Agents and Multiagent Systems, pp 17–24Fahim M, Fatima I, Lee S, Lee YK. Daily Life Activity Tracking Application for Smart Homes using Android Smartphone, 14th International Conference on Advanced Communication Technology, Yongin, South Korea, 19–22 February 2012, pp 241–245Kaluža B, Mirchevska V, Dovgan E, Luštrek M, Gams M (2010) An agent-based approach to care in independent living, Ambient Intelligence, Lecture Notes in Computer Science, vol. 6439, pp 177–186Costa A, Barbosa G, Melo T, Novais P (2011) Using mobile systems to monitor an ambulatory patient. In: International Symposium on Distributed Computing and Artificial Intelligence, Advances in Intelligent and Soft Computing, vol. 91, pp 337–344Olfati-Saber R, Fax J, Murray R (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233Arcelus A, Jones MH, Goubran R, Knoefel F (2007) Integration of smart home technologies in a health monitoring system for the elderly, 21st International Conference on Advanced Information Networking and Applications Workshops, vol. 2, pp 820–825Kahmen H, Faig W (1988) Surveying. Walter de Gruyter & Co, New YorkSol LM870 mobile phone features. Available at: http://es.made-in-china.com/co_runrise/product_Dual-SIM-Card-Dual-Standby-GPS-Temperature-UV-Sensor-Pedometer-Sunrise-LM870-Mobile-Phone_hesighyiy.htmlSTLM20 temperature sensor features. Datashhet available at: http://www.st.com/internet/com/TECHNICAL_RESOURCES/TECHNICAL_LITERATURE/DATASHEET/CD00119601.pdfSendra S, Lloret J, Garcia M, Toledo JF (2011) Power saving and energy optimization techniques for wireless sensor networks. J Commun 6(6):439–459Matlab Website. Available at: www.mathworks.com/products/matlabPal A (2010) Localization algorithms in wireless sensor networks: current approaches and future challenges. Netw Protocol Algorithm 2(1):45–74Garcia M, Boronat F, Tomás J, Lloret J (2009) The development of two systems for indoor wireless sensors self-location. Ad Hoc Sensor Wirel Netw 8(3–4):235–258Lloret J, Tomás J, Garcia M, Cánovas A (2009) A hybrid stochastic approach for self-location of wireless sensors in indoor environments. Sensors 9(5):3695–3712Garcia M, Sendra S, Turro C, Lloret J (2011) User’s macro and micro-mobility study using WLANs in a university campus. Int J Adv Internet Technol 4(1&2):37–46Lloret J, Tomas J, Canovas A, Bellver I. GeoWiFi: A Geopositioning System Based on WiFi Networks, The Seventh International Conference on Networking and Services (ICNS 2011), Venice (Italy), May 6–10, 2011Yu W, Su X, Hansen J (2012) A smartphone design approach to user communication interface for administering storage system network. Netw Protoc Algorithm 4(4):126–15

Fuzzy based load and energy aware multipath routing for mobile ad hoc networks

Routing is a challenging task in Mobile Ad hoc Networks (MANET) due to their dynamic topology and lack of central administration. As a consequence of un-predictable topology changes of such networks, routing protocols employed need to accurately capture the delay, load, available bandwidth and residual node energy at various locations of the network for effective energy and load balancing. This paper presents a fuzzy logic based scheme that ensures delay, load and energy aware routing to avoid congestion and minimise end-to-end delay in MANETs. In the proposed approach, forwarding delay, average load, available bandwidth and residual battery energy at a mobile node are given as inputs to a fuzzy inference engine to determine the traffic distribution possibility from that node based on the given fuzzy rules. Based on the output from the fuzzy system, traffic is distributed over fail-safe multiple routes to reduce the load at a congested node. Through simulation results, we show that our approach reduces end-to-end delay, packet drop and average energy consumption and increases packet delivery ratio for constant bit rate (CBR) traffic when compared with the popular Ad hoc On-demand Multipath Distance Vector (AOMDV) routing protocol

Applications of Soft Computing in Mobile and Wireless Communications

Soft computing is a synergistic combination of artificial intelligence methodologies to model and solve real world problems that are either impossible or too difficult to model mathematically. Furthermore, the use of conventional modeling techniques demands rigor, precision and certainty, which carry computational cost. On the other hand, soft computing utilizes computation, reasoning and inference to reduce computational cost by exploiting tolerance for imprecision, uncertainty, partial truth and approximation. In addition to computational cost savings, soft computing is an excellent platform for autonomic computing, owing to its roots in artificial intelligence. Wireless communication networks are associated with much uncertainty and imprecision due to a number of stochastic processes such as escalating number of access points, constantly changing propagation channels, sudden variations in network load and random mobility of users. This reality has fuelled numerous applications of soft computing techniques in mobile and wireless communications. This paper reviews various applications of the core soft computing methodologies in mobile and wireless communications

Impact of Mobile and Wireless Technology on Healthcare Delivery services

Modern healthcare delivery services embrace the use of leading edge technologies and new scientific discoveries to enable better cures for diseases and better means to enable early detection of most life-threatening diseases. The healthcare industry is finding itself in a state of turbulence and flux. The major innovations lie with the use of information technologies and particularly, the adoption of mobile and wireless applications in healthcare delivery [1]. Wireless devices are becoming increasingly popular across the healthcare field, enabling caregivers to review patient records and test results, enter diagnosis information during patient visits and consult drug formularies, all without the need for a wired network connection [2]. A pioneering medical-grade, wireless infrastructure supports complete mobility throughout the full continuum of healthcare delivery. It facilitates the accurate collection and the immediate dissemination of patient information to physicians and other healthcare care professionals at the time of clinical decision-making, thereby ensuring timely, safe, and effective patient care. This paper investigates the wireless technologies that can be used for medical applications, and the effectiveness of such wireless solutions in a healthcare environment. It discusses challenges encountered; and concludes by providing recommendations on policies and standards for the use of such technologies within hospitals

A Resource Intensive Traffic-Aware Scheme for Cluster-based Energy Conservation in Wireless Devices

Wireless traffic that is destined for a certain device in a network, can be exploited in order to minimize the availability and delay trade-offs, and mitigate the Energy consumption. The Energy Conservation (EC) mechanism can be node-centric by considering the traversed nodal traffic in order to prolong the network lifetime. This work describes a quantitative traffic-based approach where a clustered Sleep-Proxy mechanism takes place in order to enable each node to sleep according to the time duration of the active traffic that each node expects and experiences. Sleep-proxies within the clusters are created according to pairwise active-time comparison, where each node expects during the active periods, a requested traffic. For resource availability and recovery purposes, the caching mechanism takes place in case where the node for which the traffic is destined is not available. The proposed scheme uses Role-based nodes which are assigned to manipulate the traffic in a cluster, through the time-oriented backward difference traffic evaluation scheme. Simulation study is carried out for the proposed backward estimation scheme and the effectiveness of the end-to-end EC mechanism taking into account a number of metrics and measures for the effects while incrementing the sleep time duration under the proposed framework. Comparative simulation results show that the proposed scheme could be applied to infrastructure-less systems, providing energy-efficient resource exchange with significant minimization in the power consumption of each device.Comment: 6 pages, 8 figures, To appear in the proceedings of IEEE 14th International Conference on High Performance Computing and Communications (HPCC-2012) of the Third International Workshop on Wireless Networks and Multimedia (WNM-2012), 25-27 June 2012, Liverpool, U