Visual Search at eBay

In this paper, we propose a novel end-to-end approach for scalable visual search infrastructure. We discuss the challenges we faced for a massive volatile inventory like at eBay and present our solution to overcome those. We harness the availability of large image collection of eBay listings and state-of-the-art deep learning techniques to perform visual search at scale. Supervised approach for optimized search limited to top predicted categories and also for compact binary signature are key to scale up without compromising accuracy and precision. Both use a common deep neural network requiring only a single forward inference. The system architecture is presented with in-depth discussions of its basic components and optimizations for a trade-off between search relevance and latency. This solution is currently deployed in a distributed cloud infrastructure and fuels visual search in eBay ShopBot and Close5. We show benchmark on ImageNet dataset on which our approach is faster and more accurate than several unsupervised baselines. We share our learnings with the hope that visual search becomes a first class citizen for all large scale search engines rather than an afterthought.Comment: To appear in 23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2017. A demonstration video can be found at https://youtu.be/iYtjs32vh4

Enabling sustainable power distribution networks by using smart grid communications

Smart grid modernization enables integration of computing, information and communications capabilities into the legacy electric power grid system, especially the low voltage distribution networks where various consumers are located. The evolutionary paradigm has initiated worldwide deployment of an enormous number of smart meters as well as renewable energy sources at end-user levels. The future distribution networks as part of advanced metering infrastructure (AMI) will involve decentralized power control operations under associated smart grid communications networks. This dissertation addresses three potential problems anticipated in the future distribution networks of smart grid: 1) local power congestion due to power surpluses produced by PV solar units in a neighborhood that demands disconnection/reconnection mechanisms to alleviate power overflow, 2) power balance associated with renewable energy utilization as well as data traffic across a multi-layered distribution network that requires decentralized designs to facilitate power control as well as communications, and 3) a breach of data integrity attributed to a typical false data injection attack in a smart metering network that calls for a hybrid intrusion detection system to detect anomalous/malicious activities. In the first problem, a model for the disconnection process via smart metering communications between smart meters and the utility control center is proposed. By modeling the power surplus congestion issue as a knapsack problem, greedy solutions for solving such problem are proposed. Simulation results and analysis show that computation time and data traffic under a disconnection stage in the network can be reduced. In the second problem, autonomous distribution networks are designed that take scalability into account by dividing the legacy distribution network into a set of subnetworks. A power-control method is proposed to tackle the power flow and power balance issues. Meanwhile, an overlay multi-tier communications infrastructure for the underlying power network is proposed to analyze the traffic of data information and control messages required for the associated power flow operations. Simulation results and analysis show that utilization of renewable energy production can be improved, and at the same time data traffic reduction under decentralized operations can be achieved as compared to legacy centralized management. In the third problem, an attack model is proposed that aims to minimize the number of compromised meters subject to the equality of an aggregated power load in order to bypass detection under the conventionally radial tree-like distribution network. A hybrid anomaly detection framework is developed, which incorporates the proposed grid sensor placement algorithm with the observability attribute. Simulation results and analysis show that the network observability as well as detection accuracy can be improved by utilizing grid-placed sensors. Conclusively, a number of future works have also been identified to furthering the associated problems and proposed solutions

ns-3 Implementation of the 3GPP MIMO Channel Model for Frequency Spectrum above 6 GHz

Communications at mmWave frequencies will be a key enabler of the next generation of cellular networks, due to the multi-Gbps rate that can be achieved. However, there are still several problems that must be solved before this technology can be widely adopted, primarily associated with the interplay between the variability of mmWave links and the complexity of mobile networks. An end-to-end network simulator represents a great tool to assess the performance of any proposed solution to meet the stringent 5G requirements. Given the criticality of channel propagation characteristics at higher frequencies, we present our implementation of the 3GPP channel model for the 6-100 GHz band for the ns-3 end-to-end 5G mmWave module, and detail its associated MIMO beamforming architecture

Neuro-Dominating Set Scheme for a Fast and Efficient Robot Deployment in Internet of Robotic Things

International audienceInternet of Robotic Things (IoRT) is a new concept introduced for the first time by ABI Research. Unlike the Internet of Things (IoT), IoRT provides an active sensorization and is considered as the new evolution of IoT. In this context, we propose a Neuro-Dominating Set algorithm (NDS) to efficiently deploy a team of mobile wireless robots in an IoRT scenario, in order to reach a desired inter-robot distance, while maintaining global connectivity in the whole network. We use the term Neuro-Dominating Set to describe our approach, since it is inspired by both neural network and dominating set principles. With NDS algorithm, a robot adopts different behaviors according whether it is a dominating or a dominated robot. Our main goal is to show and demonstrate the beneficial effect of using different behaviors in the IoRT concept. The obtained results show that the proposed method outperforms an existing related technique (i.e., the Virtual Angular Force approach) and the neural network based approach presented in our previous work. As an objective, we aim to decrease the overall traveled distance and keep a low energy consumption level, while maintaining network connectivity and an acceptable convergence time

Query Processing In Location-based Services

With the advances in wireless communication technology and advanced positioning systems, a variety of Location-Based Services (LBS) become available to the public. Mobile users can issue location-based queries to probe their surrounding environments. One important type of query in LBS is moving monitoring queries over mobile objects. Due to the high frequency in location updates and the expensive cost of continuous query processing, server computation capacity and wireless communication bandwidth are the two limiting factors for large-scale deployment of moving object database systems. To address both of the scalability factors, distributed computing has been considered. These schemes enable moving objects to participate as a peer in query processing to substantially reduce the demand on server computation, and wireless communications associated with location updates. In the first part of this dissertation, we propose a distributed framework to process moving monitoring queries over moving objects in a spatial network environment. In the second part of this dissertation, in order to reduce the communication cost, we leverage both on-demand data access and periodic broadcast to design a new hybrid distributed solution for moving monitoring queries in an open space environment. Location-based services make our daily life more convenient. However, to receive the services, one has to reveal his/her location and query information when issuing locationbased queries. This could lead to privacy breach if these personal information are possessed by some untrusted parties. In the third part of this dissertation, we introduce a new privacy protection measure called query l-diversity, and provide two cloaking algorithms to achieve both location kanonymity and query l-diversity to better protect user privacy. In the fourth part of this dissertation, we design a hybrid three-tier architecture to help reduce privacy exposure. In the fifth part of this dissertation, we propose to use Road Network Embedding technique to process privacy protected queries

Improvement of the Fairbanks Atmospheric Carbon Monoxide Transport Model -- A Program for Calibration, Verification and Implementation

Completion Report Prepared for the Research Section, Alaska Department of Transportation and Public FacilitiesIn the early 70s, state, local and federal officials in Fairbanks, Alaska, became concerned with the rising incidence of high carbon monoxide episodes. Because of that concern, the Alaska Department of Highways (forerunner of the Department of Transportation and Public Facilities) and the Fairbanks North Star Borough requested that the Institute of Water Resources undertake a study to develop a computer model capability for understanding the transport of carbon monoxide and other pollutants within the Fairbanks airshed. The work was completed in June of 1976. Two publications (Carlson and Fox, 1976; Norton and Carlson, 1976) describe the initial development, documentation and implementation of the computer model. The model, ACOSP (Atmospheric Carbon monOxide Simulation Program), describes the two-dimensional behavior of pollutants in the atmosphere via solution of the convection-diffusion equation using the finite element method of numerical analysis

A parallel simulated annealing algorithm for standard cell placement on a hypercube computer

A parallel version of a simulated annealing algorithm is presented which is targeted to run on a hypercube computer. A strategy for mapping the cells in a two dimensional area of a chip onto processors in an n-dimensional hypercube is proposed such that both small and large distance moves can be applied. Two types of moves are allowed: cell exchanges and cell displacements. The computation of the cost function in parallel among all the processors in the hypercube is described along with a distributed data structure that needs to be stored in the hypercube to support parallel cost evaluation. A novel tree broadcasting strategy is used extensively in the algorithm for updating cell locations in the parallel environment. Studies on the performance of the algorithm on example industrial circuits show that it is faster and gives better final placement results than the uniprocessor simulated annealing algorithms. An improved uniprocessor algorithm is proposed which is based on the improved results obtained from parallelization of the simulated annealing algorithm

Urban Traffic Monitoring and Modeling System: An IoT Solution for Enhancing Road Safety

Qatar expects more than a million visitors during the 2022 World Cup, which will pose significant challenges. The high number of people will likely cause a rise in road traffic congestion, vehicle crashes, injuries and deaths. To tackle this problem, Naturalistic Driver Behavior can be utilised which will collect and analyze data to estimate the current Qatar traffic system, including traffic data infrastructure, safety planning, and engineering practices and standards. In this paper, an IoT based solution to facilitate such a study in Qatar is proposed. Different data points from a driver are collected and recorded in an unobtrusive manner, such as trip data, GPS coordinates, compass heading, minimum, average, and maximum speed and his driving behavior, including driver's drowsiness level. Analysis of these data points will help in prediction of crashes and road infrastructure improvements to reduce such events. It will also be used for drivers risk assessment and to detect extreme road user behaviors. A framework that will help to visualize and manage this data is also proposed, along with a Deep Learning-based application that detects drowsy driving behavior that netted an 82 percent accuracy.Comment: 6 pages, 6 figures, conference IINTEC'1