1,471 research outputs found

    Large-scale linear regression: Development of high-performance routines

    Full text link
    In statistics, series of ordinary least squares problems (OLS) are used to study the linear correlation among sets of variables of interest; in many studies, the number of such variables is at least in the millions, and the corresponding datasets occupy terabytes of disk space. As the availability of large-scale datasets increases regularly, so does the challenge in dealing with them. Indeed, traditional solvers---which rely on the use of black-box" routines optimized for one single OLS---are highly inefficient and fail to provide a viable solution for big-data analyses. As a case study, in this paper we consider a linear regression consisting of two-dimensional grids of related OLS problems that arise in the context of genome-wide association analyses, and give a careful walkthrough for the development of {\sc ols-grid}, a high-performance routine for shared-memory architectures; analogous steps are relevant for tailoring OLS solvers to other applications. In particular, we first illustrate the design of efficient algorithms that exploit the structure of the OLS problems and eliminate redundant computations; then, we show how to effectively deal with datasets that do not fit in main memory; finally, we discuss how to cast the computation in terms of efficient kernels and how to achieve scalability. Importantly, each design decision along the way is justified by simple performance models. {\sc ols-grid} enables the solution of 101110^{11} correlated OLS problems operating on terabytes of data in a matter of hours

    Catching Cheats: Detecting Strategic Manipulation in Distributed Optimisation of Electric Vehicle Aggregators

    Full text link
    Given the rapid rise of electric vehicles (EVs) worldwide, and the ambitious targets set for the near future, the management of large EV fleets must be seen as a priority. Specifically, we study a scenario where EV charging is managed through self-interested EV aggregators who compete in the day-ahead market in order to purchase the electricity needed to meet their clients' requirements. With the aim of reducing electricity costs and lowering the impact on electricity markets, a centralised bidding coordination framework has been proposed in the literature employing a coordinator. In order to improve privacy and limit the need for the coordinator, we propose a reformulation of the coordination framework as a decentralised algorithm, employing the Alternating Direction Method of Multipliers (ADMM). However, given the self-interested nature of the aggregators, they can deviate from the algorithm in order to reduce their energy costs. Hence, we study the strategic manipulation of the ADMM algorithm and, in doing so, describe and analyse different possible attack vectors and propose a mathematical framework to quantify and detect manipulation. Importantly, this detection framework is not limited the considered EV scenario and can be applied to general ADMM algorithms. Finally, we test the proposed decentralised coordination and manipulation detection algorithms in realistic scenarios using real market and driver data from Spain. Our empirical results show that the decentralised algorithm's convergence to the optimal solution can be effectively disrupted by manipulative attacks achieving convergence to a different non-optimal solution which benefits the attacker. With respect to the detection algorithm, results indicate that it achieves very high accuracies and significantly outperforms a naive benchmark

    Microfluidic polymerase chain reaction

    Get PDF
    We implement microfluidic technology to miniaturize a thermal cycling system for amplifying DNA fragments. By using a microfluidic thermal heat exchanger to cool a Peltier junction, we have demonstrated rapid heating and cooling of small volumes of solution. We use a miniature K-type thermocouple to provide a means for in situ sensing of the temperature inside the microrefrigeration system. By combining the thermocouple, two power supplies controlled by a relay system, and computer automation, we reproduce the function of a commercial polymerase chain reaction thermal cycler and demonstrate amplification of a DNA sample of about 1000 base pairs

    Consulting project - Recidar

    Get PDF
    En cuanto al proyecto de consultoría que se ha llevado a cabo para Recidar, encierra un enfoque innovador para garantizar un futuro viable a su compromiso social de abogar por procesos de economía circular en Lima. La iniciativa recomendada se construye a través de la colaboración con diferentes actores clave que permitirán optimizar el alcance y la profundidad de la nueva Recidar. La asociación con actores locales clave es la clave para que Recidar desarrolle una mejor vía para su visión a largo plazo. Dado que Recidar está actualmente atascada con el alto nivel de actividad que se le exige a diario, el trabajo externo propuesto le dará una nueva visión para construir adecuadamente su negocio de modo que pueda resistir a las importantes fluctuaciones del entorno externo en el que opera.The following consultancy project analyzes the status of Recidar's strategic plan and recommends a greater emphasis on a long-term vision. The preliminary work has been based on the search for relevant academic articles covering the different dimensions of the circular economy. In addition, the literature review covers the different management practices that a social enterprise should foster to ensure a viable long-term vision for its operations. To successfully develop a comprehensive recommendation, an industry analysis (Porter's 5 forces), external analysis (PESTEL), internal analysis (AMOFHIT) and a detailed analysis of the problem at hand have been carried out. In terms of concrete recommendations, it highlights collaboration with universities, an engagement with a professional with inside knowledge of Gamarra, initiatives within the Gamarra ecosystem and the development of an e-commerce platform. These initiatives aim to improve brand recognition, promote a circular economy, create diverse revenue streams, and most importantly, respond to Recidar's request to build a long-term strategy for the future of its social mission

    Forces driving the three-dimensional folding of eukaryotic genomes

    Get PDF
    The last decade has radically renewed our understanding of higher order chromatin folding in the eukaryotic nucleus. As a result, most current models are in support of a mostly hierarchical and relatively stable folding of chromosomes dividing chromosomal territories into A- (active) and B- (inactive) compartments, which are then further partitioned into topologically associating domains (TADs), each of which is made up from multiple loops stabilized mainly by the CTCF and cohesin chromatin-binding complexes. Nonetheless, the structure-to-function relationship of eukaryotic genomes is still not well understood. Here, we focus on recent work highlighting the biophysical and regulatory forces that contribute to the spatial organization of genomes, and we propose that the various conformations that chromatin assumes are not so much the result of a linear hierarchy, but rather of both converging and conflicting dynamic forces that act on it

    Propuesta de eliminación de barreras burocráticas por duplicidad en la emisión de los certificados de habilitación vehicular para transporte de mercancías en la región Junín

    Get PDF
    El presente trabajo tuvo como finalidad proponer una solución a la duplicidad en la emisión de certificados de habilitación vehicular para el transporte de mercancías en general por parte de la dirección regional de transportes Junín y el ministerio de transportes y comunicaciones. Debido a que las duplicidades en el sector estatal conllevan a la perdida en tiempos, costos y gastos para el estado y sobre costos a los usuarios, al existir dos entidades gubernamentales que realizan el misma servicio para el mismo público, generando así disfunciones, lo que es considerado un acto irracional dentro de la gestión pública, que se traducen en sobre costos para las empresas de transporte de mercancías en la región Junín que finalmente se ven traducidos al ciudadano al momento de adquirir el producto final transportado. Por lo expuesto el tratamiento de este problema será abordado desde la perspectiva de los actores participantes para generar mayor bienestar a la población, en especial a los usuarios de estos tipos de servicios, quienes tienen como finalidad transportar sus productos desde y hacia la región Junín y regiones aledañas, considerando el flujo de vehículos que transitan diariamente por las principales vías de esta región, el impacto en la oferta de productos de primera necesidad en Lima y Callao.The purpose of this work is to be able to propose a solution to the problems that duplication entails in the issuance of vehicle authorization certificates for the transport of goods in general by the Junín regional transport department and the Ministry of Transport and Communications; This is due to the fact that duplicities in the state sector lead to loss in time, costs and expenses for the state, as there are two government entities that perform the same service for the same public, thus generating dysfunctions, which translate into over-costs for freight transport companies in the Junín region; The treatment of this problem will be approached from the perspective of the participating actors to generate greater well-being for the population, especially the users of these types of services, whose purpose is to transport their products to and from the Junín region and surrounding regions. considering the influx of vehicles that circulate daily on the roads of this region and the impact on the supply of basic necessities in Lima and Callao

    Probing the local dielectric function of WS2 on an Au substrate by near field optical microscopy operating in the visible spectral range

    Get PDF
    The optoelectronic properties of nanoscale systems such as carbon nanotubes (CNTs), graphene nanoribbons and transition metal dichalcogenides (TMDCs) are determined by their dielectric function. This complex, frequency dependent function is affected by excitonic resonances, charge transfer effects, doping, sample stress and strain, and surface roughness. Knowledge of the dielectric function grants access to a material’s transmissive and absorptive characteristics. Here we use the dual scanning near field optical microscope (dual s-SNOM) for imaging local dielectric variations and extracting dielectric function values using a pre-established mathematical inversion method. To demonstrate our approach, we studied a monolayer of WS2 on bulk Au and identified two areas with differing levels of charge transfer. The experiments highlight a further advantage of the technique: the dielectric function of contaminated samples can be measured, as dirty areas can be easily identified and excluded for the calculation, being important especially for exfoliated 2D materials (Rodriguez et al., 2021). Our measurements are corroborated by atomic force microscopy (AFM), Kelvin force probe microscopy (KPFM), photoluminescence (PL) intensity mapping, and tip enhanced photoluminescence (TEPL). We extracted local dielectric variations from s-SNOM images and confirmed the reliability of the obtained values with spectroscopic imaging ellipsometry (SIE) measurements
    • …
    corecore