10 research outputs found

    FLASH: Randomized Algorithms Accelerated over CPU-GPU for Ultra-High Dimensional Similarity Search

    Full text link
    We present FLASH (\textbf{F}ast \textbf{L}SH \textbf{A}lgorithm for \textbf{S}imilarity search accelerated with \textbf{H}PC), a similarity search system for ultra-high dimensional datasets on a single machine, that does not require similarity computations and is tailored for high-performance computing platforms. By leveraging a LSH style randomized indexing procedure and combining it with several principled techniques, such as reservoir sampling, recent advances in one-pass minwise hashing, and count based estimations, we reduce the computational and parallelization costs of similarity search, while retaining sound theoretical guarantees. We evaluate FLASH on several real, high-dimensional datasets from different domains, including text, malicious URL, click-through prediction, social networks, etc. Our experiments shed new light on the difficulties associated with datasets having several million dimensions. Current state-of-the-art implementations either fail on the presented scale or are orders of magnitude slower than FLASH. FLASH is capable of computing an approximate k-NN graph, from scratch, over the full webspam dataset (1.3 billion nonzeros) in less than 10 seconds. Computing a full k-NN graph in less than 10 seconds on the webspam dataset, using brute-force (n2Dn^2D), will require at least 20 teraflops. We provide CPU and GPU implementations of FLASH for replicability of our results

    Uncertainty in Artificial Intelligence: Proceedings of the Thirty-Fourth Conference

    Get PDF

    Computer Aided Verification

    Get PDF
    This open access two-volume set LNCS 13371 and 13372 constitutes the refereed proceedings of the 34rd International Conference on Computer Aided Verification, CAV 2022, which was held in Haifa, Israel, in August 2022. The 40 full papers presented together with 9 tool papers and 2 case studies were carefully reviewed and selected from 209 submissions. The papers were organized in the following topical sections: Part I: Invited papers; formal methods for probabilistic programs; formal methods for neural networks; software Verification and model checking; hyperproperties and security; formal methods for hardware, cyber-physical, and hybrid systems. Part II: Probabilistic techniques; automata and logic; deductive verification and decision procedures; machine learning; synthesis and concurrency. This is an open access book

    Programming Languages and Systems

    Get PDF
    This open access book constitutes the proceedings of the 31st European Symposium on Programming, ESOP 2022, which was held during April 5-7, 2022, in Munich, Germany, as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2022. The 21 regular papers presented in this volume were carefully reviewed and selected from 64 submissions. They deal with fundamental issues in the specification, design, analysis, and implementation of programming languages and systems

    Advances in knowledge discovery and data mining Part II

    Get PDF
    19th Pacific-Asia Conference, PAKDD 2015, Ho Chi Minh City, Vietnam, May 19-22, 2015, Proceedings, Part II</p

    Programming Languages and Systems

    Get PDF
    This open access book constitutes the proceedings of the 31st European Symposium on Programming, ESOP 2022, which was held during April 5-7, 2022, in Munich, Germany, as part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2022. The 21 regular papers presented in this volume were carefully reviewed and selected from 64 submissions. They deal with fundamental issues in the specification, design, analysis, and implementation of programming languages and systems

    Case studies for developing globally responsible engineers

    Get PDF
    Document realitzat amb un ajut financer de la Unió Europea. Per poder accedir al material complementari per a docents dels 28 casos estudi que formen el llibre, activeu el "Document relacionat"Col·lecció de 28 casos estudi per a professors d'enginyeria: 1. Rural development and planning in LDCs: the “Gamba Deve – Licoma axis”,district of Caia, Mozambique 2. Reducing the impact of soil erosion and reservoir siltation on agricultural production and water availability: the case study of the Laaba catchment (Burkina Faso) 3. Trade and Mobility on the Rooftop of the World: Gravity Ropeways in Nepal 4. Sustainable Development of Agriculture and Food systems with regard to Water 5. Conservation agriculture: a complex avenue to conserve and improve soils 6. The national rural water supply and sanitation programme in Tanzania 7. Use of statistical tools in a development context. Analysis of variance (ANOVA) 8. Water supply system in Kojani Island (Zanzibar, Tanzania) 9. Faecal sludge management in Lusaka, Zambia 10. Water balance on the Central Rift Valley 11. Rural electrification in developing countries via autonomous micro-grids 12. Photovoltaics electrification in off-grid areas 13. Development of a MILP model to design wind-photovoltaic stand-alone electrification projects for isolated communities in developing countries 14. Estimation if indoor air pollution and health impacts due to biomass burning in rural Northern Ghana 15.Improved cookstoves assessment 16. Supporting the adoption of clean cookstoves and fuels: why won’t people adopt the perfect stove? 17. Do-it-yourself approach as appropriate technology for solar thermal system: the example of CDF Médina, Dakar (Senegal) 18. Essential oil extraction with concentrating solar thermal energy 19. Survival in the desert sun: cool food storage 20. Energy roadmap in Ghana and Botswana 21. Social & ethical issues in engineering 22. Radio communications systems in rural environments 23. A Diffserv transport network to bring 3G access to villages in the Amazon forest 24. Finding the poynting’s theorem in a health centre in San Pablo (Peru) 25. Tanzania, Water and health 26. Flood assessment and warning system 27. Technical aspects of municipal solid waste collection: case studies from East Africa 28. Plastic recyclingPeer ReviewedPostprint (published version
    corecore