Human Computation and Convergence

Humans are the most effective integrators and producers of information, directly and through the use of information-processing inventions. As these inventions become increasingly sophisticated, the substantive role of humans in processing information will tend toward capabilities that derive from our most complex cognitive processes, e.g., abstraction, creativity, and applied world knowledge. Through the advancement of human computation - methods that leverage the respective strengths of humans and machines in distributed information-processing systems - formerly discrete processes will combine synergistically into increasingly integrated and complex information processing systems. These new, collective systems will exhibit an unprecedented degree of predictive accuracy in modeling physical and techno-social processes, and may ultimately coalesce into a single unified predictive organism, with the capacity to address societies most wicked problems and achieve planetary homeostasis.Comment: Pre-publication draft of chapter. 24 pages, 3 figures; added references to page 1 and 3, and corrected typ

Adversarial Attack and Defense on Graph Data: A Survey

Deep neural networks (DNNs) have been widely applied to various applications including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that DNNs are vulnerable to adversarial attacks. Though there are several works studying adversarial attack and defense strategies on domains such as images and natural language processing, it is still difficult to directly transfer the learned knowledge to graph structure data due to its representation challenges. Given the importance of graph analysis, an increasing number of works start to analyze the robustness of machine learning models on graph data. Nevertheless, current studies considering adversarial behaviors on graph data usually focus on specific types of attacks with certain assumptions. In addition, each work proposes its own mathematical formulation which makes the comparison among different methods difficult. Therefore, in this paper, we aim to survey existing adversarial learning strategies on graph data and first provide a unified formulation for adversarial learning on graph data which covers most adversarial learning studies on graph. Moreover, we also compare different attacks and defenses on graph data and discuss their corresponding contributions and limitations. In this work, we systemically organize the considered works based on the features of each topic. This survey not only serves as a reference for the research community, but also brings a clear image researchers outside this research domain. Besides, we also create an online resource and keep updating the relevant papers during the last two years. More details of the comparisons of various studies based on this survey are open-sourced at https://github.com/YingtongDou/graph-adversarial-learning-literature.Comment: In submission to Journal. For more open-source and up-to-date information, please check our Github repository: https://github.com/YingtongDou/graph-adversarial-learning-literatur

Practopoiesis: Or how life fosters a mind

The mind is a biological phenomenon. Thus, biological principles of organization should also be the principles underlying mental operations. Practopoiesis states that the key for achieving intelligence through adaptation is an arrangement in which mechanisms laying a lower level of organization, by their operations and interaction with the environment, enable creation of mechanisms lying at a higher level of organization. When such an organizational advance of a system occurs, it is called a traverse. A case of traverse is when plasticity mechanisms (at a lower level of organization), by their operations, create a neural network anatomy (at a higher level of organization). Another case is the actual production of behavior by that network, whereby the mechanisms of neuronal activity operate to create motor actions. Practopoietic theory explains why the adaptability of a system increases with each increase in the number of traverses. With a larger number of traverses, a system can be relatively small and yet, produce a higher degree of adaptive/intelligent behavior than a system with a lower number of traverses. The present analyses indicate that the two well-known traverses-neural plasticity and neural activity-are not sufficient to explain human mental capabilities. At least one additional traverse is needed, which is named anapoiesis for its contribution in reconstructing knowledge e.g., from long-term memory into working memory. The conclusions bear implications for brain theory, the mind-body explanatory gap, and developments of artificial intelligence technologies.Comment: Revised version in response to reviewer comment

Building Machines That Learn and Think Like People

Recent progress in artificial intelligence (AI) has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking machines will have to reach beyond current engineering trends in both what they learn, and how they learn it. Specifically, we argue that these machines should (a) build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; (b) ground learning in intuitive theories of physics and psychology, to support and enrich the knowledge that is learned; and (c) harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes towards these goals that can combine the strengths of recent neural network advances with more structured cognitive models.Comment: In press at Behavioral and Brain Sciences. Open call for commentary proposals (until Nov. 22, 2016). https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/information/calls-for-commentary/open-calls-for-commentar

Noam Chomsky on Where Artificial Intelligence Went Wrong

N

Fingerprint multiplex CARS at high speed based on supercontinuum generation in bulk media and deep learning spectral denoising

We introduce a broadband coherent anti-Stokes Raman scattering (CARS) microscope based on a 2-MHz repetition rate ytterbium laser generating 1035-nm high-energy (≈µJ level) femtosecond pulses. These features of the driving laser allow producing broadband red-shifted Stokes pulses, covering the whole fingerprint region (400-1800 cm-1), employing supercontinuum generation in a bulk crystal. Our system reaches state-of-the-art acquisition speed (<1 ms/pixel) and unprecedented sensitivity of ≈14.1 mmol/L when detecting dimethyl sulfoxide in water. To further improve the performance of the system and to enhance the signal-to-noise ratio of the CARS spectra, we designed a convolutional neural network for spectral denoising, coupled with a post-processing pipeline to distinguish different chemical species of biological tissues

Unsupervised-Learning Assisted Artificial Neural Network for Optimization

Innovations in computer technology made way for Computational Fluid Dynamics (CFD) into engineering, which supported the development of new designs by reducing the cost and time by lowering the dependency on experimentation. There is a further need to make the process of development more efficient. One such technology is Artificial Intelligence. In this thesis, we explore the application of Artificial Intelligence (AI) in CFD and how it can improve the process of development. AI is used as a buzz word for the mechanism which can learn by itself and make the decision accordingly. Machine learning (ML) is a subset of AI which learns any method without the need for any explicit algorithm. Deep Learning is another subset of ML, which is different in its composition. Deep Learning, or Neural Networks (NN), is made up of nodes like the neurons and works on the principle of the human brain. NN can be exploited for any problem without the need for any explicit algorithm for the task. It can be achieved by analyzing and inferring from the observations. Artificial Neural Network (ANN) is used for data analysis and Convolutional Neural Networks (CNN) for image analysis. Our area of interest herein is ANN and its application for a medical equipment called Convective Polymerase Chain Reaction (cPCR) device. Many have relied on engineering experimentation to develop an optimized PCR device, which requires high cost and time. That makes the use of PCR devices less cost-effective as a commonplace for healthcare. We optimize a convective PCR reactor using a high-fidelity CFD-based surrogate model to find an economical and performance-effective one. We plan numerous possible design combinations, evaluating DNA doubling time. Based on these results, an accurate surrogate model is developed for optimization using Deep Learning. We produce two kinds of surrogate models using ANN; one by directly employing ANN and another by using unsupervised learning called, k-Means-Clustering-Assisted ANN, and then compare the results from these two methods. For developing a suitable model of ANN to fit our data, we carry out the analysis of model accuracy and obtain the best design by using a differential evolution method. The best designs obtained by the two methods are verified with the corresponding result obtained from CFD. This shows an effective way of designing an optimized device by reducing the number of CFD simulations required for the development. Consequently, the computational results demonstrate that the convective PCR device can be efficiently developed using our proposed methodology, making it viable for point-of-care applications