Multimodal Data Fusion: An Overview of Methods, Challenges and Prospects

International audienceIn various disciplines, information about the same phenomenon can be acquired from different types of detectors, at different conditions, in multiple experiments or subjects, among others. We use the term "modality" for each such acquisition framework. Due to the rich characteristics of natural phenomena, it is rare that a single modality provides complete knowledge of the phenomenon of interest. The increasing availability of several modalities reporting on the same system introduces new degrees of freedom, which raise questions beyond those related to exploiting each modality separately. As we argue, many of these questions, or "challenges" , are common to multiple domains. This paper deals with two key questions: "why we need data fusion" and "how we perform it". The first question is motivated by numerous examples in science and technology, followed by a mathematical framework that showcases some of the benefits that data fusion provides. In order to address the second question, "diversity" is introduced as a key concept, and a number of data-driven solutions based on matrix and tensor decompositions are discussed, emphasizing how they account for diversity across the datasets. The aim of this paper is to provide the reader, regardless of his or her community of origin, with a taste of the vastness of the field, the prospects and opportunities that it holds

Ghost Imaging of Space Objects

Development of innovative aerospace technologies is critical for our nation to meet its goals to explore and under-stand the Earth, our solar system, and the universe. The spectacular success of many recent NASA missions hinges on the extensive technological innovations that NASA has been supporting for the past decades. To sustain this successful tradition it is very important to identify and stimulate the scientific research that may turn into a viable technology in the decades yet to come. Investment in innovative low-TRL research stimulates the growth of the scientific knowledge and enhances the technical capabilities in a way that answers the new questions and responds to new requirements

The Fizeau Interferometer Testbed

The Fizeau Interferometer Testbed (FIT) is a collaborative effort between NASA's Goddard Space Flight Center, the Naval Research Laboratory, Sigma Space Corporation, and the University of Maryland. The testbed will be used to explore the principles of and the requirements for the full, as well as the pathfinder, Stellar Imager mission concept. It has a long term goal of demonstrating closed-loop control of a sparse array of numerous articulated mirrors to keep optical beams in phase and optimize interferometric synthesis imaging. In this paper we present the optical and data acquisition system design of the testbed, and discuss the wavefront sensing and control algorithms to be used. Currently we have completed the initial design and hardware procurement for the FIT. The assembly and testing of the Testbed will be underway at Goddard's Instrument Development Lab in the coming months.Comment: 9 pages, 3 figures, accepted for publication and presentation at the 2003 IEEE Aerospace Conference, Big Sky, Montan

Drones for Project-Based Learning (PBL) Capstone Design

In this paper, we examine the learning objectives of building drone aircraft for a variety of uses. We detail some of the design and learning challenges that the students take on and the results of the student's efforts. This course is formulated for project-based learning (PBL) and self-regulated learning (SRL). In particular, the program is a Capstone Design 2-semester course that additionally has an Accreditation Board for Engineering and Technology (ABET) design and build criteria as a requirement. Completion of this project is a requirement for graduation, and students usually take the capstone design course in their senior year. For this particular capstone design, most of the topics covered are outside of the student's comfort zone and require research and decision making to arrive at a final project. We examine student motivations and difficulties. Students were allowed to set their own goals and timelines within the constraints and requirements of the project. In this paper we detail the requirements for this past year and the paths the students took. We examine the team interactions and final outcome and how this impacts their long term thinking and approach. The process of how we evaluate their learning activities as well as how they rate one another's efforts is also detailed

Ghost Imaging of Space Objects

would like to summarize that our "Ghost Imaging of Space Objects" NIAC research effort was successful. As anticipated, its main return has been the newly acquired knowledge and the understanding of the pathways that lead from this knowledge to its applications in observational astronomy. During this research we came across several fundamental insights that were not expected at the beginning. We came to realize that the ghost imaging of dark objects using background thermal light can be treated as a special case of Hanbury Brown and Twiss intensity interferometry in combination with the Babinet's principle for higher-order observables. Extensive recent work performed in this field by other research groups worldwide might seem to detract from the conceptual originality and novelty of our approach; but at the same time it serves as an encouraging indication that the chosen approach is acknowledged in the broader science community as promising. This newly found synergy, acknowledged in the CTA newsletter from May 2014 reporting on the Workshop on Hanbury Brown and Twiss interferometry in Nice, makes us confident that our published and otherwise disseminated results will be integrated into a larger-scale on-going research effort aimed at performing astronomy observations of both bright and dark objects with unparalleled resolution. While we are satisfied with acceptance of our results by the international research community as a contribution to the field of intensity interferometry as well as to the on-going mission-oriented projects, we also have been aiming at receiving support to continue and advance this research at JPL. Several proposals have been submitted in pursuit of this goal. Three of them are still under consideration, and we expect to learn about the funding decisions soon. These new projects would leverage the results of this NIAC study and extend it along well-defined directions that have been discussed above. Shifting the main paradigm of our approach towards intensity interferometry entailed another important realization, that the actual imaging of dark objects, in a sense of mapping the column optical density distribution, is possible by using known numerical techniques, such as the Gerchberg-Saxton approach. This insight was also unanticipated in the beginning and caused a shift of the research focus from the initial plan. While this focus shift has been well-justified and fruitful, it has left several issues unexplored. Some of these issues, too, are included in the future research proposals

All-Optical Noise Quenching of An Integrated Frequency Comb

Integrated frequency combs promise transformation of lab-based metrology into disruptive real-world applications. These microcombs are, however, sensitive to stochastic thermal fluctuations of the integrated cavity refractive index, with its impact becoming more significant as the cavity size becomes smaller. This tradeoff between microcomb noise performance and footprint stands as a prominent obstacle to realizing applications beyond a controlled lab environment. Here, we demonstrate that small footprint and low noise become compatible through the all-optical Kerr-induced synchronization (KIS) method. Our study unveils that the phase-locking nature of the synchronization between the cavity soliton and the injected reference pump laser enables the microcomb to no longer be limited by internal noise sources. Instead, the microcomb noise is mostly limited by external sources, namely, the frequency noise of the two pumps that doubly pin the microcomb. First, we theoretically and experimentally show that the individual comb tooth linewidths of an octave-spanning microcomb remain within the same order-of-magnitude as the pump lasers, contrary to the single-pumped case that exhibits a more than two order-of-magnitude increase from the pump to the comb edge. Second, we theoretically show that intrinsic noise sources such as thermorefractive noise in KIS are quenched at the cavity decay rate, greatly decreasing its impact. Experimentally, we show that even with free-running lasers, the KIS microcomb can exhibit better repetition rate noise performance than the predicted thermorefractive noise limitation in absence of KIS

Selected NSF projects of interest to K-12 engineering and technology education

The National Science Foundation (NSF) portfolio addressing K-12 engineering and technology education includes initiatives supported by a number of programs. This list includes projects identified by searching lists of awards in the respective NSF programs as well as projects suggested for inclusion by researchers, practitioners, and program officers. The list includes projects concerned with standards in technology education, teacher professional development, centers for learning and teaching, preparation of instructional materials, digital libraries, and technological activities in informal settings, as well as small numbers of projects in several other areas. This compilation provides current information on projects of interest to educators, instructional designers, consultants, and researchers who are concerned with the development, delivery, and evaluation of instruction to develop technological literacy, particularly in K-12 engineering and technology education. Projects are grouped under headings for each program providing primary funding. Within each program, the award numbers determine the order of listing, with the most recent awards at the beginning of the list. Each award entry includes the project title, NSF award number, funding program, amount of the award to date, starting and ending dates, the principal investigator (PI), the grantee institution, PI contact information, the url of the project Web site, a description of the project’s activities and accomplishments, relevant previous awards to the PI, products developed by the project, and information on the availability of those products

Understanding Quantum Technologies 2022

Understanding Quantum Technologies 2022 is a creative-commons ebook that provides a unique 360 degrees overview of quantum technologies from science and technology to geopolitical and societal issues. It covers quantum physics history, quantum physics 101, gate-based quantum computing, quantum computing engineering (including quantum error corrections and quantum computing energetics), quantum computing hardware (all qubit types, including quantum annealing and quantum simulation paradigms, history, science, research, implementation and vendors), quantum enabling technologies (cryogenics, control electronics, photonics, components fabs, raw materials), quantum computing algorithms, software development tools and use cases, unconventional computing (potential alternatives to quantum and classical computing), quantum telecommunications and cryptography, quantum sensing, quantum technologies around the world, quantum technologies societal impact and even quantum fake sciences. The main audience are computer science engineers, developers and IT specialists as well as quantum scientists and students who want to acquire a global view of how quantum technologies work, and particularly quantum computing. This version is an extensive update to the 2021 edition published in October 2021.Comment: 1132 pages, 920 figures, Letter forma