Adaptive pattern recognition by mini-max neural networks as a part of an intelligent processor

In this decade and progressing into 21st Century, NASA will have missions including Space Station and the Earth related Planet Sciences. To support these missions, a high degree of sophistication in machine automation and an increasing amount of data processing throughput rate are necessary. Meeting these challenges requires intelligent machines, designed to support the necessary automations in a remote space and hazardous environment. There are two approaches to designing these intelligent machines. One of these is the knowledge-based expert system approach, namely AI. The other is a non-rule approach based on parallel and distributed computing for adaptive fault-tolerances, namely Neural or Natural Intelligence (NI). The union of AI and NI is the solution to the problem stated above. The NI segment of this unit extracts features automatically by applying Cauchy simulated annealing to a mini-max cost energy function. The feature discovered by NI can then be passed to the AI system for future processing, and vice versa. This passing increases reliability, for AI can follow the NI formulated algorithm exactly, and can provide the context knowledge base as the constraints of neurocomputing. The mini-max cost function that solves the unknown feature can furthermore give us a top-down architectural design of neural networks by means of Taylor series expansion of the cost function. A typical mini-max cost function consists of the sample variance of each class in the numerator, and separation of the center of each class in the denominator. Thus, when the total cost energy is minimized, the conflicting goals of intraclass clustering and interclass segregation are achieved simultaneously

Respiratory organ motion in interventional MRI : tracking, guiding and modeling

Respiratory organ motion is one of the major challenges in interventional MRI, particularly in interventions with therapeutic ultrasound in the abdominal region. High-intensity focused ultrasound found an application in interventional MRI for noninvasive treatments of different abnormalities. In order to guide surgical and treatment interventions, organ motion imaging and modeling is commonly required before a treatment start. Accurate tracking of organ motion during various interventional MRI procedures is prerequisite for a successful outcome and safe therapy. In this thesis, an attempt has been made to develop approaches using focused ultrasound which could be used in future clinically for the treatment of abdominal organs, such as the liver and the kidney. Two distinct methods have been presented with its ex vivo and in vivo treatment results. In the first method, an MR-based pencil-beam navigator has been used to track organ motion and provide the motion information for acoustic focal point steering, while in the second approach a hybrid imaging using both ultrasound and magnetic resonance imaging was combined for advanced guiding capabilities. Organ motion modeling and four-dimensional imaging of organ motion is increasingly required before the surgical interventions. However, due to the current safety limitations and hardware restrictions, the MR acquisition of a time-resolved sequence of volumetric images is not possible with high temporal and spatial resolution. A novel multislice acquisition scheme that is based on a two-dimensional navigator, instead of a commonly used pencil-beam navigator, was devised to acquire the data slices and the corresponding navigator simultaneously using a CAIPIRINHA parallel imaging method. The acquisition duration for four-dimensional dataset sampling is reduced compared to the existing approaches, while the image contrast and quality are improved as well. Tracking respiratory organ motion is required in interventional procedures and during MR imaging of moving organs. An MR-based navigator is commonly used, however, it is usually associated with image artifacts, such as signal voids. Spectrally selective navigators can come in handy in cases where the imaging organ is surrounding with an adipose tissue, because it can provide an indirect measure of organ motion. A novel spectrally selective navigator based on a crossed-pair navigator has been developed. Experiments show the advantages of the application of this novel navigator for the volumetric imaging of the liver in vivo, where this navigator was used to gate the gradient-recalled echo sequence

TOWARD INTELLIGENT WELDING BY BUILDING ITS DIGITAL TWIN

To meet the increasing requirements for production on individualization, efficiency and quality, traditional manufacturing processes are evolving to smart manufacturing with the support from the information technology advancements including cyber-physical systems (CPS), Internet of Things (IoT), big industrial data, and artificial intelligence (AI). The pre-requirement for integrating with these advanced information technologies is to digitalize manufacturing processes such that they can be analyzed, controlled, and interacted with other digitalized components. Digital twin is developed as a general framework to do that by building the digital replicas for the physical entities. This work takes welding manufacturing as the case study to accelerate its transition to intelligent welding by building its digital twin and contributes to digital twin in the following two aspects (1) increasing the information analysis and reasoning ability by integrating deep learning; (2) enhancing the human user operative ability to physical welding manufacturing via digital twins by integrating human-robot interaction (HRI). Firstly, a digital twin of pulsed gas tungsten arc welding (GTAW-P) is developed by integrating deep learning to offer the strong feature extraction and analysis ability. In such a system, the direct information including weld pool images, arc images, welding current and arc voltage is collected by cameras and arc sensors. The undirect information determining the welding quality, i.e., weld joint top-side bead width (TSBW) and back-side bead width (BSBW), is computed by a traditional image processing method and a deep convolutional neural network (CNN) respectively. Based on that, the weld joint geometrical size is controlled to meet the quality requirement in various welding conditions. In the meantime, this developed digital twin is visualized to offer a graphical user interface (GUI) to human users for their effective and intuitive perception to physical welding processes. Secondly, in order to enhance the human operative ability to the physical welding processes via digital twins, HRI is integrated taking virtual reality (VR) as the interface which could transmit the information bidirectionally i.e., transmitting the human commends to welding robots and visualizing the digital twin to human users. Six welders, skilled and unskilled, tested this system by completing the same welding job but demonstrate different patterns and resulted welding qualities. To differentiate their skill levels (skilled or unskilled) from their demonstrated operations, a data-driven approach, FFT-PCA-SVM as a combination of fast Fourier transform (FFT), principal component analysis (PCA), and support vector machine (SVM) is developed and demonstrates the 94.44% classification accuracy. The robots can also work as an assistant to help the human welders to complete the welding tasks by recognizing and executing the intended welding operations. This is done by a developed human intention recognition algorithm based on hidden Markov model (HMM) and the welding experiments show that developed robot-assisted welding can help to improve welding quality. To further take the advantages of the robots i.e., movement accuracy and stability, the role of the robot upgrades to be a collaborator from an assistant to complete a subtask independently i.e., torch weaving and automatic seam tracking in weaving GTAW. The other subtask i.e., welding torch moving along the weld seam is completed by the human users who can adjust the travel speed to control the heat input and ensure the good welding quality. By doing that, the advantages of humans (intelligence) and robots (accuracy and stability) are combined together under this human-robot collaboration framework. The developed digital twin for welding manufacturing helps to promote the next-generation intelligent welding and can be applied in other similar manufacturing processes easily after small modifications including painting, spraying and additive manufacturing

Object-Based Rendering and 3D reconstruction Using a Moveable Image-Based System

published_or_final_versio

Automatic Control and Fault Diagnosis of MEMS Lateral Comb Resonators

Recent advancements in microfabrication of Micro Electro Mechanical Systems have made MEMS an important part of many applications such as safety and sensor/control devices. Miniature structure of MEMS makes them very sensitive to the environmental and operating conditions. In addition, fault in the device might change the parameters and result in unwanted behavioral variations. Therefore, imperfect device structure, fault and operating point dependencies suggest for active control of MEMS.;This research is focused on two main areas of control and fault diagnosis of MEMS devices. In the control part, the application of adaptive controllers is introduced for trajectory control of the device under health and fault conditions. Fault in different forms in the structure of the device are modeled and foundry manufactured for experimental verifications. Pull-in voltage effect in the MEMS Lateral Comb Resonators are investigated and controlled by variable structure controllers. Reliability of operation is enhanced by active control of the device under fault conditions.;The second part of this research is focused on the fault diagnosis of the MEMS devices. Fault is introduced and investigated for better understanding of the system behavioral changes. Modeling of the device in different operating conditions suggests for the multiple-model adaptive estimation (MMAE) fault diagnosis technique. Application of Kalman filters in MMAE is investigated and the performance of the fault diagnosis is compared with other techniques such as self-tuning and auto self-tuning techniques. According to the varying parameters of the system, online parameter identification systems are required to monitor the parameter variations and model the system accurately. Self-tuning banks are applied and combined with MMAE to provide accurate fault diagnosis systems. Different parameter identification techniques result in different system performances. In this regard, this research investigates the application of Recursive Least Square with Forgetting Factor. Different techniques for tuning of forgetting factor value are introduced and their results are compared for better performance. The organization of this dissertation is as follows:;Chapter I introduces the structure of the MEMS Lateral Comb Resonator; Chapter II introduces the application of control techniques and displacement feedback approach. Chapter III investigates the control approach and experimental results. In chapter IV, a new controller is introduced and designed for the MEMS trajectory controls. Chapter V is about the fault and different techniques of fault diagnosis in MEMS LCRs. Chapter 6 is the future work suggested through the current results and observations. Each chapter contains a section to summarize the concluding remarks

Experimental studies on shock wave interactions with flexible surfaces and development of flow diagnostic tools

Nowadays, light-weight composite materials have increasingly used for high-speed flight vehicles to improve their performance and efficiency. At supersonic speed, sonic fatigue, panel flutter, severe instabilities, and even catastrophic structural failure would occur due to the shock wave impingement on several flexible components of a given structural system either internally or externally. Therefore, investigation on shock wave interaction with flexible surfaces is crucial for the safety and performance of high-speed flight vehicles. This work aims to investigate the mechanism of shock wave interaction with flexible surfaces with and without the presence of the boundary layer. The first part involves the shock wave generated by supersonic starting jets interaction with flexible surfaces and the other one focuses on shock wave and boundary layer interaction (SBLI) over flexible surfaces. A novel miniature and cost-effective shock tube driven by detonation transmission tubing was designed and manufactured to simulate the supersonic starting jet and investigate the interaction of a supersonic starting jet with flexible surfaces. To investigate the characterization of this novel type shock tube, the pressure-time measurement in the driven section and the time-resolved shadowgraph were performed. The result shows that the flow structure from the open end of the shock tube driven by detonation transmission tubing agrees with that of conventional compressed-gas driven shock tubes. Moreover, this novel type of shock tube has good repeatability of less than 3% with a Mach number range of 1.29-1.58 when the weight of the NONEL explosive mixture varies from 3.6mg to 12.6mg. An unsteady background oriented schlieren (BOS) measurement system and a sprayable Polymer-Ceramic unsteady pressure sensitive paint (PC-PSP) system were developed. The preliminary BOS result in a supersonic wind tunnel shows that the sensitivity of the BOS system is good enough to visualize weak density variations caused by expansion waves, boundary layer, and weak oblique shocks. Additionally, compared with the commercial PC-PSP from Innovative Scientific Solutions Incorporated (ISSI), the in-house developed unsteady PSP system has higher pressure sensitivity, lower temperature sensitivity, and photo-degradation rate. To identify the shock movement, distortion and unsteadiness during the processes of the supersonic starting jet impingement and shock wave boundary layer interaction (SBLI) over flexible surfaces, an image processing scheme involving background subtraction in the frequency domain, filtering, resampling, edge detection, adaptive threshold, contour detection, feature extraction, and fitting was proposed and applied to process shadowgraph and schlieren sequences automatically. A large shadowgraph data set characterized by low signal to noise ratio (SNR) and small spatial resolution (312×260-pixel), was used to validate the proposed scheme. The result proves that the aforementioned image processing scheme can detect, track, localize, and fit shock waves in a subpixel accuracy. The mechanism of the interaction between the initial shock wave from a supersonic starting jet and flexible surfaces was investigated based on a square shock tube driven by detonation transmitting tube. Compared with that of the solid plate case, flexible surfaces can delay the shock reflection process because of the flexible panel deformation generated by the pressure difference between the top and the bottom. The delay time is around 8µs in the case of 0.1mm thick flexible surface, whereas it declines to around 4µs in the case of 0.3mm thick flexible surface because of the lower flexibility and deformation magnitude. However, interestingly, the propagation velocity of the reflected shock wave is basically the same for the solid plate and flexible panels, which means the flexible surface doesn’t reduce the strength of the reflection wave, although it delays its propagation. Also, there is not an apparent difference in the velocity of the reflected shock wave in the case of different incident shock Mach numbers when Ms varying from 1.22 to 1.54. These experimental results from this study are useful for validating numerical codes that are used for understanding fluid-structure interaction processes