Real-time edge tracking using a tactile sensor

Object recognition through the use of input from multiple sensors is an important aspect of an autonomous manipulation system. In tactile object recognition, it is necessary to determine the location and orientation of object edges and surfaces. A controller is proposed that utilizes a tactile sensor in the feedback loop of a manipulator to track along edges. In the control system, the data from the tactile sensor is first processed to find edges. The parameters of these edges are then used to generate a control signal to a hybrid controller. Theory is presented for tactile edge detection and an edge tracking controller. In addition, experimental verification of the edge tracking controller is presented

Piezoelectric Transducers Based on Aluminum Nitride and Polyimide for Tactile Applications

The development of micro systems with smart sensing capabilities is paving the way to progresses in the technology for humanoid robotics. The importance of sensory feedback has been recognized the enabler of a high degree of autonomy for robotic systems. In tactile applications, it can be exploited not only to avoid objects slipping during their manipulation but also to allow safe interaction with humans and unknown objects and environments. In order to ensure the minimal deformation of an object during subtle manipulation tasks, information not only on contact forces between the object and fingers but also on contact geometry and contact friction characteristics has to be provided. Touch, unlike other senses, is a critical component that plays a fundamental role in dexterous manipulation capabilities and in the evaluation of objects properties such as type of material, shape, texture, stiffness, which is not easily possible by vision alone. Understanding of unstructured environments is made possible by touch through the determination of stress distribution in the surrounding area of physical contact. To this aim, tactile sensing and pressure detection systems should be integrated as an artificial tactile system. As illustrated in the Chapter I, the role of external stimuli detection in humans is provided by a great number of sensorial receptors: they are specialized endings whose structure and location in the skin determine their specific signal transmission characteristics. Especially, mechanoreceptors are specialized in the conversion of the mechanical deformations caused by force, vibration or slip on skin into electrical nerve impulses which are processed and encoded by the central nervous system. Highly miniaturized systems based on MEMS technology seem to imitate properly the large number of fast responsive mechanoreceptors present in human skin. Moreover, an artificial electronic skin should be lightweight, flexible, soft and wearable and it should be fabricated with compliant materials. In this respect a big challenge of bio-inspired technologies is the efficient application of flexible active materials to convert the mechanical pressure or stress into a usable electric signal (voltage or current). In the emerging field of soft active materials, able of large deformation, piezoelectrics have been recognized as a really promising and attractive material in both sensing and actuation applications. As outlined in Chapter II, there is a wide choice of materials and material forms (ceramics: PZT; polycrystalline films: ZnO, AlN; polymers and copolymers: PVDF, PVDF-TrFe) which are actively piezoelectric and exhibit features more or less attractive. Among them, aluminum nitride is a promising piezoelectric material for flexible technology. It has moderate piezoelectric coefficient, when available in c-axis oriented polycrystalline columnar structure, but, at same time, it exhibits low dielectric constant, high temperature stability, large band gap, large electrical resistivity, high breakdown voltage and low dielectric loss which make it suitable for transducers and high thermal conductivity which implies low thermal drifts. The high chemical stability allows AlN to be used in humid environments. Moreover, all the above properties and its deposition method make AlN compatible with CMOS technology. Exploiting the features of the AlN, three-dimensional AlN dome-shaped cells, embedded between two metal electrodes, are proposed in this thesis. They are fabricated on general purpose Kapton™ substrate, exploiting the flexibility of the polymer and the electrical stability of the semiconductor at the same time. As matter of fact, the crystalline layers release a compressive stress over the polymer, generating three-dimensional structures with reduced stiffness, compared to the semiconductor materials. In Chapter III, a mathematical model to calculate the residual stresses which arise because of mismatch in coefficient of thermal expansion between layers and because of mismatch in lattice constants between the substrate and the epitaxially grown films is adopted. The theoretical equation is then used to evaluate the dependence of geometrical features of the fabricated three-dimensional structures on compressive residual stress. Moreover, FEM simulations and theoretical models analysis are developed in order to qualitative explore the operation principle of curved membranes, which are labelled dome-shaped diaphragm transducers (DSDT), both as sensors and as piezo-actuators and for the related design optimization. For the reliability of the proposed device as a force/pressure sensor and piezo-actuator, an exhaustive electromechanical characterization of the devices is carried out. A complete description of the microfabrication processes is also provided. As shown in Chapter IV, standard microfabrication techniques are employed to fabricate the array of DSDTs. The overall microfabrication process involves deposition of metal and piezoelectric films, photolithography and plasma-based dry and wet etching to pattern thin films with the desired features. The DSDT devices are designed and developed according to FEM and theoretical analysis and following the typical requirements of force/pressure systems for tactile applications. Experimental analyses are also accomplished to extract the relationship between the compressive residual stress due to the aluminum nitride and the geometries of the devices. They reveal different deformations, proving the dependence of the geometrical features of the three-dimensional structures on residual stress. Moreover, electrical characterization is performed to determine capacitance and impedance of the DSDTs and to experimentally calculate the relative dielectric constant of sputtered AlN piezoelectric film. In order to investigate the mechanical behaviour of the curved circular transducers, a characterization of the flexural deflection modes of the DSDT membranes is carried out. The natural frequency of vibrations and the corresponding displacements are measured by a Laser Doppler Vibrometer when a suitable oscillating voltage, with known amplitude, is applied to drive the piezo-DSDTs. Finally, being developed for tactile sensing purpose, the proposed technology is tested in order to explore the electromechanical response of the device when impulsive dynamic and/or long static forces are applied. The study on the impulsive dynamic and long static stimuli detection is then performed by using an ad hoc setup measuring both the applied loading forces and the corresponding generated voltage and capacitance variation. These measurements allow a thorough test of the sensing abilities of the AlN-based DSDT cells. Finally, as stated in Chapter V, the proposed technology exhibits an improved electromechanical coupling with higher mechanical deformation per unit energy compared with the conventional plate structures, when the devices are used as piezo-actuator. On the other hand, it is well suited to realize large area tactile sensors for robotics applications, opening up new perspectives to the development of latest generation biomimetic sensors and allowing the design and the fabrication of miniaturized devices

Sensing and describing 3-D structure

Discovering the three dimensional structure of an object is important for a variety of robot tasks. Single sensor systems such as machine vision systems cannot reliably compute three dimensional structure in unconstrained environments. Active, exploratory tactile sensing can be used to complement passive stereo vision data to derive robust surface and feature descriptions of objects. The control for tactile sensing is provided by the vision system which provides regions of interest that the tactile system can explore. The descriptions of surfaces and features are accurate and can be used in a later matching phase against a model data base of objects to identify the object and its position and orientation in space

Sensory processing and world modeling for an active ranging device

In this project, we studied world modeling and sensory processing for laser range data. World Model data representation and operation were defined. Sensory processing algorithms for point processing and linear feature detection were designed and implemented. The interface between world modeling and sensory processing in the Servo and Primitive levels was investigated and implemented. In the primitive level, linear features detectors for edges were also implemented, analyzed and compared. The existing world model representations is surveyed. Also presented is the design and implementation of the Y-frame model, a hierarchical world model. The interfaces between the world model module and the sensory processing module are discussed as well as the linear feature detectors that were designed and implemented

Novel Tactile-SIFT Descriptor for Object Shape Recognition

Using a tactile array sensor to recognize an object often requires multiple touches at different positions. This process is prone to move or rotate the object, which inevitably increases difficulty in object recognition. To cope with the unknown object movement, this paper proposes a new tactile-SIFT descriptor to extract features in view of gradients in the tactile image to represent objects, to allow the features being invariant to object translation and rotation. The tactile-SIFT segments a tactile image into overlapping subpatches, each of which is represented using a dn-dimensional gradient vector, similar to the classic SIFT descriptor. Tactile-SIFT descriptors obtained from multiple touches form a dictionary of k words, and the bag-of-words method is then used to identify objects. The proposed method has been validated by classifying 18 real objects with data from an off-the-shelf tactile sensor. The parameters of the tactile-SIFT descriptor, including the dimension size dn and the number of subpatches sp, are studied. It is found that the optimal performance is obtained using an 8-D descriptor with three subpatches, taking both the classification accuracy and time efficiency into consideration. By employing tactile-SIFT, a recognition rate of 91.33% has been achieved with a dictionary size of 50 clusters using only 15 touches

ホール効果を利用したコンパクトかつ柔軟な分散型3軸スキンセンサー「uSkin」の開発

早大学位記番号:新8143早稲田大

MKS: a multisensor kernel system

Journal ArticleThe multisensor kernel system (MKS) is presented as a means for multisensor integration and data acquisition. This system has been developed in the context of a robot work station equipped with various types of sensors utilizing three-dimensional laser range finder data and two-dimensional camera data. Specific goals that have been achieved include 1) Developing a suitable low-level representation of raw data and/or features extracted from the raw data of the various sensors; 2) Providing a method for efficient reconfiguration of the sensor system in terms of "logical" sensors which map onto physical sensors and computation; and 3) Providing a basis for high-level object modeling techniques