The effective use of the DSmT for multi-class classification

International audienceThe extension of the Dezert-Smarandache theory (DSmT) for the multi-class framework has a feasible computational complexity for various applications when the number of classes is limited or reduced typically two classes. In contrast, when the number of classes is large, the DSmT generates a high computational complexity. This paper proposes to investigate the effective use of the DSmT for multi-class classification in conjunction with the Support Vector Machines using the One-Against-All (OAA) implementation, which allows offering two advantages: firstly, it allows modeling the partial ignorance by including the complementary classes in the set of focal elements during the combination process and, secondly, it allows reducing drastically the number of focal elements using a supervised model by introducing exclusive constraints when classes are naturally and mutually exclusive. To illustrate the effective use of the DSmT for multi-class classification, two SVM-OAA implementations are combined according three steps: transformation of the SVM classifier outputs into posterior probabilities using a sigmoid technique of Platt, estimation of masses directly through the proposed model and combination of masses through the Proportional Conflict Redistribution (PCR6). To prove the effective use of the proposed framework, a case study is conducted on the handwritten digit recognition. Experimental results show that it is possible to reduce efficiently both the number of focal elements and the classification error rate

Sensor Fusion for Object Detection and Tracking in Autonomous Vehicles

Autonomous driving vehicles depend on their perception system to understand the environment and identify all static and dynamic obstacles surrounding the vehicle. The perception system in an autonomous vehicle uses the sensory data obtained from different sensor modalities to understand the environment and perform a variety of tasks such as object detection and object tracking. Combining the outputs of different sensors to obtain a more reliable and robust outcome is called sensor fusion. This dissertation studies the problem of sensor fusion for object detection and object tracking in autonomous driving vehicles and explores different approaches for utilizing deep neural networks to accurately and efficiently fuse sensory data from different sensing modalities. In particular, this dissertation focuses on fusing radar and camera data for 2D and 3D object detection and object tracking tasks. First, the effectiveness of radar and camera fusion for 2D object detection is investigated by introducing a radar region proposal algorithm for generating object proposals in a two-stage object detection network. The evaluation results show significant improvement in speed and accuracy compared to a vision-based proposal generation method. Next, radar and camera fusion is used for the task of joint object detection and depth estimation where the radar data is used in conjunction with image features to generate object proposals, but also provides accurate depth estimation for the detected objects in the scene. A fusion algorithm is also proposed for 3D object detection where where the depth and velocity data obtained from the radar is fused with the camera images to detect objects in 3D and also accurately estimate their velocities without requiring any temporal information. Finally, radar and camera sensor fusion is used for 3D multi-object tracking by introducing an end-to-end trainable and online network capable of tracking objects in real-time

Robô interativo

Dissertação de mestrado em Engenharia InformáticaUma das principais fronteiras atuais na robótica é a possibilidade de permitir ao ser humano partilhar o mesmo ambiente de trabalho que o robô, ou mesmo interagir com ele diretamente. São várias as aplicações que tal desenvolvimento pode permitir, desde a medicina até ao mundo industrial. Desde que surgiram as máquinas tem como objetivo facilitar e otimizar a capacidade humana de produção, fazendo trabalho nas indústrias melhor e mais rápido que o homem, assim em muitos casos acabaram substituindo a mão-de-obra humana. Porém em alguns casos o trabalho poderia ter um melhor desempenho se humanos e robôs trabalhassem em conjunto. Este projeto tem em vista estimular a interação entre um humano e um robô, mais concretamente o robô tenta perceber se o humano presta atenção e dá feedback das ações que o mesmo desempenha. O projeto é focado na monitorização da atenção, em que o robô procura focar a atenção no comportamento do humano e através disso perceber se este está a interagir com ele. Para o desenvolvimento do projeto foi criada uma estrutura que permite ao robô efetuar os vários movimentos de interação com o humano, mais concretamente o robô tem a forma de uma aranha pelo simples facto de podermos ter um maior número de movimentos. Para o robô conseguir comunicar, sentir e interagir com o ser humano, este possuir alguns sensores que permitem essa interação.One of the main current frontiers in robotics is the possibility of allowing the human being to share the same work environment that the robot, or even interact with him directly. There are several applications that can allow such development, from medicine to the industrial world. Since emerged machines aims to facilitate and optimize the human capacity, doing work in the industries better and faster than humans, so in many cases ended up replacing hand labor human. But in some cases the work could have better performance if humans and robots work together. This project aims to stimulate interaction between a human and a robot, more specifically, the robot tries to understand if human watches and gives feedback of the actions that it performs. The project is focused on monitoring of attention, in which the robot seeks to focus attention on human behavior and thereby realize if he is interacting with it. To develop the project was created a structure that enables the robot to perform various movements to interact with the human, more specifically the robot has the shape of a spider simply because we have a larger number of movements. To allow the robot communicate, feel and interact with humans, the robot has some sensors that allow this interaction

Fusion ensembliste de donn´ees pour la surveillance des personnes d´ependantes en habitat intelligent

Our research work is a part of the project FUI 14 FEDER Collectivités E-monitor’âge. This project takes place within the framework of Ambient Assisted Living (AAL) which aims to improve the safety and the comfort of elderly people living in smart nursing homes. This work aims to monitor the activities of elderly persons using information from different sensors. The ADL (Activities of Daily Living) are used to evaluate the ability of the person to perform on their own a selection of the activities which are essential for an independent living in the everyday life. Generally, process knowledge and measurements coming from sensors are prone to indeterminable noise. In our work, we suppose that these errors are unknown but bounded. Taking into account this hypothesis, we show how to solve the estimation issue using set-membership computations techniques. Our algorithm, based on set-membership approach, consists of two steps. The prediction step, based on the use of a random walk mobility with minimum assumptions (maximum speed of moving), employs the previous state estimate to provide the prediction zone where the person may be located. The correction step uses the informations coming from the sensors to refine this predicted zone. This step uses a relaxed constraints propagation technique, q-relaxed intersection, to deal with faulty measurements. This proposed method allows us to compute the uncertainty domain for the reconstructed localization of moving targets as dealing with outliers.Mes travaux de recherches en thèse s’inscrivent dans le cadre du projet FUIE-monitorâge. L’objectif du projet, réunissant de nombreux partenaires industriels et universitaires, est d’améliorer la prise en charge individualisée et la sécurité du résident dans les établissements d’hébergement pour personnes âgées dépendantes(EHPAD). Dans ce travail, nous avons élaboré une méthode de fusion de données multimodales issues des différents capteurs installés dans un smart home. Ces informations sont utilisées pour la localisation intérieure des personnes afin de surveiller leurs activités journalières. Généralement, les mesures issues des capteurs sont soumises à des incertitudes. Dans nos travaux, ces erreurs sont supposées inconnues mais bornées. En tenant compte de cette hypothèse, une méthode de résolution d’un problème d’estimation d’état est élaborée en se basant sur des calculs ensemblistes. Notre algorithme de filtrage ensembliste comporte deux étapes. La première, dite de prédiction, est basée sur l’utilisation d’un modèle de marche aléatoire avec des hypothèses minimales (vitesse de déplacement maximale) pour prédire la zone où se trouve la personne. La deuxième étape, dite de correction, consiste à utiliser la mesure pour affiner cette zone. Cette étape utilise une technique de propagation de contraintes relâchée, q-relaxed intersection, pour permettre une meilleure robustesse par rapport aux données aberrantes. Notre algorithme est capable de quantifier, par un intervalle, l’incertitude commise sur les positions de cibles en mouvement tout en détectant les défauts de capteurs

Advances and Applications of Dezert-Smarandache Theory (DSmT) for Information Fusion (Collected Works), Vol. 4

The fourth volume on Advances and Applications of Dezert-Smarandache Theory (DSmT) for information fusion collects theoretical and applied contributions of researchers working in different fields of applications and in mathematics. The contributions (see List of Articles published in this book, at the end of the volume) have been published or presented after disseminating the third volume (2009, http://fs.unm.edu/DSmT-book3.pdf) in international conferences, seminars, workshops and journals. First Part of this book presents the theoretical advancement of DSmT, dealing with Belief functions, conditioning and deconditioning, Analytic Hierarchy Process, Decision Making, Multi-Criteria, evidence theory, combination rule, evidence distance, conflicting belief, sources of evidences with different importance and reliabilities, importance of sources, pignistic probability transformation, Qualitative reasoning under uncertainty, Imprecise belief structures, 2-Tuple linguistic label, Electre Tri Method, hierarchical proportional redistribution, basic belief assignment, subjective probability measure, Smarandache codification, neutrosophic logic, Evidence theory, outranking methods, Dempster-Shafer Theory, Bayes fusion rule, frequentist probability, mean square error, controlling factor, optimal assignment solution, data association, Transferable Belief Model, and others. More applications of DSmT have emerged in the past years since the apparition of the third book of DSmT 2009. Subsequently, the second part of this volume is about applications of DSmT in correlation with Electronic Support Measures, belief function, sensor networks, Ground Moving Target and Multiple target tracking, Vehicle-Born Improvised Explosive Device, Belief Interacting Multiple Model filter, seismic and acoustic sensor, Support Vector Machines, Alarm classification, ability of human visual system, Uncertainty Representation and Reasoning Evaluation Framework, Threat Assessment, Handwritten Signature Verification, Automatic Aircraft Recognition, Dynamic Data-Driven Application System, adjustment of secure communication trust analysis, and so on. Finally, the third part presents a List of References related with DSmT published or presented along the years since its inception in 2004, chronologically ordered