Improving the Accuracy of Fuzzy Decision Tree by Direct Back Propagation with Adaptive Learning Rate and Momentum Factor for User Localization

AbstractMost prevailing availability of wireless networks has elevated an interest in developing a smart indoor environment by utilizing the hand held devices of the users. The user localization helps in automating the activities like automating switch on/off of the room lights, air conditioning etc., which makes the environment smart. Here, we consider locating the users as a pattern classification problem and use Fuzzy decision tree (FDT) as a knowledge discovery method to locate the users based on the wireless signal strength observed by their handheld devices. To increase the FDT accuracy and to achieve faster convergence, we came up with a novel strategy named Improved Neuro Fuzzy Decision Tree with an adaptive learning rate and momentum factor to optimize the parameters of FDT. The proposed approach can be used for any classification problem. From the results obtained, we observe that our proposed algorithm achieves better convergence and accuracy

Neural fuzzy digital filtering: multivariate identifier filters involving multiple inputs and multiple outputs (mimo)

Multivariate identifier filters (multiple inputs and multiple outputs - MIMO) are adaptive digital systems having a loop in accordance with an objective function to adjust matrix parameter convergence to observable reference system dynamics. One way of complying with this condition is to use fuzzy logic inference mechanisms which interpret and select the best matrix parameter from a knowledge base. Such selection mechanisms with neural networks can provide a response from the best operational level for each change in state (Shannon, 1948). This paper considers the MIMO digital filter model using neuro fuzzy digital filtering to find an adaptive  parameter matrix which is integrated into the Kalman filter by the transition matrix. The filter uses the neural network as back-propagation into the fuzzy mechanism to do this, interpreting its variables and its respective levels and selecting the best values for automatically adjusting transition matrix values. The Matlab simulation describes the neural fuzzy digital filter giving an approximation of exponential convergence seen in functional error.Los filtros identificadores multivariables (MIMO) son sistemas digitales adaptivos que cuentan con retroalimentación para que, de acuerdo a una función objetivo, ajusten su matriz de parámetros con la que se aproximan a la di-námica observable del sistema de referencia. Una forma de que un identificador cumpla con esas condiciones, es la de la lógica difusa por medio de sus mecanismos de in-ferencia que interpretan y seleccionan en una base de co-nocimiento la mejor matriz de parámetros. Estos mecanismos de selección mediante las redes neuronales permiten encontrar la respuesta con el mejor nivel de operación para cada cambio de estado (Shannon, 1948). En este artículo se considera en el modelo MIMO del filtrado digital, el proceso neuronal difuso para la estimación matricial de parámetros adaptiva, que se integra en el filtro de Kalman a través de la matriz de transición. Para ello se utilizó la red neuronal del tipo retropropagación en el mecanismo difuso, interpretando sus variables y sus respectivos niveles, seleccionando los mejores valores para ajustar automáticamente los valores de la matriz de transición. La simulación en Matlab presenta al filtrado digital neuronal difuso dando el seguimiento, observándose un funcional de error decreciente exponencialmente

A Survey of Neural Trees

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to integrate NNs and DTs explicitly or implicitly. In this survey, these approaches are organized in a school which we term as neural trees (NTs). This survey aims to present a comprehensive review of NTs and attempts to identify how they enhance the model interpretability. We first propose a thorough taxonomy of NTs that expresses the gradual integration and co-evolution of NNs and DTs. Afterward, we analyze NTs in terms of their interpretability and performance, and suggest possible solutions to the remaining challenges. Finally, this survey concludes with a discussion about other considerations like conditional computation and promising directions towards this field. A list of papers reviewed in this survey, along with their corresponding codes, is available at: https://github.com/zju-vipa/awesome-neural-treesComment: 35 pages, 7 figures and 1 tabl

The Encyclopedia of Neutrosophic Researchers - vol. 3

This is the third volume of the Encyclopedia of Neutrosophic Researchers, edited from materials offered by the authors who responded to the editor’s invitation. The authors are listed alphabetically. The introduction contains a short history of neutrosophics, together with links to the main papers and books. Neutrosophic set, neutrosophic logic, neutrosophic probability, neutrosophic statistics, neutrosophic measure, neutrosophic precalculus, neutrosophic calculus and so on are gaining significant attention in solving many real life problems that involve uncertainty, impreciseness, vagueness, incompleteness, inconsistent, and indeterminacy. In the past years the fields of neutrosophics have been extended and applied in various fields, such as: artificial intelligence, data mining, soft computing, decision making in incomplete / indeterminate / inconsistent information systems, image processing, computational modelling, robotics, medical diagnosis, biomedical engineering, investment problems, economic forecasting, social science, humanistic and practical achievements

Modelado de sistemas multimedia para personalización y recomendación híbrida a partir del consumo audiovisual de los usuarios

This doctoral thesis focuses on the modeling of multimedia systems to create personalized recommendation services based on the analysis of users’ audiovisual consumption. Research is focused on the characterization of both users’ audiovisual consumption and content, specifically images and video. This double characterization converges into a hybrid recommendation algorithm, adapted to different application scenarios covering different specificities and constraints. Hybrid recommendation systems use both content and user information as input data, applying the knowledge from the analysis of these data as the initial step to feed the algorithms in order to generate personalized recommendations. Regarding the user information, this doctoral thesis focuses on the analysis of audiovisual consumption to infer implicitly acquired preferences. The inference process is based on a new probabilistic model proposed in the text. This model takes into account qualitative and quantitative consumption factors on the one hand, and external factors such as zapping factor or company factor on the other. As for content information, this research focuses on the modeling of descriptors and aesthetic characteristics, which influence the user and are thus useful for the recommendation system. Similarly, the automatic extraction of these descriptors from the audiovisual piece without excessive computational cost has been considered a priority, in order to ensure applicability to different real scenarios. Finally, a new content-based recommendation algorithm has been created from the previously acquired information, i.e. user preferences and content descriptors. This algorithm has been hybridized with a collaborative filtering algorithm obtained from the current state of the art, so as to compare the efficiency of this hybrid recommender with the individual techniques of recommendation (different hybridization techniques of the state of the art have been studied for suitability). The content-based recommendation focuses on the influence of the aesthetic characteristics on the users. The heterogeneity of the possible users of these kinds of systems calls for the use of different criteria and attributes to create effective recommendations. Therefore, the proposed algorithm is adaptable to different perceptions producing a dynamic representation of preferences to obtain personalized recommendations for each user of the system. The hypotheses of this doctoral thesis have been validated by conducting a set of tests with real users, or by querying a database containing user preferences - available to the scientific community. This thesis is structured based on the different research and validation methodologies of the techniques involved. In the three central chapters the state of the art is studied and the developed algorithms and models are validated via self-designed tests. It should be noted that some of these tests are incremental and confirm the validation of previously discussed techniques. Resumen Esta tesis doctoral se centra en el modelado de sistemas multimedia para la creación de servicios personalizados de recomendación a partir del análisis de la actividad de consumo audiovisual de los usuarios. La investigación se focaliza en la caracterización tanto del consumo audiovisual del usuario como de la naturaleza de los contenidos, concretamente imágenes y vídeos. Esta doble caracterización de usuarios y contenidos confluye en un algoritmo de recomendación híbrido que se adapta a distintos escenarios de aplicación, cada uno de ellos con distintas peculiaridades y restricciones. Todo sistema de recomendación híbrido toma como datos de partida tanto información del usuario como del contenido, y utiliza este conocimiento como entrada para algoritmos que permiten generar recomendaciones personalizadas. Por la parte de la información del usuario, la tesis se centra en el análisis del consumo audiovisual para inferir preferencias que, por lo tanto, se adquieren de manera implícita. Para ello, se ha propuesto un nuevo modelo probabilístico que tiene en cuenta factores de consumo tanto cuantitativos como cualitativos, así como otros factores de contorno, como el factor de zapping o el factor de compañía, que condicionan la incertidumbre de la inferencia. En cuanto a la información del contenido, la investigación se ha centrado en la definición de descriptores de carácter estético y morfológico que resultan influyentes en el usuario y que, por lo tanto, son útiles para la recomendación. Del mismo modo, se ha considerado una prioridad que estos descriptores se puedan extraer automáticamente de un contenido sin exigir grandes requisitos computacionales y, de tal forma que se garantice la posibilidad de aplicación a escenarios reales de diverso tipo. Por último, explotando la información de preferencias del usuario y de descripción de los contenidos ya obtenida, se ha creado un nuevo algoritmo de recomendación basado en contenido. Este algoritmo se cruza con un algoritmo de filtrado colaborativo de referencia en el estado del arte, de tal manera que se compara la eficiencia de este recomendador híbrido (donde se ha investigado la idoneidad de las diferentes técnicas de hibridación del estado del arte) con cada una de las técnicas individuales de recomendación. El algoritmo de recomendación basado en contenido que se ha creado se centra en las posibilidades de la influencia de factores estéticos en los usuarios, teniendo en cuenta que la heterogeneidad del conjunto de usuarios provoca que los criterios y atributos que condicionan las preferencias de cada individuo sean diferentes. Por lo tanto, el algoritmo se adapta a las diferentes percepciones y articula una metodología dinámica de representación de las preferencias que permite obtener recomendaciones personalizadas, únicas para cada usuario del sistema. Todas las hipótesis de la tesis han sido debidamente validadas mediante la realización de pruebas con usuarios reales o con bases de datos de preferencias de usuarios que están a disposición de la comunidad científica. La diferente metodología de investigación y validación de cada una de las técnicas abordadas condiciona la estructura de la tesis, de tal manera que los tres capítulos centrales se estructuran sobre su propio estudio del estado del arte y los algoritmos y modelos desarrollados se validan mediante pruebas autónomas, sin impedir que, en algún caso, las pruebas sean incrementales y ratifiquen la validación de técnicas expuestas anteriormente

Design of Neuro-Fuzzy Decision Trees

In order to improve accuracy of fuzzy decision trees classification we propose a procedure of parameters adaptation by means of neural network training. In the direct cycle, fuzzy decision trees are based on the algorithm of fuzzy ID3; in the feedback cycle, parameters of fuzzy decision trees are adapted based on stochastic gradient algorithm by traverse to the root nodes back from the leaves. Using this strategy, the hierarchical structure of the fuzzy decision trees remains fixed

Design of neuro-fuzzy decision trees

In order to improve accuracy of fuzzy decision trees classification we propose a procedure of parameters adaptation by means of neural network training. In the direct cycle, fuzzy decision trees are based on the algorithm of fuzzy ID3; in the feedback cycle, parameters of fuzzy decision trees are adapted based on stochastic gradient algorithm by traverse to the root nodes back from the leaves. Using this strategy, the hierarchical structure of the fuzzy decision trees remains fixed