Indonesian Plate Number Identification Using YOLACT and Mobilenetv2 in the Parking Management System

A vehicle registration plate is used for vehicle identity. In recent years, technology to identify plate numbers automatically or known as Automatic License Plate Recognition (ALPR) has grown over time. Convolutional Neural Network and   YOLACT are used to do plate number recognition from a video. The number plate recognition process consists of 3 stages. The first stage determines the coordinates of the number plate area on a video frame using YOLACT. The second stage is to separate each character inside the plat number using morphological operations, horizontal projection, and topological structural. The third stage is recognizing each character candidate using CNN MobileNetV2. To reduce computation time by only take several frames in the video, frame sampling is performed. This experiment study uses frame sampling, YOLACT epoch, MobileNet V2 epoch, and the ratio of validation data as parameters. The best results are with 250ms frame sampling succeed to reduce computational times up to 78%, whereas the accuracy is affected by the MobileNetV2 model with 100 epoch and ratio of split data validation 0,1 which results in 83,33% in average accuracy. Frame sampling can reduce computational time however higher frame sampling value causes the system fails to obtain plate region area

Modelo para la identificación de matrículas en la Ciudad de México mediante algoritmos de aprendizaje automático

Computer vision is one of the fields of Artificial Intelligence that is flourishing because it focuses on the development and improvement of techniques that allow computers to identify, process and classify images, in a way that resembles human vision. This feature makes them an excellent tool for vehicle control systems. For this reason, we developed a system for the recognition of Mexico City license plates using artificial vision techniques, image processing and automatic learning, in order to monitor and speed up response times, when a stolen vehicle is found.La visión artificial es uno de los campos de la Inteligencia Artificial que está en auge debido a que se centra en el desarrollo y mejoramiento de técnicas que permiten a las computadoras identificar, procesar y clasificar las imágenes de una manera similar a lo que hace la visión humana. Esta característica los vuelve una excelente herramienta para los sistemas de control vehicular. Por ello, nosotros desarrollamos un sistema para el reconocimiento de matrículas de la Ciudad de México mediante técnicas de visión artificial, procesamiento de imágenes y aprendizaje automático, con la finalidad de monitorear y agilizar los tiempos de respuesta en caso de encontrar un vehículo robado

Modelo para a identificação de placas na Cidade do México usando algoritmos de aprendizado de máquina

Computer vision is one of the fields of Artificial Intelligence that is flourishing because it focuses on the development and improvement of techniques that allow computers to identify, process and classify images, in a way that resembles human vision. This feature makes them an excellent tool for vehicle control systems. For this reason, we developed a system for the recognition of Mexico City license plates using artificial vision techniques, image processing and automatic learning, in order to monitor and speed up response times, when a stolen vehicle is found.La visión artificial es uno de los campos de la Inteligencia Artificial que está en auge debido a que se centra en el desarrollo y mejoramiento de técnicas que permiten a las computadoras identificar, procesar y clasificar las imágenes de una manera similar a lo que hace la visión humana. Esta característica los vuelve una excelente herramienta para los sistemas de control vehicular. Por ello, nosotros desarrollamos un sistema para el reconocimiento de matrículas de la Ciudad de México mediante técnicas de visión artificial, procesamiento de imágenes y aprendizaje automático, con la finalidad de monitorear y agilizar los tiempos de respuesta en caso de encontrar un vehículo robado.A visão artificial é um dos campos da Inteligência Artificial que está no auge debido a que se centralize no desarrollo e aprimoramento de técnicas que permite que o computador identifique, processe e classifique as imagens de uma maneira similar a lo que hace a visão humanos. Esta característica dos vuelve é uma excelente ferramenta para os sistemas de controle veicular. Por isso, nosotros desarrollamos um sistema para o reconhecimento de matrículas da Ciudad de México com técnicas de visão artificial, processamento de imagens e aprendizado automático, com a finalidad de monitorear e agilizar os tempos de resposta no caso de encontrar um veículo roubado

System for automatic detection and classification of cars in traffic

Objective: To develop a system for automatic detection and classification of cars in traffic in the form of a device for autonomic, real-time car detection, license plate recognition, and car color, model, and make identification from video. Methods: Cars were detected using the You Only Look Once (YOLO) v4 detector. The YOLO output was then used for classification in the next step. Colors were classified using the k-Nearest Neighbors (kNN) algorithm, whereas car models and makes were identified with a single-shot detector (SSD). Finally, license plates were detected using the OpenCV library and Tesseract-based optical character recognition. For the sake of simplicity and speed, the subsystems were run on an embedded Raspberry Pi computer. Results: A camera was mounted on the inside of the windshield to monitor cars in front of the camera. The system processed the camera’s video feed and provided information on the color, license plate, make, and model of the observed car. Knowing the license plate number provides access to details about the car owner, roadworthiness, car or license place reports missing, as well as whether the license plate matches the car. Car details were saved to file and displayed on the screen. The system was tested on real-time images and videos. The accuracies of car detection and car model classification (using 8 classes) in images were 88.5% and 78.5%, respectively. The accuracies of color detection and full license plate recognition were 71.5% and 51.5%, respectively. The system operated at 1 frame per second (1 fps). Conclusion: These results show that running standard machine learning algorithms on low-cost hardware may enable the automatic detection and classification of cars in traffic. However, there is significant room for improvement, primarily in license plate recognition. Accordingly, potential improvements in the future development of the system are proposed

Full depth CNN classifier for handwritten and license plate characters recognition

Character recognition is an important research field of interest for many applications. In recent years, deep learning has made breakthroughs in image classification, especially for character recognition. However, convolutional neural networks (CNN) still deliver state-of-the-art results in this area. Motivated by the success of CNNs, this paper proposes a simple novel full depth stacked CNN architecture for Latin and Arabic handwritten alphanumeric characters that is also utilized for license plate (LP) characters recognition. The proposed architecture is constructed by four convolutional layers, two max-pooling layers, and one fully connected layer. This architecture is low-complex, fast, reliable and achieves very promising classification accuracy that may move the field forward in terms of low complexity, high accuracy and full feature extraction. The proposed approach is tested on four benchmarks for handwritten character datasets, Fashion-MNIST dataset, public LP character datasets and a newly introduced real LP isolated character dataset. The proposed approach tests report an error of only 0.28% for MNIST, 0.34% for MAHDB, 1.45% for AHCD, 3.81% for AIA9K, 5.00% for Fashion-MNIST, 0.26% for Saudi license plate character and 0.97% for Latin license plate characters datasets. The license plate characters include license plates from Turkey (TR), Europe (EU), USA, United Arab Emirates (UAE) and Kingdom of Saudi Arabia (KSA)

Advances in Sensors, Big Data and Machine Learning in Intelligent Animal Farming

Animal production (e.g., milk, meat, and eggs) provides valuable protein production for human beings and animals. However, animal production is facing several challenges worldwide such as environmental impacts and animal welfare/health concerns. In animal farming operations, accurate and efficient monitoring of animal information and behavior can help analyze the health and welfare status of animals and identify sick or abnormal individuals at an early stage to reduce economic losses and protect animal welfare. In recent years, there has been growing interest in animal welfare. At present, sensors, big data, machine learning, and artificial intelligence are used to improve management efficiency, reduce production costs, and enhance animal welfare. Although these technologies still have challenges and limitations, the application and exploration of these technologies in animal farms will greatly promote the intelligent management of farms. Therefore, this Special Issue will collect original papers with novel contributions based on technologies such as sensors, big data, machine learning, and artificial intelligence to study animal behavior monitoring and recognition, environmental monitoring, health evaluation, etc., to promote intelligent and accurate animal farm management

Semantic guided multi-future human motion prediction

L'obiettivo della tesi è quello di esplorare il possibile utilizzo di un modello basato su reti neurali già sviluppato per la previsione multi-futuro del moto di un agente umano. Data una traiettoria con informazione spaziale (sotto forma di angoli relativi dei giunti) di una struttura semplificata di scheletro umano, si cerca di aumentare l'accuratezza di previsione del modello grazie all'aggiunta di informazione semantica. Per informazione semantica si intende il significato ad alto livello dell'azione che l'agente umano sta compiendo.Investigate the potential utilization of a pre-existing neural network model, originally designed for multi-future prediction of human agent motion in a static camera scene, adapted to forecast rotational trajectories of human joints. By incorporating semantic information, pertaining to the higher-level depiction of the human agent's action, the objective is to enhance the prediction accuracy of the model. The study made use of the AMASS and BABEL datasets to achieve this purpose

Intelligent Sensors for Human Motion Analysis

The book, "Intelligent Sensors for Human Motion Analysis," contains 17 articles published in the Special Issue of the Sensors journal. These articles deal with many aspects related to the analysis of human movement. New techniques and methods for pose estimation, gait recognition, and fall detection have been proposed and verified. Some of them will trigger further research, and some may become the backbone of commercial systems