Research of Indonesian license plates recognition on moving vehicles

The recognition of the characters in the license plate has been widely studied, but research to recognize the character of the license plate on a moving car is still rarely studied. License plate recognition on a moving car has several difficulties, for example capturing still images on moving images with non-blurred results. In addition, there are also several problems such as environmental disturbances (low lighting levels and heavy rain). In this study, a novel framework for recognizing license plate numbers is proposed that can overcome these problems. The proposed method in this study: detects moving vehicles, judges the existence of moving vehicles, captures moving vehicle images, deblurring images, locates license plates, extracts vertical edges, removes unnecessary edge lines, segments license plate locations, Indonesian license plate cutting character segmenting, character recognition. Experiments were carried out under several conditions: suitable conditions, poor lighting conditions (dawn, evening, and night), and unfavourable weather conditions (heavy rain, moderate rain, and light rain). In the experiment to test the success of the license plate number recognition, it was seen that the proposed method succeeded in recognizing 98.1 % of the total images tested. In unfavorable conditions such as poor lighting or when there are many disturbances such as rain, there is a decrease in the success rate of license plate recognition. Still, the proposed method's experimental results were higher than the method without deblurring by 1.7 %. There is still unsuccessful in recognizing license plates from the whole experiment due to a lot of noise. The noise can occur due to unfavourable environmental conditions such as heavy rain

Deep Learning Based Automatic Vehicle License Plate Recognition System for Enhanced Vehicle Identification

An innovative Automatic Vehicle License Plate Recognition (AVLPR) system that effectively identifies vehicles using deep learning algorithms. Accurate and real-time license plate identification has grown in importance with the rise in demand for improved security and traffic management.The convolutional neural network (CNN) architecture used in the AVLPR system enables the model to automatically learn and extract discriminative characteristics from photos of license plates. To ensure the system's robustness and adaptability, the dataset utilized for training and validation includes a wide range of license plate designs, fonts, and lighting situations.We incorporate data augmentation approaches to accommodate differences in license plate orientation, scale, and perspective throughout the training process to improve recognition accuracy. Additionally, we use transfer learning to enhance the system's generalization abilities by refining the pre-trained model on a sizable dataset.A trustworthy and effective solution for vehicle identification duties is provided by the Deep Learning-Based Automatic Vehicle License Plate Recognition System. Deep learning approaches are used to guarantee precise and instantaneous recognition, making it suitable for many uses such as law enforcement, parking management, and intelligent transportation systems

Vehicle Plate Number Detection and Recognition Using Improved Algorithm

The growing Tanzanian population currently estimated to be 48 Million people and their use of vehicles as means of transport has kept increasing making enforcing traffic rules and regulations among road users a major challenge. This calls for a need to have an automated system that monitors the motorists with a pre-defined sense of intelligence. A Vehicle Detection and Recognition Algorithm which can provide automated access to relevant information to a number plate from information systems containing and managing databases on vehicle and their movements is required. This paper presents work on developed algorithm that localizes plate area, extract and segment character, and finally recognizes and interprets registration number from vehicle image. MATLAB R2012b Simulation software with Image Processing toolbox is employed. HSV color space image, morphological and statistical analysis operations were integrated and employed to a vehicle image to compute plate number area. In segmentation the properties like aspect ratio, extent, and area ratio were important measurement parameters. Finally, the template matching database and statistical character extracted from car image was correlated to recognize alphanumeric character to deduce car registration number.   Keywords— Character extraction, Detection algorithm, Recognition algorithm, Morphological matching, Template matchin

Parking lot monitoring system using an autonomous quadrotor UAV

The main goal of this thesis is to develop a drone-based parking lot monitoring system using low-cost hardware and open-source software. Similar to wall-mounted surveillance cameras, a drone-based system can monitor parking lots without affecting the flow of traffic while also offering the mobility of patrol vehicles. The Parrot AR Drone 2.0 is the quadrotor drone used in this work due to its modularity and cost efficiency. Video and navigation data (including GPS) are communicated to a host computer using a Wi-Fi connection. The host computer analyzes navigation data using a custom flight control loop to determine control commands to be sent to the drone. A new license plate recognition pipeline is used to identify license plates of vehicles from video received from the drone

Text detection and recognition in natural scene images

This thesis addresses the problem of end-to-end text detection and recognition in natural scene images based on deep neural networks. Scene text detection and recognition aim to find regions in an image that are considered as text by human beings, generate a bounding box for each word and output a corresponding sequence of characters. As a useful task in image analysis, scene text detection and recognition attract much attention in computer vision field. In this thesis, we tackle this problem by taking advantage of the success in deep learning techniques. Car license plates can be viewed as a spacial case of scene text, as they both consist of characters and appear in natural scenes. Nevertheless, they have their respective specificities. During the research progress, we start from car license plate detection and recognition. Then we extend the methods to general scene text, with additional ideas proposed. For both tasks, we develop two approaches respectively: a stepwise one and an integrated one. Stepwise methods tackle text detection and recognition step by step by respective models; while integrated methods handle both text detection and recognition simultaneously via one model. All approaches are based on the powerful deep Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), considering the tremendous breakthroughs they brought into the computer vision community. To begin with, a stepwise framework is proposed to tackle text detection and recognition, with its application to car license plates and general scene text respectively. A character CNN classifier is well trained to detect characters from an image in a sliding window manner. The detected characters are then grouped together as license plates or text lines according to some heuristic rules. A sequence labeling based method is proposed to recognize the whole license plate or text line without character level segmentation. On the basis of the sequence labeling based recognition method, to accelerate the processing speed, an integrated deep neural network is then proposed to address car license plate detection and recognition concurrently. It integrates both CNNs and RNNs in one network, and can be trained end-to-end. Both car license plate bounding boxes and their labels are generated in a single forward evaluation of the network. The whole process involves no heuristic rule, and avoids intermediate procedures like image cropping or feature recalculation, which not only prevents error accumulation, but also reduces computation burden. Lastly, the unified network is extended to simultaneous general text detection and recognition in natural scene. In contrast to the one for car license plates, some innovations are proposed to accommodate the special characteristics of general text. A varying-size RoI encoding method is proposed to handle the various aspect ratios of general text. An attention-based sequence-to-sequence learning structure is adopted for word recognition. It is expected that a character-level language model can be learnt in this manner. The whole framework can be trained end-to-end, requiring only images, the ground-truth bounding boxes and text labels. Through end-to-end training, the learned features can be more discriminative, which improves the overall performance. The convolutional features are calculated only once and shared by both detection and recognition, which saves the processing time. The proposed method has achieved state-of-the-art performance on several standard benchmark datasets.Thesis (Ph.D.) -- University of Adelaide, School of Computer Science, 201