27 research outputs found
Concealed Object Detection for Passive Millimeter-Wave Security Imaging Based on Task-Aligned Detection Transformer
Passive millimeter-wave (PMMW) is a significant potential technique for human
security screening. Several popular object detection networks have been used
for PMMW images. However, restricted by the low resolution and high noise of
PMMW images, PMMW hidden object detection based on deep learning usually
suffers from low accuracy and low classification confidence. To tackle the
above problems, this paper proposes a Task-Aligned Detection Transformer
network, named PMMW-DETR. In the first stage, a Denoising Coarse-to-Fine
Transformer (DCFT) backbone is designed to extract long- and short-range
features in the different scales. In the second stage, we propose the Query
Selection module to introduce learned spatial features into the network as
prior knowledge, which enhances the semantic perception capability of the
network. In the third stage, aiming to improve the classification performance,
we perform a Task-Aligned Dual-Head block to decouple the classification and
regression tasks. Based on our self-developed PMMW security screening dataset,
experimental results including comparison with State-Of-The-Art (SOTA) methods
and ablation study demonstrate that the PMMW-DETR obtains higher accuracy and
classification confidence than previous works, and exhibits robustness to the
PMMW images of low quality
Simultaneous Bayesian Compressive Sensing and Blind Deconvolution
Publication in the conference proceedings of EUSIPCO, Bucharest, Romania, 201
An electromagnetic imaging system for metallic object detection and classification
PhD ThesisElectromagnetic imaging currently plays a vital role in various disciplines, from engineering to medical applications and is based upon the characteristics of electromagnetic fields and their interaction with the properties of materials. The detection and characterisation of metallic objects which pose a threat to safety is of great interest in relation to public and homeland security worldwide. Inspections are conducted under the prerequisite that is divested of all metallic objects. These inspection conditions are problematic in terms of the disruption of the movement of people and produce a soft target for terrorist attack. Thus, there is a need for a new generation of detection systems and information technologies which can provide an enhanced characterisation and discrimination capabilities.
This thesis proposes an automatic metallic object detection and classification system. Two related topics have been addressed: to design and implement a new metallic object detection system; and to develop an appropriate signal processing algorithm to classify the targeted signatures. The new detection system uses an array of sensors in conjunction with pulsed excitation. The contributions of this research can be summarised as follows: (1) investigating the possibility of using magneto-resistance sensors for metallic object detection; (2) evaluating the proposed system by generating a database consisting of 12 real handguns with more than 20 objects used in daily life; (3) extracted features from the system outcomes using four feature categories referring to the objects’ shape, material composition, time-frequency signal analysis and transient pulse response; and (4) applying two classification methods to classify the objects into threats and non-threats, giving a successful classification rate of more than 92% using the feature combination and classification framework of the new system.
The study concludes that novel magnetic field imaging system and their signal outputs can be used to detect, identify and classify metallic objects. In comparison with conventional induction-based walk-through metal detectors, the magneto-resistance sensor array-based system shows great potential for object identification and discrimination. This novel system design and signal processing achievement may be able to produce significant improvements in automatic threat object detection and classification applications.Iraqi Cultural Attaché, Londo
Navigation system based in motion tracking sensor for percutaneous renal access
Tese de Doutoramento em Engenharia BiomédicaMinimally-invasive kidney interventions are daily performed to diagnose and treat several renal
diseases. Percutaneous renal access (PRA) is an essential but challenging stage for most of these
procedures, since its outcome is directly linked to the physician’s ability to precisely visualize and
reach the anatomical target.
Nowadays, PRA is always guided with medical imaging assistance, most frequently using X-ray
based imaging (e.g. fluoroscopy). Thus, radiation on the surgical theater represents a major risk to
the medical team, where its exclusion from PRA has a direct impact diminishing the dose exposure
on both patients and physicians.
To solve the referred problems this thesis aims to develop a new hardware/software framework
to intuitively and safely guide the surgeon during PRA planning and puncturing.
In terms of surgical planning, a set of methodologies were developed to increase the certainty of
reaching a specific target inside the kidney. The most relevant abdominal structures for PRA were
automatically clustered into different 3D volumes. For that, primitive volumes were merged as a local
optimization problem using the minimum description length principle and image statistical
properties. A multi-volume Ray Cast method was then used to highlight each segmented volume.
Results show that it is possible to detect all abdominal structures surrounding the kidney, with the
ability to correctly estimate a virtual trajectory.
Concerning the percutaneous puncturing stage, either an electromagnetic or optical solution
were developed and tested in multiple in vitro, in vivo and ex vivo trials. The optical tracking solution
aids in establishing the desired puncture site and choosing the best virtual puncture trajectory.
However, this system required a line of sight to different optical markers placed at the needle base,
limiting the accuracy when tracking inside the human body. Results show that the needle tip can
deflect from its initial straight line trajectory with an error higher than 3 mm. Moreover, a complex
registration procedure and initial setup is needed.
On the other hand, a real-time electromagnetic tracking was developed. Hereto, a catheter
was inserted trans-urethrally towards the renal target. This catheter has a position and orientation
electromagnetic sensor on its tip that function as a real-time target locator. Then, a needle integrating a similar sensor is used. From the data provided by both sensors, one computes a virtual puncture
trajectory, which is displayed in a 3D visualization software. In vivo tests showed a median renal and
ureteral puncture times of 19 and 51 seconds, respectively (range 14 to 45 and 45 to 67 seconds).
Such results represent a puncture time improvement between 75% and 85% when comparing to
state of the art methods.
3D sound and vibrotactile feedback were also developed to provide additional information about
the needle orientation. By using these kind of feedback, it was verified that the surgeon tends to
follow a virtual puncture trajectory with a reduced amount of deviations from the ideal trajectory,
being able to anticipate any movement even without looking to a monitor. Best results show that 3D
sound sources were correctly identified 79.2 ± 8.1% of times with an average angulation error of
10.4º degrees. Vibration sources were accurately identified 91.1 ± 3.6% of times with an average
angulation error of 8.0º degrees.
Additionally to the EMT framework, three circular ultrasound transducers were built with a needle
working channel. One explored different manufacture fabrication setups in terms of the piezoelectric
materials, transducer construction, single vs. multi array configurations, backing and matching
material design. The A-scan signals retrieved from each transducer were filtered and processed to
automatically detect reflected echoes and to alert the surgeon when undesirable anatomical
structures are in between the puncture path. The transducers were mapped in a water tank and
tested in a study involving 45 phantoms. Results showed that the beam cross-sectional area
oscillates around the ceramics radius and it was possible to automatically detect echo signals in
phantoms with length higher than 80 mm.
Hereupon, it is expected that the introduction of the proposed system on the PRA procedure,
will allow to guide the surgeon through the optimal path towards the precise kidney target, increasing
surgeon’s confidence and reducing complications (e.g. organ perforation) during PRA. Moreover, the
developed framework has the potential to make the PRA free of radiation for both patient and surgeon
and to broad the use of PRA to less specialized surgeons.Intervenções renais minimamente invasivas são realizadas diariamente para o tratamento e
diagnóstico de várias doenças renais. O acesso renal percutâneo (ARP) é uma etapa essencial e
desafiante na maior parte destes procedimentos. O seu resultado encontra-se diretamente
relacionado com a capacidade do cirurgião visualizar e atingir com precisão o alvo anatómico.
Hoje em dia, o ARP é sempre guiado com recurso a sistemas imagiológicos, na maior parte
das vezes baseados em raios-X (p.e. a fluoroscopia). A radiação destes sistemas nas salas cirúrgicas
representa um grande risco para a equipa médica, aonde a sua remoção levará a um impacto direto
na diminuição da dose exposta aos pacientes e cirurgiões.
De modo a resolver os problemas existentes, esta tese tem como objetivo o desenvolvimento
de uma framework de hardware/software que permita, de forma intuitiva e segura, guiar o cirurgião
durante o planeamento e punção do ARP.
Em termos de planeamento, foi desenvolvido um conjunto de metodologias de modo a
aumentar a eficácia com que o alvo anatómico é alcançado. As estruturas abdominais mais
relevantes para o procedimento de ARP, foram automaticamente agrupadas em volumes 3D, através
de um problema de optimização global com base no princípio de “minimum description length” e
propriedades estatísticas da imagem. Por fim, um procedimento de Ray Cast, com múltiplas funções
de transferência, foi utilizado para enfatizar as estruturas segmentadas. Os resultados mostram que
é possível detetar todas as estruturas abdominais envolventes ao rim, com a capacidade para
estimar corretamente uma trajetória virtual.
No que diz respeito à fase de punção percutânea, foram testadas duas soluções de deteção
de movimento (ótica e eletromagnética) em múltiplos ensaios in vitro, in vivo e ex vivo. A solução
baseada em sensores óticos ajudou no cálculo do melhor ponto de punção e na definição da melhor
trajetória a seguir. Contudo, este sistema necessita de uma linha de visão com diferentes
marcadores óticos acoplados à base da agulha, limitando a precisão com que a agulha é detetada
no interior do corpo humano. Os resultados indicam que a agulha pode sofrer deflexões à medida
que vai sendo inserida, com erros superiores a 3 mm.
Por outro lado, foi desenvolvida e testada uma solução com base em sensores
eletromagnéticos. Para tal, um cateter que integra um sensor de posição e orientação na sua ponta, foi colocado por via trans-uretral junto do alvo renal. De seguida, uma agulha, integrando um sensor
semelhante, é utilizada para a punção percutânea. A partir da diferença espacial de ambos os
sensores, é possível gerar uma trajetória de punção virtual. A mediana do tempo necessário para
puncionar o rim e ureter, segundo esta trajetória, foi de 19 e 51 segundos, respetivamente
(variações de 14 a 45 e 45 a 67 segundos). Estes resultados representam uma melhoria do tempo
de punção entre 75% e 85%, quando comparados com o estado da arte dos métodos atuais.
Além do feedback visual, som 3D e feedback vibratório foram explorados de modo a fornecer
informações complementares da posição da agulha. Verificou-se que com este tipo de feedback, o
cirurgião tende a seguir uma trajetória de punção com desvios mínimos, sendo igualmente capaz
de antecipar qualquer movimento, mesmo sem olhar para o monitor. Fontes de som e vibração
podem ser corretamente detetadas em 79,2 ± 8,1% e 91,1 ± 3,6%, com erros médios de angulação
de 10.4º e 8.0 graus, respetivamente.
Adicionalmente ao sistema de navegação, foram também produzidos três transdutores de
ultrassom circulares com um canal de trabalho para a agulha. Para tal, foram exploradas diferentes
configurações de fabricação em termos de materiais piezoelétricos, transdutores multi-array ou
singulares e espessura/material de layers de suporte. Os sinais originados em cada transdutor
foram filtrados e processados de modo a detetar de forma automática os ecos refletidos, e assim,
alertar o cirurgião quando existem variações anatómicas ao longo do caminho de punção. Os
transdutores foram mapeados num tanque de água e testados em 45 phantoms. Os resultados
mostraram que o feixe de área em corte transversal oscila em torno do raio de cerâmica, e que os
ecos refletidos são detetados em phantoms com comprimentos superiores a 80 mm.
Desta forma, é expectável que a introdução deste novo sistema a nível do ARP permitirá
conduzir o cirurgião ao longo do caminho de punção ideal, aumentado a confiança do cirurgião e
reduzindo possíveis complicações (p.e. a perfuração dos órgãos). Além disso, de realçar que este
sistema apresenta o potencial de tornar o ARP livre de radiação e alarga-lo a cirurgiões menos
especializados.The present work was only possible thanks to the support by the Portuguese Science and
Technology Foundation through the PhD grant with reference SFRH/BD/74276/2010 funded by
FCT/MEC (PIDDAC) and by Fundo Europeu de Desenvolvimento Regional (FEDER), Programa
COMPETE - Programa Operacional Factores de Competitividade (POFC) do QREN
Remote Detection of Concealed Guns and Explosives
A reliable method of remotely detecting concealed guns and explosives attached to the
human body is of great interest to governments and security forces throughout the world.
This thesis describes the development and trials of a new remote non-imaging concealed
threat detection method using active millimetre wave radar using the microwave and mmwave
frequencies bands 14 – 40 and 75 – 110 GHz (Ku, K, Ka and W). The method is
capable of not only screening for concealed objects, like the current generation of
concealed object detectors, but also of differentiating between mundane and threat objects.
The areas focused upon during this investigation were: identifying the impact of different
commonly worn fabrics as barriers to detection; consulting with end users about their
requirements and operational needs; a comparison of different frequency bands for the
detection of guns and explosives; exploring the effects of polarisation on object detection;
a performance comparison of different detection schemes using Artificial Neural
Networks; improving existing data acquisition systems and prototyping of a real-time
capture system
Concealed Explosives Detection using Swept Millimetre Waves
The aim of this project is to develop a system for the stand-o detection (typically ten
metres) of concealed body-worn explosives. The system must be capable of detecting
a layer of explosive material hidden under clothing and distinguishing explosives from
everyday objects. Millimetre wave radar is suitable for this application. Millimetre
Waves are suitable because they are not signi cantly attenuated by atmospheric con-
ditions and clothing textiles are practically transparent to this radiation. Detection
of explosive layers from a few mm in thickness to a few cm thickness is required. A
quasi optical focussing element is required to provide su cient antenna directivity to
form a narrow, highly directional beam of millimetre waves, which can be directed and
scanned over the person being observed.
A system of antennae and focussing optics has been modelled and built using designs
from nite element analysis (FEA) software. Using the developed system, represen-
tative data sets have been acquired using a Vector Network Analyser (VNA) to act
as transmitter and receiver, with the data saved for processing at a later time. A
novel data analysis algorithm using Matlab has been developed to carry out Fourier
Transforms of the data and then perform pattern matching techniques using arti cial
neural networks (ANN's). New ways of aligning and sorting data have been found
using cross-correlation to order the data by similar data slices and then sorting the
data by amplitude to take the strongest 50% of data sets.
The signi cant contribution to knowledge of this project will be a system which can
be eld tested and which will detect a layer of dielectric at a stando distance, typically
of ten metres, and signal processing algorithms which can recognise the di erence
17
between the response of threat and non-threat objects. This has partially been achieved
by the development of focussing optics to acquire data sets which have then been aligned
by cross-correlation, sorted and then used to train a pattern matching technique using
neural networks. This technique has shown good results in di erentiating between a
person wearing simulated explosives and a person not carrying simulated explosives.
Further work for this project includes acquiring more data sets of everyday objects
and training the neural network to distinguish between threat objects and non-threat
objects. The operational range also needs increasing using either a larger aperture
optical element or a similarly sized Cassegrain antenna. The system needs adapting
for real time use with the data processing techniques developed in Matlab.
The VNA is operated over a band of 14 to 40 GHz, future work includes moving to
a stand-alone transmitter and receiver operating at w-band (75 to 110 GHz)
Combined use of GPR and Other NDTs for road pavement assessment: an overview
Roads are the main transportation system in any country and, therefore, must be maintained in good physical condition to provide a safe and seamless flow to transport people and goods. However, road pavements are subjected to various defects because of construction errors, aging, environmental conditions, changing traffic load, and poor maintenance. Regular inspections are therefore recommended to ensure serviceability and minimize maintenance costs. Ground-penetrating radar (GPR) is a non-destructive testing (NDT) technique widely used to inspect the subsurface condition of road pavements. Furthermore, the integral use of NDTs has received more attention in recent years since it provides a more comprehensive and reliable assessment of the road network. Accordingly, GPR has been integrated with complementary NDTs to extend its capabilities and to detect potential pavement surface and subsurface distresses and features. In this paper, the non-destructive methods commonly combined with GPR to monitor both flexible and rigid pavements are briefly described. In addition, published work combining GPR with other NDT methods is reviewed, emphasizing the main findings and limitations of the most practical combination methods. Further, challenges, trends, and future perspectives of the reviewed combination works are highlighted, including the use of intelligent data analysis.Xunta de Galicia | Ref. ED431F 2021/08Ministerio de Ciencia e Innovación | Ref. RYC2019–026604-
Close-Range Sensing and Data Fusion for Built Heritage Inspection and Monitoring - A Review
Built cultural heritage is under constant threat due to environmental pressures, anthropogenic damages, and interventions. Understanding the preservation state of monuments and historical structures, and the factors that alter their architectural and structural characteristics through time, is crucial for ensuring their protection. Therefore, inspection and monitoring techniques are essential for heritage preservation, as they enable knowledge about the altering factors that put built cultural heritage at risk, by recording their immediate effects on monuments and historic structures. Nondestructive evaluations with close-range sensing techniques play a crucial role in monitoring. However, data recorded by different sensors are frequently processed separately, which hinders integrated use, visualization, and interpretation. This article’s aim is twofold: i) to present an overview of close-range sensing techniques frequently applied to evaluate built heritage conditions, and ii) to review the progress made regarding the fusion of multi-sensor data recorded by them. Particular emphasis is given to the integration of data from metric surveying and from recording techniques that are traditionally non-metric. The article attempts to shed light on the problems of the individual and integrated use of image-based modeling, laser scanning, thermography, multispectral imaging, ground penetrating radar, and ultrasonic testing, giving heritage practitioners a point of reference for the successful implementation of multidisciplinary approaches for built cultural heritage scientific investigations
Advanced Geoscience Remote Sensing
Nowadays, advanced remote sensing technology plays tremendous roles to build a quantitative and comprehensive understanding of how the Earth system operates. The advanced remote sensing technology is also used widely to monitor and survey the natural disasters and man-made pollution. Besides, telecommunication is considered as precise advanced remote sensing technology tool. Indeed precise usages of remote sensing and telecommunication without a comprehensive understanding of mathematics and physics. This book has three parts (i) microwave remote sensing applications, (ii) nuclear, geophysics and telecommunication; and (iii) environment remote sensing investigations
THE USE OF POINT CLOUD DATA TO SUPPORT CONCRETE BRIDGE DECK CONDITION ASSESSMENT
Bridge deck condition assessments are typically conducted through visual physical inspections, utilizing traditional contact sensors for Non-Destructive Evaluation techniques such as hammer Sounding and chain dragging which require the expertise of trained inspectors. However, the accuracy of these inspections is limited by the level of deterioration of the bridge deck, as the ability of the inspectors is proportional to the apparent level of damage. This study aims to improve the accuracy of bridge deck inspection processes by utilizing non-destructive evaluation techniques, including the analysis of point cloud data gathered via Light Detection and Ranging (LiDAR) as a geometry-capturing tool. The overall goal of this research is to evaluate and quantify the effectiveness and efficiency of LiDAR sensors in contributing to the suite of technologies available to perform bridge deck condition assessment. To achieve this, the research proposes to understand the deterioration pattern of New Jersey bridges, evaluate the results gathered from point cloud data collected on a full-scale bridge deck, quantify the information gained from deploying LiDAR on operating bridges in New Jersey, and investigate the costs related to current bridge condition assessment practices and the impact of incorporating the use of LiDAR sensors. Two data processing approaches were chosen to measure gross and fine dimensions of the evaluated bridge decks, resulting in an accuracy of 96% with respect to results gathered from inspection reports