6,539 research outputs found
Multimodal spatio-temporal deep learning framework for 3D object detection in instrumented vehicles
This thesis presents the utilization of multiple modalities, such as image and lidar, to incorporate spatio-temporal information from sequence data into deep learning architectures for 3Dobject detection in instrumented vehicles. The race to autonomy in instrumented vehicles or self-driving cars has stimulated significant research in developing autonomous driver assistance systems (ADAS) technologies related explicitly to perception systems. Object detection plays a crucial role in perception systems by providing spatial information to its subsequent modules; hence, accurate detection is a significant task supporting autonomous driving. The advent of deep learning in computer vision applications and the availability of multiple sensing modalities such as 360° imaging, lidar, and radar have led to state-of-the-art 2D and 3Dobject detection architectures. Most current state-of-the-art 3D object detection frameworks consider single-frame reference. However, these methods do not utilize temporal information associated with the objects or scenes from the sequence data. Thus, the present research hypothesizes that multimodal temporal information can contribute to bridging the gap between 2D and 3D metric space by improving the accuracy of deep learning frameworks for 3D object estimations. The thesis presents understanding multimodal data representations and selecting hyper-parameters using public datasets such as KITTI and nuScenes with Frustum-ConvNet as a baseline architecture. Secondly, an attention mechanism was employed along with convolutional-LSTM to extract spatial-temporal information from sequence data to improve 3D estimations and to aid the architecture in focusing on salient lidar point cloud features. Finally, various fusion strategies are applied to fuse the modalities and temporal information into the architecture to assess its efficacy on performance and computational complexity. Overall, this thesis has established the importance and utility of multimodal systems for refined 3D object detection and proposed a complex pipeline incorporating spatial, temporal and attention mechanisms to improve specific, and general class accuracy demonstrated on key autonomous driving data sets
The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions
The Metaverse offers a second world beyond reality, where boundaries are
non-existent, and possibilities are endless through engagement and immersive
experiences using the virtual reality (VR) technology. Many disciplines can
benefit from the advancement of the Metaverse when accurately developed,
including the fields of technology, gaming, education, art, and culture.
Nevertheless, developing the Metaverse environment to its full potential is an
ambiguous task that needs proper guidance and directions. Existing surveys on
the Metaverse focus only on a specific aspect and discipline of the Metaverse
and lack a holistic view of the entire process. To this end, a more holistic,
multi-disciplinary, in-depth, and academic and industry-oriented review is
required to provide a thorough study of the Metaverse development pipeline. To
address these issues, we present in this survey a novel multi-layered pipeline
ecosystem composed of (1) the Metaverse computing, networking, communications
and hardware infrastructure, (2) environment digitization, and (3) user
interactions. For every layer, we discuss the components that detail the steps
of its development. Also, for each of these components, we examine the impact
of a set of enabling technologies and empowering domains (e.g., Artificial
Intelligence, Security & Privacy, Blockchain, Business, Ethics, and Social) on
its advancement. In addition, we explain the importance of these technologies
to support decentralization, interoperability, user experiences, interactions,
and monetization. Our presented study highlights the existing challenges for
each component, followed by research directions and potential solutions. To the
best of our knowledge, this survey is the most comprehensive and allows users,
scholars, and entrepreneurs to get an in-depth understanding of the Metaverse
ecosystem to find their opportunities and potentials for contribution
Variable optical elements for fast focus control
In this Review, we survey recent developments in the emerging field of high-speed variable-z-focus optical elements, which are driving important innovations in advanced imaging and materials processing applications. Three-dimensional biomedical imaging, high-throughput industrial inspection, advanced spectroscopies, and other optical characterization and materials modification methods have made great strides forward in recent years due to precise and rapid axial control of light. Three state-of-the-art key optical technologies that enable fast z-focus modulation are reviewed, along with a discussion of the implications of the new developments in variable optical elements and their impact on technologically relevant applications
Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration
The filming of sporting events projects and flattens the movement of athletes
in the world onto a 2D broadcast image. The pixel locations of joints in these
images can be detected with high validity. Recovering the actual 3D movement of
the limbs (kinematics) of the athletes requires lifting these 2D pixel
locations back into a third dimension, implying a certain scene geometry. The
well-known line markings of sports fields allow for the calibration of the
camera and for determining the actual geometry of the scene. Close-up shots of
athletes are required to extract detailed kinematics, which in turn obfuscates
the pertinent field markers for camera calibration. We suggest partial sports
field registration, which determines a set of scene-consistent camera
calibrations up to a single degree of freedom. Through joint optimization of 3D
pose estimation and camera calibration, we demonstrate the successful
extraction of 3D running kinematics on a 400m track. In this work, we combine
advances in 2D human pose estimation and camera calibration via partial sports
field registration to demonstrate an avenue for collecting valid large-scale
kinematic datasets. We generate a synthetic dataset of more than 10k images in
Unreal Engine 5 with different viewpoints, running styles, and body types, to
show the limitations of existing monocular 3D HPE methods. Synthetic data and
code are available at https://github.com/tobibaum/PartialSportsFieldReg_3DHPE.Comment: accept at "9th International Workshop on Computer Vision in Sports
(CVsports) at CVPR 2023
Anuário científico da Escola Superior de Tecnologia da Saúde de Lisboa - 2021
É com grande prazer que apresentamos a mais recente edição (a 11.ª) do Anuário Científico da Escola Superior de Tecnologia da Saúde de Lisboa. Como instituição de ensino superior, temos o compromisso de promover e incentivar a pesquisa científica em todas as áreas do conhecimento que contemplam a nossa missão. Esta publicação tem como objetivo divulgar toda a produção científica desenvolvida pelos Professores, Investigadores, Estudantes e Pessoal não Docente da ESTeSL durante 2021. Este Anuário é, assim, o reflexo do trabalho árduo e dedicado da nossa comunidade, que se empenhou na produção de conteúdo científico de elevada qualidade e partilhada com a Sociedade na forma de livros, capítulos de livros, artigos publicados em revistas nacionais e internacionais, resumos de comunicações orais e pósteres, bem como resultado dos trabalhos de 1º e 2º ciclo. Com isto, o conteúdo desta publicação abrange uma ampla variedade de tópicos, desde temas mais fundamentais até estudos de aplicação prática em contextos específicos de Saúde, refletindo desta forma a pluralidade e diversidade de áreas que definem, e tornam única, a ESTeSL. Acreditamos que a investigação e pesquisa científica é um eixo fundamental para o desenvolvimento da sociedade e é por isso que incentivamos os nossos estudantes a envolverem-se em atividades de pesquisa e prática baseada na evidência desde o início dos seus estudos na ESTeSL. Esta publicação é um exemplo do sucesso desses esforços, sendo a maior de sempre, o que faz com que estejamos muito orgulhosos em partilhar os resultados e descobertas dos nossos investigadores com a comunidade científica e o público em geral. Esperamos que este Anuário inspire e motive outros estudantes, profissionais de saúde, professores e outros colaboradores a continuarem a explorar novas ideias e contribuir para o avanço da ciência e da tecnologia no corpo de conhecimento próprio das áreas que compõe a ESTeSL. Agradecemos a todos os envolvidos na produção deste anuário e desejamos uma leitura inspiradora e agradável.info:eu-repo/semantics/publishedVersio
Unmanned Aerial Vehicles (UAVs) to compare foraging sea turtle density and distribution of sea turtles in two contrasting habitats in the Chagos Archipelago
Unmanned Aerial Vehicles (UAVs) facilitate observation of elusive species or remote locations, and are increasingly used to survey marine habitats. Marine Protected Areas (MPAs) are a conservation tool used to protect marine species, and regular population assessments can establish if MPAs are effectively facilitating the recovery of endangered species. Sea turtles in the Western Indian Ocean have been historically exploited through trade and by-catch causing a reduction in numbers. Here, UAVs were utilised to assess the population density and distribution of green (Chelonia mydas) and hawksbill (Eretmochelys imbricata) turtles between ocean and lagoon environments in the Chagos Archipelago. Analysis protocols were developed to process UAV imagery, including carapace-measurement techniques, and certainty-classing turtle observations (Definite, Probable or Possible). Along 20 km of coastline, 5.13 km2 was surveyed across 11 days between July 2019 – February 2021 resulting in a high-certainty estimate of 381 turtles and a low-certainty estimate of 660. Species and life-stage identification implicate Chagos as developmental habitat for immature hawksbill turtles: 78.47% (n = 299/381) of identified definite turtles were immature, of which 66.55% (n = 199/299) were hawksbill. Diego Garcia Ocean Site 1, West sites and Turtle Cove were significant turtle hotspots (high-certainty results: 257.19 individuals/km2, 146.15 individuals/km2, and 135.08 individuals/km2, respectively), while Marina sites were least-dense (0 - 4.87 individuals/km2). Results for low-certainty data were comparable: 325.27 individuals/km2 in Diego Garcia Site 1, followed by 309.27 and 292.67 individuals/km2 in Turtle Cove. Population density decreased significantly with increasing distance from the shore, and decreased with increasing distance from Turtle Cove. Green turtles were smaller (50.33 ± 17.65 cm straight-carapace length, SCL) than hawksbill turtles (53.16 ± 11.17 cm SCL). This study highlights the Chagos Archipelago as developmental habitat for immature turtles, and demonstrates the applicability of UAVs for in-situ population monitoring to infer conservation status of marine megafauna
Interview with Wolfgang Knauss
An oral history in four sessions (September 2019–January 2020) with Wolfgang Knauss, von Kármán Professor of Aeronautics and Applied Mechanics, Emeritus. Born in Germany in 1933, he speaks about his early life and experiences under the Nazi regime, his teenage years in Siegen and Heidelberg during the Allied occupation, and his move to Pasadena, California, in 1954 under the sponsorship of a local minister and his family. He enrolled in Caltech as an undergraduate in 1957, commencing a more than half-century affiliation with the Institute and GALCIT (today the Graduate Aerospace Laboratories of Caltech). He recalls the roots of his interest in aeronautics, his PhD solid mechanics studies with his advisor, M. Williams, and the GALCIT environment in the late 1950s and 1960s at the dawn of the Space Age, including the impact of Sputnik and classes with NASA astronauts. He discusses his experimental and theoretical work on materials deformation, dynamic fracture, and crack propagation, including his solid-propellant fuels research for NASA and the US Army, wide-ranging programs with the US Navy, and his pioneering micromechanics investigations and work on the time-dependent fracture of polymers in the 1990s.
He offers his perspective on GALCIT’s academic culture, its solid mechanics and fluid mechanics programs, and its evolving administrative directions over the course of five decades, as well as its impact and reputation both within and beyond Caltech. He describes his work with Caltech’s undergraduate admissions committee and his scientific collaborations with numerous graduate students and postdocs and shares his recollections of GALCIT and other Caltech colleagues, including C. Babcock, D. Coles, R.P. Feynman, Y.C. Fung, G. Neugebauer, G. Housner, D. Hudson, H. Liepmann, A. Klein, G. Ravichandran, A. Rosakis, A. Roshko, and E. Sechler.
Six appendices contributed by Dr. Knauss, offering further insight into his life and career, also form part of this oral history and are cross-referenced in the main text
Cost-effective non-destructive testing of biomedical components fabricated using additive manufacturing
Biocompatible titanium-alloys can be used to fabricate patient-specific medical components using additive manufacturing (AM). These novel components have the potential to improve clinical outcomes in various medical scenarios. However, AM introduces stability and repeatability concerns, which are potential roadblocks for its widespread use in the medical sector. Micro-CT imaging for non-destructive testing (NDT) is an effective solution for post-manufacturing quality control of these components. Unfortunately, current micro-CT NDT scanners require expensive infrastructure and hardware, which translates into prohibitively expensive routine NDT. Furthermore, the limited dynamic-range of these scanners can cause severe image artifacts that may compromise the diagnostic value of the non-destructive test. Finally, the cone-beam geometry of these scanners makes them susceptible to the adverse effects of scattered radiation, which is another source of artifacts in micro-CT imaging.
In this work, we describe the design, fabrication, and implementation of a dedicated, cost-effective micro-CT scanner for NDT of AM-fabricated biomedical components. Our scanner reduces the limitations of costly image-based NDT by optimizing the scanner\u27s geometry and the image acquisition hardware (i.e., X-ray source and detector). Additionally, we describe two novel techniques to reduce image artifacts caused by photon-starvation and scatter radiation in cone-beam micro-CT imaging.
Our cost-effective scanner was designed to match the image requirements of medium-size titanium-alloy medical components. We optimized the image acquisition hardware by using an 80 kVp low-cost portable X-ray unit and developing a low-cost lens-coupled X-ray detector. Image artifacts caused by photon-starvation were reduced by implementing dual-exposure high-dynamic-range radiography. For scatter mitigation, we describe the design, manufacturing, and testing of a large-area, highly-focused, two-dimensional, anti-scatter grid.
Our results demonstrate that cost-effective NDT using low-cost equipment is feasible for medium-sized, titanium-alloy, AM-fabricated medical components. Our proposed high-dynamic-range strategy improved by 37% the penetration capabilities of an 80 kVp micro-CT imaging system for a total x-ray path length of 19.8 mm. Finally, our novel anti-scatter grid provided a 65% improvement in CT number accuracy and a 48% improvement in low-contrast visualization. Our proposed cost-effective scanner and artifact reduction strategies have the potential to improve patient care by accelerating the widespread use of patient-specific, bio-compatible, AM-manufactured, medical components
Optical coherence tomography methods using 2-D detector arrays
Optical coherence tomography (OCT) is a non-invasive, non-contact optical technique that allows cross-section imaging of biological tissues with high spatial resolution, high sensitivity and high dynamic range. Standard OCT uses a focused beam to illuminate a point on the target and detects the signal using a single photodetector. To acquire transverse information, transversal scanning of the illumination point is required. Alternatively, multiple OCT channels can be operated in parallel simultaneously; parallel OCT signals are recorded by a two-dimensional (2D) detector array. This approach is known as Parallel-detection OCT. In this thesis, methods, experiments and results using three parallel OCT techniques, including full -field (time-domain) OCT (FF-OCT), full-field swept-source OCT (FF-SS-OCT) and line-field Fourier-domain OCT (LF-FD-OCT), are presented. Several 2D digital cameras of different formats have been used and evaluated in the experiments of different methods. With the LF-FD-OCT method, photography equipment, such as flashtubes and commercial DSLR cameras have been equipped and tested for OCT imaging. The techniques used in FF-OCT and FF-SS-OCT are employed in a novel wavefront sensing technique, which combines OCT methods with a Shack-Hartmann wavefront sensor (SH-WFS). This combination technique is demonstrated capable of measuring depth-resolved wavefront aberrations, which has the potential to extend the applications of SH-WFS in wavefront-guided biomedical imaging techniques
Coding Christianity: Negotiating Religious Dialogue in Online Participatory Spaces
This dissertation examines rhetorical conditions and internet-mediated communication strategies that open and close dialogue between individuals with diverse and conflicting worldviews. The author illustrates this tension through sacred-secular interactions in college composition classrooms and online environments, positing that navigating conflict between these discourses—namely those espoused by religiously committed students and public university instructors—often requires stepping outside of adversarial communication frameworks. This project makes a case for models of civic engagement that use more deliberative rhetorical approaches prioritizing empathy over defensiveness and understanding before persuasion. To develop these non-adversarial communication approaches for the composition classroom, the author looks to participatory media for insights and studies the negotiation strategies of Christian and atheist YouTube users who leverage the affordances of the video medium, internet logics, and invitational rhetorical strategies to engage ideological differences in their respective online communities. Through mixed methods research involving in-depth interviews with five YouTube vloggers, netnographic study of over 3,000 videos, and statistical analysis of 76,000+ user comments, Coding Christianity finds that perspective-taking in conflict-ridden environments can happen between netizens when content creators opt out of “flame wars” and, instead, explicitly model critical openness and charitable listening to perceived “others.” The author ultimately suggests that sacred-secular tension in both academic and digital environments be used, not diffused, to negotiate conflicting values and engage in rigorous, civil dialogues
- …