FlightGoggles: A Modular Framework for Photorealistic Camera, Exteroceptive Sensor, and Dynamics Simulation

FlightGoggles is a photorealistic sensor simulator for perception-driven robotic vehicles. The key contributions of FlightGoggles are twofold. First, FlightGoggles provides photorealistic exteroceptive sensor simulation using graphics assets generated with photogrammetry. Second, it provides the ability to combine (i) synthetic exteroceptive measurements generated in silico in real time and (ii) vehicle dynamics and proprioceptive measurements generated in motio by vehicle(s) in a motion-capture facility. FlightGoggles is capable of simulating a virtual-reality environment around autonomous vehicle(s). While a vehicle is in flight in the FlightGoggles virtual reality environment, exteroceptive sensors are rendered synthetically in real time while all complex extrinsic dynamics are generated organically through the natural interactions of the vehicle. The FlightGoggles framework allows for researchers to accelerate development by circumventing the need to estimate complex and hard-to-model interactions such as aerodynamics, motor mechanics, battery electrochemistry, and behavior of other agents. The ability to perform vehicle-in-the-loop experiments with photorealistic exteroceptive sensor simulation facilitates novel research directions involving, e.g., fast and agile autonomous flight in obstacle-rich environments, safe human interaction, and flexible sensor selection. FlightGoggles has been utilized as the main test for selecting nine teams that will advance in the AlphaPilot autonomous drone racing challenge. We survey approaches and results from the top AlphaPilot teams, which may be of independent interest.Comment: Initial version appeared at IROS 2019. Supplementary material can be found at https://flightgoggles.mit.edu. Revision includes description of new FlightGoggles features, such as a photogrammetric model of the MIT Stata Center, new rendering settings, and a Python AP

An Active helideck testbed for floating structures based on a Stewart-Gough platform

A parallel robot testbed based on Stewart-Gough platform called Active-helideck is designed, developed and tested as a helicopter floating helideck. The objective of this testbed is to show the advantages of helicopters that use an active helideck upon landing on and taking off from ships or from offshore structures. Active-helideck compensates simulated movements of a ship at sea. The main goal of this study is to maintain the robot’s end effector (helideck) in a quasi-static position in accordance to an absolute inertial frame. Compensation is carried out through the coordinate action of its six prismatic actuators in function of an inertial measurement unit. Moreover, the simulation of the sea movement is done by a parallel robot called ship platform with three degrees of freedom. The ship platform is built with a vertical oscillation along the z axis, i.e. heave, and rotates on remaining axes, i.e. roll and pitch. Active helideck is able to compensate simulated movements by considering the ship as an inertial frame as observed in the experiment

GN&C Engineering Best Practices for Human-Rated Spacecraft Systems

The NASA Engineering and Safety Center (NESC) recently completed an in-depth assessment to identify a comprehensive set of engineering considerations for the Design, Development, Test and Evaluation (DDT&E) of safe and reliable human-rated spacecraft systems. Reliability subject matter experts, discipline experts, and systems engineering experts were brought together to synthesize the current "best practices" both at the spacecraft system and subsystems levels. The objective of this paper is to summarize, for the larger Community of Practice, the initial set of Guidance, Navigation and Control (GN&C) engineering Best Practices as identified by this NESC assessment process

Flightmare: A Flexible Quadrotor Simulator

Currently available quadrotor simulators have a rigid and highly-specialized structure: either are they really fast, physically accurate, or photo-realistic. In this work, we propose a paradigm-shift in the development of simulators: moving the trade-off between accuracy and speed from the developers to the end-users. We use this design idea to develop a novel modular quadrotor simulator: Flightmare. Flightmare is composed of two main components: a configurable rendering engine built on Unity and a flexible physics engine for dynamics simulation. Those two components are totally decoupled and can run independently from each other. This makes our simulator extremely fast: rendering achieves speeds of up to 230 Hz, while physics simulation of up to 200,000 Hz. In addition, Flightmare comes with several desirable features: (i) a large multi-modal sensor suite, including an interface to extract the 3D point-cloud of the scene; (ii) an API for reinforcement learning which can simulate hundreds of quadrotors in parallel; and (iii) an integration with a virtual-reality headset for interaction with the simulated environment. We demonstrate the flexibility of Flightmare by using it for two completely different robotic tasks: learning a sensorimotor control policy for a quadrotor and path-planning in a complex 3D environment

An approach to simulation of autonomous vehicles

Tese de mestrado integrado. Engenharia Electrotécnica e de Computadores (Major de Telecomunicações). Faculdade de Engenharia. Universidade do Porto. 200

Space science/space station attached payload pointing accommodation study: Technology assessment white paper

Technology assessment is performed for pointing systems that accommodate payloads of large mass and large dimensions. Related technology areas are also examined. These related areas include active thermal lines or power cables across gimbals, new materials for increased passive damping, tethered pointing, and inertially reacting pointing systems. Conclusions, issues and concerns, and recommendations regarding the status and development of large pointing systems for space applications are made based on the performed assessments

Viking '75 spacecraft design and test summary. Volume 3: Engineering test summary

The engineering test program for the lander and the orbiter are presented. The engineering program was developed to achieve confidence that the design was adequate to survive the expected mission environments and to accomplish the mission objective

Design and Test of an Attitude Determination and Control System for a 6U CubeSat using AFIT\u27s CubeSat Testbed

The design and test of a 6U CubeSat Attitude Determination and Control System (ADCS) are explored to establish single-axis control using AFIT\u27s CubeSat testbed consisting of a Helmholtz cage and hemi-spherical air bearing. The Helmholtz cage produces a near-uniform magnetic field inside the cage while the air bearing provides a near-frictionless surface for ADCS testing. The ADCS testbed includes a four wheel pyramid reaction wheel array (RWA) for actuation and an inertial measurement unit (IMU) for attitude determination. Along with the ADCS hardware, the ADCS testbed also includes an Electrical Power System (EPS) and Command and Data Handling (CDH) for power and wireless telemetry, respectively. Attitude estimation is performed using the QUEST algorithm with magnetometer and accelerometer sensor data to estimate a current quaternion. A Proportional-Integral-Derivative (PID) controller is used for control of the ADCS testbed while each reaction wheel motor is controlled by a proportional gain. ..