Gauge theory is a well-established concept in quantum physics,
electrodynamics, and cosmology. This theory has recently proliferated into new
areas, such as mechanics and astrodynamics. In this paper, we discuss a few
applications of gauge theory in finite-dimensional dynamical systems with
implications to numerical integration of differential equations. We distinguish
between rescriptive and descriptive gauge symmetry. Rescriptive gauge symmetry
is, in essence, re-scaling of the independent variable, while descriptive gauge
symmetry is a Yang-Mills-like transformation of the velocity vector field,
adapted to finite-dimensional systems. We show that a simple gauge
transformation of multiple harmonic oscillators driven by chaotic processes can
render an apparently "disordered" flow into a regular dynamical process, and
that there exists a remarkable connection between gauge transformations and
reduction theory of ordinary differential equations. Throughout the discussion,
we demonstrate the main ideas by considering examples from diverse engineering
and scientific fields, including quantum mechanics, chemistry, rigid-body
dynamics and information theory