We demonstrate a means of creating a digital image by using a two axis tilt
micromirror to scan a scene. For each different orientation we extract a single
grayscale value from the mirror and combine them to form a single composite
image. This allows one to choose the distribution of the samples, and so in
principle a variable resolution image could be created. We demonstrate this
ability to control resolution by constructing a voltage table that compensates
for the non-linear response of the mirrors to the applied voltage.Comment: 8 pages, 5 figures, preprin

Hicks, R. Andrew

Kurzweg, Timothy P.

Nasis, Vasileios T.

English

arXiv

Optics Letters, 32(9): pp. 1066-1068.We demonstrate a means of creating a digital image by using a two axis tilt micromirror to scan a scene.
For each different orientation we extract a single grayscale value from the mirror and combine them to form
a single composite image. This allows one to choose the distribution of the samples, and so in principle a
variable resolution image could be created. We demonstrate this ability to control resolution and projection by
constructing a voltage table that compensates for the non-linear response of the mirrors to the applied voltage

Hicks, Robert Andrew

Drexel Libraries E-Repository and Archives

 
 
 
 
 
 
 
 
 
 
 
 
 
College of Arts and Sciences 
    
      
 
Drexel E-Repository and Archive (iDEA) 
http://idea.library.drexel.edu/   
 
 
Drexel University Libraries 
www.library.drexel.edu
 
 
 
 
 
 
 
 
 
 
 
The following item is made available as a courtesy to scholars by the author(s) and Drexel University Library and may 
contain materials and content, including computer code and tags, artwork, text, graphics, images, and illustrations 
(Material) which may be protected by copyright law. Unless otherwise noted, the Material is made available for non 
profit and educational purposes, such as research, teaching and private study. For these limited purposes, you may 
reproduce (print, download or make copies) the Material without prior permission. All copies must include any 
copyright notice originally included with the Material. You must seek permission from the authors or copyright 
owners for all uses that are not allowed by fair use and other provisions of the U.S. Copyright Law. The 
responsibility for making an independent legal assessment and securing any necessary permission rests with persons 
desiring to reproduce or use the Material. 
 
 
Please direct questions to archives@drexel.edu
 
Programmable imaging with two-axis micromirrors
R. Andrew Hicks
Department of Mathematics, Drexel University
3141 Chestnut St., Philadelphia, PA 19104, USA
Vasileios T. Nasis
Department of Electrical and Computer Engineering, Drexel University
3141 Chestnut St., Philadelphia, PA 19104, USA
Timothy P. Kurzweg
Department of Electrical and Computer Engineering, Drexel University
3141 Chestnut St., Philadelphia, PA 19104, USA
Compiled February 9, 2007
We demonstrate a means of creating a digital image by using a two axis tilt micromirror to scan a scene.
For each different orientation we extract a single grayscale value from the mirror and combine them to form
a single composite image. This allows one to choose the distribution of the samples, and so in principle a
variable resolution image could be created. We demonstrate this ability to control resolution and projection by
constructing a voltage table that compensates for the non-linear response of the mirrors to the applied voltage.
c© 2007 Optical Society of America
OCIS codes: 110.0110, 230.3990, 230.4040.
Imaging systems that differ from the traditional lens-
film paradigm have recently been appearing in increas-
ing numbers. One of the earliest is coded aperture imag-
ing, which dates back to the 1961 work of Mertz and
Young.1 This is an example of computational imaging,
in which the optical system is designed to include com-
putational component that performs a task that is not
a mere heuristic. Other examples (not attempting to be
exhaustive) include Cathey and Dowksy wave-front cod-
ing introduced in 1995,2 which allows for optical imag-
ing with great depth of field. More recent examples in-
clude light field imaging, for which one may consult the
excellent survey by Levoy.3 Zomet and Nayar used liq-
uid crystal masks for “lensless imaging”.4 Split aperture
imaging for extended dynamic range was investigated by
Aggarwal and Ahuja.5
Here we consider imaging with a single micromirror,
as a first step to building a system that will utilize
a large array. Micro-Opto-Electro-Mechanical Systems
(MOEMS) is a relatively new field which appears to
have a multitude of applications. Perhaps the best known
MOEMS is the Texas Instruments’ Digital Micromirror
Device (DMD), which is an NxN array of SRAM cells,
each covered by a tilting mirror.6 Each of these mirrors
is either in a binary “on” or “off” state. The primary
application of this device is for the projection of images.
The availability of Texas Instruments DMD chip has
resulted in a number of new approaches to imaging, such
as the work by Baraniuk et al. on compressive imag-
ing and Nayar et al. on programmable imaging for dy-
namic range and increased field of view.7, 8 Of course
medical imaging includes numerous examples of compu-
tational imaging techniques, largely based on solving in-
verse problems, such as CAT, ultra-sound, and optical
tomography, which we will not even attempt to survey.
Optical switching is another application area for
MOEMS. Here, mirrors can eliminate the costly conver-
sion from the optical domain to the electrical domain
for switching. An example is Lucent’s WaveStar Lamb-
daRouter, which used an 8x8 array of 2-axis 600 µm
diameter micromirrors to achieve fiber array switching
for 256 channels.9 A later version of the array consisted
of 16x16 mirrors. Each mirror may be individually actu-
ated and can achieve 100,000 distinct states.10
In this letter, we present our initial results on pho-
tographic imaging with using a single two-axis tilt mi-
cromirror which can operate in the kilohertz range. We
demonstrate a means of calibrating the mirrors for imag-
ing purposes and show that by choosing various voltage
functions one can program the sensor to mimic different
types of lenses.
Note that while the term “imaging” is commonly asso-
ciated with MOEMS, it is usually not used in the sense of
photographic imaging.11 Exceptions include work done
by Nayar et al. with the DMD to extend dynamic range
and work by Last et al. on micro-cameras which use
a 1-axis mirror to increase the field of view.8, 12 Previ-
ous work by the authors described simulations and some
manual experiments.13
In conventional macroscopic photography there is the
notion of image mosaicing, in which one combines two
or more images with some common overlap to create a
single image of higher resolution than its constituents.
An omnidirectional example, which is the main motiva-
tion for this work, is that done by Kropp et al. as part of
the MIT City Scanning Project.14 In mosaicing, gener-
1
ally a camera is moved to obtain images. A conceivable
alternative is to point the camera at a movable mirror.15
Here we propose the use of micromirrors for this pur-
pose in conjunction with a video camera for the purpose
of obtaining one or more pixels from each image of the
recorded video and combining them to form an image.
One characteristic of such a sensor is its ability to sam-
ple in a prescribed fashion. For example, if an image
was recorded, then it should be possible to choose a re-
gion of the scene for closer inspection, and extract more
samples from that region. This becomes particularly at-
tractive for wide angle or panoramic imaging in which
the total solid angle being imaged is large, and hence
a relatively small number of pixels are allocated to a
typical steradian. For example, conventional panoramic
imaging systems consisting of a curved mirror and video
camera have the drawback that the resolution is gen-
erally non-uniform. While it is possible to design cata-
dioptric systems that are equiresolution, these systems
still lack the ability to “zoom in” on an object of inter-
est.16 If a curved mirror is imaged with a micromirror
though, more pixels could be taken from the regions of
interest. This could be especially useful for tracking and
surveillance applications.
Images were synthesized by scanning a test pattern
consisting of 5 mm squares, each broken into four sub-
squares, two of which contained smaller checkerboard
patterns, with checkers .5 mm in the northwest sub-
square and .25 mm in the southeast sub-square, as de-
picted Fig. 1. Using a single mirror we extracted a single
pixel (the same pixel in each case) from the micromirror.
Fig. 2 is a schematic of our device. Our mirror has a ±7
degree tilt, with voltages varying from ±120. Scanning
the test pattern with uniformly spaced voltages from -
105 to -65 volts on one actuator and -79 to 80 volts on an-
other for a fixed single mirror, we constructed a 160x160
composite grayscale image, depicted in Fig. 3A, by ex-
tracting a single pixel from each image. The non-linear
response of the mirror to the applied voltages results in a
distorted image. Nevertheless, using this composite im-
age, it was then possible to build a non-linear table of
voltages, which could sample the image uniformly. Thus
we may control how the scene is sampled. The table was
built using the fact that the voltages corresponding to
the corners of the checkers were known. 81 sample points
were chosen resulting in two 9x9 voltage tables. These
were then expanded to 129x129 tables via bilinear inter-
polation and this table was then used to image the same
test pattern. The result appears in Fig. 3B. In both im-
ages the .25 mm checkers are not visible, but the .5 mm
checkers are, so we are at the limit of the resolution of
the device. These images were created using a conven-
tional 640x480 video camera and a 75 mm double Gauss
macro lens. Our illumination source was a 35W halogen
lamp placed 7 cm from the test pattern, which was 6 cm
away from the mirror. The camera was 125 cm from the
micromirror.
The the advantages of imaging with micromirror ar-
rays is the ability to choose the voltages. For example,
Fig.3C we see a “fisheye” image formed by altering the
uniform voltage table and rescanning. On the other hand
pincushion distortion can be achieved in a similar man-
ner, as depicted by the image in Fig. 3D.
Note that for each orientation of the mirror that the
“virtual viewpoint” does change, but continuously. This
does introduce some distortion but all distortion is in a
sense accounted for by choosing an appropriate voltage
table.
Our work here is a proof of concept, and we have not
optimized our choice of off the shelf lenses. Our ultimate
vision is a sensor in which data was being gathered simul-
taneously from an entire array of micromirrors, at a high
frame rate. Our main notion of a programmable sensor is
that the sampling may not necessarily be uniform, but
be chosen by the user. Ideally, in application one may
choose to alter the voltage table to obtain various ef-
fects, such as uniform resolution in solid angle, foveation
on a particular region, or if high enough speeds could be
achieved, tracking an object.
Several idealizations can be imagined to improve im-
age resolution, quality and increase the rate of data ac-
quisition. First, it may be that more than a single pixel
could be extracted from each mirror. Second, a two axis
tilt array with properties similar to the Texas Instru-
ments DMD would be able to operate in the megahertz
range and have small enough dead space between pix-
els that the array could possibly be treated as a single,
continuous deformable mirror. Introducing an array of
mirrors into the model raises complex questions, such
as whether the mirrors could be calibrated well enough
so sampling could be “interwoven” between the mirrors,
perhaps allowing for super-resolution. Work is being per-
formed at several institutions to create such two axis tilt
arrays, and our hope is that the ideas introduced in this
paper will adapt to such new technology.
Acknowledgments
The authors would like to thank Vladimir Aksyuk,
John Gates and and Rick Papazian of Lucent Technolo-
gies/Bell Laboratories, G.K. Ananthasuresh of the In-
dian Institute of Science, Bangalore, Jungsang Kim of
Duke University ECE. This work was supported by NSF-
DMS-0211283 and NSF-IIS-0413012.
References
1. L. Mertz and N.O. Young. Fresnel transforms of images.
In Proc. Int. Conf. on Opt. Instrum. Techniques, ed.
K.J. Habell, pages 305–310. Chapman and Hall, London,
1961.
2. W. T. Cathey and R. Dowski. New paradigm for imaging
sys- tems. Applied Optics, 41:18591866, 1995.
3. M. Levoy. Light fields and computational imaging. IEEE
Computer, pages 46–55, 2006.
4. A. Zomet and S. Nayar. Lensless imaging with a control-
lable aperture. In Proc. Computer Vision Pattern Recog-
nition, pages 339–346, 2006.
2
5. M. Aggarwal and N. Ahuja. Split aperture imaging for
high dynamic range. International Journal of Computer
Vision, 58:7–17, 2004.
6. L. Hornbeck. From cathode rays to digital micromirrors:
A history of electronic projection display technology.
Texas Instruments Technical Journal, 15:7–46, 1998.
7. D. Takhar, J. Lask, M. Wakin, M. Duarte, D. Baron,
S. Sarvotham, K. Kelly, and . Baraniuk. A new compres-
sive imaging camera architecture using optical-domain
compression. In Proc. of Computational Imaging IV at
SPIE Electronic Imaging, pages 1–15. SPIE Optical En-
gineering Press, San Jose, CA, 2006.
8. S. Nayar, V. Branzoi, and T. Boult. Programmable
imaging using a digital micromirror array. In Proc. 2004
IEEE Computer Society Conference on Computer Vi-
sion and Pattern Recognition, pages 436–443, 2004.
9. D. Bishop, C. R. Giles, and S. Das. The rise of optical
switching. Scientific American, 248:88–95, 2001.
10. J. Kim, C.J. Nuzman, B. Kumar, D.F. Lieuwen, J.S.
Kraus, A. Weiss, C.P. Lichtenwalner, A.R. Papazian,
R.E. Frahm, N.R. Basavanhally, D.A. Ramsey, V.A.
Aksyuk, F. Pardo, M.E. Simon, V. Lifton, H.B. Chan,
M. Haueis, A. Gasparyan, H.R. Shea, S. Arney, C.A.
Bolle, P.R. Kolodner, R. Ryf, D.T. Neilson, and J.V.
Gates. 1100 x 1100 port mems-based optical crosscon-
nect with 4-db maximum loss. IEEE Photonics Tech-
nology Letters No 11, 15:1537–1539, 2003.
11. B. Gogoi H. Urey, D. Dickensheets. Proceedings of SPIE
Volume: 6114 MOEMS Display, Imaging, and Miniatur-
ized Microsystems IV. SPIE Press, 2006.
12. L. Zhou M. Last, V. Milanovic J. Kahn, and K. Pister.
Towards a 1mm3 camera – the field stitching micromir-
ror. In Proceedings of Eurosensors 2003, Guimaraes,
Portugal, 2003.
13. V. Nasis, R. Hicks, and T. Kurzweg. Digital photo-
graphic imaging using moems. In Proceedings of SPIE
Volume 6114 MOEMS Display, Imaging, and Miniatur-
ized Microsystems IV, 2006.
14. A. Kropp, N. Master, and S. Teller. Acquiring and
rendering high-resolution spherical mosaics. In Proc.
IEEE Workshop on Omnidirectional Vision, pages 47–
53, 2000.
15. T. Nakao and A. Kashitani. Panoramic camera using a
mirror rotation mechanism and a fast image mosaicing.
In Proc. Int. Conf. on Image Processing, Thessaloniki,
Greece, pages 1045–1048, 2001.
16. R. Hicks and R. Perline. Equiresolution catadioptric
sensors. Applied Optics, 44:6108–6114, 2005.
3
List of Figures
4
Fig. 1. The fundamental unit of our test pattern. A checkerboard pattern was chosen to allow for calibration. The
two different size checkers illustrated that the resolution of the device was between .5 mm and .025 mm.
5
C A M E R A
M I C R O M I R R O R
T E S T P A T T E R N
Fig. 2. The relationship between the camera, the array, and the test pattern.
6
A . B
.
C . D .
Fig. 3. A. A 160x160 image created by scanning the test pattern with a single mirror and uniformly spaced volt-
ages. B. A 129x129 image obtained by using a nonlinear voltage table. C. Fisheye distortion can be introduced by
transforming the voltage table in a radial manner. D. Pin-cushion distortion introduced by transforming the voltage
table appropriately.
7


Programmable imaging with two-axis micromirrors

https://idea.library.drexel.edu/islandora/object/idea%3A1636/datastream/OBJ/download/Programmable_imaging_with_two-axis_micromirrors.pdf

Imaging with two-axis micromirrors

Abstract

Similar works

Full text

Available Versions

Drexel Libraries E-Repository and Archives