1,029 research outputs found
The interpretations of line drawings with contrast failure and shadows
Abstract. In line drawings derived from real images, lines may be missing due to contrast failure and objects with curved surfaces may cast shadows from multiple light sources. This paper shows that it is the presence of shadows, rather than contrast failure, that renders the line drawing labelling problem NP-complete. However, shadows are a valuable visual cue, since their presence is formally shown to reduce the average ambiguity of drawings. This is especially true when constraints concerning shadow formation are employed to differentiate shadow and non-shadow lines. The extended junction constraint, concerning straight lines colinear with junctions, compensates the loss of information caused by contrast failure. In fact, we observe the contrast failure paradox: a drawing is sometimes less ambiguous when lines are partly missing due to contrast failure. It is known that the coplanarity of sets of object vertices can be deduced from the presence of straight lines in the drawing. This paper shows that these coplanarity constraints are robust to the presence of contrast failure
Interpreting line drawings of curved objects,”
Abstract In this paper, we study the problem of interpreting line drawings of scenes composed of opaque regular solid objects bounded by piecewise smooth surfaces with no markings or texture on them. It is assumed that the line drawing has been formed by orthographic projection of such a scene under general viewpoint, that the line drawing is error free, and that there are no lines due to shadows or specularities. Our definition implicitly excludes laminae, wires, and the apices of cones. A major component of the interpretation of line drawings is line labelling. By line labelling we mean (a) classification of each image curve as corresponding to either a depth or orientation discontinuity in the scene, and (b) further subclassification of each kind of discontinuity. For a depth discontinuity we determine whether it is a limb-a locus of points on the surface where the line of sight is tangent to the surface-or an occluding edge-a tangent plane discontinuity of the surface. For an orientation discontinuity, we determine whether it corresponds to a convex or concave edge. This paper presents the first mathematically rigorous scheme for labelling line drawings of the class of scenes described. Previous schemes for labelling line drawings of scenes containing curved objects were heuristic, incomplete, and lacked proper mathematical justification. By analyzing the projection of the neighborhoods of different kinds of points on a piecewise smooth surface, we are able to catalog all local labelling possibilities for the different types of junctions in a line drawing. An algorithm is developed which utilizes this catalog to determine all legal labellings of the line drawing. A local minimum complexity rule-at each vertex select those labellings which correspond to the minimum number of faces meeting at the vertex-is used in order to prune highly counter-intuitive interpretations. The labelling scheme was implemented and tested on a number of line drawings. The labellings obtained are few and by and large in accordance with human interpretations
From surfaces to objects : Recognizing objects using surface information and object models.
This thesis describes research on recognizing partially obscured objects using
surface information like Marr's 2D sketch ([MAR82]) and surface-based geometrical
object models. The goal of the recognition process is to produce a fully
instantiated object hypotheses, with either image evidence for each feature or
explanations for their absence, in terms of self or external occlusion.
The central point of the thesis is that using surface information should be
an important part of the image understanding process. This is because surfaces
are the features that directly link perception to the objects perceived (for
normal "camera-like" sensing) and because surfaces make explicit information
needed to understand and cope with some visual problems (e.g. obscured features).
Further, because surfaces are both the data and model primitive, detailed
recognition can be made both simpler and more complete.
Recognition input is a surface image, which represents surface orientation and
absolute depth. Segmentation criteria are proposed for forming surface patches
with constant curvature character, based on surface shape discontinuities which
become labeled segmentation- boundaries.
Partially obscured object surfaces are reconstructed using stronger surface based
constraints. Surfaces are grouped to form surface clusters, which are 3D
identity-independent solids that often correspond to model primitives. These are
used here as a context within which to select models and find all object features.
True three-dimensional properties of image boundaries, surfaces and surface
clusters are directly estimated using the surface data.
Models are invoked using a network formulation, where individual nodes
represent potential identities for image structures. The links between nodes are
defined by generic and structural relationships. They define indirect evidence relationships
for an identity. Direct evidence for the identities comes from the data
properties. A plausibility computation is defined according to the constraints inherent
in the evidence types. When a node acquires sufficient plausibility, the
model is invoked for the corresponding image structure.Objects are primarily represented using a surface-based geometrical model.
Assemblies are formed from subassemblies and surface primitives, which are
defined using surface shape and boundaries. Variable affixments between assemblies
allow flexibly connected objects.
The initial object reference frame is estimated from model-data surface relationships,
using correspondences suggested by invocation. With the reference
frame, back-facing, tangential, partially self-obscured, totally self-obscured and
fully visible image features are deduced. From these, the oriented model is used
for finding evidence for missing visible model features. IT no evidence is found,
the program attempts to find evidence to justify the features obscured by an unrelated
object. Structured objects are constructed using a hierarchical synthesis
process.
Fully completed hypotheses are verified using both existence and identity
constraints based on surface evidence.
Each of these processes is defined by its computational constraints and are
demonstrated on two test images. These test scenes are interesting because they
contain partially and fully obscured object features, a variety of surface and solid
types and flexibly connected objects. All modeled objects were fully identified
and analyzed to the level represented in their models and were also acceptably
spatially located.
Portions of this work have been reported elsewhere ([FIS83], [FIS85a], [FIS85b],
[FIS86]) by the author
Human perception in segmentation of sketches
In this paper, we study the segmentation of sketched engineering
drawings into a set of straight and curved segments. Our immediate objective is
to produce a benchmarking method for segmentation algorithms. The criterion
is to minimise the differences between what the algorithm detects and what
human beings perceive. We have created a set of sketched drawings and have
asked people to segment them. By analysis of the produced segmentations, we
have obtained the number and locations of the segmentation points which
people perceive. Evidence collected during our experiments supports useful
hypotheses, for example that not all kinds of segmentation points are equally
difficult to perceive. The resulting methodology can be repeated with other
drawings to obtain a set of sketches and segmentation data which could be used
as a benchmark for segmentation algorithms, to evaluate their capability to
emulate human perception of sketches
- …