Recognizing Interspersed sketches quickly

Sketch recognition is the automated recognition of hand-drawn diagrams. When allowing users to sketch as they would naturally, users may draw shapes in an interspersed manner, starting a second shape before finishing the first. In order to provide freedom to draw interspersed shapes, an exponential combination of subshapes must be considered. Because of this, most sketch recognition systems either choose not to handle interspersing, or handle only a limited pre-defined amount of interspersing. Our goal is to eliminate such interspersing drawing constraints from the sketcher. This paper presents a high-level recognition algorithm that, while still exponential, allows for complete interspersing freedom, running in near real-time through early effective sub-tree pruning. At the core of the algorithm is an indexing technique that takes advantage of geometric sketch recognition techniques to index each shape for efficient access and fast pruning during recognition. We have stresstested our algorithm to show that the system recognizes shapes in less than a second even with over a hundred candidate subshapes on screen.National Science Foundation (U.S.) (IIS Creative IT Grant #0757557

On-line hand-drawn electric circuit diagram recognition using 2D dynamic programming

9 pagesInternational audienceIn order to facilitate sketch recognition, most online existing works assume that people will not start to draw a new symbol before the current one has been finished. We propose in this paper a method that relaxes this constraint. The proposed methodology relies on a two-dimensional dynamic programming (2D-DP) technique allowing symbol hypothesis generation, which can correctly segment and recognize interspersed symbols. In addition, as discriminative classifiers usually have limited capability to reject outliers, some domain specific knowledge is included to circumvent those errors due to untrained patterns corresponding to erroneous segmentation hypotheses. With a point-level measurement, the experiment shows that the proposed novel approach is able to achieve an accuracy of more than 90 percent

Empiricism without Magic: Transformational Abstraction in Deep Convolutional Neural Networks

In artificial intelligence, recent research has demonstrated the remarkable potential of Deep Convolutional Neural Networks (DCNNs), which seem to exceed state-of-the-art performance in new domains weekly, especially on the sorts of very difficult perceptual discrimination tasks that skeptics thought would remain beyond the reach of artificial intelligence. However, it has proven difficult to explain why DCNNs perform so well. In philosophy of mind, empiricists have long suggested that complex cognition is based on information derived from sensory experience, often appealing to a faculty of abstraction. Rationalists have frequently complained, however, that empiricists never adequately explained how this faculty of abstraction actually works. In this paper, I tie these two questions together, to the mutual benefit of both disciplines. I argue that the architectural features that distinguish DCNNs from earlier neural networks allow them to implement a form of hierarchical processing that I call “transformational abstraction”. Transformational abstraction iteratively converts sensory-based representations of category exemplars into new formats that are increasingly tolerant to “nuisance variation” in input. Reflecting upon the way that DCNNs leverage a combination of linear and non-linear processing to efficiently accomplish this feat allows us to understand how the brain is capable of bi-directional travel between exemplars and abstractions, addressing longstanding problems in empiricist philosophy of mind. I end by considering the prospects for future research on DCNNs, arguing that rather than simply implementing 80s connectionism with more brute-force computation, transformational abstraction counts as a qualitatively distinct form of processing ripe with philosophical and psychological significance, because it is significantly better suited to depict the generic mechanism responsible for this important kind of psychological processing in the brain

Sketch interpretation using multiscale stochastic models of temporal patterns

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2006.Includes bibliographical references (p. 102-114).Sketching is a natural mode of interaction used in a variety of settings. For example, people sketch during early design and brainstorming sessions to guide the thought process; when we communicate certain ideas, we use sketching as an additional modality to convey ideas that can not be put in words. The emergence of hardware such as PDAs and Tablet PCs has enabled capturing freehand sketches, enabling the routine use of sketching as an additional human-computer interaction modality. But despite the availability of pen based information capture hardware, relatively little effort has been put into developing software capable of understanding and reasoning about sketches. To date, most approaches to sketch recognition have treated sketches as images (i.e., static finished products) and have applied vision algorithms for recognition. However, unlike images, sketches are produced incrementally and interactively, one stroke at a time and their processing should take advantage of this. This thesis explores ways of doing sketch recognition by extracting as much information as possible from temporal patterns that appear during sketching.(cont.) We present a sketch recognition framework based on hierarchical statistical models of temporal patterns. We show that in certain domains, stroke orderings used in the course of drawing individual objects contain temporal patterns that can aid recognition. We build on this work to show how sketch recognition systems can use knowledge of both common stroke orderings and common object orderings. We describe a statistical framework based on Dynamic Bayesian Networks that can learn temporal models of object-level and stroke-level patterns for recognition. Our framework supports multi-object strokes, multi-stroke objects, and allows interspersed drawing of objects - relaxing the assumption that objects are drawn one at a time. Our system also supports real-valued feature representations using a numerically stable recognition algorithm. We present recognition results for hand-drawn electronic circuit diagrams. The results show that modeling temporal patterns at multiple scales provides a significant increase in correct recognition rates, with no added computational penalties.by Tevfik Metin Sezgin.Ph.D

Faith after the Fight: Overcoming Doubts and Trauma from Warfare

In the aftermath of intense kinetic battlefield engagements where friendly, civilian, and enemy casualties occur, Christian combat veterans express difficulty reconciling God’s omniscience, omnipresence, and benevolence with their traumatic experience. The result has been prolonged episodes of despondence with God that presents itself as an impediment to continued faith or worse, an outright rejection of His existence. Exposure to the horrors of armed conflict can have a profoundly detrimental effect on a service member’s faith, but a person can begin the process to heal the invisible wounds of spiritual trauma by not abandoning their faith in God but instead clinging to it and finding a resolution to their doubts through an exercise in theodicy; all within a community context with genuine and consistent confidants who serve as mainstays throughout the introspective process

Exhibiting Berthe Morisot after the Advent of Feminist Art History

Feminist art historians reassessed French Impressionist Berthe Morisot (1841-1895) throughout the late twentieth and early twenty-first century, a period in which her work coincidentally received steady exposure in major museum exhibitions. This thesis examines how the feminist art historical project intersects with exhibitions that give prominence to Morisot’s work. Critical reviews by Morisot scholars argue that more frequent display of the artist’s work has not correlated to nuanced interpretation. Moreover, prominent feminist scholars and museum theorists maintain that curators virtually exclude their contributions. Attending to these recurrent concerns, this thesis charts shifts in emphases and inquiry in writing centered on Morisot to survey the extent to which curators convey new constructions of her artistic, social, and historical identities. This analysis will observe how distinct exhibition forms—the retrospective, the Impressionism blockbuster, and the gendered “women Impressionists” show—may frame Morisot’s work differently according to their organizing principles

Extending Reach with Technology: Seattle Opera's Multipronged Experiment to Deepen Relationships and Reach New Audiences

This case study describes the Seattle Opera's four-year-long effort to test which kinds of technology channels work well in audience engagement. Its experiments with technology included a simulcast of Madama Butterfly at an 8,300-capacity sports arena, interactive kiosks in the opera house lobby and online videos that took viewers behind the scenes of the opera's signature production of Wagner's Ring cycle. Every season employed at least some winning engagement tools, driven in large part by the company's efforts to gather information before determining what applications to use. Although the majority of the tools were most effective at enhancing the experience of patrons who already had a deep connection with the company, the simulcast, in project's fourth year, also brought in opera newcomers. One important lesson from the work was that effective strategies required the involvement not just of the marketing department, but of the entire organization, including its union representatives

Biopower: bodies, minds and biographical subjection in Victorian Lives of the Poets

This article discusses the diagnostic and exhibitionary character of nineteenth-century biographical discourse, with particular attention to Percy Bysshe Shelley. The article proposes that suggestive parallels between the life of the individual body and the textual materials of the written Life were often made in the nineteenth century. These parallels can be related to Foucauldian arguments about pastoral power and the individual subject, medicine and the case history, irrationality and juvenescence. The article argues that poetic subjects discussed as eccentric or pathological ‘genius’ were the ideal subjects and exemplify the proliferation and operation of forms of ‘biopower’. With these arguments in mind, the article analyses biographical writing about Shelley up to 1860. Specifically, the article discusses how Shelley’s biography moved from the somatic diagnosis of the poet’s ‘constitution consumptive’ in sketches by William Hazlitt and Leigh Hunt, to taking his thoughts, behaviour and writing as symptomatic of psychosomatic pathology. Looking in particular at the biographical productions of Thomas Jefferson Hogg and Thomas Medwin, the article suggests how ‘biopower’ compensated for the absence of the diagnosable body by concentrating on and disciplining the embodied mind, in line with nineteenth-century 'moral management', 'domestic psychiatry', and the construction of 'the mind of the child'. Finally, the article considers Victorian biography’s rhetoric of rational disenchantment and disillusionment, and suggests that it was conversely highly significant in establishing a version of beautifully and ineffectually irrational Romantic poetry. Looking forward to later periods, the article also proposes a pre-history of psychoanalytic or psycho-biographical criticism, and its ‘hermeneutics of suspicion’, in nineteenth- century biography

Revisiting Louis Roelandt’s Aula Academica : interior decoration and visitor experience in early 19th-century Belgian architecture

Since the inauguration of the Aula Academica in Ghent in 1826, its grand proportions and lavish decoration have impressed visitors. An examplar of tasteful, neoclassical architecture, the university building soon joined the list of Belgium's canonical buildings. The Aula was the first commission of Louis Roelandt (1786-1864), a promising architect who had just returned from training in Paris at the Ecole speciale d'architecture under Charles Percier and Pierre-Francois-Leonard Fontaine. Through a detailed analysis of the design process, this article examines how Roelandt's design forms part of an international architectural culture that understood not just the principles of composition but how composition combines with the ways an interior is used. Drawing on the example of a national pantheon commemorating important people, Roelandt created an ensemble in which architectural composition, interior decoration and the visitor's path of movement contribute to the expression of architectural character

Integration of sketch-based ideation and 3D modeling with CAD systems

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.This thesis is concerned with the study of how sketch-based systems can be improved to enhance idea generation process in conceptual design stage. It is also concerned with achieving a kind of integration between sketch-based systems and CAD systems to complete the digitization of the design process as sketching phase is still not integrated with other phases due to the different nature of it and the incomplete digitization of sketching phase itself. Previous studies identified three main related issues: sketching process, sketch-based modeling, and the integration between the digitized design phases. Here, the thesis is motivated from the desire to improve sketch-based modeling to support idea generation process but unlike previous studies that only focused on the technical or drawing part of sketching, this thesis attempts to concentrate more on the mental part of the sketching process which play a key role in developing ideas in design. Another motivation of this thesis is to produce a kind of integration between sketch-based systems and CAD systems to enable 3D models produced by sketching to be edited in detailed design stage. As such, there are two main contributions have been addressed in this thesis. The first contribution is the presenting of a new approach in designing sketch-based systems that enable more support for idea generation by separating thinking and developing ideas from the 3D modeling process. This kind of separation allows designers to think freely and concentrate more on their ideas rather than 3D modeling. the second contribution is achieving a kind of integration between gesture-based systems and CAD systems by using an IGES file in exchanging data between systems and a new method to organize data within the file in an order that make it more understood by feature recognition embedded in commercial CAD systems.This study is funded by the Ministry of Higher Education of Egypt