Interactive interpretation of structured documents: Application to the recognition of handwritten architectural plans

International audienceThis paper addresses a whole architecture, including the IMISketch method. IMISketch method incorporates two aspects: document analysis and interactivity. This paper describes a global vision of all the parts of the project. IMISketch is a generic method for an interactive interpretation of handwritten sketches. The analysis of complex documents requires the management of uncertainty. While, in practice the similar methods often induce a large combinatorics, IMISketch method presents several optimization strategies to reduce the combinatorics. The goal of these optimizations is to have a time analysis compatible with user expectations. The decision process is able to solicit the user in the case of strong ambiguity: when it is not sure to make the right decision, the user explicitly validates the right decision to avoid a fastidious a posteriori verification phase due to propagation of errors.This interaction requires solving two major problems: how interpretation results will be presented to the user, and how the user will interact with analysis process. We propose to study the effects of those two aspects. The experiments demonstrate that (i) a progressive presentation of the analysis results, (ii) user interventions during it and (iii) the user solicitation by the analysis process are an efficient strategy for the recognition of complex off-line documents.To validate this interactive analysis method, several experiments are reported on off-line handwritten 2D architectural floor plans

Profiling relational data: a survey

Profiling data to determine metadata about a given dataset is an important and frequent activity of any IT professional and researcher and is necessary for various use-cases. It encompasses a vast array of methods to examine datasets and produce metadata. Among the simpler results are statistics, such as the number of null values and distinct values in a column, its data type, or the most frequent patterns of its data values. Metadata that are more difficult to compute involve multiple columns, namely correlations, unique column combinations, functional dependencies, and inclusion dependencies. Further techniques detect conditional properties of the dataset at hand. This survey provides a classification of data profiling tasks and comprehensively reviews the state of the art for each class. In addition, we review data profiling tools and systems from research and industry. We conclude with an outlook on the future of data profiling beyond traditional profiling tasks and beyond relational databases

Industrial Design

A new breed of modern designers is on the way. These non-traditional industrial designers work across disciplines, understand human beings, as well as business and technology thus bridging the gap between customer needs and technological advancement of tomorrow. This book uncovers prospective designer techniques and methods of a new age of industrial design, whose practitioners strive to construct simple and yet complex products of the future. The novel frontiers of a new era of industrial design are exposed, in what concerns the design process, in illustrating the use of new technologies in design and in terms of the advancement of culturally inspired design. The diverse perspectives taken by the authors of this book ensure stimulating reading and will assist readers in leaping forward in their own practice of industrial design, and in preparing new research that is relevant and aligned with the current challenges of this fascinating field

Computer-aided exploration of architectural design spaces: a digital sketchbook

Het ontwerpproces van architecten vormt vaak geen lineair pad van ontwerpopgave tot eindresultaat, maar wordt veeleer gekenmerkt door exploratie of het doorzoeken van meerdere alternatieven in een (conceptuele) ontwerpruimte. Dit proces wordt in de praktijk vaak ondersteund door manueel schetsen, waarbij de ontwerpers schetsboek kan gelezen worden als een reeks exploraties. Dit soort interactie met de ontwerpruimte wordt in veel mindere mate ondersteund door hedendaagse computerondersteunde ontwerpsystemen. De metafoor van een digitaal schetsboek, waarbij menselijke exploratie wordt versterkt door de (reken)kracht van een computer, is het centrale onderzoeksthema van dit proefschrift. Hoewel het opzet van een ontwerpruimte op het eerste gezicht schatplichtig lijkt aan het onderzoeksveld van de artificiële intelligentie (AI), wordt het ontwerpen hier ruimer geïnterpreteerd dan het oplossen van problemen. Als onderzoeksmethodologie worden vormengrammatica’s ingezet, die enerzijds nauw aanleunen bij de AI en een formeel raamwerk bieden voor de exploratie van ontwerpruimtes, maar tegelijkertijd ook weerstand bieden tegen de AI en een vorm van visueel denken en ambiguïteit toelaten. De twee bijhorende onderzoeksvragen zijn hoe deze vormengrammatica’s digitaal kunnen worden gerepresenteerd, en op welke manier de ontwerper-computer interactie kan gebeuren. De resultaten van deze twee onderzoeksvragen vormen de basis van een nieuw hulpmiddel voor architecten: het digitaal schetsboek

A cognition-analogous approach to early-stage creative ideation support in music composition software

Examination of the underlying principles of creativity reveal theoretical aspects that have not been well explored in creativity facilitation software. Most significantly of these, there has been little investigation into exploiting the distinctions between early- and late-stage creative processes and the attendant differences in cognitive processing active at those times, nor into employing the structural scaffolding embedded within creative works and the manner in which these can be extracted and harnessed to define levels of abstraction through which the material can be viewed and manipulated. The Wheelsong project was conceived to exploit these principles, in the service of devising more creatively facilitative music composition tools, by focusing on these earlier, exploratory stages of the creative process, and by privileging structure over minutiae, in alignment with the mode of cognition (and corresponding user needs) that dominate the exploratory phase. Explorations conducted with Wheelsong demonstrate that the platform embraces broad stylistic and cultural ranges of output. Experiments comparing the creative merits of early-stage, fragmentary outputs produced by Wheelsong against those produced by traditional representation schemes show a substantial improvement in both subjective quality and diversity indicators adhering to the structurally produced candidates, as measured by human judges

Organic Chemistry in Virtual Reality: Bridging Gaps between Two-Dimensional and Three-Dimensional Representations

The traditional two-dimensional representations in organic chemistry education highlighted the lack of depth and interactivity, impeding student learning, engagement, and comprehension. By emphasizing on the limitations of conventional educational materials, the research advocated for integrating Augmented Reality (AR) and Virtual Reality (VR) technologies, which enhance organic chemistry visualization. The main objective was to bridge the gap between two and three-dimensional perspectives, offering a more dynamic and interactive learning experience. The thesis aimed to assess traditional teaching methods in organic chemistry—lectures, textbooks, and laboratory exercises. It also aimed to identify their challenges in conveying complex molecular structures and reactions effectively. Additionally, it explored the integration of Virtual Reality (VR) and Augmented Reality (AR) with these conventional methods. The goal had been to develop a cohesive educational framework that combined the strengths of both traditional and modern technological approaches. This blended learning model was meant to improve student engagement and understanding by incorporating dynamic visualizations into lectures as well as interactive content into textbooks. Building on this premise, the research focused on the following questions: 1. What challenges do traditional teaching methods face in teaching organic chemistry concepts adequately? 2. What advantages do VR and AR offer in organic chemistry education compared to traditional methods? 3. What impact do VR and AR technologies have on student engagement in organic chemistry compared to traditional teaching methods? 4. How can VR and AR be tailored to meet pedagogical and andragogical needs in organic chemistry education? 5. Why are VR and AR more effective than traditional methods in enhancing learning in organic chemistry? 6. What are the best strategies for integrating VR and AR into the organic chemistry curricula to enhance learning alongside traditional methods? 7. How can AR and VR in organic chemistry education be aligned with Vygotsky’s Zone of Proximal Development to improve learning outcomes? 8. How can AR and VR be personalized in organic chemistry education to support individual learning and Piaget\u27s theory of self-learning? 9. What are the benefits and challenges of applying the \u27Ship Early, Ship Often\u27 approach to developing AR and VR tools in organic chemistry education? Upon the completion of this research, a literature review was conducted additionally as well as visual and content analyses. Based upon the research conducted, a visual solution was created to guide curriculum developers, textbook publishers, researchers, and educators in integrating VR and AR technologies into traditional organic chemistry curricula. The deliverable theory of the visual was a high-fidelity wireframe prototype created for VR and AR in Organic Chemistry, designed to enhance student engagement and understanding by combining immersive technology with traditional teaching methods. The project also featured a responsive website to inform stakeholders about the benefits of this integration, supported by print media like brochures, posters, and billboards for broader outreach and awareness. The high-fidelity wireframe prototype with the responsive website and supporting print media, were crucial elements in reshaping organic chemistry education, bridging the gap between traditional pedagogy and andragogy as well as futuristic learning paradigms

Evolutionary design assistants for architecture

In its parallel pursuit of an increased competitivity for design offices and more pleasurable and easier workflows for designers, artificial design intelligence is a technical, intellectual, and political challenge. While human-machine cooperation has become commonplace through Computer Aided Design (CAD) tools, a more improved collaboration and better support appear possible only through an endeavor into a kind of artificial design intelligence, which is more sensitive to the human perception of affairs. Considered as part of the broader Computational Design studies, the research program of this quest can be called Artificial / Autonomous / Automated Design (AD). The current available level of Artificial Intelligence (AI) for design is limited and a viable aim for current AD would be to develop design assistants that are capable of producing drafts for various design tasks. Thus, the overall aim of this thesis is the development of approaches, techniques, and tools towards artificial design assistants that offer a capability for generating drafts for sub-tasks within design processes. The main technology explored for this aim is Evolutionary Computation (EC), and the target design domain is architecture. The two connected research questions of the study concern, first, the investigation of the ways to develop an architectural design assistant, and secondly, the utilization of EC for the development of such assistants. While developing approaches, techniques, and computational tools for such an assistant, the study also carries out a broad theoretical investigation into the main problems, challenges, and requirements towards such assistants on a rather overall level. Therefore, the research is shaped as a parallel investigation of three main threads interwoven along several levels, moving from a more general level to specific applications. The three research threads comprise, first, theoretical discussions and speculations with regard to both existing literature and the proposals and applications of the thesis; secondly, proposals for descriptive and prescriptive models, mappings, summary illustrations, task structures, decomposition schemes, and integratory frameworks; and finally, experimental applications of these proposals. This tripartite progression allows an evaluation of each proposal both conceptually and practically; thereby, enabling a progressive improvement of the understanding regarding the research question, while producing concrete outputs on the way. Besides theoretical and interpretative examinations, the thesis investigates its subject through a set of practical and speculative proposals, which function as both research instruments and the outputs of the study. The first main output of the study is the “design_proxy” approach (d_p), which is an integrated approach for draft making design assistants. It is an outcome of both theoretical examinations and experimental applications, and proposes an integration of, (1) flexible and relaxed task definitions and representations (instead of strict formalisms), (2) intuitive interfaces that make use of usual design media, (3) evaluation of solution proposals through their similarity to given examples, and (4) a dynamic evolutionary approach for solution generation. The design_proxy approach may be useful for AD researchers that aim at developing practical design assistants, as has been examined and demonstrated with the two applications, i.e., design_proxy.graphics and design_proxy.layout. The second main output, the “Interleaved Evolutionary Algorithm” (IEA, or Interleaved EA) is a novel evolutionary algorithm proposed and used as the underlying generative mechanism of design_proxybased design assistants. The Interleaved EA is a dynamic, adaptive, and multi-objective EA, in which one of the objectives leads the evolution until its fitness progression stagnates; in the sense that the settings and fitness values of this objective is used for most evolutionary decisions. In this way, the Interleaved EA enables the use of different settings and operators for each of the objectives within an overall task, which would be the same for all objectives in a regular multi-objective EA. This property gives the algorithm a modular structure, which offers an improvable method for the utilization of domain-specific knowledge for each sub-task, i.e., objective. The Interleaved EA can be used by Evolutionary Computation (EC) researchers and by practitioners who employ EC for their tasks. As a third main output, the “Architectural Stem Cells Framework” is a conceptual framework for architectural design assistants. It proposes a dynamic and multi-layered method for combining a set of design assistants for larger tasks in architectural design. The first component of the framework is a layer-based, parallel task decomposition approach, which aims at obtaining a dynamic parallelization of sub-tasks within a more complicated problem. The second component of the framework is a conception for the development mechanisms for building drafts, i.e., Architectural Stem Cells (ASC). An ASC can be conceived as a semantically marked geometric structure, which contains the information that specifies the possibilities and constraints for how an abstract building may develop from an undetailed stage to a fully developed building draft. ASCs are required for re-integrating the separated task layers of an architectural problem through solution-based development. The ASC Framework brings together many of the ideas of this thesis for a practical research agenda and it is presented to the AD researchers in architecture. Finally, the “design_proxy.layout” (d_p.layout) is an architectural layout design assistant based on the design_proxy approach and the IEA. The system uses a relaxed problem definition (producing draft layouts) and a flexible layout representation that permits the overlapping of design units and boundaries. User interaction with the system is carried out through intuitive 2D graphics and the functional evaluations are performed by measuring the similarity of a proposal to existing layouts. Functioning in an integrated manner, these properties make the system a practicable and enjoying design assistant, which was demonstrated through two workshop cases. The d_p.layout is a versatile and robust layout design assistant that can be used by architects in their design processes