Overfitting in Synthesis: Theory and Practice (Extended Version)

In syntax-guided synthesis (SyGuS), a synthesizer's goal is to automatically generate a program belonging to a grammar of possible implementations that meets a logical specification. We investigate a common limitation across state-of-the-art SyGuS tools that perform counterexample-guided inductive synthesis (CEGIS). We empirically observe that as the expressiveness of the provided grammar increases, the performance of these tools degrades significantly. We claim that this degradation is not only due to a larger search space, but also due to overfitting. We formally define this phenomenon and prove no-free-lunch theorems for SyGuS, which reveal a fundamental tradeoff between synthesizer performance and grammar expressiveness. A standard approach to mitigate overfitting in machine learning is to run multiple learners with varying expressiveness in parallel. We demonstrate that this insight can immediately benefit existing SyGuS tools. We also propose a novel single-threaded technique called hybrid enumeration that interleaves different grammars and outperforms the winner of the 2018 SyGuS competition (Inv track), solving more problems and achieving a $5\times$ mean speedup.Comment: 24 pages (5 pages of appendices), 7 figures, includes proofs of theorem

Shape exploration in design : formalising and supporting a transformational process

The process of sketching can support the sort of transformational thinking that is seen as essential for the interpretation and reinterpretation of ideas in innovative design. Such transformational thinking, however, is not yet well supported by computer-aided design systems. In this paper, outcomes of experimental investigations into the mechanics of sketching are described, in particular those employed by practising architects and industrial designers as they responded to a series of conceptual design tasks,. Analyses of the experimental data suggest that the interactions of designers with their sketches can be formalised according to a finite number of generalised shape rules. A set of shape rules, formalising the reinterpretation and transformations of shapes, e.g. through deformation or restructuring, are presented. These rules are suggestive of the manipulations that need to be afforded in computational tools intended to support designers in design exploration. Accordingly, the results of the experimental investigations informed the development of a prototype shape synthesis system, and a discussion is presented in which the future requirements of such systems are explored

Building Domain Specific Languages for Voice Recognition Applications

This paper presents a method of implementing the voice recognition for the control of software applications. The solutions proposed are based on transforming a subset of the natural language in commands recognized by the application using a formal language defined by the means of a context free grammar. At the end of the paper is presented the modality of integration of voice recognition and of voice synthesis for the Romanian language in Windows applications.voice recognition, formal languages, context free grammars, text to speech

Metamodel Instance Generation: A systematic literature review

Modelling and thus metamodelling have become increasingly important in Software Engineering through the use of Model Driven Engineering. In this paper we present a systematic literature review of instance generation techniques for metamodels, i.e. the process of automatically generating models from a given metamodel. We start by presenting a set of research questions that our review is intended to answer. We then identify the main topics that are related to metamodel instance generation techniques, and use these to initiate our literature search. This search resulted in the identification of 34 key papers in the area, and each of these is reviewed here and discussed in detail. The outcome is that we are able to identify a knowledge gap in this field, and we offer suggestions as to some potential directions for future research.Comment: 25 page