Code Generation for Efficient Query Processing in Managed Runtimes

In this paper we examine opportunities arising from the conver-gence of two trends in data management: in-memory database sys-tems (IMDBs), which have received renewed attention following the availability of affordable, very large main memory systems; and language-integrated query, which transparently integrates database queries with programming languages (thus addressing the famous ‘impedance mismatch ’ problem). Language-integrated query not only gives application developers a more convenient way to query external data sources like IMDBs, but also to use the same querying language to query an application’s in-memory collections. The lat-ter offers further transparency to developers as the query language and all data is represented in the data model of the host program-ming language. However, compared to IMDBs, this additional free-dom comes at a higher cost for query evaluation. Our vision is to improve in-memory query processing of application objects by introducing database technologies to managed runtimes. We focus on querying and we leverage query compilation to im-prove query processing on application objects. We explore dif-ferent query compilation strategies and study how they improve the performance of query processing over application data. We take C] as the host programming language as it supports language-integrated query through the LINQ framework. Our techniques de-liver significant performance improvements over the default LINQ implementation. Our work makes important first steps towards a future where data processing applications will commonly run on machines that can store their entire datasets in-memory, and will be written in a single programming language employing language-integrated query and IMDB-inspired runtimes to provide transparent and highly efficient querying. 1

CORMASS: A Compact and Efficient NIR Spectrograph for Studying Low-Mass Objects

CorMASS (Cornell Massachusetts Slit Spectrograph) is a compact, low-resolution (R=300), double-pass prism cross-dispersed near-infrared (NIR) spectrograph in operation on the Palomar Observatory 60-inch telescope. Its 2-dimensional spectral format provides simultaneous coverage from lambda ~ 0.75 microns to lambda ~ 2.5 microns (z'JHK bands). A remotely operated cold flip mirror permits its NICMOS3 detector to function as a K_s slit viewer to assist object placement into the 2 arcsec x 15 arcsec slit. CorMASS was primarily designed for the rapid spectral classification of low-mass stellar and sub-stellar objects identified by the Two-Micron All Sky Survey (2MASS). CorMASS' efficiency and resolution also make it a versatile instrument for the spectral observation and classification of many other types of bright objects (K<14) including quasars, novae, and emission line objects.Comment: To be published in Feb 2001 PASP, 19 pages, 12 Figures, High Resolution file can be retrieved from ftp://iras2.tn.cornell.edu/pub/wilson/papers/cormass.ps.g

Towards a relational model for component interconnection

The basic motivation of component based development is to replace conventional programming by the composition of reusable off-the-shelf units, externally coordinated through a network of connecting devices, to achieve a common goal. This paper introduces a new relational model for software connectors and discusses some preliminary work on its implementation in HASKELL. The proposed model adopts a coordination point of view in order to deal with components’ temporal and spatial decoupling and, therefore, to provide support for looser levels of inter-component dependency and effective external control

PRETZEL: Opening the Black Box of Machine Learning Prediction Serving Systems

Machine Learning models are often composed of pipelines of transformations. While this design allows to efficiently execute single model components at training time, prediction serving has different requirements such as low latency, high throughput and graceful performance degradation under heavy load. Current prediction serving systems consider models as black boxes, whereby prediction-time-specific optimizations are ignored in favor of ease of deployment. In this paper, we present PRETZEL, a prediction serving system introducing a novel white box architecture enabling both end-to-end and multi-model optimizations. Using production-like model pipelines, our experiments show that PRETZEL is able to introduce performance improvements over different dimensions; compared to state-of-the-art approaches PRETZEL is on average able to reduce 99th percentile latency by 5.5x while reducing memory footprint by 25x, and increasing throughput by 4.7x.Comment: 16 pages, 14 figures, 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI), 201

Communicating Java Threads

The incorporation of multithreading in Java may be considered a significant part of the Java language, because it provides udimentary facilities for concurrent programming. However, we belief that the use of channels is a fundamental concept for concurrent programming. The channel approach as described in this paper is a realization of a systematic design method for concurrent programming in Java based on the CSP paradigm. CSP requires the availability of a Channel class and the addition of composition constructs for sequential, parallel and alternative processes. The Channel class and the constructs have been implemented in Java in compliance with the definitions in CSP. As a result, implementing communication between processes is facilitated, enabling the programmer to avoid deadlock more easily, and freeing the programmer from synchronization and scheduling constructs. The use of the Channel class and the additional constructs is illustrated in a simple application

Hot Swapping Protocol Implementations in the OPNET Modeler Development Environment

This research effort demonstrates hot swapping protocol implementations in OPNET via the building of a dependency injection testing framework. The thesis demonstrates the externalization (compiling as stand-alone code) of OPNET process models, and their inclusion into custom DLL\u27s (Dynamically Linked Libraries). A framework then utilizes these process model DLL\u27s, to specify, or “inject,” process implementations post-compile time into an OPNET simulation. Two separate applications demonstrate this mechanism. The first application is a toolkit that allows for the testing of multiple routing related protocols in various combinations without code re-compilation or scenario re-generation. The toolkit produced similar results as the same simulation generated manually with OPNET. The second application demonstrates the viability of a unit testing mechanism for the externalized process models. The unit testing mechanism was demonstrated by integrating with CxxTest and executing xUnit style test suits

Multiplex boundary work in innovation projects: the role of collaborative spaces for cross-functional and open innovation

Purpose This study investigates the role of collaborative spaces as organizational support for internal innovation through cross-functional teams and for open innovation with external stakeholders. In particular, the study focuses on collaborative spaces as tools for multiplex (i.e., simultaneous internal and external boundary management in innovation projects). Design/methodology/approach The authors conducted a qualitative study in a multi-divisional organization that set up in its headquarters a collaborative space for collaborative product development. Data were collected through semi-structured interviews and participant observations. Findings Findings highlight that the relation between expectations and experiences about the collaborative space impact on employees\u27 ability to perform boundary work inside and outside the organization. In addition to the collaborative space\u27s affording role for expectations about hands-on collaborative innovation (space as laboratory), the study also highlights a set of collaboration constraints. These latter are generated by perceived boundary configurations (i.e. degree of boundary permeability and infrastructure in internal and external collaborations) and by discrepancies between expectations (space as laboratory) and actual collaboration experiences in the space (i.e. space as maze, cloister, showcase and silo). We show that space-generated constraints slow down internal and external boundary work for innovation and generate a trade-off between them. Originality/value Using the process-based perspective of boundary work, the paper connects studies on cross-functional teaming and open innovation through the concept of “multiplex boundary work.” It also contributes to the literature on boundary work by showing the challenges of using collaborative spaces as organizational support tools for multiplex boundary spanning

Flexi-WVSNP-DASH: A Wireless Video Sensor Network Platform for the Internet of Things

abstract: Video capture, storage, and distribution in wireless video sensor networks (WVSNs) critically depends on the resources of the nodes forming the sensor networks. In the era of big data, Internet of Things (IoT), and distributed demand and solutions, there is a need for multi-dimensional data to be part of the Sensor Network data that is easily accessible and consumable by humanity as well as machinery. Images and video are expected to become as ubiquitous as is the scalar data in traditional sensor networks. The inception of video-streaming over the Internet, heralded a relentless research for effective ways of distributing video in a scalable and cost effective way. There has been novel implementation attempts across several network layers. Due to the inherent complications of backward compatibility and need for standardization across network layers, there has been a refocused attention to address most of the video distribution over the application layer. As a result, a few video streaming solutions over the Hypertext Transfer Protocol (HTTP) have been proposed. Most notable are Apple’s HTTP Live Streaming (HLS) and the Motion Picture Experts Groups Dynamic Adaptive Streaming over HTTP (MPEG-DASH). These frameworks, do not address the typical and future WVSN use cases. A highly flexible Wireless Video Sensor Network Platform and compatible DASH (WVSNP-DASH) are introduced. The platform's goal is to usher video as a data element that can be integrated into traditional and non-Internet networks. A low cost, scalable node is built from the ground up to be fully compatible with the Internet of Things Machine to Machine (M2M) concept, as well as the ability to be easily re-targeted to new applications in a short time. Flexi-WVSNP design includes a multi-radio node, a middle-ware for sensor operation and communication, a cross platform client facing data retriever/player framework, scalable security as well as a cohesive but decoupled hardware and software design.Dissertation/ThesisDoctoral Dissertation Electrical Engineering 201