234 research outputs found
A Metric for Linear Temporal Logic
We propose a measure and a metric on the sets of infinite traces generated by
a set of atomic propositions. To compute these quantities, we first map
properties to subsets of the real numbers and then take the Lebesgue measure of
the resulting sets. We analyze how this measure is computed for Linear Temporal
Logic (LTL) formulas. An implementation for computing the measure of bounded
LTL properties is provided and explained. This implementation leverages SAT
model counting and effects independence checks on subexpressions to compute the
measure and metric compositionally
Efficient Parallel Reinforcement Learning Framework using the Reactor Model
Parallel Reinforcement Learning (RL) frameworks are essential for mapping RL
workloads to multiple computational resources, allowing for faster generation
of samples, estimation of values, and policy improvement. These computational
paradigms require a seamless integration of training, serving, and simulation
workloads. Existing frameworks, such as Ray, are not managing this
orchestration efficiently, especially in RL tasks that demand intensive
input/output and synchronization between actors on a single node. In this
study, we have proposed a solution implementing the reactor model, which
enforces a set of actors to have a fixed communication pattern. This allows the
scheduler to eliminate work needed for synchronization, such as acquiring and
releasing locks for each actor or sending and processing coordination-related
messages. Our framework, Lingua Franca (LF), a coordination language based on
the reactor model, also supports true parallelism in Python and provides a
unified interface that allows users to automatically generate dataflow graphs
for RL tasks. In comparison to Ray on a single-node multi-core compute
platform, LF achieves 1.21x and 11.62x higher simulation throughput in OpenAI
Gym and Atari environments, reduces the average training time of synchronized
parallel Q-learning by 31.2%, and accelerates multi-agent RL inference by
5.12x.Comment: 10 pages, 11 figure
Effect of dislocations on charge carrier mobility-lifetime product in synthetic single crystal diamond
The authors report correlations between variations in charge transport of electrons and holes in synthetic single crystal diamond and the presence of nitrogen impurities and dislocations. The spatial distribution of these defects was imaged using their characteristic luminescence emission and compared with maps of carrier drift length measured by ion beam induced charge imaging. The images indicate a reduction of electron and hole mobility-lifetime product due to nitrogen impurities and dislocations. Very good charge transport is achieved in selected regions where the dislocation density is minimal
Modal Reactors
Complex software systems often feature distinct modes of operation, each
designed to handle a particular scenario that may require the system to respond
in a certain way. Breaking down system behavior into mutually exclusive modes
and discrete transitions between modes is a commonly used strategy to reduce
implementation complexity and promote code readability. However, such
capabilities often come in the form of self-contained domain specific languages
or language-specific frameworks. The work in this paper aims to bring the
advantages of modal models to mainstream programming languages, by following
the polyglot coordination approach of Lingua Franca (LF), in which verbatim
target code (e.g., C, C++, Python, Typescript, or Rust) is encapsulated in
composable reactive components called reactors. Reactors can form a dataflow
network, are triggered by timed as well as sporadic events, execute
concurrently, and can be distributed across nodes on a network.
With modal models in LF, we introduce a lean extension to the concept of
reactors that enables the coordination of reactive tasks based on modes of
operation. The implementation of modal reactors outlined in this paper
generalizes to any LF-supported language with only modest modifications to the
generic runtime system
LNCS
Responsiveness—the requirement that every request to a system be eventually handled—is one of the fundamental liveness properties of a reactive system. Average response time is a quantitative measure for the responsiveness requirement used commonly in performance evaluation. We show how average response time can be computed on state-transition graphs, on Markov chains, and on game graphs. In all three cases, we give polynomial-time algorithms
Consistency vs. Availability in Distributed Real-Time Systems
In distributed applications, Brewer's CAP theorem tells us that when networks
become partitioned (P), one must give up either consistency (C) or availability
(A). Consistency is agreement on the values of shared variables; availability
is the ability to respond to reads and writes accessing those shared variables.
Availability is a real-time property whereas consistency is a logical property.
We have extended the CAP theorem to relate quantitative measures of these two
properties to quantitative measures of communication and computation latency
(L), obtaining a relation called the CAL theorem that is linear in a max-plus
algebra. This paper shows how to use the CAL theorem in various ways to help
design real-time systems. We develop a methodology for systematically trading
off availability and consistency in application-specific ways and to guide the
system designer when putting functionality in end devices, in edge computers,
or in the cloud. We build on the Lingua Franca coordination language to provide
system designers with concrete analysis and design tools to make the required
tradeoffs in deployable software.Comment: 12 pages. arXiv admin note: text overlap with arXiv:2109.0777
Demo Abstract: Building IoT Applications with Accessors in CapeCode
We demonstrate CapeCode, a tool for composing actor-oriented building blocks for applications in the Internet of Things design space
- …