5 research outputs found
Bayesian Neural Architecture Search using A Training-Free Performance Metric
Recurrent neural networks (RNNs) are a powerful approach for time series
prediction. However, their performance is strongly affected by their
architecture and hyperparameter settings. The architecture optimization of RNNs
is a time-consuming task, where the search space is typically a mixture of
real, integer and categorical values. To allow for shrinking and expanding the
size of the network, the representation of architectures often has a variable
length. In this paper, we propose to tackle the architecture optimization
problem with a variant of the Bayesian Optimization (BO) algorithm. To reduce
the evaluation time of candidate architectures the Mean Absolute Error Random
Sampling (MRS), a training-free method to estimate the network performance, is
adopted as the objective function for BO. Also, we propose three fixed-length
encoding schemes to cope with the variable-length architecture representation.
The result is a new perspective on accurate and efficient design of RNNs, that
we validate on three problems. Our findings show that 1) the BO algorithm can
explore different network architectures using the proposed encoding schemes and
successfully designs well-performing architectures, and 2) the optimization
time is significantly reduced by using MRS, without compromising the
performance as compared to the architectures obtained from the actual training
procedure
Improving the Decision-Making Process of Self-Adaptive Systems by Accounting for Tactic Volatility
When self-adaptive systems encounter changes within their surrounding
environments, they enact tactics to perform necessary adaptations. For example,
a self-adaptive cloud-based system may have a tactic that initiates additional
computing resources when response time thresholds are surpassed, or there may
be a tactic to activate a specific security measure when an intrusion is
detected. In real-world environments, these tactics frequently experience
tactic volatility which is variable behavior during the execution of the
tactic.
Unfortunately, current self-adaptive approaches do not account for tactic
volatility in their decision-making processes, and merely assume that tactics
do not experience volatility. This limitation creates uncertainty in the
decision-making process and may adversely impact the system's ability to
effectively and efficiently adapt. Additionally, many processes do not properly
account for volatility that may effect the system's Service Level Agreement
(SLA). This can limit the system's ability to act proactively, especially when
utilizing tactics that contain latency.
To address the challenge of sufficiently accounting for tactic volatility, we
propose a Tactic Volatility Aware (TVA) solution. Using Multiple Regression
Analysis (MRA), TVA enables self-adaptive systems to accurately estimate the
cost and time required to execute tactics. TVA also utilizes Autoregressive
Integrated Moving Average (ARIMA) for time series forecasting, allowing the
system to proactively maintain specifications