5,119 research outputs found
Hidden Markov Models and their Application for Predicting Failure Events
We show how Markov mixed membership models (MMMM) can be used to predict the
degradation of assets. We model the degradation path of individual assets, to
predict overall failure rates. Instead of a separate distribution for each
hidden state, we use hierarchical mixtures of distributions in the exponential
family. In our approach the observation distribution of the states is a finite
mixture distribution of a small set of (simpler) distributions shared across
all states. Using tied-mixture observation distributions offers several
advantages. The mixtures act as a regularization for typically very sparse
problems, and they reduce the computational effort for the learning algorithm
since there are fewer distributions to be found. Using shared mixtures enables
sharing of statistical strength between the Markov states and thus transfer
learning. We determine for individual assets the trade-off between the risk of
failure and extended operating hours by combining a MMMM with a partially
observable Markov decision process (POMDP) to dynamically optimize the policy
for when and how to maintain the asset.Comment: Will be published in the proceedings of ICCS 2020;
@Booklet{EasyChair:3183, author = {Paul Hofmann and Zaid Tashman}, title =
{Hidden Markov Models and their Application for Predicting Failure Events},
howpublished = {EasyChair Preprint no. 3183}, year = {EasyChair, 2020}
Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey
Wireless sensor networks (WSNs) consist of autonomous and resource-limited
devices. The devices cooperate to monitor one or more physical phenomena within
an area of interest. WSNs operate as stochastic systems because of randomness
in the monitored environments. For long service time and low maintenance cost,
WSNs require adaptive and robust methods to address data exchange, topology
formulation, resource and power optimization, sensing coverage and object
detection, and security challenges. In these problems, sensor nodes are to make
optimized decisions from a set of accessible strategies to achieve design
goals. This survey reviews numerous applications of the Markov decision process
(MDP) framework, a powerful decision-making tool to develop adaptive algorithms
and protocols for WSNs. Furthermore, various solution methods are discussed and
compared to serve as a guide for using MDPs in WSNs
Learning with bounded memory.
The paper studies infinite repetition of finite strategic form games. Players use a learning behavior and face bounds on their cognitive capacities. We show that for any given beliefprobability over the set of possible outcomes where players have no experience. games can be payoff classified and there always exists a stationary state in the space of action profiles. In particular, if the belief-probability assumes all possible outcomes without experience to be equally likely, in one class of Prisoners' Dilemmas where the average defecting payoff is higher than the cooperative payoff and the average cooperative payoff is lower than the defecting payoff, play converges in the long run to the static Nash equilibrium while in the other class of Prisoners' Dilemmas where the reserve holds, play converges to cooperation. Results are applied to a large class of 2 x 2 games.Cognitive complexity; Bounded logistic quantal response learning; Long run outcomes;
Demand Estimation at Manufacturer-Retailer Duo: A Macro-Micro Approach
This dissertation is divided into two phases. The main objective of this phase is to use Bayesian MCMC technique, to attain (1) estimates, (2) predictions and (3) posterior probability of sales greater than certain amount for sampled regions and any random region selected from the population or sample. These regions are served by a single product manufacturer who is considered to be similar to newsvendor. The optimal estimates, predictions and posterior probabilities are obtained in presence of advertising expenditure set by the manufacturer, past historical sales data that contains both censored and exact observations and finally stochastic regional effects that cannot be quantified but are believed to strongly influence future demand. Knowledge of these optimal values is useful in eliminating stock-out and excess inventory holding situations while increasing the profitability across the entire supply chain.
Subsequently, the second phase, examines the impact of Cournot and Stackelberg games in a supply-chain on shelf space allocation and pricing decisions. In particular, we consider two scenarios: (1) two manufacturers competing for shelf space allocation at a single retailer, and (2) two manufacturers competing for shelf space allocation at two competing retailers, whose pricing decisions influence their demand which in turn influences their shelf-space allocation. We obtain the optimal pricing and shelf-space allocation in these two scenarios by optimizing the profit functions for each of the players in the game. Our numerical results indicate that (1) Cournot games to be the most profitable along the whole supply chain whereas Stackelberg games and mixed games turn out to be least profitable, and (2) higher the shelf space elasticity, lower the wholesale price of the product; conversely, lower the retail price of the product, greater the shelf space allocated for that product
Implementation of Discrete Time Markov Chain Method to Estimate The Transition of Smartphone Brands Usage in Balikpapan
The increasingly rapid competition in the industrial world today encourages all companies to be able to compete by prioritizing the products they offer, one of which is smartphones. Indonesia is one of the countries with the largest smartphone market share in Asia, with the number of active smartphone users in Indonesia reaching 177 million people in 2021 according to data released by the Statista research institute in March 2022. With these conditions, many smartphone companies always follow the direction of development of sophisticated communication technology media and offer a variety of complete and attractive facilities to encourage people to buy these products. One method that can be used to model this uncertainty is Discrete Time Markov chain which can be implemented as a tool for decision making and predicting future events. Therefore, this study was conducted to know the shifting pattern of smartphone use by consumers and predict the shift in smartphone market share for the coming period. The results of the study found that the steady state or equilibrium condition was achieved in the 10th period or in 2032 with the steady state percentage of each brand, namely Samsung = 22.49%, Oppo = 20.82 %, Xiaomi = 17.01%, Realme = 11.54%, Vivo = 11.41%, Apple = 10.27%, and other brands = 6.46%. The increase in market share is predicted to occur in the Oppo, Realme, and Vivo brands, while the decrease in market share will occur in the Apple, Samsung, Xiaomi and other brands
QAmplifyNet: Pushing the Boundaries of Supply Chain Backorder Prediction Using Interpretable Hybrid Quantum - Classical Neural Network
Supply chain management relies on accurate backorder prediction for
optimizing inventory control, reducing costs, and enhancing customer
satisfaction. However, traditional machine-learning models struggle with
large-scale datasets and complex relationships, hindering real-world data
collection. This research introduces a novel methodological framework for
supply chain backorder prediction, addressing the challenge of handling large
datasets. Our proposed model, QAmplifyNet, employs quantum-inspired techniques
within a quantum-classical neural network to predict backorders effectively on
short and imbalanced datasets. Experimental evaluations on a benchmark dataset
demonstrate QAmplifyNet's superiority over classical models, quantum ensembles,
quantum neural networks, and deep reinforcement learning. Its proficiency in
handling short, imbalanced datasets makes it an ideal solution for supply chain
management. To enhance model interpretability, we use Explainable Artificial
Intelligence techniques. Practical implications include improved inventory
control, reduced backorders, and enhanced operational efficiency. QAmplifyNet
seamlessly integrates into real-world supply chain management systems, enabling
proactive decision-making and efficient resource allocation. Future work
involves exploring additional quantum-inspired techniques, expanding the
dataset, and investigating other supply chain applications. This research
unlocks the potential of quantum computing in supply chain optimization and
paves the way for further exploration of quantum-inspired machine learning
models in supply chain management. Our framework and QAmplifyNet model offer a
breakthrough approach to supply chain backorder prediction, providing superior
performance and opening new avenues for leveraging quantum-inspired techniques
in supply chain management
Data and Design: Advancing Theory for Complex Adaptive Systems
Complex adaptive systems exhibit certain types of behaviour that are difficult to predict or understand using reductionist approaches, such as linearization or assuming conditions of optimality. This research focuses on the complex adaptive systems associated with public health. These are noted for being driven by many latent forces, shaped centrally by human behaviour.
Dynamic simulation techniques, including agent-based models (ABMs) and system dynamics (SD) models, have been used to study the behaviour of complex adaptive systems, including in public health. While much has been learned, such work is still hampered by important limitations. Models of complex systems themselves can be quite complex, increasing the difficulty in explaining unexpected model behaviour, whether that behaviour comes from model code errors or is due to new learning. Model complexity also leads to model designs that are hard to adapt to growing knowledge about the subject area, further reducing model-generated insights.
In the current literature of dynamic simulations of human public health behaviour, few focus on capturing explicit psychological theories of human behaviour. Given that human behaviour, especially health and risk behaviour, is so central to understanding of processes in public health, this work explores several methods to improve the utility and flexibility of dynamic models in public health. This work is undertaken in three projects.
The first uses a machine learning algorithm, the particle filter, to augment a simple ABM in the presence of continuous disease prevalence data from the modelled system. It is shown that, while using the particle filter improves the accuracy of the ABM, when compared with previous work using SD with a particle filter, the ABM has some limitations, which are discussed.
The second presents a model design pattern that focuses on scalability and modularity to improve the development time, testability, and flexibility of a dynamic simulation for tobacco smoking. This method also supports a general pattern of constructing hybrid models --- those that contain elements of multiple methods, such as agent-based or system dynamics. This method is demonstrated with a stylized example of tobacco smoking in a human population.
The final line of work implements this modular design pattern, with differing mechanisms of addiction dynamics, within a rich behavioural model of tobacco purchasing and consumption. It integrates the results from a discrete choice experiment, which is a widely used economic method for study human preferences. It compares and contrasts four independent addiction modules under different population assumptions. A number of important insights are discussed: no single module was universally more accurate across all human subpopulations, demonstrating the benefit of exploring a diversity of approaches; increasing the number of parameters does not necessarily improve a module's predictions, since the overall least accurate module had the second highest number of parameters; and slight changes in module structure can lead to drastic improvements, implying the need to be able to iteratively learn from model behaviour
Monotonic regression based on Bayesian P-splines: an application to estimating price response functions from store-level scanner data
Generalized additive models have become a widely used instrument for flexible regression analysis. In many practical situations, however, it is desirable to restrict the flexibility of nonparametric estimation in order to accommodate a presumed monotonic relationship between a covariate and the response variable. For example, consumers usually will buy less of a brand if its price increases, and therefore one expects a brand's unit sales to be a decreasing function in own price. We follow a Bayesian approach using penalized B-splines and incorporate the assumption of monotonicity in a natural way by an appropriate specification of the respective prior distributions. We illustrate the methodology in an empirical application modeling demand for a brand of orange juice and show that imposing monotonicity constraints for own- and cross-item price effects improves the predictive validity of the estimated sales response function considerably
- …