Human-Machine Collaborative Optimization via Apprenticeship Scheduling

Coordinating agents to complete a set of tasks with intercoupled temporal and resource constraints is computationally challenging, yet human domain experts can solve these difficult scheduling problems using paradigms learned through years of apprenticeship. A process for manually codifying this domain knowledge within a computational framework is necessary to scale beyond the ``single-expert, single-trainee" apprenticeship model. However, human domain experts often have difficulty describing their decision-making processes, causing the codification of this knowledge to become laborious. We propose a new approach for capturing domain-expert heuristics through a pairwise ranking formulation. Our approach is model-free and does not require enumerating or iterating through a large state space. We empirically demonstrate that this approach accurately learns multifaceted heuristics on a synthetic data set incorporating job-shop scheduling and vehicle routing problems, as well as on two real-world data sets consisting of demonstrations of experts solving a weapon-to-target assignment problem and a hospital resource allocation problem. We also demonstrate that policies learned from human scheduling demonstration via apprenticeship learning can substantially improve the efficiency of a branch-and-bound search for an optimal schedule. We employ this human-machine collaborative optimization technique on a variant of the weapon-to-target assignment problem. We demonstrate that this technique generates solutions substantially superior to those produced by human domain experts at a rate up to 9.5 times faster than an optimization approach and can be applied to optimally solve problems twice as complex as those solved by a human demonstrator.Comment: Portions of this paper were published in the Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) in 2016 and in the Proceedings of Robotics: Science and Systems (RSS) in 2016. The paper consists of 50 pages with 11 figures and 4 table

An Exploratory Study of Patient Falls

Debate continues between the contribution of education level and clinical expertise in the nursing practice environment. Research suggests a link between Baccalaureate of Science in Nursing (BSN) nurses and positive patient outcomes such as lower mortality, decreased falls, and fewer medication errors. Purpose: To examine if there a negative correlation between patient falls and the level of nurse education at an urban hospital located in Midwest Illinois during the years 2010-2014? Methods: A retrospective crosssectional cohort analysis was conducted using data from the National Database of Nursing Quality Indicators (NDNQI) from the years 2010-2014. Sample: Inpatients aged ≥ 18 years who experienced a unintentional sudden descent, with or without injury that resulted in the patient striking the floor or object and occurred on inpatient nursing units. Results: The regression model was constructed with annual patient falls as the dependent variable and formal education and a log transformed variable for percentage of certified nurses as the independent variables. The model overall is a good fit, F (2,22) = 9.014, p = .001, adj. R2 = .40. Conclusion: Annual patient falls will decrease by increasing the number of nurses with baccalaureate degrees and/or certifications from a professional nursing board-governing body

Incorporating capacitative constraint to the preference-based conference scheduling via domain transformation approach

No AbstractKeywords: conference scheduling; domain transformation approach; capacity optimizatio

A domain transformation approach for addressing staff scheduling problems

Staff scheduling is a complex combinatorial optimisation problem concerning allocation of staff to duty rosters in a wide range of industries and settings. This thesis presents a novel approach to solving staff scheduling problems, and in particular nurse scheduling, by simplifying the problem space through information granulation. The complexity of the problem is due to a large solution space and the many constraints that need to be satisfied. Published research indicates that methods based on random searches of the solution space did not produce good-quality results consistently. In this study, we have avoided random searching and proposed a systematic hierarchical method of granulation of the problem domain through pre-processing of constraints. The approach is general and can be applied to a wide range of staff scheduling problems. The novel approach proposed here involves a simplification of the original problem by a judicious grouping of shift types and a grouping of individual shifts into weekly sequences. The schedule construction is done systematically, while assuring its feasibility and minimising the cost of the solution in the reduced problem space of weekly sequences. Subsequently, the schedules from the reduced problem space are translated into the original problem space by taking into account the constraints that could not be represented in the reduced space. This two-stage approach to solving the scheduling problem is referred to here as a domain-transformation approach. The thesis reports computational results on both standard benchmark problems and a specific scheduling problem from Kajang Hospital in Malaysia. The results confirm that the proposed method delivers high-quality results consistently and is computationally efficient

A domain transformation approach for addressing staff scheduling problems

Staff scheduling is a complex combinatorial optimisation problem concerning allocation of staff to duty rosters in a wide range of industries and settings. This thesis presents a novel approach to solving staff scheduling problems, and in particular nurse scheduling, by simplifying the problem space through information granulation. The complexity of the problem is due to a large solution space and the many constraints that need to be satisfied. Published research indicates that methods based on random searches of the solution space did not produce good-quality results consistently. In this study, we have avoided random searching and proposed a systematic hierarchical method of granulation of the problem domain through pre-processing of constraints. The approach is general and can be applied to a wide range of staff scheduling problems. The novel approach proposed here involves a simplification of the original problem by a judicious grouping of shift types and a grouping of individual shifts into weekly sequences. The schedule construction is done systematically, while assuring its feasibility and minimising the cost of the solution in the reduced problem space of weekly sequences. Subsequently, the schedules from the reduced problem space are translated into the original problem space by taking into account the constraints that could not be represented in the reduced space. This two-stage approach to solving the scheduling problem is referred to here as a domain-transformation approach. The thesis reports computational results on both standard benchmark problems and a specific scheduling problem from Kajang Hospital in Malaysia. The results confirm that the proposed method delivers high-quality results consistently and is computationally efficient

An Integrated Framework for Staffing and Shift Scheduling in Hospitals

Over the years, one of the main concerns confronting hospital management is optimising the staffing and scheduling decisions. Consequences of inappropriate staffing can adversely impact on hospital performance, patient experience and staff satisfaction alike. A comprehensive review of literature (more than 1300 journal articles) is presented in a new taxonomy of three dimensions; problem contextualisation, solution approach, evaluation perspective and uncertainty. Utilising Operations Research methods, solutions can provide a positive contribution in underpinning staffing and scheduling decisions. However, there are still opportunities to integrate decision levels; incorporate practitioners view in solution architectures; consider staff behaviour impact, and offer comprehensive applied frameworks. Practitioners’ perspectives have been collated using an extensive exploratory study in Irish hospitals. A preliminary questionnaire has indicated the need of effective staffing and scheduling decisions before semi-structured interviews have taken place with twenty-five managers (fourteen Directors and eleven head nurses) across eleven major acute Irish hospitals (about 50% of healthcare service deliverers). Thematic analysis has produced five key themes; demand for care, staffing and scheduling issues, organisational aspects, management concern, and technology-enabled. In addition to other factors that can contribute to the problem such as coordination, environment complexity, understaffing, variability and lack of decision support. A multi-method approach including data analytics, modelling and simulation, machine learning, and optimisation has been employed in order to deliver adequate staffing and shift scheduling framework. A comprehensive portfolio of critical factors regarding patients, staff and hospitals are included in the decision. The framework was piloted in the Emergency Department of one of the leading and busiest university hospitals in Dublin (Tallaght Hospital). Solutions resulted from the framework (i.e. new shifts, staff workload balance, increased demands) have showed significant improvement in all key performance measures (e.g. patient waiting time, staff utilisation). Management team of the hospital endorsed the solution framework and are currently discussing enablers to implement the recommendation

Performance analysis of organizations as complex systems.

This dissertation provides a method for evaluating the difference in performance after an organization makes a change while considering the stochastic nature in which it operates. A procedure that uses simulation to estimate outcomes by adjusting controllable parameters and leaving uncontrolled parameters unadjusted is proposed. As healthcare organizations are considered as highly complex systems, a case study involving a scheduling tactic change in the mother-baby service line of a hospital is used to demonstrate application of this procedure. The goal in the case study was to reduce delays in transitioning care of mother patients from the labor and delivery unit to the postpartum care unit. The Holds Rate metric measured delays as the number of mothers deemed to be unintentionally delayed from transferring to the postpartum care unit to the total number of deliveries. While the scheduling tactic change did not yield the anticipated result, the proposed procedure was used to show that performance would have been worse had the change not been made. Hospital leadership chose to keep the solution and target performance was later surpassed. Ultimately, hospital leaders heralded the project as a great success. The proposed procedure was applied with two different simulation methods. A Monte Carlo simulation model was used to measure Holds Rate and a discrete-event simulation model to measure the average delay time experienced by patients waiting to be placed in a postpartum bed following delivery. The results of the procedure with both models led to the same conclusion that the scheduling tactic change indeed reduced delays in the transitions of care between the two hospital units. The case study demonstrated the validity and applicability of the proposed procedure and organizations may benefit from its use as leaders may be more prone to act since analysis with the procedure isolates the effects of uncontrolled parameters. Isolating these effects to better understand those of controlled parameters can promote an organization’s sustainability by advancing knowledge of cause-and-effect relationships. Future research with this topic can include application with other simulation methods, investigating the impacts of technology advancements, and considering a method of analysis using Bayesian inference