Deep Reinforcement Learning-Based Dynamic Reconfiguration Planning for Digital Twin-Driven Smart Manufacturing Systems With Reconfigurable Machine Tools

© 2024 The Author(s). This is an open access article under the Creative Commons Attribution-Non Commercial-No Derivatives CC BY-NC-ND licence, https://creativecommons.org/licenses/by-nc-nd/4.0/Smart manufacturing systems are a new paradigm in Industry 4.0 driven by the emerging information and communication technology and artificial intelligence that converge to digital twin, which are able to perceive, recognize, and handle the changes in demand and production. Reconfigurable machine tools (RMTs) can promote the flexibility of smart manufacturing systems. The fundamental problem lies in dynamically reconfiguring the RMTs in smart manufacturing systems efficiently and accurately by considering the flexibility of production precedence and operation sequences simultaneously. Therefore, in this article, a deep reinforcement learning-based reconfiguration planning method of digital twin-driven smart manufacturing systems with RMT is proposed to seek optimal reconfiguration policy online. The reconfiguration processes of smart manufacturing systems are modeled by considering reconfiguration cost, moving cost, and processing cost. Deep Q-network is adopted to explore the state space and action space to find the optimal reconfiguration scheme with the highest return. An industry case study is presented to demonstrate the effectiveness and efficiency of the proposed method, where the reconfiguration processes of a smart manufacturing system consisting of five RMTs for producing four parts are discussed.Peer reviewe

Factors influencing the quality of clinical trials on traditional Chinese medicine— Qualitative interviews with trial auditors, clinicians and academic researchers

Background: As clinical trials evaluating the efficacy of traditional Chinese medicine (TCM) therapies have increased, several empirical studies have shown that the quality of TCM trials are generally low in terms of risk of bias. This qualitative study aimed to investigate the factors influencing the quality of TCM clinical trials to provide strategic advice on trial quality improvement. Methods: One focus group with clinical trial auditors (n=4) and six indepth semi-structured interviews with clinical research organization managers (n=2), lecturers and researchers in TCM academic institutions (n=2), a chief physician in a TCM oncology department and a PhD candidate specialized in non-pharmaceutical TCM interventions were conducted. The interviews were audio-recorded, transcribed verbatim and thematically analyzed. Results: Factors that influenced the quality of TCM clinical trials merged on the following 6 themes: trial design; trialists/ participants; trial conducting; TCM specified problems; trial monitoring, and finally societal influences. The lack of expertise and time inputs of the trialists were repeatedly mentioned. Methodological difficulties experienced when conducting TCM trials included calculating sample size, analyzing the efficacy of TCM decoctions with multiple ingredients, blinding in trials investigating non-pharmaceutical TCM interventions were highlighted. Interviewees agreed that third-party monitoring can help improving trial quality and improved participant welfare and may accelerate recruiting processes and increase compliance; however more comprehensive regulations and funding requirements would be needed. Conclusions: This study identified real-life issues influencing the quality of TCM clinical trials from design to reporting. In addition to mandatory training for TCM trial designers and coordinators, more effective institutional oversight is required. Future studies should explore specific measures to address the methodological problems in TCM trials and explore how the quality of TCM trials can affect further evidence synthesis and clinical practice

Symbolic State Space Optimization for Long Horizon Mobile Manipulation Planning

In existing task and motion planning (TAMP) research, it is a common assumption that experts manually specify the state space for task-level planning. A well-developed state space enables the desirable distribution of limited computational resources between task planning and motion planning. However, developing such task-level state spaces can be non-trivial in practice. In this paper, we consider a long horizon mobile manipulation domain including repeated navigation and manipulation. We propose Symbolic State Space Optimization (S3O) for computing a set of abstracted locations and their 2D geometric groundings for generating task-motion plans in such domains. Our approach has been extensively evaluated in simulation and demonstrated on a real mobile manipulator working on clearing up dining tables. Results show the superiority of the proposed method over TAMP baselines in task completion rate and execution time.Comment: To be published in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 202

Acupuncture for the prevention of chemotherapy-induced nausea and vomiting in cancer patients: A systematic review and meta-analysis.

Purpose To assess the effectiveness and safety of acupuncture for the prevention of chemotherapy-induced nausea and vomiting (CINV), with a specific intention on exploring sources of between-study variation in treatment effects. Methods MEDLINE, EMBASE, Cochrane CENTRAL, CINAHL, Chinese Biomedical Literature Database, VIP Chinese Science and Technology Periodicals Database, China National Knowledge Infrastructure, and Wanfang were searched to identify randomized controlled trials (RCTs) that compared acupuncture to sham acupuncture or usual care (UC). The main outcome is complete control (no vomiting episodes and/or no more than mild nausea) of CINV. GRADE approach was used to rate the certainty of evidence. Results Thirty-eight RCTs with a total of 2503 patients were evaluated. Acupuncture in addition to UC may increase the complete control of acute vomiting (RR, 1.13; 95% CI, 1.02 to 1.25; 10 studies) and delayed vomiting (RR, 1.47; 95% CI, 1.07 to 2.00; 10 studies) when compared with UC only. No effects were found for all other review outcomes. The certainty of evidence was generally low or very low. None of the predefined moderators changed the overall findings, but in an exploratory moderator analysis we found that an adequate reporting of planned rescue antiemetics might decrease the effect size of complete control of acute vomiting (p = 0.035). Conclusion Acupuncture in addition to usual care may increase the complete control of chemotherapy-induced acute vomiting and delayed vomiting but the certainty of evidence was very low. Well-designed RCTs with larger sample sizes, standardized treatment regimens, and core outcome measures are needed.post-print721 K

Acupuncture for the prevention of chemotherapy‐induced nausea and vomiting in cancer patients: A systematic review and meta‐analysis

Purpose: To assess the effectiveness and safety of acupuncture for the prevention of chemotherapy-induced nausea and vomiting (CINV), with a specific intention on exploring sources of between-study variation in treatment effects. Methods: MEDLINE, EMBASE, Cochrane CENTRAL, CINAHL, Chinese Biomedical Literature Database, VIP Chinese Science and Technology Periodicals Database, China National Knowledge Infrastructure, and Wanfang were searched to identify randomized controlled trials (RCTs) that compared acupuncture to sham acupuncture or usual care (UC). The main outcome is complete control (no vomiting episodes and/or no more than mild nausea) of CINV. GRADE approach was used to rate the certainty of evidence. Results: Thirty-eight RCTs with a total of 2503 patients were evaluated. Acupuncture in addition to UC may increase the complete control of acute vomiting (RR, 1.13; 95% CI, 1.02 to 1.25; 10 studies) and delayed vomiting (RR, 1.47; 95% CI, 1.07 to 2.00; 10 studies) when compared with UC only. No effects were found for all other review outcomes. The certainty of evidence was generally low or very low. None of the predefined moderators changed the overall findings, but in an exploratory moderator analysis we found that an adequate reporting of planned rescue antiemetics might decrease the effect size of complete control of acute vomiting (p = 0.035). Conclusion: Acupuncture in addition to usual care may increase the complete control of chemotherapy-induced acute vomiting and delayed vomiting but the certainty of evidence was very low. Well-designed RCTs with larger sample sizes, standardized treatment regimens, and core outcome measures are needed

Patient motivation as a predictor of digital health intervention effects: A meta-epidemiological study of cancer trials

The objective of this meta-epidemiological study was to develop a rating that captures participants’ motivation at the study level in digital health intervention (DHI) randomised controlled trials (RCTs). The rating was used to investigate whether participants’ motivation is associated with the effect estimates in DHI RCTs for cancer patients. The development of the rating was based on a bottom-up approach involving the collection of information that captures participants’ baseline motivation in empirical studies from the Smartphone-RCCT Database. We specified three indicators for rating: indicator 1 captures whether the study team actively selects or enhances the motivation of the potential study participants; indicator 2 captures the study participants’ active engagement before the treatment allocation; and indicator 3 captures the potential bond and trust between the study participants and the person/institution referring to the study. The rating of each indicator and the overall rating varies between high motivation, moderate motivation, and low motivation. We applied the rating across 27 DHI RCTs with cancer patients. We performed meta-regression analysis to examine the effect of patient motivation on quality of life (QoL), psychological outcomes, and attrition. The intraclass correlation coefficient (ICC) indicated moderate to poor inter-rater reliability. The meta-regression showed that cancer patients’ overall motivation before engaging in the intervention was associated with the treatment effect of QoL. Patient motivation was not found to be associated with psychological outcomes or attrition. Subgroup analyses revealed that the clinical effects of DHIs were more prevalent in the high-motivation subgroups, whereas the low-motivation subgroups were unlikely to show intervention benefits. The likelihood of dropouts from DHIs seems to be especially high among the low-bond (indicator 3) subgroup. We suggest using single indicators since they reflect specific content. Better reporting about baseline motivation is required to enable meaningful interpretations in not only primary studies but also in evidence syntheses

Simultaneous detection of cerebral blood perfusion and cerebral edema using swept‐source optical coherence tomography

The progression of ischemic cerebral edema (CE) is closely related to the level of cerebral blood perfusion (CBP) and affects each other. Simultaneous detection of CBP and CE is helpful in understanding the mechanisms of ischemic CE development. In this article, a wide field of view swept‐source optical coherence tomography system was used to detect CE status and CBP levels simultaneously in middle cerebral artery occlusion rats. Images reflecting these two physiological states can be reconstructed with only one C‐scan. We quantify these two physiological states into four parameters, which contain two vascular parameters (vascular displacement distance and vascular perfusion density) and two edema parameters (optical attenuation coefficient and edema area). The association between the two vascular parameters and the two edema parameters was analyzed. The results show that there is a strong linear relationship between blood flow parameters and edema parameters. This work provides a new option for CE in vivo detection, and is very likely to play an important role in the development of relevant drugs or in selection of treatment options.In this article, a wide field of view swept‐source optical coherence tomography system was used to detect cerebral edema status and cerebral blood perfusion levels simultaneously in middle cerebral artery occlusion rats. Images reflecting these two physiological states can be reconstructed with only one C‐scan. We quantify these two physiological states into four parameters, which contain two vascular parameters and two edema parameters. The association between the two vascular parameters and the two edema parameters was analyzed. The results show that there is a strong linear relationship between blood flow parameters and edema parameters.Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/153673/1/jbio201960087_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/153673/2/jbio201960087.pd

A Microalbuminuria Threshold to Predict the Risk for the Development of Diabetic Retinopathy in Type 2 Diabetes Mellitus Patients

OBJECTIVE: To test the hypothesis that a microalbuminuria (MA) threshold can help predict the risk for the development of diabetic retinopathy (DR) in type 2 diabetes mellitus (T2DM)_ patients. DESIGN: We conducted a cross-sectional study of 4739 subjects with T2DM and a prospective study of 297 subjects with T2DM in China respectively. METHODS: Clinical and laboratory data were collected and biologic risk factors associated with any DR were analysed. RESULTS: In the cross-sectional study, we found that MA was an independent risk factor for DR development; further, when the patients were divided into MA deciles, odds ratio (ORs) of DR for the patients in the sixth MA decile (10.7 mg/24 h) was 1.579-fold (1.161-2.147) compared to that for patients in the first MA decile. Furthermore, the OR of DR increased with a gradual increase in MA levels. Similarly, in the prospective study, during a mean follow-up of 4.5 years, we found that 51 patients (29.0%) of the 176 subjects with high MA level (10.7-30 mg/24 h) developed DR, while 17 patients (14.1%) of the 121 subjects with lower MA (<10.7 mg/24 h) developed DR, and the relative risk ratio of the development of DR is 2.13(95% CI, 1.58-3.62, P<0.001). CONCLUSION: These data suggest that an MA threshold can predict the risk for the development of DR in type 2 diabetes mellitus, although it is still within the traditionally established normal range

Fictional Worlds, Real Connections: Developing Community Storytelling Social Chatbots through LLMs

We address the integration of storytelling and Large Language Models (LLMs) to develop engaging and believable Social Chatbots (SCs) in community settings. Motivated by the potential of fictional characters to enhance social interactions, we introduce Storytelling Social Chatbots (SSCs) and the concept of story engineering to transform fictional game characters into "live" social entities within player communities. Our story engineering process includes three steps: (1) Character and story creation, defining the SC's personality and worldview, (2) Presenting Live Stories to the Community, allowing the SC to recount challenges and seek suggestions, and (3) Communication with community members, enabling interaction between the SC and users. We employed the LLM GPT-3 to drive our SSC prototypes, "David" and "Catherine," and evaluated their performance in an online gaming community, "DE (Alias)," on Discord. Our mixed-method analysis, based on questionnaires (N=15) and interviews (N=8) with community members, reveals that storytelling significantly enhances the engagement and believability of SCs in community settings