Is the LITE version of the usability metric for user experience (UMUX-LITE) a reliable tool to support rapid assessment of new healthcare technology?

Objective To ascertain the reliability of a standardised, short-scale measure of satisfaction in the use of new healthcare technology i.e., the LITE version of the usability metric for user experience (UMUX-LITE). Whilst previous studies have demonstrated the reliability of UMUX-LITE, and its relationship with measures of likelihood to recommend a product, such as the Net Promoter Score (NPS) in other sectors no such testing has been undertaken with healthcare technology. Materials and methods Six point-of-care products at different stages of development were assessed by 120 healthcare professionals. UMUX-LITE was used to gather their satisfaction in use, and NPS to declare their intention to promote the product. Inferential statistics were used to: i) ascertain the reliability of UMUX-LITE, and ii) assess the relationship between UMUX-LITE and NPS at different stages of products development. Results UMUX-LITE showed an acceptable reliability (α = 0.7) and a strong positive correlation with NPS (r = 0.455, p < .001). This is similar to findings in other fields of application. The level of product development did not affect the UMUX-LITE scores, while the stage of development was a significant predictor (R2 = 0.49) of the intention to promote. Discussion and conclusion Practitioners may apply UMUX-LITE alone, or in combination with the NPS, to complement interview and ‘homemade’ scales to investigate the quality of new products at different stages of development. This shortened scale is appropriate for use in the context of healthcare in which busy professionals have a minimal amount of time to support innovation

Integration Readiness levels Evaluation and Systems Architecture: A Literature Review

The success of complex systems projects is strongly influenced by their architecture. A key role of a system architect is to decide whether and how to integrate new technologies in a system architecture. Technology readiness levels (TRL) scale has been used for decades to support decision making regarding the technology infusion in complex systems, but it still faces challenges related to the integration of technologies to a system architecture. Integration Readiness Levels (IRL) scale has been elaborated in the last decade to face these challenges, representing the integration maturity between the technological elements of a system. The aim of this theoretical article is to perform a literature review on IRL scale evaluation and on systems architecture, through bibliographic research. Results show the review organized in five topics that surrounds the research objective, presenting the IRL and TRL scales evolution, comparing their evaluation practices, and exploring the architecture complexity of systems. Suggestions for future research are proposed based on these results

A fuzzy clustering methodology to analyze interfaces and assess integration risks in large-scale systems

“Interface analysis and integration risk assessment for a large-scale, complex system is a difficult systems engineering task, but critical to the success of engineering systems with extraordinary capabilities. When dealing with large-scale systems there is little time for data gathering and often the analysis can be overwhelmed by unknowns and sometimes important factors are not measurable because of the complexities of the interconnections within the system. This research examines the significance of interface analysis and management, identifies weaknesses in literature on risk assessment for a complex system, and exploits the benefits of soft computing approaches in the interface analysis in a complex system and in the risk assessment of system integration readiness. The research aims to address some of the interface analysis challenges in a large-scale system development lifecycle such as the ones often experienced in aircraft development. The resulting product from this research is contributed to systems engineering by providing an easy-to-use interface assessment and methodology for a trained systems engineer to break the system into communities of dense interfaces and determine the integration readiness and risks based on those communities. As a proof of concept this methodology is applied on a power seat system in a commercial aircraft with data from the Critical Design Review”--Abstract, page iv

Mapping the “Valley of Death”: managing selection and technology advancement in NASA's small business innovation research program

In this paper, we determine the risk mitigation process inherent in managing a portfolio of technologies diverse in both their readiness for infusion and the nature of the performing organization, focusing on the so-called “valley of death” in which the technology's principles have been proven but prototypes have yet to be developed. Using the Technology Readiness Levels (TRLs) of projects funded by the National Aeronautics and Space Administration Small Business Innovation Research program, a two-stage competitive process, we find that the result of selection of the first round is a tendency toward larger companies. In the second round of funding, technology maturity is a stronger determinant of selection and company headcount is no longer a statistically significant driver. This combination allows the program to manage risk and deliver real technical advancement from even the smallest companies. We find that technologies typically advance from TRL 2, concept formulation, at the program's outset to roughly TRL 5, component validation, at the program's conclusion; these outcomes precede economic benefits from the subsidy. These findings illuminate a mechanism to address risk as well as demonstrating the technical outcomes of a managed early-stage technology program.https://ieeexplore.ieee.org/abstract/document/8716715?casa_token=uUAUGzC-oncAAAAA:wTYXtzE7RvWUtL2Ga22ofhxkAQ3aepwxa25eeW84W30gw0NFAOgalaP_lJgqYdk4ZUb7JiD0iQAccepted manuscrip

Sourcing Innovation: probing Technology Readiness Levels with a design framework

International audienceSupplier-buyer exchanges are well addressed in literature except in the case of unknown objects. Sourcing Innovation, i.e. the process of finding external sources of innovation and then bringing those innovations into the firm should transform incoming unknown objects to ascribe them value. Technology Readiness Levels (TRL) have formalised the unknown in supplier-buyer exchanges in many industries for forty years but there is no evidence that they enable that transformation. We then use design theories, i.e. the Technology-Environment framework, to probe TRL through analysing ten cases combining documents analyses and longitudinal studies. We found that TRL avoid fixating on a low mature technology and are not an obstacle at genericity; however they fixate when the buyer waits a certain TRL prior exploring the new technology value. Finally TRL are unable to guide designers towards generativity notably because they embrace a definition of Environment focused on the prototyping method

Contextual role of TRLs and MRLs in technology management.

Technology Readiness Levels (TRLs) have been used extensively from the 1970s, especially in the National Aeronautics and Space Administration (NASA). Their application was recommended by the General Accounting Office in 1999 to be used for major Department of Defense acquisition projects. Manufacturing Readiness Levels (MRLs) have been proposed for improving the way manufacturing risks and readiness are identified; they were introduced to the defense community in 2005, but have not been used as broadly as TRLs. Originally TRLs were used to assess the readiness of a single technology. With the emergence of more complex systems and system of systems, it has been increasingly recognized that TRLs have limitations, especially when considering integration of complex systems. Therefore, it is important to use TRLs in the correct context. Details on TRLs and MRLs are reported in this paper. More recent indices to establish a better understanding of the integrated readiness state of systems are presented. Newer readiness indices, System Readiness Levels (SRLs) and Integration Readiness Levels, are discussed and their limitations and advantages are presented, along with an example of computing SRLs. It is proposed that a modified SRL be considered that explicitly includes the MRLs and a modification of the TRLs to include the Integrated Technology Index (ITI) and/or the Advancement Degree of Difficulty index proposed by NASA. Finally, the use of indices to perform technology assessments are placed into the overall context of technology management, recognizing that factors to transition and manage technology include cost, schedule, manufacturability, integration readiness, and technology maturity

A holistic approach for ameliorating the effect of ‘valley of death’ in technology assimilation

Technology assimilation is an increasingly important topic in modern manufacturing industries. Successful technology assimilation not only supports the development of better products, but also can provide a competitive edge in fast-moving markets, such as the automotive industry. Technology assimilation is a complex process, with a high failure rate, with technologies that seem promising in the research phase, failing to be assimilated into the final product. This high failure rate for technology assimilation is costly, in both time and other resources, and so has resulted in the effect of the Valley of Death . Tools and methods for technology assessment are essential enablers of successful product development, a process that requires collaboration from both engineering and business professionals to be successful.This thesis presents research that was aimed at ameliorating the Valley of Death effect during technology assimilation, particularly in the environment of the automotive Original Equipment Manufacturers (OEMs). The research was undertaken in close collaboration with Jaguar Land Rover Limited. Such collaboration provided first-hand information and direct engagement that supported and enabled this research.A review of the relevant theoretical concepts and the process of technology assimilation was undertaken, with a focus on the tools and methods that have been applied. The literature review resulted in an identification of the gaps and challenges among current technology assimilation approaches. This work also resulted in a conceptual model being developed to represent three different viewpoints that it is argued are essential to understand for successful technology assimilation, namely: Natural Technological Viewpoint, Social Technological Viewpoint and Human Technological Viewpoint. These three viewpoints were then further elaborated in a Hexahedron Model of Technology, alongside consideration of technology assimilation complexity, capability of technology and the contribution of a potential technology, allowing six different perspectives to be considered during the process of assessing if a specific technology is suitable for assimilation into a complex product.In this thesis, the Hexahedron Model of Technology, as the name suggests, allows consideration of six different facets for successful technology assimilation, and can be further elaborated to include more aspects of technology based on the future work. This model can also support an enterprise to understand how to develop the technology in a direction that might increase the likelihood of successful assimilation.The approach to technology assimilation presented in the thesis first sets out a Technology Assessment Framework and methods for populating and applying it. The Hexahedron Model of Technology provides a structural platform for assessing the subjective factors that need to be considered during technology assimilation in a structured way. This process helps to reduce the number of technologies that are considered for assimilation; by pre-eliminating some relatively weak technologies and taking forward only those more likely to succeed. A Technology Refinement and Modification Algorithm was then developed that provides suggestions, at a high-level, for the direction for technology improvement to help make the technology better match the requirements. This algorithm hence helps to further increase the chances of successful technology assimilation.The Technology Assessment Framework and Technology Refinement and Modification Algorithm were applied to two case studies. One of these cases was conducted to demonstrate the process of the proposed approach whereas the other one was part of a real-world project in collaboration with the Jaguar Land Rover Limited. Overall, this research demonstrates a two-step holistic approach to technology assimilation that first reduces the number of technologies considered for assimilation and then establishes the direction for development of new technology to improve the likelihood of successful technology assimilation.</div

Development of the concept of strategic benefit management in portfolio of projects

Istraživanje prikazano u okviru doktorske disertacije se bavi razvojem i testiranjem koncepta strateškog upravljanja koristima kao sistema modela, koji treba da doprinesu optimalnom upravljanju koristima kroz sve faze životnog ciklusa projektnog i portfolio menadžmenta. U ovoj disertaciji je najpre dat teorijski prikaz koncepta, polazeći od šire naučne osnove, preko njegovog teorijskog objašnjenja, pa do detaljne analize modela, sastavnih elemenata koncepta. U radu su definisana tri modela koji su sastavni delovi koncepta i svaki od njih se tiče po jedne faze u stvaranju projektnih koristi. Koncept strateškog upravljanja koristima ima interdisciplinarni karakter, obzirom na to da obuhvata različite oblasti projektnog menadžmenta, operacionih istraživanja i analize zrelosti sistema menadžmenta. U istraživačkom delu rada, koncept strateškog upravljanja koristima je testiran u oblasti portfolia projekata energetske efikasnosti u javnim zgradama. Specifičnost ovih projekata je da donose različite tipove koristi, pa su samim tim i pogodni za testiranje koncepta. Koristeći podatke o realizovanim projektima, istraživanje je nastojalo da utvrdi da li bi primena koncepta strateškog upravljanja koristima dala bolje rezultate u odnosu na poznate metode koje se primenjuju u praksi. Shodno rezultatima istraživanja, date su i preporuke o poboljšanju prakse projektnog i portfolio menadžmenta u oblasti poboljšanja energetske efikasnosti, ali i uopšte, kao i o daljim istraživanjima koja se tiču upravljanja projektnim koristima.The research presented in the doctoral dissertation deals with the development and testing of the concept of strategic benefit management as a system of models, which should contribute to the optimal benefit management through all phases of the development life cycle of project and portfolio management. In this dissertation, firstly, the theoretical presentation of the concept is given, starting from a wider scientific basis, through its theoretical explanation, to a detailed analysis of the models, the constituent elements of the concept. The paper defines three models that are integral parts of the concept and each of them relates to one phase in the creation of project benefits. The concept of strategic benefit management has an interdisciplinary character, as it covers various areas of project management, operational research and analysis of management systems maturity. In the research part of the paper, the concept of strategic benefit management has been tested in the portfolio of energy efficiency projects in public buildings. The specificity of these projects is that they bring different types of benefits, so they are also suitable for testing the concept. Using data on realized projects, the research sought to determine whether the application of the concept of strategic benefit management would yield better results than the known methods applied in practice. According to the results of the research, recommendations were given on improving the project and portfolio management practices in the field of energy efficiency improvement, but also in general, as well as on further research concerning the project benefit management