A THREE DIMENSIONAL (3D) VISION BASED DEFECT INSPECTION SYSTEM FOR GLUING APPLICATION

A Robot Vision System (RVS) is an adaptive and dynamic system that caters to a wide range of jobs where each involves a set of operations required to be done at a predetermined workstation. This research is focused on the development of a vision system to be integrated with KUKA arm robot. Pyramid object is used as a complimentary of the windscreen car as a model. It developed using plain cardboard with dimension of 15cm x 15cm. 2D matching application introduced to identify the characteristic of the object used in the system using CCD camera. Object used must be trained in training phase to create object template and used again in recognition phase for object classification. Then, two CCD cameras are used; placed at the top and front of the object to extract object’s edge location using Harris Point. Data extracted from it are used to find 3D coordination of each edge. Equation of straight line mostly used in this method to identify x, y and z coordinates. Data obtained from the system then used to give instruction to KUKA arm robot for gluing purposes. Pixel coordinates must be converted to robot coordinates for easier understanding by the robot. Three types of defect are trained as model templates and save to the memory known as bumper, gap and bubble defect. Each defect has special characteristic. Inspection system developed to identify problems occurs in gluing process. Template matching method used to call model trained in training phase to identify the uncertainties. Each defect occurs comes with its coordinate’s information for correction. Correction of defect consists of two phase; 1st CoD where correction is completed in first time and 2nd CoD where correction still need to be completed after the first correction. Data for all the process are recorded to prove that this algorithm made improvement with the previous research

Human-machine networks: Towards a typology and profiling framework

© Springer International Publishing Switzerland 2016. In this paper we outline an initial typology and framework for the purpose of profiling human-machine networks, that is, collective structures where humans and machines interact to produce synergistic effects. Profiling a humanmachine network along the dimensions of the typology is intended to facilitate access to relevant design knowledge and experience. In this way the profiling of an envisioned or existing human-machine network will both facilitate relevant design discussions and, more importantly, serve to identify the network type. We present experiences and results from two case trials: a crisis management system and a peerto- peer reselling network. Based on the lessons learnt from the case trials we suggest potential benefits and challenges, and point out needed future work

SHARED PATH Service Design and Artificial Intelligence in Designing Human-Centred Digital Services

Digitalization and the growing service economy place challenges on organizations for transforming their service offerings to match the high user expectations. Services increasingly exploit digital technologies which play an important role in the creation of service experiences. One of the examples is artificial intelligence (AI), which may actively perform in customer service, but also provide solutions in the back end of services. While AI actively takes part in the creation of service value, the line between human and machine in the service encounters blurs. This creates new type of service components which need to be designed as part of digital service journeys. This dissertation is constructed around seven scientific publications that explore the merging of AI and service design in creating human-centred digital service solutions. The focus in the publications is on applying service design principles to AI-enabled services, from which an AI assistant is an example. AI assistants interact with users through text and voice interfaces and can be perceived as a gateway to complex digital service ecosystems. AI assistants are rather new as services, and they touch upon areas that, besides the design challenges, are ethically, philosophically and legally demanding. Here, service designers face changes both in the design process and in their role as designers. This study was conducted as a qualitative research with roots in the practice of design research. The main research data consist of five case studies and seven expert interviews analysed through coding, content analysis and visual mapping to answer the following research question: How is AI affecting the practice of service design and the design of digital services? The findings from the publications are concluded under the following four topics: (1) AI changes the design of digital service interactions, (2) AI assistants perform as actors in digital services, (3) AI needs to be human-centred rather than human-like and (4) AI assists and augments the practice of service design. Under these topics, the discussion highlights the ethical considerations and humanization aspect of AI as a part of designing and the design outcomes as AI-enabled services.Digitalisaatio ja kasvava palvelukeskeinen markkinatalous asettavat organisaatioille muutoshaasteitta, jotta palvelutarjonnalla pystyttäisiin vastaamaan käyttäjien korkeisiin odotuksiin. Palvelut hyödyntävät yhä enenevissä määrin digitaalista teknologiaa osana palvelukokemusten tuottamista. Yhtenä esimerkkinä teknologioista on tekoäly, jolla voi jo olla aktiivinen osa asiakaspalvelussa sekä ratkaisujen tuottajana palveluiden taustajärjestelmissä. Kun tekoälyn rooli palveluarvon tuottamisessa kasvaa, raja ihmisen ja koneen välillä voi hämärtyä. Tekoäly luo näin uudenlaisia palveluelementtejä, jotka tulee muotoilla osaksi digitaalisia palvelupolkuja. Väitöstyö pohjautuu seitsemään tieteelliseen julkaisuun, joiden kautta tutkimus tarkastelee tekoälyn ja palvelumuotoilun yhteyttä ihmislähtöisten digipalveluiden muotoilemisessa. Julkaisut keskittyvät palvelumuotoilun näkökulmaan tekoälyavusteisten palveluiden kehittämisessä ja käyttävät esimerkkikontekstina tekoälyassistentteja. Tekoälyassistentti on digitaalisen palvelun muoto, joka on vuorovaikutuksessa asiakkaan kanssa joko tekstin tai puheen kautta. Tekoälyassistentti voi myös toimia keulakuvana laajemmalle palvelutarjonnalle ja palveluekosysteemeille. Tekoälyassistentit ovat palvelumuotona melko uusia ja niiden aihepiirit ovat muotoiluhaasteen lisäksi eettisesti, filosofisesti ja juridisesti haastavia. Tämä luo palvelumuotoilijalle haastavan asetelman niin muotoiluprosessiin kuin omaan työhön muotoilijana. Väitöstutkimus on toteutettu laadullisena tutkimuksena muotoilun tutkimuksen kentällä. Tutkimuksen ensisijainen aineisto koostuu viidestä tapaustutkimuksesta ja seitsemästä asiantuntijahaastattelusta. Aineistoa on analysoitu koodaamisen, sisällönanalyysin sekä visuaalisen analyysin keinoin. Analyysin kautta vastataan tutkimuskysymykseen: Mikä on tekoäly vaikutus palvelumuotoilutoimintaan ja digitaalisten palveluiden muotoilemiseen? Tutkimustulokset esitellään neljän aihepiirin kautta: (1) Tekoäly muuttaa digitaalisten palveluiden vuorovaikutusten muotoilua, (2) tekoälyassistentit ovat aktiivisia toimijoita digitaalisissa palveluissa, (3) tekoälyn on oltava ihmiskeskeistä, ei ihmismäistä, ja (4) tekoäly tukee ja laajentaa palvelumuotoilutoimintaa. Näiden aihepiirien kautta tutkimustulokset nostavat esiin tekoälyn eettiset ja inhimilliset näkökulmat osana tekoälyavusteisia palveluita sekä niitä tuottavaa palvelumuotoilutoimintaa

An overview of research on human-centered design in the development of artificial general intelligence

Abstract: This article offers a comprehensive analysis of Artificial General Intelligence (AGI) development through a humanistic lens. Utilizing a wide array of academic and industry resources, it dissects the technological and ethical complexities inherent in AGI's evolution. Specifically, the paper underlines the societal and individual implications of AGI and argues for its alignment with human values and interests. Purpose: The study aims to explore the role of human-centered design in AGI's development and governance. Design/Methodology/Approach: Employing content analysis and literature review, the research evaluates major themes and concepts in human-centered design within AGI development. It also scrutinizes relevant academic studies, theories, and best practices. Findings: Human-centered design is imperative for ethical and sustainable AGI, emphasizing human dignity, privacy, and autonomy. Incorporating values like empathy, ethics, and social responsibility can significantly influence AGI's ethical deployment. Talent development is also critical, warranting interdisciplinary initiatives. Research Limitations/Implications: There is a need for additional empirical studies focusing on ethics, social responsibility, and talent cultivation within AGI development. Practical Implications: Implementing human-centered values in AGI development enables ethical and sustainable utilization, thus promoting human dignity, privacy, and autonomy. Moreover, a concerted effort across industry, academia, and research sectors can secure a robust talent pool, essential for AGI's stable advancement. Originality/Value: This paper contributes original research to the field by highlighting the necessity of a human-centered approach in AGI development, and discusses its practical ramifications.Comment: 20 page

Security and Privacy for IoT Ecosystems

Smart devices have become an integral part of our everyday life. In contrast to smartphones and laptops, Internet of Things (IoT) devices are typically managed by the vendor. They allow little or no user-driven customization. Users need to use and trust IoT devices as they are, including the ecosystems involved in the processing and sharing of personal data. Ensuring that an IoT device does not leak private data is imperative. This thesis analyzes security practices in popular IoT ecosystems across several price segments. Our results show a gap between real-world implementations and state-of-the-art security measures. The process of responsible disclosure with the vendors revealed further practical challenges. Do they want to support backward compatibility with the same app and infrastructure over multiple IoT device generations? To which extent can they trust their supply chains in rolling out keys? Mature vendors have a budget for security and are aware of its demands. Despite this goodwill, developers sometimes fail at securing the concrete implementations in those complex ecosystems. Our analysis of real-world products reveals the actual efforts made by vendors to secure their products. Our responsible disclosure processes and publications of design recommendations not only increase security in existing products but also help connected ecosystem manufacturers to develop secure products. Moreover, we enable users to take control of their connected devices with firmware binary patching. If a vendor decides to no longer offer cloud services, bootstrapping a vendor-independent ecosystem is the only way to revive bricked devices. Binary patching is not only useful in the IoT context but also opens up these devices as research platforms. We are the first to publish tools for Bluetooth firmware and lower-layer analysis and uncover a security issue in Broadcom chips affecting hundreds of millions of devices manufactured by Apple, Samsung, Google, and more. Although we informed Broadcom and customers of their technologies of the weaknesses identified, some of these devices no longer receive official updates. For these, our binary patching framework is capable of building vendor-independent patches and retrofit security. Connected device vendors depend on standards; they rarely implement lower-layer communication schemes from scratch. Standards enable communication between devices of different vendors, which is crucial in many IoT setups. Secure standards help making products secure by design and, thus, need to be analyzed as early as possible. One possibility to integrate security into a lower-layer standard is Physical-Layer Security (PLS). PLS establishes security on the Physical Layer (PHY) of wireless transmissions. With new wireless technologies emerging, physical properties change. We analyze how suitable PLS techniques are in the domain of mmWave and Visible Light Communication (VLC). Despite VLC being commonly believed to be very secure due to its limited range, we show that using VLC instead for PLS is less secure than using it with Radio Frequency (RF) communication. The work in this thesis is applied to mature products as well as upcoming standards. We consider security for the whole product life cycle to make connected devices and IoT ecosystems more secure in the long term

Gray areas inside black boxes: Tracing actor-networks and ethics in professional design practice

In this study, I analyze professional designers’ experiences of exercising agency and enacting ethics in design practice. This research is based on a focus group and a series of individual interviews with design and technology practitioners at technology companies and design consultancies. First, based on grounded theory analysis, I present a thematic analysis of ethical issues in professional design practice and the mitigating strategies used by designers. Second, based on actor-network theory (ANT), I present three vignettes to describe the human and nonhuman networks of professional designers and how they increase agency and ethics in design. The contributions of this work include an application of actor-network theory to professional design practice, an empirical account of the human and nonhuman networks of professional design practice, and descriptions of how agency and ethical responsibility are distributed and shared across humans and nonhumans

Designing for Autonomy, Competence and Relatedness in Robot-Assisted Language Learning

The current number of immigrants has risen quickly in recent years due to globalization. People move to another country for economic, educational, emotional, and other reasons. As a result, immigrants need to learn the host language to integrate into their new living environment. However, the process of learning the host language for adult immigrants faces many challenges. Among those challenges, maintaining intrinsic motivation is critical for a long-term language study process and the well-being of adult immigrants. Self-Determination Theory (SDT) is a popular theoretical framework that explains human motivation, especially intrinsic motivation, through a psychological approach to understand its nature. According to SDT, humans are intrinsically motivated through the satisfaction of the three basic needs of Autonomy, Competence, and Relatedness. Many researchers have applied the theory to different topics and directions, including language learning. On the other hand, social robots have been used extensively in the language learning context due to their physical embodiments and the application of artificial intelligence in robotics. Furthermore, research has proven that social robots can create a relaxed and engaging learning environment, thus motivating language learners. The thesis designs and implements a RALL application called SAMQ using QTrobot, a humanoid social robot capable of producing body gestures, displaying different facial expressions, and multilingual communication. The study aims to investigate SAMQ’s ability to evoke intrinsic motivations of adult immigrants in learning the Finnish language. While previous research focuses on English as the second language (L2) and targets children, this thesis’s L2 is Finnish, and the learners are adult immigrants. The thesis conducts semi-structured interviews during the Pre-study phase (N=6) to gather real insights from adult immigrants living in Finland, to understand demotivating factors in their language learning experience and the unsatisfied aspects of the three basic needs. The qualitative findings from the Pre-study contribute to the design and implementation of two versions of SAMQ, aiming at evoking intrinsic motivations through satisfying unmet needs. The first version is a Quiz-only program that tests several assumptions regarding human-robot interaction (HRI). The final version of SAMQ is a more comprehensive language learning application that supports two modes of study: Learning and Quizzes. It consists of multiple modifications that address all adult immigrants’ basic needs while additionally promoting intrinsic motivation through media. The final Evaluation of SAMQ (N=6) includes a questionnaire and a semi-structured interview. The quantitative results of the questionnaire validated the ability of using social robots to evoke adult learners’ intrinsic motivation in the RALL context. The qualitative findings from the research high-light the importance of social robots’ physical embodiments in eliciting intrinsic motivation for adult learners through satisfying Relatedness. In addition, the use of voice modality creates a genuine HRI for adult learners, fulfilling both Autonomy and Competence, resulting in an engaging and smooth learning experience. Besides that, the use of adult learners’ L1 plays a crucial role in facilitating a relaxed and familiar learning environment, supplying both Competence and Relatedness. Moreover, multimedia learning materials make the learning experience more vivid and attractive. Ultimately, the result shows that accessibility and flexibility are essential attributes for adult learners to maintain their motivation for long-term language study through the satisfaction of Autonomy. Finally, the thesis proposes a design guideline for the RALL context. It consists of five design implications for evoking intrinsic motivation in adult learners through satisfying the three basic psychological needs of Autonomy, Competence, and Relatedness. The design guideline acts as a proposal for future design and implementation of RALL programs for adults and contributes to developing the human-robot interaction field

Design of Industrial Workplaces to relieve Workers when Interacting with Joint-Arm-Robots

A comprehensive understanding of the needs of the user is required to design adequate workplace systems in general, but especially in the highly digitised area of industry where operators are interacting with autonomously operating machines. There is little knowledge in design criteria for professionals to enable adequate developments of system design for Human-Machine Interaction, e.g. Human-Robot Collaboration regarding the effects of design decisions to all three levels of Human Factors, i.e. physiological, cognitive and organisational limitations. Moreover, there is little known about objective measurement procedures that evaluate whether the operator subjectively perceives the workplace system design as assistance and improvement. The research presented in the following is affiliated with the scientific discipline of Human Factors Engineering and focuses on the evaluation of Human Factor issues within the digitised industry. Based on broad theoretical and empirical investigations, the results of this research extend our knowledge of adequate Human-Centred Design by providing reliable, powerful design criteria for workplaces where operators interact with machines/collaborate with robots, but also an overall technique, the Objective Workload Detection Method, for evaluation of the effectiveness of design investigation focusing on cognitive stress relief. Through the application of this method within a controlled experiment, the validation of the derived design criteria was confirmed. The study significantly shows how the cognitive workload can be relieved by an assisting environment. This work also gives one best-practice design example of a self-adapting workplace system for hybrid Human-Robot Teams. Following the Human-Centred Design method, the concept of Assisting Industrial Workplace System for Human-Robot Collaboration has been successfully developed as a flexible hybrid unit design. The prototype is related to a real-world scenario from the aerospace industry and the demonstrator was implemented within a laboratory set-up. This work seamlessly applies techniques from interdisciplinary science fields, e.g. Engineering, Neuroscience, Gestalt theory, and Design. Equally, the design criteria and the evaluation method will support professionals from varied disciplines to succeed in the creation process of future system-designs by giving a clear indication of future Human-Centred Design research