Developing a Prototype to Translate Pakistan Sign Language into Text and Speech While Using Convolutional Neural Networking

The purpose of the study is to provide a literature review of the work done on sign language in Pakistan and the world. This study also provides a framework of an already developed prototype to translate Pakistani sign language into speech and text while using convolutional neural networking (CNN) to facilitate unimpaired teachers to bridge the communication gap among the deaf learners and unimpaired teachers. Due to the lack of sign language teaching, unimpaired teachers face difficulty in communicating with impaired learners. This communication gap can be filled with the help of this translation tool. Research indicates that a prototype has been evolved that can translate the English textual content into sign language and highlighted that there is a need for translation tool which can translate the signs into English text. The current study will provide an architectural framework of the Pakistani sign language to English text translation tool that how different components of technology like deep learning, convolutional neural networking, python, tensor Flow, and NumPy, InceptionV3 and transfer learning, eSpeak text to speech help in the development of a translation tool prototype. Keywords: Pakistan sign language (PSL), sign language (SL), translation, deaf, unimpaired, convolutional neural networking (CNN). DOI: 10.7176/JEP/10-15-18 Publication date:May 31st 201

French Optical Telegraphy, 1793-1855: Hardware, Software, Administration

The relatively stable contribution of technological change to aggregate growth masks technological trajectories which are, at the sectoral level, often highly discontinuous. For decades, even centuries, the capabilities used to produce a particular good or service may continue essentially unchanged or with relatively minor evolutionary modifications. Sometimes without much warning a breakthrough innovation will create a new technological paradigm, along with an accompanying gale of creative destruction, which is then followed by a period of consolidation within a maturing framework

Middleware’s message : the financial technics of codata

In this paper, I will argue for the relevance of certain distinctive features of messaging systems, namely those in which data (a) can be sent and received asynchronously, (b) can be sent to multiple simultaneous recipients and (c) is received as a “potentially infinite” flow of unpredictable events. I will describe the social technology of the stock ticker, a telegraphic device introduced at the New York Stock Exchange in the 1860s, with reference to early twentieth century philosophers of synchronous experience (Bergson), simultaneous sign interpretations (Mead and Peirce), and flows of discrete events (Bachelard). Then, I will show how the ticker’s data flows developed into the 1990s-era technologies of message queues and message brokers, which distinguished themselves through their asynchronous implementation of ticker-like message feeds sent between otherwise incompatible computers and terminals. These latter systems’ characteristic “publish/subscribe” communication pattern was one in which conceptually centralized (if logically distributed) flows of messages would be “published,” and for which “subscribers” would be spontaneously notified when events of interest occurred. This paradigm—common to the so-called “message-oriented middleware” systems of the late 1990s—would re-emerge in different asynchronous distributed system contexts over the following decades, from “push media” to Twitter to the Internet of Things

Review of three-dimensional human-computer interaction with focus on the leap motion controller

Modern hardware and software development has led to an evolution of user interfaces from command-line to natural user interfaces for virtual immersive environments. Gestures imitating real-world interaction tasks increasingly replace classical two-dimensional interfaces based on Windows/Icons/Menus/Pointers (WIMP) or touch metaphors. Thus, the purpose of this paper is to survey the state-of-the-art Human-Computer Interaction (HCI) techniques with a focus on the special field of three-dimensional interaction. This includes an overview of currently available interaction devices, their applications of usage and underlying methods for gesture design and recognition. Focus is on interfaces based on the Leap Motion Controller (LMC) and corresponding methods of gesture design and recognition. Further, a review of evaluation methods for the proposed natural user interfaces is given

Computer Music Algorithms. Bio-inspired and Artificial Intelligence Applications

2014 - 2015Music is one of the arts that have most benefited from the invention of computers. Originally, the term Computer Music was used in the scientific community to identify the application of information technology in music composition. It began over time to include the theory and application of new or existing technologies in music, such as sound synthesis, sound design, acoustic, psychoacoustic. Thanks to its interdisciplinary nature, Computer Music can be seen as the encounter of different disciplines. In the last years technology has redefined the way individuals can work, communicate, share experiences, constructively debate, and actively participate to any aspect of the daily life, ranging from business to education, from political and intellectual to social, and also in music activity, such as play music, compose music and so on. In this new context, Computer Music has become an emerging research area for the application of Computational Intelligence techniques, such as machine learning, pattern recognition, bio-inspired algorithms and so on. My research activity is concerned with the Bio-inspired and Artificial Intelligence Applications in the Computer Music. Some of the problems I addressed are summarized in the following. Automatic composition of background music for games, films and other human activities: EvoBackMusic. Systems for real-time composition of background music respond to changes of the environment by generating music that matches the current state of the environment and/or of the user. We propose one such a system that we call EvoBackMusic. It is a multiagent system that exploits a feed-forward neural network and a multi-objective genetic algorithm to produce background music. The neural network is trained to learn the preferences of the user and such preferences are exploited by the genetic algorithm to compose the music. The composition process takes into account a set of controllers that describe several aspects of the environment, like the dynamism of both the user and the 2 context, other physical characteristics, and the emotional state of the user. Previous system mainly focus on the emotional aspect. Publications: • Roberto De Prisco, Delfina Malandrino, Gianluca Zaccagnino, Rocco Zaccagnino: ‘‘An Evolutionary Composer for Real-Time Background Music’’. EvoMUSART 2016: 135-151. Interaction modalities for music performances: MarcoSmiles. In this field we considered new interaction modalities during music performances by using hands without the support of a real musical instrument. Exploiting natural user interfaces (NUI), initially conceived for the game market, it is possible to enhance the traditional modalities of interaction when accessing to technology, build new forms of interactions by transporting users in a virtual dimension, but that fully reflects the reality, and finally, improve the overall perceived experience. The increasing popularity of these innovative interfaces involved their adoption in other fields, including Computer Music. We propose a system, named MarcoSmiles, specifically designed to allow individuals to perform music in an easy, innovative, and personalized way. The idea is to design new interaction modalities during music performances by using hands without the support of a real musical instrument. We exploited Artificial Neural Networks to customize the virtual musical instrument, to provide the information for the mapping of the hands configurations into musical notes and, finally, to train and test these configurations. We performed several tests to study the behavior of the system and its efficacy in terms of learning capabilities. Publications: • Roberto De Prisco, Delfina Malandrino, Gianluca Zaccagnino, Rocco Zaccagnino: ‘‘Natural Users Interfaces to support and enhance Real-Time Music Performance’’. AVI 2016. 3 Bio-inspired approach for automatic music composition Here we describe a new bio-inspired approach for automatic music composition in a specific style: Music Splicing System. Splicing systems were introduced by Tom Head (1987) as a formal model of a recombination process between DNA molecules. The existing literature on splicing systems mainly focuses on the computational power of these systems and on the properties of the generated languages; very few applications based on splicing systems have been introduced. We show a novel application of splicing systems to build an automatic music composer. As a result of a performance study we proved that our composer outperforms other meta-heuristics by producing better music according to a specific measure of quality evaluation, and this proved that the proposed system can be seen also as a new valid bio-inspired strategy for automatic music composition. Publications: ▪ Clelia De Felice, Roberto De Prisco, Delfina Malandrino, Gianluca Zaccagnino, Rocco Zaccagnino, Rosalba Zizza: ‘‘Splicing Music Composition’’. Information Sciences Journal, 385: 196 – 215 (2017). ▪ Clelia De Felice, Roberto De Prisco, Delfina Malandrino, Gianluca Zaccagnino, Rocco Zaccagnino, Rosalba Zizza: ‘‘Chorale Music Splicing System: An Algorithmic Music Composer Inspired by Molecular Splicing’’. EvoMusart 2015: 50 – 61. Music and Visualization Here we describe new approaches for learning of harmonic and melodic rules of classic music, by using visualization techniques: VisualMelody and VisualHarmony. Experienced musicians have the ability to understand the structural elements of music compositions. Such an ability is built over time through the study of music theory, the understanding of rules that guide the composition of music, and through countless hours of practice. The learning process is hard, especially for classical music, where the rigidity of the music structures and styles requires great effort to understand, assimilate, and then master the learned notions. In particular, we focused our attention on a specific type of music compositions, namely, music in chorale style (4-voice music). Composing such type of music 4 is often perceived as a difficult task, because of the rules the composer has to adhere to. In this paper we propose a visualization technique that can help people lacking a strong knowledge of music theory. The technique exploits graphic elements to draw the attention on the possible errors in the composition. We then developed two interactive systems, named VisualMelody and VisualHarmony, that employ the proposed visualization techniques to facilitate the understanding of the structure of music compositions. The aim is to allow people to make 4-voice music composition in a quick and effective way, i.e., avoiding errors, as dictated by classical music theory rules. Publications: ▪ Roberto De Prisco, Delfina Malandrino, Donato Pirozzi, Gianluca Zaccagnino, Rocco Zaccagnino: ‘‘Understanding the structure of music compositions: is visualization an effective approach?’’ Information Visualization Journal, 2016. (DOI): 10.1177/1473871616655468 • Delfina Malandrino, Donato Pirozzi, Gianluca Zaccagnino, Rocco Zaccagnino: ‘‘A Color-Based Visualization Approach to Understand Harmonic Structures of Musical Compositions’’. IV 2015: 56-61. • Delfina Malandrino, Donato Pirozzi, Gianluca Zaccagnino, Rocco Zaccagnino: ‘‘Visual Approaches for Harmonic Analysis of 4-part Music: Implementation and Evaluation’’. Major revision – Journal of Visual Languages and Computing, 2016. [edited by Author]XIV n.s

Information Inflation: Can The Legal System Adapt?

Information is fundamental to the legal system. Accordingly, lawyers must understand that information, as a cultural and technological edifice, has profoundly and irrevocably changed. There has been a civilization- wide morph, or pulse, or one might say that information has evolved. This article discusses the new inflationary dynamic, which has caused written information to multiply by as much as ten thousand-fold recently. The resulting landscape has stressed the legal system and indeed, it is becoming prohibitively expensive for lawyers even to search through information. This is particularly true in litigation

Technology Made Legible: A Cultural Study of Software as a Form of Writing in the Theories and Practices of Software Engineering

My dissertation proposes an analytical framework for the cultural understanding of the group of technologies commonly referred to as 'new' or 'digital'. I aim at dispelling what the philosopher Bernard Stiegler calls the 'deep opacity' that still surrounds new technologies, and that constitutes one of the main obstacles in their conceptualization today. I argue that such a critical intervention is essential if we are to take new technologies seriously, and if we are to engage with them on both the cultural and the political level. I understand new technologies as technologies based on software. I therefore suggest that a complex understanding of technologies, and of their role in contemporary culture and society, requires, as a preliminary step, an investigation of how software works. This involves going beyond studying the intertwined processes of its production, reception and consumption - processes that typically constitute the focus of media and cultural studies. Instead, I propose a way of accessing the ever present but allegedly invisible codes and languages that constitute software. I thus reformulate the problem of understanding software-based technologies as a problem of making software legible. I build my analysis on the concept of software advanced by Software Engineering, a technical discipline born in the late 1960s that defines software development as an advanced writing technique and software as a text. This conception of software enables me to analyse it through a number of reading strategies. I draw on the philosophical framework of deconstruction as formulated by Jacques Derrida in order to identify the conceptual structures underlying software and hence 'demystify' the opacity of new technologies. Ultimately, I argue that a deconstructive reading of software enables us to recognize the constitutive, if unacknowledged, role of technology in the formation of both the human and academic knowledge. This reading leads to a self-reflexive interrogation of the media and cultural studies' approach to technology and enhances our capacity to engage with new technologies without separating our cultural understanding from our political practices

Why do we tell stories? Personal notes on visual storytelling in photography

The purpose of this study is to investigate the relationship between visual storytelling and photography practice over the history, reasons and different approaches of storytelling. Besides, it aims to evaluate the role and effects of visual storytelling on my photography practice with examples from the history of photography and visual arts. During this evaluation, this study questions the reasons for choosing photography as a means of storytelling and explains the development along with the production process of my photographic series titled “Ida: The Story of a Mountain”. This photographic study conducted through practicing a personal narrative approach, aims to experience that geography by means of photography in the context of the relationship between human and nature in the region of Mount Ida. This study, which spans three years in total and is still ongoing, does not aim to make determinations on the economic, political and sociological conditions of this geography. It examines the relationship I have established as a photographer in the context of the relationship between the guest and the host

FIELD, Issue 91, Fall 2014

https://digitalcommons.oberlin.edu/field/1096/thumbnail.jp