Deconstructing Speech: new tools for speech manipulation

My research at the London College of Communication is concerned with archives of recorded speech, what new tools need to be devised for its manipulation and how to go about this process of invention. Research into available forms of analysis of speech is discussed below with regard to two specific areas, feature vectors from linear predictive coding (LPC) analysis and hidden Markov-model-based automatic speech recognition (ASR) systems. These are discussed in order to demonstrate that whilst aspects of each may be useful in devising a system of speech-archive manipulation for artistic use. Their drawbacks and deficiencies for use in art – consequent of the reasons for their invention – necessitate the creation of tools with artistic, rather than engineering agendas in mind. It is through the initial process of devising conceptual tools for understanding speech as sound objects that I have been confronted with issues of semiotics and semantics of the voice and of the relationship between sound and meaning in speech, and of the role of analysis in mediating existing methods of communication. This is discussed with reference to Jean-Jacques Nattiez’s Music and Discourse: Towards a Semiology of Music (Nattiez 1987). The ‘trace’ – a neutral level of semiotic analysis proposed by Nattiez, far from being hypothetical as suggested by Hatten (1992: 88–98) and others, is present by analogy to many forms of mediation in modern spoken communication and the reproduction of music, and it is precisely this neutrality with regards to meaning that tools for manipulation of speech must possess, since the relationships between the sound of speech and its meaning are ‘intense’ (after Deleuze 1968

Temperature increase measurements of multiple 10 ms pulses of 2.01 μm laser light incident on ex-vivo rabbit corneas

2011 Summer.Includes bibliographical references.Current laser safety standards for multiple-pulse lasers are based primarily on modeling and the results of single-pulse studies. Previous thermal effects studies have focused on histological and visible endpoints, with only a few studies examining the actual temperatures achieved. The goal of this research was to probe the actual temperature profile produced by 2.01-micron laser pulses in the cornea. In this study the corneal temperature rise from multiple 2.01-micron Tm:YAG laser pulses was investigated using ex-vivo rabbit eyes. An infrared thermal camera employing microbolometer detectors captured surface temperature rises resulting from laser pulses. Thermal measurements were taken with single 10-ms pulses as well as two-, three-, and four-pulse sequences while holding the total energy delivered constant for the two- through four-pulse train measurements. An average temperature increase of 8.3 degrees C was observed with the single pulse at 2.8 J/cm2/pulse irradiance. For two pulses, an average temperature increase of 10.0 degrees C was observed for 2.7 J/cm2/pulse irradiance. For three pulses, an average temperature increase of 5.8 degrees C was observed for 1.9 J/cm2/pulse irradiance. For four pulses, an average temperature increase of 4.4 degrees C was observed for 1.5 J/cm2/pulse irradiance. A comparison of the data to temperatures required for denaturing proteins and the current laser safety guidelines is presented. It appears that the MPE may be overly conservative by a factor of at least 15. It is recommended that the 2.01-micron laser MPE be investigated to determine if a revision of the standard is warranted

Elastic Rhythm in Signal-Synchronised Sequencing Objects for Pure Data

This paper presents a family of objects for manipulating polyrhythmic sequences and isorhythmic relationships, in both the signal and event domains. These work together and are tightly synchronised to an audio phase signal, so that relative temporal relationships can be tempo-manipulated in a linear fashion. Many permutations of polyrhythmic sequences including incomplete tuplets, scrambled elements, interleaved tuplets and any complex franctional relation can be realised. Similarly, these many be driven with controllable isorhythmic generators derived from a single driver, so that sequences of different fractionally related lengths may be combined and synchronised. It is possible to use signals to drive audio playback that are directly generated, so that disparate sound files may be combined into sequences. A set of sequenced parameters are included to facilitate this process

Elastic Rhythm in Signal-Synchronised Sequencing Objects for Pure Data

This paper presents a family of objects for manipulating polyrhythmic sequences and isorhythmic relationships, in both the signal and event domains. These work together and are tightly synchronised to an audio phase signal, so that relative temporal relationships can be tempo-manipulated in a linear fashion. Many permutations of polyrhythmic sequences including incomplete tuplets, scrambled elements, interleaved tuplets and any complex franctional relation can be realised. Similarly, these many be driven with controllable isorhythmic generators derived from a single driver, so that sequences of different fractionally related lengths may be combined and synchronised. It is possible to use signals to drive audio playback that are directly generated, so that disparate sound files may be combined into sequences. A set of sequenced parameters are included to facilitate this process

Non-overlapping dual camera fall detection using the NAO humanoid robot

With an aging population and a greater desire for independence, the dangers of falling incidents in the elderly have become particularly pronounced. In light of this, several technologies have been developed with the aim of preventing or monitoring falls. Failing to strike the balance between several factors including reliability, complexity and invasion of privacy has seen prohibitive in the uptake of these systems. Some systems rely on cameras being mounted in all rooms of a user's home while others require being worn 24 hours a day. This paper explores a system using a humanoid NAO robot with dual vertically mounted cameras to perform the task of fall detection

A path to a renewable energy system: A financing and regulatory model

As the effects of climate change become more and more evident, the necessity of transitioning to a carbon-free economy and powering our energy and transportation systems from renewables energy sources is quite evident. This transition to a renewable- based energy system will be a massive undertaking, similar to the efforts put into WWII, where the country was united with unity of purpose. Taking on the vested interests of the fossil fuel industry and all their subsidiaries will take a political will that does not exist in this country at this time. Hermann Scheer describes what he calls a social movement; he feels only this can overcome the “agency capture” of our political systems by the fossil fuel industry. In my analysis of economic theory I concentrated on Nikolai Kondratiev’s “long-wave theory” of the capitalistic system of growth and recession, which take place over approximately a fifty year cycle. Further, I examined Joseph Schumpeter’s adaptation of Kondratiev’s theory; Schumpeter ties every wave to a new fuel source that overtakes and replaces the existing fuel source and creates a new prosperity. In the “technology wave” (which we are currently in) it is my theory that the new fuel source will be renewables: solar, wind, geothermal, tidal, etc. The American spirit of entrepreneurship, invention and innovation will move renewables along the normal diffusion curve creating this new wealth and prosperity. Using these natural forces to provide the energy to run our society will keep us in harmony with the planet. The processes used to extract our energy from the planet are destructive and must end because they cause environmental and health problems. There has been a very well-funded and effective campaign to deny the effects of fossil fuels on our climate and it is having a very profound effect. Society’s indolence on this matter is a poor choice. The real question that needs to be asked is, while there might be the fossil fuel reserves to last the world well into the 21st century, can the environment survive this? No. We see CO2 concentration in the atmosphere rising and climate change precipitously taking place as evidenced by flooding, severe storms and other extreme weather events. The recent super storm Sandy, which has devastated parts of the east coast, exhibits this. I believe Sandy was climate change related and the climate change models have predicted these extreme events. I argue in this thesis that current conditions: reaching “peak oil,” rising CO2 emissions, maintaining American military hegemony to secure fossil fuel supplies and the enduring severe weather events, will drive our capitalist system toward restructuring itself to create a new energy system fueled by innovation, invention and entrepreneurship with the government taking on a support role for the new renewable energy system. The laggards of the old fossil fuel energy system will desperately cling to their positions, but these will eventually give way to the new wave. This will create a future where energy is produced from the earth’s natural forces and not torn from the earth to be burned. Government’s role should be to provide incentives for investments in renewables through favorable legislation and regulations. A level playing field needs to be created for renewables to put them on par with fossil fuels