Detection And Correction Of Under-/Overexposed Optical Soundtracks By Coupling Image And Audio Signal Processing

International audienceFilm restoration using image processing, has been an active research field during the last years. However, the restoration of the soundtrack has been mainly performed in the sound domain, using signal processing methods, despite the fact that it is recorded as a continuous image between the images of the film and the perforations. While the very few published approaches focus on removing dust particles or concealing larger corrupted areas, no published works are devoted to the restoration of soundtracks degraded by substantial underexposure or overexposure. Digital restoration of optical soundtracks is an unexploited application field and, besides, scientifically rich, because it allows mixing both image and signal processing approaches. After introducing the principles of optical soundtrack recording and playback, this contribution focuses on our first approaches to detect and cancel the effects of under and overexposure. We intentionally choose to get a quantification of the effect of bad exposure in the 1D audio signal domain instead of 2D image domain. Our measurement is sent as feedback value to an image processing stage where the correction takes place, building up a "digital image and audio signal" closed loop processing. The approach is validated on both simulated alterations and real data

A novel technique for high-resolution frequency discriminators and their application to pitch and onset detection in empirical musicology

This thesis presents and evaluates software for simultaneous, high-resolution time-frequency discrimination. Whilst this is a problem that arises in many areas of engineering, the software here is developed to assist musicological investigations. In order to analyse musical performances, we must first know what is happening and when; that is, at what time each note begins to sound (the note onset) and what frequencies are present (the pitch). The work presented here focusses on onset detection, although the representation of data used for this task could also be used to track the pitch. A potential method of determining pitch on a sample-to-sample basis is given in the final chapter. Extant software for onset detection uses standard signal processing techniques to search for changes in features like the spectrum or phase. These methods struggle somewhat, as they are constrained by the uncertainty principle, which states that, as time resolution is increased, frequency resolution must decrease and vice versa. However, we can hear changes in frequency to a far greater time resolution than the uncertainty principle would suggest is possible. There is an active process in the inner ear which adds energy and enables this perceptual acuity. The mathematical expression which describes this system is known as the Hopf bifurcation. By building a bank of tuned resonators in software, each of which operates at a Hopf bifurcation, and driving it with audio, changes in frequency can be detected in times that defy the uncertainty relation, as we are not seeking to directly measure the time-frequency features of a system, rather it is used to drive a system. Time and frequency information is then available from the internal state variables of the system. The characteristics of this bank of resonators - called a 'DetectorBank' - are investigated thoroughly. The bandwidth of each resonator ('detector') can be as narrow as 0.922Hz and the system bandwidth is extended to the Nyquist frequency. A nonlinear system may be expected to respond poorly when presented with multiple simultaneous input frequencies; however, the DetectorBank performs well under these circumstances. The data generated by the DetectorBank is then analysed by an OnsetDetector. Both the development and testing of this OnsetDetector are detailed. It is tested using a repository of recordings of individual notes played on a variety of instruments, with promising results. These results are discussed, problems with the current implementation are identified and potential solutions presented. This OnsetDetector can then be combined with a PitchTracker to create a NoteDetector, capable of detecting not only a single note onset time and pitch, but information about changes that occur within a note. Musical notes are not static entities: they contain much variation. Both the performer's intonation and the characteristics of the instrument itself have an effect on the frequency present, as well as features like vibrato. Knowledge of these frequency components, and how they appear or disappear over the course of the note, is valuable information and the software presented here enables the collection of this data

Research and Creative Activity, July 1, 2019-June 30, 2020: Major Sponsored Programs and Faculty Accomplishments in Research and Creative Activity, University of Nebraska-Lincoln

Foreword by Bob Wilhelm, Vice Chancellor for Research and Economic Development: This booklet highlights successes in research, scholarship and creative activity by University of Nebraska–Lincoln faculty during the fiscal year running July 1, 2019, to June 30, 2020. It lists investigators, project titles and funding sources on major grants and sponsored awards received during the year; fellowships and other recognitions and honors bestowed on our faculty; books published by faculty; performances, exhibitions and other creative activity; and patents and licensing agreements issued. Based on your feedback, the Office of Research and Economic Development expanded this publication to include peer-reviewed journal articles and conference presentations and recognize students and faculty mentors participating in the Undergraduate Creative Activities and Research Experience Program (UCARE) and the First-Year Research Experiences program (FYRE). While metrics cannot convey the full story of our work, they are tangible measures of impact. Nebraska achieved a record $317 million in total research expenditures in FY 2019, a 26$450 million in research expenditures by 2025. Husker researchers are stimulating economic growth through university-sponsored industry activity. Nebraska Innovation Campus created 1,657 jobs statewide and had a total economic impact of $324.1 million in FY 2019. NUtech Ventures brought in$6.6 million in licensing income in FY 2020. The University of Nebraska system now ranks 65th among the top 100 academic institutions receiving U.S. patents, jumping 14 spots from 2019. I am proud of the Nebraska Research community for facing the challenges of 2020 with grit and determination. Our researchers quickly adapted to develop solutions for an evolving pandemic — all while working apart and keeping themselves and their families safe. As an institution, we made a commitment to embrace an anti-racism journey and work toward racial equity. Advancing conversations and developing lasting solutions is among the most important work we can do as scholars. Against the backdrop of the pandemic, rising racial and social tensions, and natural disasters, Nebraska researchers worked diligently to address other pressing issues, such as obesity and related diseases, nanomaterials, agricultural resilience and the state’s STEM workforce. Let’s continue looking forward to what we can accomplish together. Thank you for participating in the grand challenges process and helping identify the wicked problems that Nebraska has unique expertise to solve. Soon, ORED will unveil a Research Roadmap that outlines how our campus will develop research expertise; enrich creative activity; bolster commitment to diversity, equity and inclusion; enhance economic development; and much more. Amidst the uncertainty of 2020, I remain confident in our faculty’s talent and commitment. I am pleased to present this record of accomplishments. Contents Awards of $5 Million or More Awards of$1 Million to $4,999,999 Awards of$250,000 to $999,999 Early Career Awards Arts and Humanities Awards of$250,000 or More Arts and Humanities Awards of $50,000 to$249,999 Arts and Humanities Awards of $5,000 to$49,999 Patents License Agreements Creative Activity Books Recognitions and Honors Journal Articles Conference Presentations UCARE and FYRE Projects Glossar

1993-1994 Academic Catalog

https://digitalcommons.cedarville.edu/academic_catalogs/1033/thumbnail.jp