Saliency Map for Visual Perception

Human and other primates move their eyes to select visual information from the scene, psycho-visual experiments (Constantinidis, 2005) suggest that attention is directed to visually salient locations in the image. This allows human beings to bring the fovea onto the relevant parts of the image, to interpret complex scenes in real time. In visual perception, an important result was the discovery of a limited set of visual properties (called pre attentive), detected in the first 200-300 milliseconds of observation of a scene, by the low-level visual system. In last decades many progresses have been made into research of visual perception by analyzing both bottom up (stimulus driven) and top down (task dependent) processes involved in human attention. Visual Saliency deals with identifying fixation points that a human viewer would focus on the first seconds of the observation of a scene

“lana Tai - No Dia Em Que Nasceu Uma Aquarela”: Composing Via Audio Descriptors [lana Tai-no Dia Em Que Nasceu Uma Aquarela: Diário De Bordo De Uma Composição A Partir De Descritores De áudio]

This article is a review of a music creative processes in which it was applied compositional strategies combined to sound spectral analysis based on audio descriptors. This procedure supported the creation of the work “Lana Tai-no dia em que nasceu uma aquarela” for string orchestra. For that, some instrumental mixtures and orchestration were made using a Sound DataBase. In this particular case, a virtual environment in Pure Data (PD) software, using the library for analysis fucntions PDescriptors, analyzed some potential orchestral settings. All the results, issues and compositional reflections were used to create “Lana Tai-no dia em que nasceu uma aquarela”. This approach rises up a new contribution in the development of research in both creative processes and the creation of new unpublished works. © 2015, Universidade Federal de Minas Gerais. All rights reserved.201532338363Assayag, G., Rueda, C., Laurson, M., Agon, C., Delerue, O., Computer-assisted composition at ircam: From patchwork to openmusic (1999) Computer Music Journal, 23 (3), pp. 59-72Ballet, G., Borghesi, R., Hoffmann, P., Lévy, F., Studio Online 3.0: An Internet “Killer Application” for Remote Access to IRCAM Sounds and Processing tools (1999) Journées d’Informatique Musicale, , FranceBarbedo, J.G.A., Lopes, A., Automatic genre classification of musical signals (2007) EURASIP Journal on Applied Signal Processing, 2007 (1), 157pBerlioz, H., (1844) Treatise on Instrumentation by Hector Berlioz and Richard Strauss, , translated by Theodore Front, published by Edwin F. Kalmus, NY, NY 1948Bogdanov, D., Wack, N., Gómez, E., Essentia: An audio analysis library for music information retrieval (2013) Proceedings of ISMIRBoulez, P., Timbre and composition-timbre and language (1987) Contemporary Music Review, 2, pp. 161-171. , Translated by R. RobertsonByrd, D., Fingerhut, M., The History of ISMIR-A Short Happy Tale (2002) D-Lib Magazine, 8 (11)Carpentier, G., (2008) Approche Computationelle De l’orchestration Musicale-Optimization multicritère Sous Contraintes De Combinaisons Instrumentales Dans De Grandes Banques De Sons, , Ph.D. Thesis, University Pierre et Marie Curie, ParisCartwright, M., Pardo, B., Social-Eq: Crowdsourcing An Equalization Descriptor Map (2013) N. 14O International Conference-Ismir, , Curitiba-BrazilDeshpande, H., Singh, R., Nam, U., Classification of music signals in the visual domain (2001) Proceedings of the Conference on Digital Audio Effects, pp. 1-4Dieleman, S., Schrauwen, B., Multiscale Approaches To Music Audio Feature Learning (2013) 14O International Conference-Ismir-Curitiba-BrazilDownie, J.S., Ehmann, A.F., Bay, M., Jones, M.C., The Music Information Retrieval Evaluation eXchange: Some Observations and Insights (2010) International MIR Systems Evaluation Laboratory, , University of IllinoisEsling, P., Agon, C., Multiobjective Time Series Matching for Audio Classification and Retrieval (2013) IEEE Transactions on Audio, Speech, and Language Processing, 21 (10), pp. 2057-2072Esling, P., Agon, C., (2010) Composition of Sound Mixtures with Spectral Maquettes, , Ann Arbor, MI: MPublishing, University of Michigan LibraryEsling, P., Carpentier, G., Agon, C., Dynamic musical orchestration using genetic algorithms and a spectro-temporal description of musical instruments (2010) Applications of Evolutionary Computation, pp. 371-380. , SpringerFujishima, T., (1999) Realtime Chord Recognition of Musical Sound: A System Using Common Lisp Music, 4p. , CCRMA, Stanford UniversityGomez, E., (2006) Tonal Description of Music Audio Signals, , Ph.D. dissertation, MTG, Universitat Pompeu Fabra, Barcelona, SpainHarvey, J., The Composer’s View: Atonality (1980) The Musical Times, 699pHummel, T.A., Simulation of human voice timbre by orchestration of acoustic music instruments (2005) Proceedings of ICMC, 185pLambrou, T., Kudumakis, P., Speller, R., Sandler, M., Linney, A., Classification of audio signals using statistical features on time and wavelet transform domains. Acoustics, Speech and Signal Processing (1998) Proceedings of the 1998 IEEE International Conference On, 6, pp. 3621-3624Laurson, M., Kuuskankare, M., PWGL: A Novel Visual Language based on Common Lisp, CLOS and OpenGL (2002) Proceedings of International Computer Music Conference, pp. 142-145. , Gothenburg, SwedenMalt, M., Jourdan, E., .Descriptors: A library for real-time descriptors analysis (2008) 5Th Sound and Music Computing Conference, , Berlin, AllemagneMalt, M., Jourdan, E., (2009) Real-Time Uses of Low Level Sound Descriptors as Event Detection Functions Using the Max/Msp Zsa.Descriptors Library, , SBCM, Recife, BrazilManzolli, J., (1988) Um Modelo Matemático Para Timbre Orquestral, , Dissertação de mestrado, IMECC, Unicamp(2005) Creation and Perception of a Contemporary Musical Work: The Angel of Death by Roger Reynolds, , Ircam, ParisMonteiro, A., Criação e Performance Musical no Contexto dos Instrumentos Digitais (2012) Dissertação De Mestrado. Núcleo Interdisciplonar De Comunicação Sonora-Nics/Unicamp, 159p. , Universidade Estadual CampinasPadovani, J., Ferraz, S., (2011) Proto-História, Evolução E Situação Atual Das Técnicas Estendidas Na Criação Musical E Na Performance, 11. , Música HodiePampalk, E., Computational models of music similarity and their application in music information retrieval (2006) Tese De Doutorado, , Austria: Vienna University of TechnologyPeeters, G., (2004) A Large Set of Audio Features for Sound Description (Similarity and Classification) in the CUIDADO Project, CUIDADO, , Project ReportPereira, E., (2009) Estudos Sobre Uma Ferramenta De Classificação Musical, 65p. , Dissertação de Mestrado-Universidade Estadual Campinas, FEECPires, A.S., (2011) Métodos De segmentação Musical Baseados Em Descritores Sonoros, , Dissertação de Mestrado, Universidade de São PauloPiston, W., Orchestration (1955) W Norton & Company IncorporatedPuckette, M.S., (1996) Pure Data. Proceedings, International Computer Music Conference, pp. 269-272. , San Francisco: International Computer Music AssociationPsenicka, D., Sporch: An algorithm for orchestration based on spectral analyses of recorded sounds (2003) Proceedings of ICMC, 184pRose, F., Hetrick, J.E., Enhancing orchestration technique via spectrally based linear algebra methods (2009) Computer Music Journal, 33 (1), pp. 32-41Rimsky-Korsakov, N., Principles of Orchestration (1922) Traduzido Por Edward Agate, , Maximilian Steinberg, New York: Dover PublicationsSchafer, M., (1997) A afinação Do Mundo. Título Original Em inglês: The Tuning of The World, , Editora UNESPSheh, A., Ellis, D.P.W., Chord segmentation and recognition using EM-trained hidden Markov models (2003) International Conference on MIR, , Baltimore, USAShepard, R.N., Structural representations of musical pitch (1982) The Psychology of Music, , Deutsch, D., editor, First Edition. Swets & ZeitlingerTheodoridis, S., (2009) Pattern Recognition, 967p. , KOUTROUMBAS, Academic pressThoshkahna, B., Nsabimana, F., Ramakrishnan, K.R., A Transient Detection Algorithm For Audio Using Iterative Analysis Of Stft (2011) 12Th International Society for MIR ConferenceWang, A., (2003) An Industrial Strength Audio Search Algorithm, , ISMI