The Use of Audio in Minimal Access Surgery

In minimal access surgery (MAS) (also known as minimally invasive surgery), operations are carried out by making small incisions in the skin and inserting special apparatus into potential body cavities through those incisions. Laparoscopic MAS procedures are conducted in the patient’s abdomen. The aim of MAS is faster recovery, shorter hospitalisation and fewer major post-operative complications; all resulting in lower societal cost with better patient acceptability. The technique is markedly dependent on supporting technologies for vision, instrumentation, energy delivery, anaesthesia, and monitoring. However, in practice, much MAS continues to take longer and be associated with an undesirable frequency of unwanted minor (or occasionally major) mishaps. Many of these difficulties result precisely from the complexity and mal-adaptation of the additional technology and from lack of familiarity with it. A survey of South East England surgeons showed the two main stress factors on surgeons to be the technical difficulty of the procedure and time pressures placed on the surgeon by third parties. Many of the problems associated with MAS operations are linked to the control and monitoring of the equipment. This paper describes work begun to explore ergonomic enhancements to laparoscopic operating technology that could result in faster and safer laparoscopic operations, less surgeon stress and reduce dependence on ancillary staff. Auditory displays have been used to communicate complex information to users in a modality that is complementary to the visual channel. This paper proposes the development of a control and feedback system that will make use of auditory displays to improve the amount of information that can be communicated to the surgeon and his assistant without overloading the visual channel. Control of the system would be enhanced by the addition of voice input to allow the surgeon direct control

How Does a P System Sound?

P systems are computational devices versatile enough to represent many real-life scenarios. In this paper, we present a first interpretation for P systems where a computation produces a set of sounds. The idea is to associate sounds to the application of specific rules in the P system. The application of such rules produces sounds of one time unit. Different rules produce different sounds. The combination of such sounds along time can be interpreted as music.Ministerio de Ciencia e Innovación TIN2008-04487-EMinisterio de Ciencia e Innovación TIN-2009-13192Junta de Andalucía P08-TIC-0420

DNA sonification for public engagement in bioinformatics

Funding: This work was funded by the Science and Technology Facilities Council (STFC) grant numbers ST/R000328/1 and ST/T000872/1.Objective: Visualisation methods, primarily color-coded representation of sequence data, have been a predominant means of representation of DNA data. Algorithmic conversion of DNA sequence data to sound – sonification – represents an alternative means of representation that uses a different range of human sensory perception. We propose that sonification has value for public engagement with DNA sequence information because it has potential to be entertaining as well as informative. We conduct preliminary work to explore the potential of DNA sequence sonification in public engagement with bioinformatics. We apply a simple sonification technique for DNA, in which each DNA base is represented by a specific note. Additionally, a beat may be added to indicate codon boundaries or for musical effect. We report a brief analysis from public engagement events we conducted that featured this method of sonification. Results: We report on use of DNA sequence sonification at two public events. Sonification has potential in public engagement with bioinformatics, both as a means of data representation and as a means to attract audience to a drop-in stand. We also discuss further directions for research on integration of sonification into bioinformatics public engagement and education.Publisher PDFPeer reviewe

Sleep Musicalization: Automatic Music Composition from Sleep Measurements

Peer reviewe

Using sound to understand protein sequence data:New sonification algorithms for protein sequences and multiple sequence alignments

Funding: This work was supported by the UKRI Biotechnology and Biological Sciences Research Council (BBSRC) grant number BB/M010996/1.Background The use of sound to represent sequence data – sonification – has great potential as an alternative and complement to visual representation, exploiting features of human psychoacoustic intuitions to convey nuance more effectively. We have created five parameter-mapping sonification algorithms that aim to improve knowledge discovery from protein sequences and small protein multiple sequence alignments. For two of these algorithms, we investigated their effectiveness at conveying information. To do this we focussed on subjective assessments of user experience. This entailed a focus group session and survey research by questionnaire of individuals engaged in bioinformatics research. Results For single protein sequences, the success of our sonifications for conveying features was supported by both the survey and focus group findings. For protein multiple sequence alignments, there was limited evidence that the sonifications successfully conveyed information. Additional work is required to identify effective algorithms to render multiple sequence alignment sonification useful to researchers. Feedback from both our survey and focus groups suggests future directions for sonification of multiple alignments: animated visualisation indicating the column in the multiple alignment as the sonification progresses, user control of sequence navigation, and customisation of the sound parameters. Conclusions Sonification approaches undertaken in this work have shown some success in conveying information from protein sequence data. Feedback points out future directions to build on the sonification approaches outlined in this paper. The effectiveness assessment process implemented in this work proved useful, giving detailed feedback and key approaches for improvement based on end-user input. The uptake of similar user experience focussed effectiveness assessments could also help with other areas of bioinformatics, for example in visualisation.Publisher PDFPeer reviewe

Understanding sorting algorithms using music and spatial distribution

This thesis is concerned with the communication of information using auditory techniques. In particular, a music-based interface has been used to communicate the operation of a number of sorting algorithms to users. This auditory interface has been further enhanced by the creation of an auditory scene including a sound wall, which enables the auditory interface to utilise music parameters in conjunction with 2D/3D spatial distribution to communicate the essential processes in the algorithms. The sound wall has been constructed from a grid of measurements using a human head to create a spatial distribution. The algorithm designer can therefore communicate events using pitch, rhythm and timbre and associate these with particular positions in space. A number of experiments have been carried out to investigate the usefulness of music and the sound wall in communicating information relevant to the algorithms. Further, user understanding of the six algorithms has been tested. In all experiments the effects of previous musical experience has been allowed for. The results show that users can utilise musical parameters in understanding algorithms and that in all cases improvements have been observed using the sound wall. Different user performance was observed with different algorithms and it is concluded that certain types of information lend themselves more readily to communication through auditory interfaces than others. As a result of the experimental analysis, recommendations are given on how to improve the sound wall and user understanding by improved choice of the musical mappings

Data Sonification in Creative Practice

Sonification is the process of data transmission with non-speech audio. While finding increasing acceptance as a scientific method, particularly where a visual representation of data is inadequate, it is still often derided as a ‘gimmick’. Composers have also shown growing interest in sonification as a compositional method. Both in science and in music, the criticism towards this method relates to poor aesthetics and gratuitous applications. This thesis aims to address these issues through an accompanying portfolio of pieces which use sonification as a compositional tool. It establishes the principles of ‘musification’, which can be defined as a sonification which uses musical structures; a sonification organised by musical principles. The practice-as-research portfolio explores a number of data sources, musical genres and science-music collaborations. The main contributions to knowledge derived from the project are a portfolio of compositions, a compositional framework for sonification and an evaluation framework for musification. This thesis demonstrates the validity of practice-as-research as a methodology in sonification research

Safe and Sound: Proceedings of the 27th Annual International Conference on Auditory Display

Complete proceedings of the 27th International Conference on Auditory Display (ICAD2022), June 24-27. Online virtual conference