125 research outputs found

    Computer Vision and Architectural History at Eye Level:Mixed Methods for Linking Research in the Humanities and in Information Technology

    Get PDF
    Information on the history of architecture is embedded in our daily surroundings, in vernacular and heritage buildings and in physical objects, photographs and plans. Historians study these tangible and intangible artefacts and the communities that built and used them. Thus valuableinsights are gained into the past and the present as they also provide a foundation for designing the future. Given that our understanding of the past is limited by the inadequate availability of data, the article demonstrates that advanced computer tools can help gain more and well-linked data from the past. Computer vision can make a decisive contribution to the identification of image content in historical photographs. This application is particularly interesting for architectural history, where visual sources play an essential role in understanding the built environment of the past, yet lack of reliable metadata often hinders the use of materials. The automated recognition contributes to making a variety of image sources usable forresearch.<br/

    New interactive interface design for STEM museums: a case study in VR immersive technology

    Get PDF
    Novel technologies are used to develop new museum exhibits, aiming to attract visitors’ attention. However, using new technology is not always successful, perhaps because the design of a new exhibit was inappropriate, or users were unfamiliar with interacting with a new device. As a result, choosing alternative technology to create a unique interactive display is critical. The results of using technology best practices enable the designer to help reduce failures. This research uses virtual reality (VR) immersive technology as a case study to explore how to design a new interactive exhibit in science, technology, engineering and mathematics (STEM) museums. VR has seen increased use in Thailand museums, but people are unfamiliar with it, and few use it daily. It had problems with health concerns such as motion sickness, and the virtual reality head-mounted display (VR HMD) restricts social interaction, which is essential for museum visitors. This research focuses on improving how VR is deployed in STEM museums by proposing a framework for designing a new VR exhibit that supports social interaction. The research question is, how do we create a new interactive display using VR immersive technology while supporting visitor social interaction? The investigation uses mixed methods to construct the proposed framework, including a theoretical review, museum observational study, and experimental study. The in-the-wild study and workshop were conducted to evaluate the proposed framework. The suggested framework provides guidelines for designing a new VR exhibit. The component of a framework has two main parts. The first part is considering factors for checking whether VR technology suit for creating a new exhibit. The second part is essential components for designing a new VR exhibit includes Content Design, Action Design, Social Interaction Design, System Design, and Safety and Health. Various kinds of studies were conducted to answer the research question. First, a museum observational study led to an understanding of the characteristics of interactive exhibits in STEM museums, the patterns of social interaction, the range of immersive technology that museums use and the practice of using VR technology in STEM museums. Next, the alternative design for an interactive exhibit study investigates the effect on the user experience of tangible, gesture and VR technologies. It determines the factors that make the user experience different and suggests six aspects to consider when choosing technology. Third, social interaction design in VR for museum study explores methods to connect players; single player, symmetric connection (VR HMD and VR HMD) and asymmetric connection (VR HMD and PC), to provide social interaction while playing the VR exhibit and investigates social features and social mechanics for visitors to communicate and exchange knowledge. It found that the symmetric connection provides better social interaction than others. However, the asymmetric link is also a way for visitors to exchange knowledge. The study recommends using mixed symmetric and asymmetric connections when deploying VR exhibits in a museum. This was confirmed by the in-the-wild research and validated the framework that indicated it helped staff manage the VR exhibit and provided a co-presence and co-player experience. Fourth, the content design of a display in the virtual environment study examines the effect of design content between 2D and 3D on visitors' learning and memory. It showed that content design with 2D and 3D did not influence visitors to gain knowledge and remember the exhibit’s story. However, the 3D view offers more immersion and emotion than the 2D view. The research proposes using 3D when designing content to evoke a player’s emotion; designing content for a VR exhibit should deliver experience rather than text-based learning. Furthermore, the feedback on the qualitative results of each study provided insight into the design user experience. Evaluation of the proposed framework is the last part of this research. A study in the wild was conducted to validate the proposed framework in museums. Two VR exhibits were adjusted with features that matched the proposed framework’s suggested components and were deployed in the museum to gather visitors' feedback. It received positive feedback from the visitors, and visitors approved of using VR technology in the museum. The results of user feedback from a workshop to evaluate the helpfulness of the framework showed that the framework's components are appropriate, and the framework is practical when designing a new VR exhibit, particularly for people unfamiliar with VR technology. In addition, the proposed framework of this research may be applied to study emerging technology to create a novel exhibit

    Beyond Quantity: Research with Subsymbolic AI

    Get PDF
    How do artificial neural networks and other forms of artificial intelligence interfere with methods and practices in the sciences? Which interdisciplinary epistemological challenges arise when we think about the use of AI beyond its dependency on big data? Not only the natural sciences, but also the social sciences and the humanities seem to be increasingly affected by current approaches of subsymbolic AI, which master problems of quality (fuzziness, uncertainty) in a hitherto unknown way. But what are the conditions, implications, and effects of these (potential) epistemic transformations and how must research on AI be configured to address them adequately

    Computer Vision and Architectural History at Eye Level:Mixed Methods for Linking Research in the Humanities and in Information Technology

    Get PDF
    Information on the history of architecture is embedded in our daily surroundings, in vernacular and heritage buildings and in physical objects, photographs and plans. Historians study these tangible and intangible artefacts and the communities that built and used them. Thus valuableinsights are gained into the past and the present as they also provide a foundation for designing the future. Given that our understanding of the past is limited by the inadequate availability of data, the article demonstrates that advanced computer tools can help gain more and well-linked data from the past. Computer vision can make a decisive contribution to the identification of image content in historical photographs. This application is particularly interesting for architectural history, where visual sources play an essential role in understanding the built environment of the past, yet lack of reliable metadata often hinders the use of materials. The automated recognition contributes to making a variety of image sources usable forresearch.<br/

    Computer Vision and Architectural History at Eye Level:Mixed Methods for Linking Research in the Humanities and in Information Technology

    Get PDF
    Information on the history of architecture is embedded in our daily surroundings, in vernacular and heritage buildings and in physical objects, photographs and plans. Historians study these tangible and intangible artefacts and the communities that built and used them. Thus valuableinsights are gained into the past and the present as they also provide a foundation for designing the future. Given that our understanding of the past is limited by the inadequate availability of data, the article demonstrates that advanced computer tools can help gain more and well-linked data from the past. Computer vision can make a decisive contribution to the identification of image content in historical photographs. This application is particularly interesting for architectural history, where visual sources play an essential role in understanding the built environment of the past, yet lack of reliable metadata often hinders the use of materials. The automated recognition contributes to making a variety of image sources usable forresearch.<br/

    Jahrbuch des Dubnow-Instituts / Dubnow Institute Yearbook XIX 2020/2021

    Get PDF
    Der Schwerpunkt dieses Jahrbuchs ist Else Lasker-Schüler gewidmet. Anhand ausgewählter Werke wie dem 1913 erschienenen Gedichtband "Hebräische Balladen" werden die Palästina-Imaginationen der Dichterin mit ihren realen Erfahrungen, die sie etwa 1937 in "Das Hebräerland" verarbeitete, abgeglichen. Historische und literaturwissenschaftliche Beiträge setzen Lasker-Schülers Schreiben in Beziehung zur Vorstellungswelt ihrer Zeitgenossen, indem sie das Schicksal von Flucht und Exil, den unwiederbringlichen Verlust der Heimat und die Bedeutung der Muttersprache als Aspekte einer deutsch-jüdischen Erfahrungsgeschichte konzeptualisieren. Im Allgemeinen Teil stehen die materiellen Spuren jüdischer Lebenswelten Ostmitteleuropas im Zentrum. Am Beispiel von verschiedenen Einrichtungen und Sammlungen jüdischer Provenienz werden die Dynamiken von mitunter multiplen Zerstörungsgeschichten und transnationalen Rettungsinitiativen während und nach dem Zweiten Weltkrieg untersucht. Ergänzend dazu finden sich Beiträge zur italienisch-jüdischen Geschichte, zur jüdischen Geschichte als Gegenstand der Historiografie sowie zur Rechtsgeschichte in dem Band

    Computer Vision and Architectural History at Eye Level:Mixed Methods for Linking Research in the Humanities and in Information Technology

    Get PDF
    Information on the history of architecture is embedded in our daily surroundings, in vernacular and heritage buildings and in physical objects, photographs and plans. Historians study these tangible and intangible artefacts and the communities that built and used them. Thus valuableinsights are gained into the past and the present as they also provide a foundation for designing the future. Given that our understanding of the past is limited by the inadequate availability of data, the article demonstrates that advanced computer tools can help gain more and well-linked data from the past. Computer vision can make a decisive contribution to the identification of image content in historical photographs. This application is particularly interesting for architectural history, where visual sources play an essential role in understanding the built environment of the past, yet lack of reliable metadata often hinders the use of materials. The automated recognition contributes to making a variety of image sources usable forresearch.<br/

    CLARIN

    Get PDF
    The book provides a comprehensive overview of the Common Language Resources and Technology Infrastructure – CLARIN – for the humanities. It covers a broad range of CLARIN language resources and services, its underlying technological infrastructure, the achievements of national consortia, and challenges that CLARIN will tackle in the future. The book is published 10 years after establishing CLARIN as an Europ. Research Infrastructure Consortium

    NON-VERBAL COMMUNICATION WITH PHYSIOLOGICAL SENSORS. THE AESTHETIC DOMAIN OF WEARABLES AND NEURAL NETWORKS

    Get PDF
    Historically, communication implies the transfer of information between bodies, yet this phenomenon is constantly adapting to new technological and cultural standards. In a digital context, it’s commonplace to envision systems that revolve around verbal modalities. However, behavioural analysis grounded in psychology research calls attention to the emotional information disclosed by non-verbal social cues, in particular, actions that are involuntary. This notion has circulated heavily into various interdisciplinary computing research fields, from which multiple studies have arisen, correlating non-verbal activity to socio-affective inferences. These are often derived from some form of motion capture and other wearable sensors, measuring the ‘invisible’ bioelectrical changes that occur from inside the body. This thesis proposes a motivation and methodology for using physiological sensory data as an expressive resource for technology-mediated interactions. Initialised from a thorough discussion on state-of-the-art technologies and established design principles regarding this topic, then applied to a novel approach alongside a selection of practice works to compliment this. We advocate for aesthetic experience, experimenting with abstract representations. Atypically from prevailing Affective Computing systems, the intention is not to infer or classify emotion but rather to create new opportunities for rich gestural exchange, unconfined to the verbal domain. Given the preliminary proposition of non-representation, we justify a correspondence with modern Machine Learning and multimedia interaction strategies, applying an iterative, human-centred approach to improve personalisation without the compromising emotional potential of bodily gesture. Where related studies in the past have successfully provoked strong design concepts through innovative fabrications, these are typically limited to simple linear, one-to-one mappings and often neglect multi-user environments; we foresee a vast potential. In our use cases, we adopt neural network architectures to generate highly granular biofeedback from low-dimensional input data. We present the following proof-of-concepts: Breathing Correspondence, a wearable biofeedback system inspired by Somaesthetic design principles; Latent Steps, a real-time auto-encoder to represent bodily experiences from sensor data, designed for dance performance; and Anti-Social Distancing Ensemble, an installation for public space interventions, analysing physical distance to generate a collective soundscape. Key findings are extracted from the individual reports to formulate an extensive technical and theoretical framework around this topic. The projects first aim to embrace some alternative perspectives already established within Affective Computing research. From here, these concepts evolve deeper, bridging theories from contemporary creative and technical practices with the advancement of biomedical technologies.Historicamente, os processos de comunicação implicam a transferência de informação entre organismos, mas este fenómeno está constantemente a adaptar-se a novos padrões tecnológicos e culturais. Num contexto digital, é comum encontrar sistemas que giram em torno de modalidades verbais. Contudo, a análise comportamental fundamentada na investigação psicológica chama a atenção para a informação emocional revelada por sinais sociais não verbais, em particular, acções que são involuntárias. Esta noção circulou fortemente em vários campos interdisciplinares de investigação na área das ciências da computação, dos quais surgiram múltiplos estudos, correlacionando a actividade nãoverbal com inferências sócio-afectivas. Estes são frequentemente derivados de alguma forma de captura de movimento e sensores “wearable”, medindo as alterações bioeléctricas “invisíveis” que ocorrem no interior do corpo. Nesta tese, propomos uma motivação e metodologia para a utilização de dados sensoriais fisiológicos como um recurso expressivo para interacções mediadas pela tecnologia. Iniciada a partir de uma discussão aprofundada sobre tecnologias de ponta e princípios de concepção estabelecidos relativamente a este tópico, depois aplicada a uma nova abordagem, juntamente com uma selecção de trabalhos práticos, para complementar esta. Defendemos a experiência estética, experimentando com representações abstractas. Contrariamente aos sistemas de Computação Afectiva predominantes, a intenção não é inferir ou classificar a emoção, mas sim criar novas oportunidades para uma rica troca gestual, não confinada ao domínio verbal. Dada a proposta preliminar de não representação, justificamos uma correspondência com estratégias modernas de Machine Learning e interacção multimédia, aplicando uma abordagem iterativa e centrada no ser humano para melhorar a personalização sem o potencial emocional comprometedor do gesto corporal. Nos casos em que estudos anteriores demonstraram com sucesso conceitos de design fortes através de fabricações inovadoras, estes limitam-se tipicamente a simples mapeamentos lineares, um-para-um, e muitas vezes negligenciam ambientes multi-utilizadores; com este trabalho, prevemos um potencial alargado. Nos nossos casos de utilização, adoptamos arquitecturas de redes neurais para gerar biofeedback altamente granular a partir de dados de entrada de baixa dimensão. Apresentamos as seguintes provas de conceitos: Breathing Correspondence, um sistema de biofeedback wearable inspirado nos princípios de design somaestético; Latent Steps, um modelo autoencoder em tempo real para representar experiências corporais a partir de dados de sensores, concebido para desempenho de dança; e Anti-Social Distancing Ensemble, uma instalação para intervenções no espaço público, analisando a distância física para gerar uma paisagem sonora colectiva. Os principais resultados são extraídos dos relatórios individuais, para formular um quadro técnico e teórico alargado para expandir sobre este tópico. Os projectos têm como primeiro objectivo abraçar algumas perspectivas alternativas às que já estão estabelecidas no âmbito da investigação da Computação Afectiva. A partir daqui, estes conceitos evoluem mais profundamente, fazendo a ponte entre as teorias das práticas criativas e técnicas contemporâneas com o avanço das tecnologias biomédicas

    Mixing Methods: Practical Insights from the Humanities in the Digital Age

    Get PDF
    The digital transformation is accompanied by two simultaneous processes: digital humanities challenging the humanities, their theories, methodologies and disciplinary identities, and pushing computer science to get involved in new fields. But how can qualitative and quantitative methods be usefully combined in one research project? What are the theoretical and methodological principles across all disciplinary digital approaches? This volume focusses on driving innovation and conceptualising the humanities in the 21st century. Building on the results of 10 research projects, it serves as a useful tool for designing cutting-edge research that goes beyond conventional strategies
    corecore