Usability Evaluation of an Open Data Platform

Despite the rapid proliferation of open data platforms, the accessibility and ease of use of data portals is low. This factor prevents citizens and civil society organizations from exploiting open data for their goals. The poor usability of current generation of open data platforms could be attributed to the fact that these platforms were not designed for non-technical users. They are typically software products developed “by programmers for programmers or technical users”. Consequently, while reports about innovative use of open data by software developers and start-ups are common, there are very few reports about successful public use of open data to tackle concrete societal challenges. This paper provides the results and lessons learnt from the usability evaluation of the second alpha release of a next generation open data platform designed explicitly to support non-technical users. A scenario involving a transportation challenge in Dublin City was employed as the context for the evaluation of the platform. Findings provide some empirical basis for identifying important user interface design considerations, patterns for highly usable open data platforms and considerations for open data policy

StudMap 3.0 : an interoperable web-based platform for geospatial data offers in academic life

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesGeographic Information Systems has now entered the realm of web and yields for feasible solutions to balance the technology offers with the users’ needs to share, access and explore the massive amounts of geodata available. Challenges occur when moving forward from old 2D platforms towards innovative and integrated webGIS systems that align functionality with the necessity to grant a complete understanding of the surrounding reality. 3D space responds to this but, however, stands only at the beginning of its era and cannot yet reach the development of 2D web integration. Research is now aiming at possible webGIS solutions to adapt to the special structure imposed by 3D data. In this context, this thesis focuses on designing an architecture for 2D and 3D geospatial data integration on a student-oriented web platform. This concept was further delivered and validated through a real case scenario – Studmap 3.0, a webGIS platform to serve the students of the University of Muenster in their academical life. The portal currently grants availability of geospatial data and web services of regional interest in a smart GIS environment that allows access and comparison of official services with own data. The implementation of Studmap 3.0 aided in the continuous improvement of the proposed architecture model and developed under a design science research cycle that reached its end once the final approval of its users was attained via a usability evaluation. Final strengths and drawbacks of the proposed architecture were ultimately identified together with an expert usability evaluation and a lab-based usability test of the resulting portal interface suitability for academic use. The results fall under the acceptable range with an 83.75 score for the System Usability Scale standardized questions when addressed to experts and a score of 83.87 when addressed to students. For the open-ended questions, the interface received an overall positive critique. A summary of future participants’ opinion on the benefits, drawbacks and proposed improvements was also delivered. Peers interested in similar concepts can use both this model and its final remarks as a reference for their work

SoK: Cryptographically Protected Database Search

Protected database search systems cryptographically isolate the roles of reading from, writing to, and administering the database. This separation limits unnecessary administrator access and protects data in the case of system breaches. Since protected search was introduced in 2000, the area has grown rapidly; systems are offered by academia, start-ups, and established companies. However, there is no best protected search system or set of techniques. Design of such systems is a balancing act between security, functionality, performance, and usability. This challenge is made more difficult by ongoing database specialization, as some users will want the functionality of SQL, NoSQL, or NewSQL databases. This database evolution will continue, and the protected search community should be able to quickly provide functionality consistent with newly invented databases. At the same time, the community must accurately and clearly characterize the tradeoffs between different approaches. To address these challenges, we provide the following contributions: 1) An identification of the important primitive operations across database paradigms. We find there are a small number of base operations that can be used and combined to support a large number of database paradigms. 2) An evaluation of the current state of protected search systems in implementing these base operations. This evaluation describes the main approaches and tradeoffs for each base operation. Furthermore, it puts protected search in the context of unprotected search, identifying key gaps in functionality. 3) An analysis of attacks against protected search for different base queries. 4) A roadmap and tools for transforming a protected search system into a protected database, including an open-source performance evaluation platform and initial user opinions of protected search.Comment: 20 pages, to appear to IEEE Security and Privac

The ABCD of usability testing

We introduce a methodology for tracking and auditing feedback, errors and suggestions for software packages. This short paper describes how we innovate on the evaluation mechanism, introducing an (Antecedent, Barrier, Consequence and Development) ABCD form, embedded within an eParticipation platform to enable end users to easily report on any usability issues. This methodology will be utilised to improve the STEP cloud eParticipation platform (part of the current STEP Horizon2020 project http://step4youth.eu. The platform is currently being piloted in real life contexts, with the participation of public authorities that are integrating the eParticipation platform into their regular decision-making practices. The project is involving young people, through engagement and motivation strategies and giving them a voice in Environmental decision making at the local level. The pilot evaluation aims to demonstrate how open engagement needs to be embedded within public sector processes and the usability methodology reported here will help to identify the key barriers for wide scale deployment of the platform

BlogForever D5.2: Implementation of Case Studies

This document presents the internal and external testing results for the BlogForever case studies. The evaluation of the BlogForever implementation process is tabulated under the most relevant themes and aspects obtained within the testing processes. The case studies provide relevant feedback for the sustainability of the platform in terms of potential users’ needs and relevant information on the possible long term impact

Evaluating usability of cross-platform smartphone applications

The computing power of smartphones is increasing as time goes. However, the proliferation of multiple different types of operating platforms affected interoperable smartphone applications development. Thus, the cross-platform development tools are coined. Literature showed that smartphone applications developed with the native platforms have better user experience than the cross-platform counterparts. However, comparative evaluation of usability of cross-platform applications on the deployment platforms is not studied yet. In this work, we evaluated usability of a crossword puzzle developed with PhoneGap on Android, Windows Phone, and BlackBerry. The evaluation was conducted focusing on the developer's adaptation effort to native platforms and the end users. Thus, we observed that usability of the cross-platform crossword puzzle is unaffected on the respective native platforms and the SDKs require only minimal configuration effort. In addition, we observed the prospect of HTML5 and related web technologies as our future work towards evaluating and enhancing usability in composing REST-based services for smartphone applications

From usability to secure computing and back again

Secure multi-party computation (MPC) allows multiple parties to jointly compute the output of a function while preserving the privacy of any individual party’s inputs to that function. As MPC protocols transition from research prototypes to realworld applications, the usability of MPC-enabled applications is increasingly critical to their successful deployment and widespread adoption. Our Web-MPC platform, designed with a focus on usability, has been deployed for privacy-preserving data aggregation initiatives with the City of Boston and the Greater Boston Chamber of Commerce. After building and deploying an initial version of the platform, we conducted a heuristic evaluation to identify usability improvements and implemented corresponding application enhancements. However, it is difficult to gauge the effectiveness of these changes within the context of real-world deployments using traditional web analytics tools without compromising the security guarantees of the platform. This work consists of two contributions that address this challenge: (1) the Web-MPC platform has been extended with the capability to collect web analytics using existing MPC protocols, and (2) as a test of this feature and a way to inform future work, this capability has been leveraged to conduct a usability study comparing the two versions ofWeb-MPC. While many efforts have focused on ways to enhance the usability of privacy-preserving technologies, this study serves as a model for using a privacy-preserving data-driven approach to evaluate and enhance the usability of privacy-preserving websites and applications deployed in realworld scenarios. Data collected in this study yields insights into the relationship between usability and security; these can help inform future implementations of MPC solutions.Published versio

A web-based platform for people with memory problems and their caregivers (CAREGIVERSPRO-MMD): Mixed-methods evaluation of usability

Background: The increasing number of people with dementia (PwD) drives research exploring Web-based support interventions to provide effective care for larger populations. In this concept, a Web-based platform (CAREGIVERSPRO-MMD, 620911) was designed to (1) improve the quality of life for PwD, (2) reduce caregiver burden, (3) reduce the financial costs for care, and (4) reduce administration time for health and social care professionals. Objective: The objective of this study was to evaluate the usability and usefulness of CAREGIVERSPRO-MMD platform for PwD or mild cognitive impairment (MCI), informal caregivers, and health and social care professionals with respect to a wider strategy followed by the project to enhance the user-centered approach. A secondary aim of the study was to collect recommendations to improve the platform before the future pilot study. Methods: A mixed methods design was employed for recruiting PwD or MCI (N=24), informal caregivers (N=24), and professionals (N=10). Participants were asked to rate their satisfaction, the perceived usefulness, and ease of use of each function of the platform. Qualitative questions about the improvement of the platform were asked when participants provided low scores for a function. Testing occurred at baseline and 1 week after participants used the platform. The dropout rate from baseline to the follow-up was approximately 10% (6/58). Results: After 1 week of platform use, the system was useful for 90% (20.75/23) of the caregivers and for 89% (5.36/6) of the professionals. When users responded to more than 1 question per platform function, the mean of satisfied users per function was calculated. These user groups also provided positive evaluations for the ease of use (caregivers: 82%, 18.75/23; professionals: 97%, 5.82/6) and their satisfaction with the platform (caregivers: 79%, 18.08/23; professionals: 73%, 4.36/6). Ratings from PwD were lower than the other groups for usefulness (57%, 13/23), ease of use (41%, 9.4/23), and overall satisfaction (47%, 11/23) with the platform (