A Review of the Open Educational Resources (OER) Movement: Achievements, Challenges, and New Opportunities

Examines the state of the foundation's efforts to improve educational opportunities worldwide through universal access to and use of high-quality academic content

TectoMT – a deep-­linguistic core of the combined Chimera MT system

Chimera is a machine translation system that combines the TectoMT deep-linguistic core with phrase-based MT system Moses. For English–Czech pair it also uses the Depfix post-correction system. All the components run on Unix/Linux platform and are open source (available from Perl repository CPAN and the LINDAT/CLARIN repository). The main website is https://ufal.mff.cuni.cz/tectomt. The development is currently supported by the QTLeap 7th FP project (http://qtleap.eu)

TRE-FX:Delivering a federated network of trusted research environments to enable safe data analytics

Trusted Research Environments (TREs) are secure locations in which data are placed for researchers to analyse. TREs host administrative data, hospital data or any other data that needs to remain securely isolated, but it is hard for a researcher to perform an analysis across multiple TREs, requesting and gathering the outputs from each one. This is a common problem in the UK's devolved healthcare system of geographical and governance boundaries. There are different ways of implementing TREs and the analysis tools that use them. A solution must be straightforward for existing, independent systems to adopt, must cope with the variety of system implementations, and must work within the "Five Safes" framework that enables data services to provide safe research access to data. TRE-FX assembled leading infrastructure researchers, analysis tool makers, TRE providers and public engagement specialists to streamline the exchange of data requests and results. The "Five Safes RO-Crate" standard packages up (Crates) the Objects needed for Research requests and results with the information needed for the tools and TRE providers to ensure that the crates are reviewed and processed according to Five Safes principles. TRE-FX showed how this works using software components and an end-to-end demonstrator implemented by a TRE in Wales. Two other TREs, in Scotland and England, are preparing to follow suit. Two analysis tool providers (Bitfount and DataSHIELD) modified their systems to use the RO-Crates. The next step is practical implementation as part of the HDR UK programme. Two large European projects will develop the approach further. TRE-FX shows that it is possible to streamline how analysis tools access multiple TREs while enabling the TREs to ensure that the access is safe. The approach scales as more TREs are added and can be adopted by established systems. Researchers will then be able to perform an analysis across multiple TREs much more easily, widening the scope of their research and making more effective use of the UK's data. If we had had this for COVID-19 data analysis, it would have super-charged researchers to be able to quickly answer pressing questions across the UK. This work was funded by UK Research & Innovation [Grant Number MC_PC_23007] as part of Phase 1 of the DARE UK (Data and Analytics Research Environments UK) programme, delivered in partnership with Health Data Research UK (HDR UK) and Administrative Data Research UK (ADR UK)

Improving fairness in machine learning systems: What do industry practitioners need?

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the development of algorithmic tools to assess and mitigate such unfairness. If these tools are to have a positive impact on industry practice, however, it is crucial that their design be informed by an understanding of real-world needs. Through 35 semi-structured interviews and an anonymous survey of 267 ML practitioners, we conduct the first systematic investigation of commercial product teams' challenges and needs for support in developing fairer ML systems. We identify areas of alignment and disconnect between the challenges faced by industry practitioners and solutions proposed in the fair ML research literature. Based on these findings, we highlight directions for future ML and HCI research that will better address industry practitioners' needs.Comment: To appear in the 2019 ACM CHI Conference on Human Factors in Computing Systems (CHI 2019

Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI

A key challenge in professional fact-checking is its limited scalability in relation to the magnitude of false information. While many Natural Language Processing (NLP) tools have been proposed to enhance fact-checking efficiency and scalability, both academic research and fact-checking organizations report limited adoption of such tooling due to insufficient alignment with fact-checker practices, values, and needs. To address this gap, we investigate a co-design method, Matchmaking for AI, which facilitates fact-checkers, designers, and NLP researchers to collaboratively discover what fact-checker needs should be addressed by technology and how. Our co-design sessions with 22 professional fact-checkers yielded a set of 11 novel design ideas. They assist in information searching, processing, and writing tasks for efficient and personalized fact-checking; help fact-checkers proactively prepare for future misinformation; monitor their potential biases; and support internal organization collaboration. Our work offers implications for human-centered fact-checking research and practice and AI co-design research

Where can teens find health information? A survey of web portals designed for teen health information seekers

The Web is an important source for health information for most teens with access to the Web (Gray et al, 2005a; Kaiser, 2001). While teens are likely to turn to the Web for health information, research has indicated that their skills in locating, evaluating and using health information are weak (Hansen et al, 2003; Skinner et al, 2003, Gray et al, 2005b). This behaviour suggests that the targeted approach to finding health information that is offered by web portals would be useful to teens. A web portal is the entry point for information on the Web. It is the front end, and often the filter, that users must pass through in order to link to actual content. Unlike general search engines such as Google, content that is linked to a portal has usually been pre-selected and even created by the organization that hosts the portal, assuring some level of quality control. The underlying architecture of the portal is structured and thus offers an organized approach to exploring a specific health topic. This paper reports on an environmental scan of the Web, the purpose of which was to identify and describe portals to general health information, in English and French, designed specifically for teens. It answers two key questions. First of all, what portals exist? And secondly, what are their characteristics? The portals were analyzed through the lens of four attributes: Usability, interactivity, reliability and findability. Usability is a term that incorporates concepts of navigation, layout and design, clarity of concept and purpose, underlying architecture, in-site assistance and, for web content with text, readability. Interactivity relates to the type of interactions and level of engagement required by the user to access health information on a portal. Interaction can come in the form of a game, a quiz, a creative experience, or a communication tool such as an instant messaging board, a forum or blog. Reliability reflects the traditional values of accuracy, currency, credibility and bias, and in the web-based world, durabililty. Findability is simply the ease with which a portal can be discovered by a searcher using the search engine that is most commonly associated with the Web by young people - Google - and using terms related to teen health. Findability is an important consideration since the majority of teens begin their search for health information using search engines (CIBER, 2008; Hansen et al, 2003). The content linked to by the portals was not evaluated, nor was the portals’ efficacy as a health intervention. Teens looking for health information on the Web in English have a wide range of choices available but French-language portals are much rarer and harder to find. A majority of the portals found and reviewed originated from hospitals, associations specializing in a particular disease, and governmental agencies, suggesting that portals for teens on health related topics are generally reliable. However, only a handful of the portals reviewed were easy to find, suggesting that valuable resources for teens remain buried in the Web

Preemie Care: A Co-designed Digital Tool to Improve Communication Between Health Personnel and Parents of Preterm Infants

Communication between parents and health providers is essential in the Neonatal Intensive Care Unit (NICU) settings to ensure both parties collaborate in infant care. However, in most NICUs, the interaction between parents and NICU staff is strained, thus hindering communication. These communication challenges are due to language, medical vocabulary and cultural barriers between NICU staff and mothers. These challenges create communication gaps, which disempower parents and frustrate health staff. To bridge NICU communication gaps, several researchers have deployed digital health interventions. However, although the existing NICU technologies have effectively improved NICU communication, most parents struggle to interact with these interventions because they do not fit parents' technical and literacy capabilities. These design gaps arise because parents were not fully included in the design process of the existing NICU digital interventions. In this research, we sought to address the communication gaps within the NICU environment by employing a co-design approach to develop a digital intervention that supports infant care journey in a low-resource NICU setting. The co-design process included six research phases that spanned over 32 months. We engaged mothers of premature infants and NICU staff throughout this process while focusing on identifying how best to involve NICU stakeholders in a codesign process to ensure that the final intervention was usable and useful. The co-design process led to the development of MoM connect workflow which was disqualified by mothers and NICU staff because it did not meet mothers' needs. We further engaged NICU stakeholders in the co-design process and agreed on developing Preemie Care (PMC) system, an educational resource tool that disseminated digital health videos in multiple languages and through multiple technologies to empower parents and NICU staff to work together and advocate for their preterm infants. PMC system was deployed at Groote Schuur NICU for eight months where we interacted with users and monitored it usage logs to evaluate its efficacy. Our empirical evidence revealed that access to health information improved parents and their social networks medical vocabulary, thus empowering them to engage with their peers and NICU staff. We also learned that sharing health information in multiple languages does not resolve the language barriers among multilingual NICU parents. Instead, our results show that bilingual parents prefer accessing health information in multiple languages to improve their medical vocabulary and understandability, thus empowering them to engage in their infants' health care and decision-making. Hence, this research provides the design mechanisms for a NICU intervention to bridge communication gaps between bilingual parents and NICU staff. This work contributes to the field of Human-Computer Interaction(HCI) by highlighting the ethical and methodological considerations to engage NICU stakeholders interacting in a sensitive NICU setting in a collaborative co-design process. We also contribute to HCI knowledge by providing design mechanisms for a NICU intervention meant to bridge communication gaps between bilingual parents and NICU staff in a low-resource setting and design features of a digital NICU intervention that enhance family-centred care in the NICU setting