Bayes model for assessing the reading difficulty of English text for English education in Jordan

Predicting the reading difficulty level of English texts is a critical process for second language education and assessment. Reading difficulty level is concerned with the problem of matching a reader’s proficiency and the appropriate text. The reading difficulty level or readability assessment is the process for predicting the reading grade level required from an input text or document, which corresponds to the reader and to the materials. Students in Jordan at their academic levels find obstacles in finding relevant readable data for any subject at their levels. This paper is intended to introduce a model that foretells the reading difficulty level of a given text in terms of a student's ability to read and understand English as a non-native English speaker in Jordanian schools. In this paper, Jordanian students were classified into four categories according to their knowledge of English. The prediction of the reading difficulty level is achieved by using a modern statistical model that is situated on the Bayes model. The model compares the given text with some standard predefined text that strongly reflects the ability to read and understand English text. The accuracy of the proposed model was tested using the hold-out method. The overall prediction accuracy was 75.9%

Examining the Part-of-speech Features in Assessing the Readability of Vietnamese Texts

The readability of the text plays a very important role in selecting appropriate materials for the level of the reader. Text readability in Vietnamese language has received a lot of attention in recent years, however, studies have mainly been limited to simple statistics at the level of a sentence length, word length, etc. In this article, we investigate the role of word-level grammatical characteristics in assessing the difficulty of texts in Vietnamese textbooks. We have used machine learning models (for instance, Decision Tree, K-nearest neighbor, Support Vector Machines, etc.) to evaluate the accuracy of classifying texts according to readability, using grammatical features in word level along with other statistical characteristics. Empirical results show that the presence of POS-level characteristics increases the accuracy of the classification by 2-4%

A meta-analysis of second language cloze testing research

Numerous studies have accumulated over the last forty years in which second language testing researchers have examined various cloze test characteristics, including what cloze tests are measuring, under what conditions, and for what type of learners. In order to understand the accumulated knowledge of cloze procedures in second language testing research, the following research questions were posed: 1. What are the test and learner characteristics in the primary cloze test studies to date? 2. How does the deletion pattern affect the reliability of the cloze results? 3. How do various scoring methods (exact, acceptable, and clozentropy) affect the reliability of the cloze tests? 4. What is the strength of relationship between acceptable and exact scoring methods

Affection of the part of speech elements in Vietnamese text readability

While English text readability has been studied for a long time, investigating text readability in Vietnamese, a low-resourced language with poorresearch technologies and data sets questionable of international importance, is at its beginnings. In readability research, it is generally the “word” that has been carefully investigated. Based on the comparison of elements affecting readability of the “word” unit in English, we determine the parts of speech (POS) in Vietnamese that were found to influence Vietnamese text readability. In this study, prose texts in Vietnamese textbooks at different difficulty level were taken as the data to find out the POS frequencies and their correlations. In terms of frequency, our findings can initially assist users when editing documents, reforming textbooks, and question banks for native Vietnamese in general and foreigners in particular. Even more important, with these findings we can identify those linguistic elements that are considered the “potential” POS affecting Vietnamese text readability, and make grounds for further studies

BasahaCorpus: An Expanded Linguistic Resource for Readability Assessment in Central Philippine Languages

Current research on automatic readability assessment (ARA) has focused on improving the performance of models in high-resource languages such as English. In this work, we introduce and release BasahaCorpus as part of an initiative aimed at expanding available corpora and baseline models for readability assessment in lower resource languages in the Philippines. We compiled a corpus of short fictional narratives written in Hiligaynon, Minasbate, Karay-a, and Rinconada -- languages belonging to the Central Philippine family tree subgroup -- to train ARA models using surface-level, syllable-pattern, and n-gram overlap features. We also propose a new hierarchical cross-lingual modeling approach that takes advantage of a language's placement in the family tree to increase the amount of available training data. Our study yields encouraging results that support previous work showcasing the efficacy of cross-lingual models in low-resource settings, as well as similarities in highly informative linguistic features for mutually intelligible languages.Comment: Final camera-ready paper for EMNLP 2023 (Main

Reading Difficulty Levels of Selected Articles in the Journal of Research in Music Education and Journal of Historical Research in Music Education

abstract: Readability formulas are used widely in education, and increasingly in business and government. Over 30 years of research on more than 200 readability formulas has demonstrated moderate to strong predictive correlations with reading comprehension. In this study, five well-known readability formulas correlated highly with each other when applied to selected recent historical articles (N = 22) from two music education research journals. The mean level of difficulty (readability) for all 22 articles was grade 14.04, near the beginning of the second year of college. Since research shows that most people read below their highest completed school grade and also prefer easier materials, this is probably an appropriate level of difficulty for the presumptive readers of these two journals (i.e., holders of undergraduate and graduate degrees). Professors, librarians, and others responsible for guiding students toward reading material at appropriate levels of readability could benefit from these results.Abstract in Chines

Readability of pediatric health materials for preventive dental care

BACKGROUND: This study examined the content and general readability of pediatric oral health education materials for parents of young children. METHODS: Twenty-seven pediatric oral health pamphlets or brochures from commercial, government, industry, and private nonprofit sources were analyzed for general readability ("usability") according to several parameters: readability, (Flesch-Kincaid grade level, Flesch Reading Ease, and SMOG grade level); thoroughness, (inclusion of topics important to young childrens' oral health); textual framework (frequency of complex phrases, use of pictures, diagrams, and bulleted text within materials); and terminology (frequency of difficult words and dental jargon). RESULTS: Readability of the written texts ranged from 2(nd )to 9(th )grade. The average Flesch-Kincaid grade level for government publications was equivalent to a grade 4 reading level (4.73, range, 2.4 – 6.6); F-K grade levels for commercial publications averaged 8.1 (range, 6.9 – 8.9); and industry published materials read at an average Flesch-Kincaid grade level of 7.4 (range, 4.7 – 9.3). SMOG readability analysis, based on a count of polysyllabic words, consistently rated materials 2 to 3 grade levels higher than did the Flesch-Kincaid analysis. Government sources were significantly lower compared to commercial and industry sources for Flesch-Kincaid grade level and SMOG readability analysis. Content analysis found materials from commercial and industry sources more complex than government-sponsored publications, whereas commercial sources were more thorough in coverage of pediatric oral health topics. Different materials frequently contained conflicting information. CONCLUSION: Pediatric oral health care materials are readily available, yet their quality and readability vary widely. In general, government publications are more readable than their commercial and industry counterparts. The criteria for usability and results of the analyses presented in this article can be used by consumers of dental educational materials to ensure that their choices are well-suited to their specific patient population

Evaluating four readability formulas for Afrikaans

For almost a hundred years now, readability formulas have been used to measure how difficult it is to comprehend a given text. To date, four readability formulas have been developed for Afrikaans. Two such formulas were published by Van Rooyen (1986), one formula by McDermid Heyns (2007) and one formula by McKellar (2008). In our quantitative study the validity of these four formulas was tested. We selected 10 texts written in Afrikaans – five articles from a popular magazine and five documents used in government communications. All characteristics included in the four readability formulas were first measured for each text. We then developed five different cloze tests for each text to assess actual text comprehension. Thereafter, 149 Afrikaans-speaking participants with varying levels of education each completed a set of two of the resulting 50 cloze tests. On comparing the data on text characteristics to the cloze test scores from the participants, the accuracy of the predictions from the four existing formulas for Afrikaans could be determined. Both Van Rooyen formulas produced readability scores that were not significantly correlated with actual comprehension scores as measured with the cloze tests. For the McKellar formula, however, this correlation was significant and for the McDermid Heyns formula the correlation with the cloze test scores almost reached significance. From the outcomes of each of these last two formulas, about 40% of the variance in cloze scores could be predicted. Readability predictions based only on the average number of characters per word, however, performed considerably better: about 65% of the variance in the cloze scores could be predicted just from the average number of characters per word.Keywords: Afrikaans, cloze test, readability formula, text comprehension, text difficult

National Survey of Patients’ Bill of Rights Statutes

BACKGROUND Despite vigorous national debate between 1999–2001 the federal patients' bill of rights (PBOR) was not enacted. However, states have enacted legislation and the Joint Commission defined an accreditation standard to present patients with their rights. Because such initiatives can be undermined by overly complex language, we surveyed the readability of hospital PBOR documents as well as texts mandated by state law. METHODS State Web sites and codes were searched to identify PBOR statutes for general patient populations. The rights addressed were compared with the 12 themes presented in the American Hospital Association's (AHA) PBOR text of 2002. In addition, we obtained PBOR texts from a sample of hospitals in each state. Readability was evaluated using Prose, a software program which reports an average of eight readability formulas RESULTS Of 23 states with a PBOR statute for the general public, all establish a grievance policy, four protect a private right of action, and one stipulates fines for violations. These laws address an average of 7.4 of the 12 AHA themes. Nine states' statutes specify PBOR text for distribution to patients. These documents have an average readability of 15th grade (range, 11.6, New York, to 17.0, Minnesota). PBOR documents from 240 US hospitals have an average readability of 14th grade (range, 8.2 to 17.0) CONCLUSIONS While the average U.S. adult reads at an 8th grade reading level, an advanced college reading level is routinely required to read PBOR documents. Patients are not likely to learn about their rights from documents they cannot read.Pfizer Clear Health Communication Initiativ