Small Language Models Improve Giants by Rewriting Their Outputs

Large language models (LLMs) have demonstrated impressive few-shot learning capabilities, but they often underperform compared to fine-tuned models on challenging tasks. Furthermore, their large size and restricted access only through APIs make task-specific fine-tuning impractical. Moreover, LLMs are sensitive to different aspects of prompts (e.g., the selection and order of demonstrations) and can thus require time-consuming prompt engineering. In this light, we propose a method to correct LLM outputs without relying on their weights. First, we generate a pool of candidates by few-shot prompting an LLM. Second, we refine the LLM-generated outputs using a smaller model, the LM-corrector (LMCor), which is trained to rank, combine and rewrite the candidates to produce the final target output. Our experiments demonstrate that even a small LMCor model (250M) substantially improves the few-shot performance of LLMs (62B) across diverse tasks. Moreover, we illustrate that the LMCor exhibits robustness against different prompts, thereby minimizing the need for extensive prompt engineering. Finally, we showcase that the LMCor can be seamlessly integrated with different LLMs at inference time, serving as a plug-and-play module to improve their performance

Linguistics and race: An interdisciplinary approach towards an LSA statement on race

In order to work towards greater racial justice within linguistics, the challenge remains for linguists to develop a cohesive theory of and approach to race and racial analysis in linguistics that is influenced by researchers of different methodological approaches and racial backgrounds. A formal LSA statement on race will provide linguistic researchers with a framework for studying race and will also serve as a method of intellectual and social inclusion in linguistics. We draw on interdisciplinary expertise in related fields, including psychology, sociology, anthropology, education, and ethnic studies, to examine how scholars from neighboring disciplines have formally conceptualized and dealt with race and racial classification strategies. Points of convergence as well as divergence are articulated, drawing insights that may advance work related to race within and beyond linguistics

Discussion about Visual Dependence in Balance Control: European Society for Clinical Evaluation of Balance Disorders

To access publisher's full text version of this article, please click on the hyperlink in Additional Links field or click on the hyperlink at the top of the page marked FilesThe executive committee of the European Society for the clinical evaluation of balance disorders meets annually to address equilibrium problems that are not well understood. This is a review paper on discussions in the latest meeting we held. MATERIALS AND METHODS: Seeing patients with vestibular disorders who end up depending on visual information as part of their compensation process is a common clinical occurrence. However, this "visual dependence" can generate symptoms, which include nausea, sensations of imbalance, and anxiety. It is unclear how this develops, as symptoms can be widely variable from patient to patient. There are several triggering factors to this symptom set, and quantifying it in a given patient is extremely difficult Results: The committee agreed that the presence of this symptom set can be suggestive of vestibular pathology, but the pathology does not have to be present. As a result, there is no correlation between symptom severity and test results. CONCLUSION: Visual dependence can often be present in a patient, although little, if any, measurable pathology is present. It is important to emphasize that although we cannot accurately measure this with either standardized testing or pertinent questionnaires, "hypersensitive" patients have a genuine disease and their symptoms are not of psychiatric origin

Occupational advice for Patients undergoing Arthroplasty of the Lower limb: An intervention development and feasibility study (The OPAL Study)

Background Hip and knee replacements are regularly performed for patients who work. There is little evidence about these patients’ needs and the factors influencing their return to work. There is a paucity of guidance to help patients return to work after surgery and a need for structured occupational advice to enable them to return to work safely and effectively. Objective(s) To develop an occupational advice intervention to support early recovery to usual activities including work which is tailored to the requirements of patients undergoing hip and knee replacements. To test the acceptability, practicality and feasibility of this intervention within current care frameworks Design An intervention mapping (IM) approach was used to develop the intervention. The research methods employed were: rapid evidence synthesis; qualitative interviews with patients and stakeholders; prospective cohort study; survey of clinical practice; modified Delphi consensus process. The developed intervention was implemented and assessed during the final feasibility stage of the IM process. Setting Orthopaedic departments within NHS secondary care. Participants Patients in work, and intending to return to work following primary elective hip and knee replacement surgery; healthcare professionals and employers. Interventions Occupational advice intervention. Main outcome measures Development of an occupational advice intervention. Fidelity of the developed intervention when delivered in a clinical setting. Patient and clinician perspectives of the intervention. Preliminary assessments of intervention effectiveness and cost. Results A cohort study (154 patients), 110 stakeholder interviews, survey of practice (152 respondents) and evidence synthesis provided the necessary information to develop the intervention. The intervention included information resources, personalized return to work plan and co-ordination from the healthcare team to support the delivery of 13 patient and 20 staff performance objectives (POs). To support delivery, a range of tools (e.g. occupational checklists, patient workbooks, employer information), roles (e.g. return-to-work coordinator) and training resources were created. Feasibility was assessed in 21 of the 26 patients recruited from 3 NHS trusts. Adherence with the defined performance objectives was 75% for patient POs and 74% for staff POs. The intervention was generally well received although the short timeframe available for implementation and concurrent research evaluation led to some confusion amongst patients and those delivering the intervention regarding its purpose and the roles and responsibilities of key staff. Limitations Implementation and uptake of the intervention was not standardized and was limited by the study timeframe. Evaluation of the intervention involved a small number of patients which limited the ability to assess it. Conclusions The developed occupational advice intervention supports best practice. Evaluation demonstrated good rates of adherence against defined performance objectives. However, a number of operational and implementation issues require further attention Future work The intervention warrants a randomised controlled trial to assess its clinical and cost effectiveness to improve rates and timing of sustained return to work after surgery. This research should include the development of a robust implementation strategy to ensure adoption is sustained. Funding This project was funded by the NIHR Health Technology Assessment programme (project number 15/28/02) Trial Registrations International Standard Randomised Controlled Trials Number Trial ID: ISRCTN27426982 International prospective register of systematic reviews (PROSPERO) Registration: CRD4201604523

Community-based exercise program reduces risk factors for falls in 65- to 75-year-old women with osteoporosis: randomized controlled trial

BACKGROUND: Exercise programs improve balance, strength and agility in elderly people and thus may prevent falls. However, specific exercise programs that might be widely used in the community and that might be “prescribed” by physicians, especially for patients with osteoporosis, have not been evaluated. We conducted a randomized controlled trial of such a program designed specifically for women with osteoporosis. METHODS: We identified women 65 to 75 years of age in whom osteoporosis had been diagnosed by dual-energy X-ray absorptiometry in our hospital between 1996 and 2000 and who were not engaged in regular weekly programs of moderate or hard exercise. Women who agreed to participate were randomly assigned to participate in a twice-weekly exercise class or to not participate in the class. We measured baseline data and, 20 weeks later, changes in static balance (by dynamic posturography), dynamic balance (by a timed figure-eight run) and knee extension strength (by dynamometry). RESULTS: Of 93 women who began the trial, 80 completed it. Before adjustment for covariates, the intervention group tended to have greater, although nonsignificant, improvements in static balance (mean difference 4.8%, 95% confidence interval [CI] –1.3% to 11.0%), dynamic balance (mean difference 3.3%, 95% CI –1.7% to 8.4%) and knee extension strength (mean difference 7.8%, 95% CI –5.4% to 21.0%). Mean crude changes in the static balance score were –0.85 (95% CI –2.91 to 1.21) for the control group and 1.40 (95% CI –0.66 to 3.46) for the intervention group. Mean crude changes in figure-eight velocity (dynamic balance) were 0.08 (95% CI 0.02 to 0.14) m/s for the control group and 0.14 (95% CI 0.08 to 0.20) m/s for the intervention group. For knee extension strength, mean changes were –0.58 (95% CI –3.02 to 1.81) kg/m for the control group and 1.03 (95% CI –1.31 to 3.34) kg/m for the intervention group. After adjustment for age, physical activity and years of estrogen use, the improvement in dynamic balance was 4.9% greater for the intervention group than for the control group (p = 0.044). After adjustment for physical activity, cognitive status and number of fractures ever, the improvement in knee extension strength was 12.8% greater for the intervention group than for the control group (p = 0.047). The intervention group also had a 6.3% greater improvement in static balance after adjustment for rheumatoid arthritis and osteoarthritis, but this difference was not significant (p = 0.06). INTERPRETATION: Relative to controls, participants in the exercise program experienced improvements in dynamic balance and strength, both important determinants of risk for falls, particularly in older women with osteoporosis