What makes for effective feedback: staff and student perspectives

Since the early 2010s the literature has shifted to view feedback as a process that students do where they make sense of information about work they have done, and use it to improve the quality of their subsequent work. In this view, effective feedback needs to demonstrate effects. However, it is unclear if educators and students share this understanding of feedback. This paper reports a qualitative investigation of what educators and students think the purpose of feedback is, and what they think makes feedback effective. We administered a survey on feedback that was completed by 406 staff and 4514 students from two Australian universities. Inductive thematic analysis was conducted on data from a sample of 323 staff with assessment responsibilities and 400 students. Staff and students largely thought the purpose of feedback was improvement. With respect to what makes feedback effective, staff mostly discussed feedback design matters like timing, modalities and connected tasks. In contrast, students mostly wrote that high-quality feedback comments make feedback effective – especially comments that are usable, detailed, considerate of affect and personalised to the student’s own work. This study may assist researchers, educators and academic developers in refocusing their efforts in improving feedbac

Clinical indicators for common paediatric conditions: processes, provenance and products of the CareTrack Kids study

BACKGROUND:In order to determine the extent to which care delivered to children is appropriate (in line with evidence-based care and/or clinical practice guidelines (CPGs)) in Australia, we developed a set of clinical indicators for 21 common paediatric medical conditions for use across a range of primary, secondary and tertiary healthcare practice facilities. METHODS:Clinical indicators were extracted from recommendations found through systematic searches of national and international guidelines, and formatted with explicit criteria for inclusion, exclusion, time frame and setting. Experts reviewed the indicators using a multi-round modified Delphi process and collaborative online wiki to develop consensus on what constituted appropriate care. RESULTS:From 121 clinical practice guidelines, 1098 recommendations were used to draft 451 proposed appropriateness indicators. In total, 61 experts (n = 24 internal reviewers, n = 37 external reviewers) reviewed these indicators over 40 weeks. A final set of 234 indicators resulted, from which 597 indicator items were derived suitable for medical record audit. Most indicator items were geared towards capturing information about under-use in healthcare (n = 551, 92%) across emergency department (n = 457, 77%), hospital (n = 450, 75%) and general practice (n = 434, 73%) healthcare facilities, and based on consensus level recommendations (n = 451, 76%). The main reason for rejecting indicators was 'feasibility' (likely to be able to be used for determining compliance with 'appropriate care' from medical record audit). CONCLUSION:A set of indicators was developed for the appropriateness of care for 21 paediatric conditions. We describe the processes (methods), provenance (origins and evolution of indicators) and products (indicator characteristics) of creating clinical indicators within the context of Australian healthcare settings. Developing consensus on clinical appropriateness indicators using a Delphi approach and collaborative online wiki has methodological utility. The final indicator set can be used by clinicians and organisations to measure and reflect on their own practice.Louise K. Wiles, Tamara D. Hooper, Peter D. Hibbert, Charlotte Molloy, Les White ... Helena Williams ... et al

Constrained Markovian dynamics of random graphs

We introduce a statistical mechanics formalism for the study of constrained graph evolution as a Markovian stochastic process, in analogy with that available for spin systems, deriving its basic properties and highlighting the role of the `mobility' (the number of allowed moves for any given graph). As an application of the general theory we analyze the properties of degree-preserving Markov chains based on elementary edge switchings. We give an exact yet simple formula for the mobility in terms of the graph's adjacency matrix and its spectrum. This formula allows us to define acceptance probabilities for edge switchings, such that the Markov chains become controlled Glauber-type detailed balance processes, designed to evolve to any required invariant measure (representing the asymptotic frequencies with which the allowed graphs are visited during the process). As a corollary we also derive a condition in terms of simple degree statistics, sufficient to guarantee that, in the limit where the number of nodes diverges, even for state-independent acceptance probabilities of proposed moves the invariant measure of the process will be uniform. We test our theory on synthetic graphs and on realistic larger graphs as studied in cellular biology.Comment: 28 pages, 6 figure

Near Mission Operations: Demonstrated Strengths and Weaknesses of a Faster, Better, Cheaper Program

The Near Earth Asteroid Rendezvous (NEAR) Mission was successfully launched on February 17, 1996 from Cape Canaveral Air Force Base. A small mission operations team of 8 to 12 people have controlled the NEAR spacecraft from the JHU/APL campus in Maryland since then, using Deep Space Network ground stations and NASCOM circuitry, a Commercial Off The Shelf (COTS) ground computer system, and a unique streamlined concept of operations. The primary science data gathering portion of the mission will not begin until rendezvous with the asteroid EROS in January 1999, but 3 exciting bonus science observations have already occurred: visible images of the Earth\u27s Moon were taken on mission day 4, passive momentum dumping was demonstrated using solar pressure and small attitude offsets held for long periods of time, and visible images of the comet Hyakutake were taken from 1 million kilometers range on mission day 37. These bonus science observations were made possible by the less-formal concept of operations coupled with a very experienced senior group of people running operations. In the arena of mission operations, the mantra faster, better, cheaper should be discarded and replaced with faster, cheaper, increased risk . No significant failures have occurred in any flight or ground subsystem, and that is fortunate because short-term operational risk was uncomfortably high in the area of contingency readiness. Contingency readiness was limited in scope due to lack of schedule time ( faster ) and man-hours ( cheaper ). No long-term operational risks are expected, but there was a sobering amount of team cross training and software tool development which remained unfinished 30 days after launch. The NEAR mission three year cruise period provides ample time to complete this work: early mission experience with simultaneous operations and software tool development will be discussed