Educational Assessment in Emerging Areas of Design: Toward the Development of a Systematic Framework Based on a Study of Rubrics

This paper presents a formative study that investigates the perceived effectiveness of rubrics as assessment tools by communication and industrial design educators and first year design students in the context of a design studio. The project is motivated by the increasing challenge of assessing subjective and intangible attributes that are associated with the teaching of emerging areas in design, and society’s growing need for measurable results. The goal of this project is to shed light on the perceived successes and failures of a specific assessment tool, known as a rubric, and use this information to improve students’ and educators’ understanding, value, and use of assessment tools. Based on the characteristics of the emerging design landscape, this paper argues the importance of assessments and the need for their improvement. It explains the construction of three assessment forms that are based on successful models used in other disciplines. This paper describes how the forms were used throughout the semester to provide an overview of course objectives and assess individual projects. It explains the contents of a questionnaire and describes how it was used at the end of the semester to evaluate students’ perceptions of the assessments forms. Feedback gained from the instructors indicated that rubrics were not more efficient than other forms of assessment but did aid the assessment of intangibles and did not reduce students’ creativity. The results of the questionnaire showed that students perceived the attributes of rubrics more positively than other forms of assessment but still favoured handwritten comments. These findings informed the proposal of a set of considerations that should be taken into account when creating assessment forms for use in classrooms that focus on emerging areas of design. They describe the importance of personal comments, clear terminology, a planned introduction of the tool, and an open-mind. Keywords: Rubrics; Assessment; Evaluation; Pedagogy; Education; Learning; Feedback.</p

Describing typeforms: a designer's response

The paper sets out an overview of a pragmatic research investigation initiated within a doctoral enquiry, and which continues to inform design practice and pedagogy. Located within the fields of typography and information design, and very much concerned with design history, enquiry emphasized exploration of alternative design research methodologies in the production of a design outcome loaded with pedagogical ambition. The issue being addressed within the investigation was the limited scope of existing typeface classificatory systems to adequately describe the diversity of forms represented within current type design practice and thus, recent acquisitions to an established teaching collection in London. Addressing this issue unexpectedly came to utilize the researcher’s own design practice as a methodology for managing emergent enquiry, and for organizing and generating new knowledge through the employment of visual information management methods. A primary outcome of the enquiry was a new framework for the description of typeforms. This new framework will be described in terms of its operation, divergence from existing models and potential for application

Information scraps: how and why information eludes our personal information management tools

In this paper we describe information scraps -- a class of personal information whose content is scribbled on Post-it notes, scrawled on corners of random sheets of paper, buried inside the bodies of e-mail messages sent to ourselves, or typed haphazardly into text files. Information scraps hold our great ideas, sketches, notes, reminders, driving directions, and even our poetry. We define information scraps to be the body of personal information that is held outside of its natural or We have much still to learn about these loose forms of information capture. Why are they so often held outside of our traditional PIM locations and instead on Post-its or in text files? Why must we sometimes go around our traditional PIM applications to hold on to our scraps, such as by e-mailing ourselves? What are information scraps' role in the larger space of personal information management, and what do they uniquely offer that we find so appealing? If these unorganized bits truly indicate the failure of our PIM tools, how might we begin to build better tools? We have pursued these questions by undertaking a study of 27 knowledge workers. In our findings we describe information scraps from several angles: their content, their location, and the factors that lead to their use, which we identify as ease of capture, flexibility of content and organization, and avilability at the time of need. We also consider the personal emotive responses around scrap management. We present a set of design considerations that we have derived from the analysis of our study results. We present our work on an application platform, jourknow, to test some of these design and usability findings

Persistent topology for natural data analysis - A survey

Natural data offer a hard challenge to data analysis. One set of tools is being developed by several teams to face this difficult task: Persistent topology. After a brief introduction to this theory, some applications to the analysis and classification of cells, lesions, music pieces, gait, oil and gas reservoirs, cyclones, galaxies, bones, brain connections, languages, handwritten and gestured letters are shown

Assessing context-based learning: Not only rigorous but also relevant

Economic factors are driving significant change in higher education. There is increasing responsiveness to market demand for vocational courses and a growing appreciation of the importance of procedural (tacit) knowledge to service the needs of the Knowledge Economy; the skills in demand are information analysis, collaborative working and 'just-in-time learning'. New pedagogical methods go some way to accommodate these skills, situating learning in context and employing information and communications technology to present realistic simulations and facilitate collaborative exchange. However, what have so far proved resistant to change are the practices of assessment. This paper endorses the case for a scholarship of assessment and proposes the development of technology-supported tools and techniques to assess context-based learning. It also recommends a fundamental rethink of the norm-referenced and summative assessment of propositional knowledge as the principal criterion for student success in universities

A Survey on Retrieval of Mathematical Knowledge

We present a short survey of the literature on indexing and retrieval of mathematical knowledge, with pointers to 72 papers and tentative taxonomies of both retrieval problems and recurring techniques.Comment: CICM 2015, 20 page