Akhtar, Iqbal

Anderson, Paul

Iacobelli, Francisco

Lange, Christian

Leonhard, Annette

Paterson, Jessie

English

This paper presents the results an investigation into the possible role of computational linguistic techniques in providing automated formative feedback on student's written work - including both traditional essays, and collaborative wikis.We first attempt to identify some of the criteria used by academic staff when marking student work. Using real examples from the School of Divinity at Edinburgh University, we analyse written feedback from the markers to produce an explicit list of criteria. We also use a number of automated tools to analyse certain features of the work and identify those which correlate with the perceived "quality".We then survey various techniques from computational linguistics to determine how they might potentially be used to identify some of these criteria automatically.We conclude that there is a real potential to produce an automated tool which would provide practically useful formative feedback. We also note that the process of rigorously defining the criteria was helpful to the academic staff in clarifying their manual marking process

Edinburgh Research Explorer

A . H e a r s t . T e x t t i l i n g : s e g m e n t i n g t e x t i n to multi-paragraph subtopic passages.

A . K . H a l l i d a y a n d R . H a s a n . C o h e s i o n in English (English Language). Longman Pub Group,

A t t a l i a n d J . B u r s t e i n . A u t o m a t e d e s s a y s c o r i n g w i t h e - r a t e r v . 2 . J o u r n a l o f T e c h n o l o g y ,

Assessment and classroom learning.

B a e . C o h e s i o n a n d c o h e r e n c e i n c h i l d r enﾒ’s written english: Immersion and english-only classes.

B o u d . A s s e s s m e n t a n d l e a r n i n g : c o n t r a d i c t o r y or complementary.

D a k k a a n d L . G r a v a n o . E fficient summarization-aware search for online news articles.

D e n t o n , J . M a d d e n , M . R o b e r t s , a n d P . Rowe. Studentsﾒ’ response to traditional and computer-assisted formative feedback: A comparative case study.

F o l t z , S . G i l l i a m , a n d S . K e n d a l l . Supporting content-based feedback in on-line writing evaluation with lsa. Interactive Learning Environments,

G i b b s a n d C . S i m p s o n . C o n d i t i o n s u n d e r w h ich assessment supports studentsﾒ’ learning.

G r a e s s e r , D . S . M c N a m a r a , a n d

H a l p i n

i e r a s . A n a d v a n c e d c o m p u t e r i z e d a i d f or the writing of comprehensible technical documents.

K a u f m a n n . C o h e s i o n a n d c o l l o c a t i o n : u s i n g context vectors in text segmentation.

K n i g h t . S u m m a t i v e a s s e s s m e n t i n h i g h e r e d u cation: practices in disarray.

M e u r e r . R e l a t i o n s h i p b e t w e e n c o h e s i o n and coherence in essays and narratives. Fragmentos,

M i l l e r . E s s a y a s s e s s m e n t w i t h l a t e n t s e mantic analysis.

N i c o l a n d D . M a c f a r l a n e - D i c k . F o r m a t i v e assessment and self-regulated learning: a model and seven principles of good feedback practice.

P e n n e b a k e r a n d L . A . K i n g . L i n g u i s t i c styles: language use as an individual difference. Journal of personality and social psychology, 77(6):1296ﾖ–1312,

R o b e r t s o n a n d P . M . W i e m e r H a s t i n g s . F e e dback on childrenﾒ’s stories via multiple interface agents.

Textual analysis with computers:

The trouble with feedback: New challenges, emerging strategies. In TLA Interchange. Centre for Teaching, Learning and Assessment,

V a l e n t i , F . N e r i , a n d A . Cucchiarelli. An overview of current research on automated essay grading.

W i e m e r - H a s t i n g s a n d A . C . Graesser. Select-a-kibitzer: A computer tool that gives meaningful feedback on student compositions. Interactive Learning Environments,

Exploring the use of computational linguistics for automated formative feedback in the humanities

Exploring the use of computational linguistics for automated formative feedback in the humanities

Abstract

Similar works

Full text

Available Versions

Edinburgh Research Explorer