Topic Development to Support Revision Feedback

Published on Mar 4, 2019 in LAK (Learning Analytics and Knowledge)
· DOI :10.1145/3303772.3303816
Jovita Vytasek8
Estimated H-index: 8
(SFU: Simon Fraser University),
Alexandra Patzak4
Estimated H-index: 4
(SFU: Simon Fraser University),
Philip H. Winne68
Estimated H-index: 68
(SFU: Simon Fraser University)
Source
Abstract
Revision is important but challenging for novice writers, particularly in post-secondary education where opportunities for personalized feedback are limited. Inexperienced writers typically overlook revision; when they do revise, they focus on surface errors rather than global revisions that enhance meaning and coherence. Writing analytics can automate personalized prompts to guide revision. We use topic modelling LDA as grounds for an analytic to scaffold holistic revision at paragraph and essay levels. The analytic visualizes topic distribution and generates three types of prompts: Introduction, Paragraph and Conclusion. Feedback encourages revisions focusing on sequencing topics, expanding underdeveloped ideas, and making holistic revisions to improve clarity and coherence of paragraphs. Model feedback was evaluated using undergraduate student essays on various topics scored by human evaluators. Model accuracy was strong for all types of feedback. This opens new branches of research to explore generating personalized feedback at paragraph and essay levels.
📖 Papers frequently viewed together
2015EDM: Educational Data Mining
3 Authors (Alok Baikadi, ..., Kevin D. Ashley)
1 Citations
2004
1 Author (John R. Hayes)
82 Citations
References28
Newest
#1Andrew Gibson (UTS: University of Technology, Sydney)H-Index: 12
#2Adam Aitken (UTS: University of Technology, Sydney)H-Index: 2
Last. Simon Knight (UTS: University of Technology, Sydney)H-Index: 14
view all 6 authors...
Reflective writing can provide a powerful way for students to integrate professional experience and academic learning. However, writing reflectively requires high quality actionable feedback, which is time-consuming to provide at scale. This paper reports progress on the design, implementation, and validation of a Reflective Writing Analytics platform to provide actionable feedback within a tertiary authentic assessment context. The contributions are: (1) a new conceptual framework for reflectiv...
30 CitationsSource
#1Thomas Daniel Ullmann (OU: Open University)H-Index: 9
Despite their importance for educational practice, reflective writings are still manually analysed and assessed, posing a constraint on the use of this educational technique. Recently, research started to investigate automated approaches for analysing reflective writing. Foundational to many automated approaches is the knowledge of words that are important for the genre. This research presents keywords that are specific to several categories of a reflective writing model. These keywords have bee...
13 CitationsSource
#1Anthony Becker (CSU: Colorado State University)H-Index: 3
Abstract Rubrics are valued for their potential to clarify teachers’ expectations, identify strengths and weaknesses, and direct students toward self-evaluation (Panadero & Jonsson, 2013). While many instructors use rubrics to assess second language writing, students are rarely involved in their development and application. This can leave students without knowledge of how rubrics are created and/or used, inhibiting their motivation and writing performance (Skillings & Ferrell, 2000). This classr...
20 CitationsSource
Apr 25, 2016 in LAK (Learning Analytics and Knowledge)
#2Ágnes Sándor (Xerox)H-Index: 12
Last. Mindy McWilliams (Georgetown University)H-Index: 5
view all 6 authors...
When used effectively, reflective writing tasks can deepen learners' understanding of key concepts, help them critically appraise their developing professional identity, and build qualities for lifelong learning. As such, reflecting writing is attracting substantial interest from universities concerned with experiential learning, reflective practice, and developing a holistic conception of the learner. However, reflective writing is for many students a novel genre to compose in, and tutors may b...
28 CitationsSource
Apr 25, 2016 in LAK (Learning Analytics and Knowledge)
#1Ye Chen (SU: Syracuse University)H-Index: 1
#2Bei Yu (SU: Syracuse University)H-Index: 15
Last. Yihan Yu (SU: Syracuse University)H-Index: 1
view all 4 authors...
Journal writing is an important and common reflective practice in education. Students' reflection journals also offer a rich source of data for formative assessment. However, the analysis of the textual reflections in class of large size presents challenges. Automatic analysis of students' reflective writing holds great promise for providing adaptive real time support for students. This paper proposes a method based on topic modeling techniques for the task of themes exploration and reflection g...
20 CitationsSource
#1Andrew Gibson (QUT: Queensland University of Technology)H-Index: 12
#2Kirsty Kitto (QUT: Queensland University of Technology)H-Index: 18
Reflective writing is an important learning task to help foster reflective practice, but even when assessed it is rarely analysed or critically reviewed due to its subjective and affective nature. We propose a process for capturing subjective and affective analytics based on the identification and recontextualisation of anomalous features within reflective text. We evaluate 2 human supervised trials of the process, and so demonstrate the potential for an automated Anomaly Recontextualisation pro...
10 CitationsSource
Mar 24, 2014 in LAK (Learning Analytics and Knowledge)
#1Duygu Simsek (OU: Open University)H-Index: 4
#2Simon Buckingham Shum (OU: Open University)H-Index: 45
Last. Ágnes Sándor (Xerox)H-Index: 12
view all 5 authors...
This paper describes a novel analytics dashboard which visualises the key features of scholarly documents. The Dashboard aggregates the salient sentences of scholarly papers, their rhetorical types and the key concepts mentioned within these sentences. These features are extracted from papers through a Natural Language Processing (NLP) technology, called Xerox Incremental Parser (XIP). The XIP Dashboard is a set of visual analytics modules based on the XIP output. In this paper, we briefly intro...
6 CitationsSource
Apr 8, 2013 in LAK (Learning Analytics and Knowledge)
#1Vilaythong Southavilay (USYD: University of Sydney)H-Index: 4
#2Kalina Yacef (USYD: University of Sydney)H-Index: 26
Last. Rafael A. Calvo (USYD: University of Sydney)H-Index: 49
view all 4 authors...
The use of cloud computing writing tools, such as Google Docs, by students to write collaboratively provides unprecedented data about the progress of writing. This data can be exploited to gain insights on how learners' collaborative activities, ideas and concepts are developed during the process of writing. Ultimately, it can also be used to provide support to improve the quality of the written documents and the writing skills of learners involved. In this paper, we propose three visualisation ...
47 CitationsSource
#1Duygu SimsekH-Index: 4
Last. Rebecca FergusonH-Index: 25
view all 5 authors...
A key competency that we seek to build in learners is a critical mind, i.e. ability to engage with the ideas in the literature, and to identify when significant claims are being made in articles. The ability to decode such moves in texts is essential, as is the ability to make such moves in one’s own writing. Computational techniques for extracting them are becoming available, using Natural Language Processing (NLP) tuned to recognize the rhetorical signals that authors use when making a signifi...
18 Citations
In Section 1 of this article, the author discusses the succession of models of adult writing that he and his colleagues have proposed from 1980 to the present. He notes the most important changes that differentiate earlier and later models and discusses reasons for the changes. In Section 2, he describes his recent efforts to model young children’s expository writing. He proposes three models that constitute an elaboration of Bereiter and Scardamalia’s knowledge-telling model. In Section 3, he d...
227 CitationsSource
Cited By1
Newest
#1Laura K. Allen (UNH: University of New Hampshire)H-Index: 15
#2Sarah D. Creer (UNH: University of New Hampshire)
Last. Mary Cati Poulos (UNH: University of New Hampshire)
view all 3 authors...
Source