Identifying determinants of teachers' judgment (in)accuracy regarding students' school-related motivations using a Bayesian cross-classified multi-level model

Published on Dec 1, 2017in Learning and Instruction
· DOI :10.1016/J.LEARNINSTRUC.2017.06.003
Anna-Katharina Praetorius14
Estimated H-index: 14
Tobias Koch15
Estimated H-index: 15
+ 2 AuthorsMarkus Dresel19
Estimated H-index: 19
(University of Augsburg)
Abstract Teachers differ considerably in their judgment accuracy of motivational student characteristics. Thus far, only few investigations have focused on explaining these differences. In this study, we investigated to what extent groups of characteristics (i.e., student, information, teacher, and class characteristics) derived from the Realistic Accuracy Model ( Funder, 1995 ) are relevant for explaining differences in teachers' judgment accuracy regarding students' school-related self-concept and autonomous motivation. Data from 1239 students and 341 teachers were analyzed using a Bayesian cross-classified multi-level modeling approach. Our analyses showed that variance in teacher judgments is largely due to variation at the level of judgments and less due to variation in the slope (i.e., the accuracy of teacher judgments). Teachers' judgment accuracy varied to a comparable degree across teachers and classes. Significant determinants for these differences were teachers' subject and students' grade point average.
📖 Papers frequently viewed together
18 Citations
7 Citations
344 Citations
#1Johanna Kaiser (CAU: University of Kiel)H-Index: 7
#2Anna Südkamp (Technical University of Dortmund)H-Index: 9
Last. Jens Möller (CAU: University of Kiel)H-Index: 38
view all 3 authors...
Teachers’ judgments of students’ academic achievement are not only affected by the achievement themselves but also by several other characteristics such as ethnicity, gender, and minority status. In real-life classrooms, achievement and further characteristics are often confounded. We disentangled achievement, ethnicity and minority status and examined whether the achievement of ethnic minority students is judged according to the predominant expectation (expectation hypothesis) and whether teach...
39 CitationsSource
#1Stephanie HerppichH-Index: 7
Last. Anna SüdkampH-Index: 9
view all 16 authors...
7 Citations
This paper investigates the attitudinal/motivational predictors of second language (L2) academic achievement. Young adult learners of English as a foreign language (N = 311) completed several self-report measures and the Single-Target Implicit Association Test. Examination of the motivational profiles of high and low achievers revealed that attachment to the L1 community and the ought-to L2 self were negatively associated with achievement, while explicit attitudes toward the L2 course and implic...
18 CitationsSource
#1Nils Machts (CAU: University of Kiel)H-Index: 5
#2Johanna Kaiser (CAU: University of Kiel)H-Index: 7
Last. Jens Möller (CAU: University of Kiel)H-Index: 38
view all 4 authors...
Abstract This paper presents a meta-analysis of the accuracy of teachers' judgments of students' cognitive abilities. The array of cognitive abilities includes intelligence, giftedness, other cognitive abilities, and creativity. The integration of 106 effect sizes from 33 studies with a meta-analytical multilevel approach led to a mean judgment accuracy of cognitive abilities of r = 0.43. Moderation analyses revealed moderate to large effects for intelligence: r = 0.50, other cognitive abilities...
44 CitationsSource
#1Tobias Koch (Lüneburg University)H-Index: 15
#2Martin Schultze (FU: Free University of Berlin)H-Index: 10
Last. Michael Eid (FU: Free University of Berlin)H-Index: 56
view all 6 authors...
ABSTRACTMultirater (multimethod, multisource) studies are increasingly applied in psychology. Eid and colleagues (2008) proposed a multilevel confirmatory factor model for multitrait-multimethod (MTMM) data combining structurally different and multiple independent interchangeable methods (raters). In many studies, however, different interchangeable raters (e.g., peers, subordinates) are asked to rate different targets (students, supervisors), leading to violations of the independence assumption ...
8 CitationsSource
#1Detlef Urhahne (University of Passau)H-Index: 17
#2Mingjing Zhu (CAS: Chinese Academy of Sciences)H-Index: 6
The study examined teachers' competence to assess students' subjective well-being, which is the basis of mental health and youth development. Forty-four teachers were asked to judge students' attitudes towards school, enjoyment at school, academic self-concept, worries about school, social problems, and physical complaints in school. Teachers' judgments were related to the self-reports of 800 eighth-grade secondary school students. Results show that teachers predicted students' subjective well-b...
15 CitationsSource
#1Courtney A. BellH-Index: 16
#2Yi QiH-Index: 6
Last. Robert C. PiantaH-Index: 139
view all 7 authors...
23 CitationsSource
#1Ines BöhmerH-Index: 6
Last. Sabine GlockH-Index: 20
view all 5 authors...
In Deutschland spielt bei der Wahl der weiterfuhrenden Schulform die Ubergangsempfehlung (Ubergangsurteil) der Grundschullehrkrafte eine bedeutende Rolle. Basierend auf dualen Prozessmodellen sozialer Urteilsbildung, die im Allgemeinen zwischen automatischen (spontanen) und kontrollierten (reflektierten) Strategien der Urteilsbildung differenzieren, untersucht die vorliegende Studie die kognitiven Prozesse der Lehrkrafte bei der Erstellung des Ubergangsurteils. Im Fokus steht dabei der Informati...
1 Citations
#1Marion Reindl (University of Augsburg)H-Index: 5
Last. Markus Dresel (University of Augsburg)H-Index: 19
view all 5 authors...
Founded on Self-Determination Theory, the present study examines the effect of negative peer climate on changes in domain-specific autonomous motivation in mathematics. Based on a three-wave longitudinal sample of 1082 secondary school students in Germany, multi-level latent growth curve analyses indicated a negative effect of classroom-specific negative peer climate on the development of autonomous motivation in mathematics, even after controlling for marks, gender and grade-level. Classrooms c...
10 CitationsSource
#1Anna-Katharina Praetorius (University of Augsburg)H-Index: 14
#2Katharina Drexler (University of Augsburg)H-Index: 2
Last. Markus Dresel (University of Augsburg)H-Index: 19
view all 8 authors...
Abstract Judging students' academic self-concepts accurately is assumed to be a necessary condition for adaptive classroom instruction. Previous studies found moderate correlations between teachers' judgements and the self-reported self-concepts. Reference values for interpreting these correlations are missing. In the present study, self–other agreements with a zero-acquaintance premise (see Ambady & Rosenthal, 1992) were proposed as such a reference value. A total of 88 teachers judged the self...
10 CitationsSource
Cited By14
#1Janneke van de Pol (UU: Utrecht University)H-Index: 12
#2Tamara van Gog (UU: Utrecht University)H-Index: 61
Last. Keith W. Thiede (BSU: Boise State University)H-Index: 24
view all 3 authors...
Abstract We investigated to what extent teachers' use of diagnostic cues and the accuracy with which they interpreted or judged the values of those cues affected teachers' monitoring accuracy. Forty-six secondary education teachers judged the text comprehension of six students (216 students in total). Mere use of diagnostic cues appeared not sufficient. Rather, accurately judging the values of a diagnostic performance cue was related to higher monitoring accuracy. Using non-diagnostic student cu...
#1Dimitra Kolovou (HSG: University of St. Gallen)
#2Alexander Naumann (Leibniz Association)H-Index: 5
Last. Anna-Katharina Praetorius (UZH: University of Zurich)H-Index: 14
view all 4 authors...
Abstract Teachers’ accuracy in judging students’ achievement is often assumed to be a general ability of teachers. Based on this assumption, teachers should be at least consistent in their accuracy across different content domains within a school subject. Yet, this assumption has rarely been investigated empirically so far. Data from 54 mathematics teachers (N = 1170 students) and 55 language teachers (N = 1255 students) were analysed using a Bayesian multivariate multilevel modelling approach. ...
1 CitationsSource
#1Tina SeidelH-Index: 34
Last. Doris HolzbergerH-Index: 11
view all 5 authors...
The present study investigates teacher diagnostic skills when observing student engagement and inferring to underlying student characteristic profiles. Five student profiles as empirically determined in previous studies are selected: three incoherent (overestimating, uninterested, and underestimating) and two coherent (strong and struggling) profiles. Teacher professional vision and underlying assumptions about processes of noticing and reasoning about the chosen diagnostic situation serve as a ...
12 CitationsSource
#1Tobias KärnerH-Index: 5
#2Julia WarwasH-Index: 5
Last. Stephan SchumannH-Index: 5
view all 3 authors...
Addressing heterogeneity in the classroom by adapting instruction to learners’ needs challenges teachers in their daily work. To provide adaptive instruction in the most flexible way, teachers face the problem of assessing students’ individual characteristics (learning prerequisites and learning needs) and situational states (learning experiences and learning progress) along with the characteristics of the learning environment. To support teachers in gathering and processing such multidimensiona...
1 CitationsSource
#1Detlef Urhahne (University of Passau)H-Index: 17
#2Lisette Wijnia (HZ University of Applied Sciences)H-Index: 11
Abstract In everyday school life, teachers need a wide range of judgment competencies to accurately assess student characteristics, learning and task requirements. The purpose of this literature review is to synthesize the methodological, empirical, theoretical, and practical knowledge from 40 years of research on the accuracy of teacher judgments. We define the accuracy of teacher judgments and differentiate the term from other related constructs. We explain the methodological approaches and su...
9 CitationsSource
#1Katharina Schnitzler (TUM: Technische Universität München)H-Index: 2
#2Doris Holzberger (TUM: Technische Universität München)H-Index: 11
Last. Tina Seidel (TUM: Technische Universität München)H-Index: 34
view all 3 authors...
Teachers’ ability to assess student cognitive and motivational-affective characteristics is a requirement to support individual students with adaptive teaching. However, teachers have difficulty in assessing the diversity among their students in terms of the intra-individual combinations of these characteristics in student profiles. Reasons for this challenge are assumed to lie in the behavioral and cognitive activities behind judgment processes. Particularly, the observation and utilization of ...
3 CitationsSource
#1Jürgen Wilbert (University of Potsdam)H-Index: 8
#2Karolina Urton (WWU: University of Münster)H-Index: 8
Last. Thomas Hennemann (University of Cologne)H-Index: 8
view all 6 authors...
It is unclear to what extent teachers can accurately assess the social inclusion of their students with and without SEN. The study aims to shed light on these desiderata. Students (N = 1.644) with SEN (learning, behavior, and language problems) and without SEN and their teachers (N = 79) participated in the study. Sociometric peer nominations, students´ self-perceived social inclusion, and teachers’ assessments regarding students’ social inclusion and self-perceived social inclusion were adminis...
#1Karina Karst (UMA: University of Mannheim)H-Index: 7
#2Meike Bonefeld (UMA: University of Mannheim)H-Index: 5
Abstract We investigate whether the attention payed to students’ learning status predicts judgment accuracy of preservice teachers and whether this attention moderates the effect of student characteristics on judgment accuracy. In a virtual classroom, 168 preservice teachers judged the math-performance of 12 students. The attention allocation (AA) was operationalized twofold (“mean AA” and “student-specific AA”) both via log-file data. Mean AA predicted the judgment accuracy (rank component) pos...
6 CitationsSource
#1Martin VenetzH-Index: 4
#2Carmen ZurbriggenH-Index: 5
Last. Susanne Schwab (NWU: North-West University)H-Index: 13
view all 3 authors...
The aim of this study was to investigate the consistency between the self-reports and teacher ratings of students’ emotional and social inclusion at school as well as for their academic self-concept. The German version of the Perceptions of Inclusion Questionnaire (PIQ) was administered to 329 grade 8 students (50.8% female, Mage = 14.5 years, SDage = 0.5 years) and their teachers. First, the three-dimensional structure of both PIQ versions was confirmed by confirmatory item factor analysis. The...
11 CitationsSource
#1Ceren Su Abacioglu (UvA: University of Amsterdam)H-Index: 3
#2Adela-Maria Isvoranu (UvA: University of Amsterdam)H-Index: 6
Last. Sacha Epskamp (UvA: University of Amsterdam)H-Index: 33
view all 5 authors...
Abstract Students' relationships with peers and teachers strongly influence their motivation to engage in learning activities. Ethnic minority students, however, are often victimized in schools, and their educational achievement lags behind that of their majority group counterparts. The aim of the present study was to explore teachers' multicultural approach within their classrooms as a possible factor of influence over students' peer relationships and motivation. We utilized the novel methodolo...
7 CitationsSource