Publikationen
At a first glance
Begrich, Lukas/Kuger, Susanne/Klieme, Eckhard/Kunter, Mareike (2021):
At a first glance. How reliable and valid is the thin slices technique to assess instructional quality?
In: Learning and Instruction
Jahrg.: 202, H. 74, S. 101466
Various approaches of assessing instructional quality have emerged in educational research. In this article, we present two studies that apply the thin slices procedure, investigating the reliability and validity of the ratings of three dimensions of instructional quality based solely on the first impressions of untrained social observers. Thirty undergraduate students rated 30-s clips from English lessons (Study 1) and Math lessons (Study 2) regarding three quality dimensions. The findings suggest high reliability in these ratings. Multilevel confirmatory analyses suggested construct validity in terms of differentiation between the three dimensions of instructional quality. Finally, we found some overlap between the thin slices ratings of classroom management and constructive support with ratings of trained raters based on observations of full lessons, as well as students’ ratings of these dimensions. We discuss these results with respect to the potential of first impressions of untrained observers to measure instructional quality.
Download
At a first glance. How reliable and valid is the thin slices technique to assess instructional quality?
In: Learning and Instruction
Jahrg.: 202, H. 74, S. 101466
Various approaches of assessing instructional quality have emerged in educational research. In this article, we present two studies that apply the thin slices procedure, investigating the reliability and validity of the ratings of three dimensions of instructional quality based solely on the first impressions of untrained social observers. Thirty undergraduate students rated 30-s clips from English lessons (Study 1) and Math lessons (Study 2) regarding three quality dimensions. The findings suggest high reliability in these ratings. Multilevel confirmatory analyses suggested construct validity in terms of differentiation between the three dimensions of instructional quality. Finally, we found some overlap between the thin slices ratings of classroom management and constructive support with ratings of trained raters based on observations of full lessons, as well as students’ ratings of these dimensions. We discuss these results with respect to the potential of first impressions of untrained observers to measure instructional quality.
Download
