Study Design & Instruments

Study Design | Instruments

Study Design

In the study’s quasi-experimental design, constructs are examined for convergent, discriminant, incremental, and predictive validity by means of a multitrait-multimethod matrix and two contrast groups. Quasi-experimental variation is achieved through the sampling (N=600), varying with regard to training in the two domains (mathematics and economics) and expertise in teaching (university students, teacher trainees, and teachers). For the three status groups, the sampling comprises 150 participants from each subject .and 300 who have had academic training in both subjects. Interdependencies between the two domains are examined based on the subsample of university students, teacher trainees, and teachers (N=300) who are educated in both mathematics and economics.

Instruments

Domain-specific constructs (mathematics and economics):

For the assessment of teaching competencies (dependent variables), performance-related formats are suggested. Thus, the characteristics of immediacy and spontaneity (AC) or the reflexive demands (RC) of teacher actions must be adequately considered. For this purpose, computer-based open answer formats in natural language and with time pressure as a reaction to video clips were developed especially for AC. For RC, tasks with text and video clips were used. An extensive item pool is already available for this purpose, with items that have already been examined especially in terms of content-related, and cognitive validity (among others by curricula analyses, expert interviews, and cognitive interviews) for pre-service and in-service teachers.

Moreover, extensively validated tests for the differentiated assessment of CK and PCK are available from previous projects in mathematics (KiL, KeiLa) and economics (Fachdidaktik, WiWiKom).
Generic constructs:

Furthermore, the following instruments are used to assess the generic constructs: Reasoning, I-S-T 2000R intelligence scales as well as a video-based instrument for the assessment of situation awareness.

Greiff, S., Wüstenberg, S., Molnár, G., Fischer, A., Funke, J., & Csapó, B. (2013). Complex problem solving in educational settings - something beyond g: Concept, assessment, measurement invariance, and construct validity. Journal of Educational Psychology, 105, 364-379.

Liepmann, D., Beauducel, A., Brocke, B. & Amthauer, R. (2007). I-S-T 2000R Intelligenz-Struktur-Test 2000 R (2., erweiterte und überarbeitete Auflage). Göttingen: Hogrefe.

Top of the page