An Analysis of the internal and external structure of the Teacher Assessment Literacy Questionnaire

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Assessment literacy refers to teachers' knowledge and skills in educational assessment. It is a prerequisite for sound assessment practices of student learning in the classroom. In an attempt to quantify teachers' assessment literacy, Plake and Impara (1992) developed Teacher Assessment Literacy Questionnaire (TALQ) consisting of 35 multiple-choice items related to basic concepts and principles in educational assessment. This study analyzed the internal and external structure of the TALQ. The internal structure was explored through item analysis and reliability analysis. The external structure was explored through confirmatory factor analysis, regression analysis, and correlational analysis. Preservice teachers (N = 259) enrolled in an educational measurement course at Sultan Qaboos University in Oman completed the TALQ. The item analysis showed that the TALQ was effective in discriminating between the different levels of the preservice teachers' assessment literacy. The scores of the TALQ had an adequate internal consistency reliability coefficient. The confirmatory factor analysis suggested that the TALQ measures a unitary construct of the assessment literacy. Regression analysis showed that gender, attitude toward educational measurement, and self-perceived confidence in educational measurement collectively and significantly correlated with assessment literacy. A significant positive relationship was also found between TALQ's scores and academic achievement scores in the course. Percentile ranks were extracted as norms for the raw scores of the sample on the TALQ. These results indicate that the TALQ provides valid and reliable score interpretations of the assessment literacy of the preservice teachers in Oman.

Original languageEnglish
Pages (from-to)515-528
Number of pages14
JournalInternational Journal of Learning
Volume18
Issue number1
Publication statusPublished - 2011

Fingerprint

literacy
questionnaire
teacher
item analysis
Oman
factor analysis
regression analysis
self-confidence
basic concept
academic achievement

Keywords

  • Assessment literacy
  • Item analysis
  • Preservice teachers
  • Reliability
  • Validity

ASJC Scopus subject areas

  • Education

Cite this

@article{b3dab869c1024663a7f9ff57dd4f01a4,
title = "An Analysis of the internal and external structure of the Teacher Assessment Literacy Questionnaire",
abstract = "Assessment literacy refers to teachers' knowledge and skills in educational assessment. It is a prerequisite for sound assessment practices of student learning in the classroom. In an attempt to quantify teachers' assessment literacy, Plake and Impara (1992) developed Teacher Assessment Literacy Questionnaire (TALQ) consisting of 35 multiple-choice items related to basic concepts and principles in educational assessment. This study analyzed the internal and external structure of the TALQ. The internal structure was explored through item analysis and reliability analysis. The external structure was explored through confirmatory factor analysis, regression analysis, and correlational analysis. Preservice teachers (N = 259) enrolled in an educational measurement course at Sultan Qaboos University in Oman completed the TALQ. The item analysis showed that the TALQ was effective in discriminating between the different levels of the preservice teachers' assessment literacy. The scores of the TALQ had an adequate internal consistency reliability coefficient. The confirmatory factor analysis suggested that the TALQ measures a unitary construct of the assessment literacy. Regression analysis showed that gender, attitude toward educational measurement, and self-perceived confidence in educational measurement collectively and significantly correlated with assessment literacy. A significant positive relationship was also found between TALQ's scores and academic achievement scores in the course. Percentile ranks were extracted as norms for the raw scores of the sample on the TALQ. These results indicate that the TALQ provides valid and reliable score interpretations of the assessment literacy of the preservice teachers in Oman.",
keywords = "Assessment literacy, Item analysis, Preservice teachers, Reliability, Validity",
author = "Alkharusi, {Hussain Ali}",
year = "2011",
language = "English",
volume = "18",
pages = "515--528",
journal = "International Journal of Learning",
issn = "1447-9494",
publisher = "Common Ground Publishing",
number = "1",

}

TY - JOUR

T1 - An Analysis of the internal and external structure of the Teacher Assessment Literacy Questionnaire

AU - Alkharusi, Hussain Ali

PY - 2011

Y1 - 2011

N2 - Assessment literacy refers to teachers' knowledge and skills in educational assessment. It is a prerequisite for sound assessment practices of student learning in the classroom. In an attempt to quantify teachers' assessment literacy, Plake and Impara (1992) developed Teacher Assessment Literacy Questionnaire (TALQ) consisting of 35 multiple-choice items related to basic concepts and principles in educational assessment. This study analyzed the internal and external structure of the TALQ. The internal structure was explored through item analysis and reliability analysis. The external structure was explored through confirmatory factor analysis, regression analysis, and correlational analysis. Preservice teachers (N = 259) enrolled in an educational measurement course at Sultan Qaboos University in Oman completed the TALQ. The item analysis showed that the TALQ was effective in discriminating between the different levels of the preservice teachers' assessment literacy. The scores of the TALQ had an adequate internal consistency reliability coefficient. The confirmatory factor analysis suggested that the TALQ measures a unitary construct of the assessment literacy. Regression analysis showed that gender, attitude toward educational measurement, and self-perceived confidence in educational measurement collectively and significantly correlated with assessment literacy. A significant positive relationship was also found between TALQ's scores and academic achievement scores in the course. Percentile ranks were extracted as norms for the raw scores of the sample on the TALQ. These results indicate that the TALQ provides valid and reliable score interpretations of the assessment literacy of the preservice teachers in Oman.

AB - Assessment literacy refers to teachers' knowledge and skills in educational assessment. It is a prerequisite for sound assessment practices of student learning in the classroom. In an attempt to quantify teachers' assessment literacy, Plake and Impara (1992) developed Teacher Assessment Literacy Questionnaire (TALQ) consisting of 35 multiple-choice items related to basic concepts and principles in educational assessment. This study analyzed the internal and external structure of the TALQ. The internal structure was explored through item analysis and reliability analysis. The external structure was explored through confirmatory factor analysis, regression analysis, and correlational analysis. Preservice teachers (N = 259) enrolled in an educational measurement course at Sultan Qaboos University in Oman completed the TALQ. The item analysis showed that the TALQ was effective in discriminating between the different levels of the preservice teachers' assessment literacy. The scores of the TALQ had an adequate internal consistency reliability coefficient. The confirmatory factor analysis suggested that the TALQ measures a unitary construct of the assessment literacy. Regression analysis showed that gender, attitude toward educational measurement, and self-perceived confidence in educational measurement collectively and significantly correlated with assessment literacy. A significant positive relationship was also found between TALQ's scores and academic achievement scores in the course. Percentile ranks were extracted as norms for the raw scores of the sample on the TALQ. These results indicate that the TALQ provides valid and reliable score interpretations of the assessment literacy of the preservice teachers in Oman.

KW - Assessment literacy

KW - Item analysis

KW - Preservice teachers

KW - Reliability

KW - Validity

UR - http://www.scopus.com/inward/record.url?scp=84855779831&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84855779831&partnerID=8YFLogxK

M3 - Article

VL - 18

SP - 515

EP - 528

JO - International Journal of Learning

JF - International Journal of Learning

SN - 1447-9494

IS - 1

ER -