Publication Date

2015

Document Type

Dissertation/Thesis

First Advisor

Flynn, Joseph E. (Associate professor)

Degree Name

Ed.D. (Doctor of Education)

Legacy Department

Department of Leadership, Educational Psychology and Foundations

LCSH

Educational tests & measurements; Educational evaluation; Curriculum development; Educational tests and measurements--Research--Illinois; Educational evaluation--Research--Illinois; Education--Evaluation--Research--Illinois; Education; Secondary--Curricula--Research--Illinois

Abstract

This dissertation investigates validity and reliability concerns surrounding high-stakes, state-level assessment with standardized testing instruments. It uses high school student test data from the 2008--2009 academic year to determine whether or to what degree ACT based accountability scores are reliable across academic settings and contexts, and whether certain non-academic factors, such as cognitive test attack strategies, have any effect on scores. Though scores trended towards reliability across settings and contexts, they were also found to vary considerably depending on non-skill related factors. These findings suggest that standardized accountability and evaluative testing programs for schools and students have unacceptably high amounts of variability and that because of their susceptibility to variance unrelated to skill proficiency, they are less than accurate and conclusive enough for the variety of needs addressed by the state's accountability program. More research is needed on the factors that impact state-level assessment scores and on accountability programs that use objective data so that decisions about public education systems can be accurate, contextualized, and appropriate.

Comments

Advisors: Joseph Flynn.||Committee members: Erica Pinter; Corrine Wickens.

Extent

194 pages

Language

eng

Publisher

Northern Illinois University

Rights Statement

In Copyright

Rights Statement 2

NIU theses are protected by copyright. They may be viewed from Huskie Commons for any purpose, but reproduction or distribution in any format is prohibited without the written permission of the authors.

Media Type

Text

Share

COinS