M.S. Ed. (Master of Education)
Department of Kinesiology and Physical Education
Competency based educational tests--Illinois||Physical education and training--Study and teaching (Secondary)--Illinois||High School students--Education--Illinois||Physical education teachers--Rating of--llinois
The purposes of this study were to: (a) determine the interrater and intrarater reliability of individuals trained to use the fitness plan scoring rubric, (b) design and implement a training workshop that would maximize interrater and intrarater reliability of individuals trained to use the scoring rubric, and (c) design a selftraining manual that would render interrater and intrarater reliability similar to the workshop-trained participants. Twelve participants evaluated fitness plans using a scoring rubric designed by members of the Illinois State Board of Education’s Physical Development and Health Assessment Advisory Committee. The scoring rubric is an analytical rubric that is divided into four dimensions: (a) goal setting, (b) planning, (c) implementation, and (d) evaluation. Eight of the 12 participants were workshop-trained to use the rubric and the remaining 4 were self-trained to use the rubric. Each participant evaluated 10 fitness plans twice, half the plans one day apart and half on the same day. Interrater reliability was estimated by calculating percent agreement to true score. Results indicated moderate rater agreement with 7 of the 12 participants above 70% agreement on trial 1 and 10 of the 12 participants reporting total score agreement above 70% on trial 2. Intrarater reliability was estimated using a one-way repeated measure of ANOVA (norm referenced) and percent agreement with themselves (criterion referenced). Again, results indicated moderate rater agreement with two participants reporting a total percent agreement with self of less than 70%. A one-way ANOVA was computed to determine any significant differences between those individuals who were workshop-trained and those individuals who were self-trained. No significant difference was found to exist. The results of this study indicate the fitness plan scoring rubric is a reliable tool for evaluating fitness plans developed by high-school students.
Day, Kathleen Landers, "Reliability of a fitness plan scoring rubric" (2000). Graduate Research Theses & Dissertations. 4724.
[viii], 82 pages
Northern Illinois University
Rights Statement 2