Program Evaluation: Nelson Literacy Reading Program
Engage Stakeholders
Who should be involved?
Teachers and
students should be involved in the program evaluation.
How might they be engaged?
They will be
engaged by answering a questionnaire and rating scale.
Focus the Evaluation
What are you going to evaluate?
The
evaluation will determine if the Nelson Literacy program is successful in
teaching students various reading strategies which they can use to help
themselves learn in all subject areas.
What is the purpose of the
evaluation?
The purpose
of the evaluation is to determine how effective and user-friendly the program
is. Is it set up to ensure teachers are
able to effectively teach students the different reading strategies?
Who will use the evaluation and how
will they use it?
Nelson
Literacy Developers – Will use the evaluation to consider improvements to their
program.
School
Divisions – Will use the evaluation to decide if the program should be
implemented in their schools.
What questions will the evaluation
seek to answer?
Do teachers
find the resource easy to use? Are the
lessons set up to ensure students are able to be successful in learning the
various reading strategies?
Are students
able to apply their reading strategies across all subject areas?
What information do you need to
answer the questions?
|
What I wish to know:
|
Indicators – How will I know it?
|
|
How useful
teachers find the resource to be
|
Results
from survey
|
|
Does the
program succeed in teaching students various reading strategies?
|
Results
from student reading comprehension testing (benchmark results) and
performance tasks from each reading strategy (from the program)
|
|
Are
students able to apply the reading strategies to help them learn new content
in all subject areas?
|
Results
from survey
|
When is the evaluation needed?
The
evaluation is needed during and after the implementation of the Nelson Literacy
program.
What evaluation design will be used?
Scriven –
Summative and Formative
Collect the Information
What sources of information will be
used?
Existing
Information: The Nelson Literacy
Resource Overview Booklet
People: Teachers and students currently using the
program
What data collection methods will be
used?
Surveys and
Tests
Instrumentation: What is needed to record the information?
Questionnaire
for teachers and students, Benchmark testing results and Performance Task
results
When will data be collected for each
method?
Survey
(Teachers) – During program
Survey
(Students) – During program
Tests –
Benchmark – Immediately after program
Demonstration
Task Results – Immediately after the teaching of each literacy strategy (During
program)
Analyze and Interpret
How will the data be analyzed?
Data analysis methods:
Responses will be read and answers compiled using the computer.
Who responsible:
I will read the teacher and student survey responses. I will compile the responses into similar
categories on the computer. Teachers will
be responsible for providing information on their students’ benchmark results
and performance task results for the different reading strategies. This information will also be categorized
using the computer.
How will the information be
interpreted – by whom?
Have
students’ benchmark results improved since the Nelson Literacy Program has been
implemented?
Nelson
Literacy program developers will use the results to determine how effective
their program is in improving students’ reading strategies and what teachers
like / dislike about the program.
Use of the Evaluation
What was learned from the
evaluation? What are the limitations?
What action
will be taken (if any), to help make improvements towards the Nelson Literacy
program?
|
To Whom
|
When / Where / How to present
|
|
Teachers
|
Email
teachers (who participated), the results from teacher surveys and student
testing results – will help teachers recognize common areas of strengths and
weaknesses
|
|
Nelson
Literacy Developers
|
Written
report, including charts / graphs displaying the results from surveys and
student achievement
|
Manage the evaluation : Human subject’s protection
Timeline
Responsibilities
Budget
Janelle Good initial thoughts about your assessment. Make sure you fully explore each aspect of this stage to help inform the development of your plan. I think that you should expand your scope of stakeholders and think about how teachers and administrators might use the results of the evaluation.
ReplyDeleteJay