Evaluate
Evaluation helps you reflect on a program, make changes in it, and make decisions about it. While the most obvious time to evaluate is at the end, you must plan ahead. You can also include evaluation along the way to help check that the program and its activities are on track.
Evaluation can help you twice: once during the education initiative and again in planning for a new initiative. During the program or event you may want to emphasize evaluation of program processes and organization. After the program, you may want to emphasize program impacts and analyze which program components contributed to those impacts.
If you've been working on your Logic
Model Worksheet ( ,
1 pp., 10KB) as you think through the design of your program, you
are already prepared to evaluate aspects of your education or outreach
initiative. Typically you might want to study whether or not the
initiative accomplished desired short term results, but all other
components of the planning model could be evaluated as well.
Reasons you might consider evaluating include: (Simmons, 2004)
- Participants' benefits
- Project improvement
- Public relations
- Funding
- Improved delivery
- Capacity building
- Clarifying project theory
- Taking stock
A University of Wisconsin on-line course can help you step through
the process of using the Logic Model to clarify program design elements,
and to help you see opportunities for evaluation, http://www.uwex.edu/ces/lmcourse/#.
BEP Research for target audiences
provides specific details about potential outcomes for a particular
target audience and provides examples of how others have studied
programs to understand their impacts.
Assess a Program will help you determine
whether you are using BEPs.
Evaluation Principles is one of the Knowledge Area BEPs, which describe the theory behind the practices.
EVALUATING YOUTH PROGRAMS
Most educators are familiar with evaluating immediate or short
term results: students read some information and we ask them a question
to find out whether they retained the main idea. To help you think
beyond tests, we provide an Evaluation Checklist for youth programs
in Educating Young People About Water — A guide to planning
and evaluation , http://www.uwex.edu/erc/eypaw.
The Checklist will help you to examine specific elements
of the program's structure and operation and to carefully
scrutinize its successes and its needs for improvement. It will
help you determine if program resources are being used effectively
and if you have met you're own and others' expectations. It also
addresses the performance of leaders and teachers.
The Evaluation Checklist seeks to answer the broad program question:
do the activities, as whole, help youth improve water quality
or quantity in their community, or is it simply a collection
of science or recreation activities? With youth programs, this particular
objective may be difficult or impossible to evaluate. Most are so
short (one day, one week, one semester) that they alone won't have
an impact on the resource. However, taken together, community youth
programs about water which are held over several years may show
a measurable improvement to the resource. A critical element of
success at this level, therefore, is making a continuing connection
with the community.
RESOURCES
Best Practices Workbook for Boating, Fishing, and Aquatic Resources
Stewardship Education , available from the Recreational Boating
and Fishing Foundation, www.rbff.org
Simmons, B. 2004. Designing
Evaluation for Education Projects ( ,
157 KB, 48 pp), available from the U.S. Department of Commerce,
National Oceanic and Atmospheric Administration (NOAA) Office of
Education and Sustainable Development. This resource provides understandable
explanations for types of evaluations, evaluation tools, and when
to conduct an evaluation.
Educating Young People About Water: A guide to planning and
evaluation , http://www.uwex.edu/erc/eypaw/guides.html
The Nonformal Environmental Education Programs: Guidelines
for Excellence , provides general guidelines for designing,
implementing and evaluating an education program, http://naaee.org/npeee/nonformal.php
OERL: Online Evaluation Resource Library, http://oerl.sri.com/home.html . This NSF
library was developed for professionals seeking to design, conduct, document, or review project evaluations.
|