Rider 82 Curriculum
2007 Pilot Report Findings
Dr. Lesley Tomaszewski and Genny Reid
February 27, 2008
Appendix M
Program Evaluation
III. Method(s) of Evaluation (formative and summative)
PROJECT EVALUATION
The evaluation plan of the Workplace Industry-Related ESL Curricula Project will include process evaluation (occurring while many of the strategies are underway) and product evaluation (occurring at the completion of activities). Both are essential to an effective evaluation of this project and both will be employed.
Process evaluation will occur while many of the strategies are underway to identify barriers to successful implementation and will allow for needed adjustment of strategies, reallocation of resources, and other management decisions based on evaluation results. These continuous improvement evaluation strategies will be based on information collected from correspondence, interviews, surveys, observations, assessments, products, and evaluations by learners, teachers, employers, representatives from partnering institutions, and project staff.
Product evaluation will occur at the completion of the activities to determine the project's merit and effectiveness. The product evaluation will be critical for assessing achieved results. These evaluation strategies will include data collection and synthesis of information obtained from all the key players including learners, employers, instructors, administrators, and project personnel.
Data will also be collected during process and product evaluations of the project to answer the following questions:
- What industry-related English skills can students perform as a result of participating in the pilot testing of the 200 hour ESL for Sales and Service curriculum for Texas adult English language learners? This will be measured by the Research Advisory Team's recommendations for collecting informal and formal data from students and teachers using instruments such as surveys, interviews, questionnaires, rubrics, and portfolios.
- What industry-related English skills can students perform as a result of participating in the pilot testing of the 200 hour ESL for Manufacturing curriculum for Texas adult English language learners? This will be measured by the Research Advisory Team's recommendations for collecting informal and formal data from students and teachers using instruments such as surveys, interviews, questionnaires, rubrics, and portfolios.
- What industry-related English skills can students perform as a result of participating in the pilot testing of the 200 hour ESL for Health Care curriculum for Texas adult English language learners? This will be measured by the Research Advisory Team's recommendations for collecting informal and formal data from students and teachers using instruments such as surveys, interviews, questionnaires, rubrics, and portfolios.
- Is the Job Readiness Curriculum adaptation for ESL learners complete?
- Is the Web site complete and does it support learning activities in the “Job Readiness Curriculum”?
- What are the results of the feedback obtained from students and teachers on the pilot testing of the multi-level extension activities for industry-related curricula?
- What are the results of the feedback obtained from students and teachers on the pilot testing of the supplemental Orientation video materials accompanying the Orientation Component?
- What oral language fluency skills can students demonstrate as a result of participating in the pilot testing of the Dialogue activities for fluency for Sales/Service for Texas’ adult ESL learners?
- What oral language fluency skills can students demonstrate as a result of participating in the pilot testing of the Dialogue activities for fluency for Manufacturing for Texas’ adult ESL learners?
- What oral language fluency skills can students perform as a result of participating in the pilot testing of the Dialogue activities for fluency for Health Care for Texas’ adult ESL learners?
Project deliverables will include:
- 200 hour curriculum for industry-related ESL for Sales and Service
- 200 hour curriculum for industry-related ESL for Manufacturing
- 200 hour curriculum for industry-related ESL for Health Care
- Multi-level extension activities for industry-related curricula products
- Supplemental video materials for the Orientation component to accompany industry-related ESL curricula
- Pilot-testing data and results
- Job Readiness Curriculum for Texas adult education ESL learners
- Stand alone Web site to support learning activities in the industry-related ESL and Job Readiness Curricula.
- Dialogue activities for fluency for Sales/Service
- Dialogue activities for fluency for Manufacturing
- Dialogue activities for fluency for Health Care
- Quarterly reports outlining major activities, accomplishments, barriers, and plans of action
- Final summative report containing a detailed evaluation of the extent of attainment of the project’s objectives
