Program evaluation plan for raising awareness of food poisoning among schoolchildren aged 8-15 in Riyadh, Saudi Arabia by 40% over 3-years.
Program evaluation is the step that follows monitoring. The information collected during monitoring the results of the project is evaluated (or compared and judged) in an analytical way against the objectives of the project. As a first step, it is crucial to identify the relevance of each indicator according to the achievement of the project’s objective(s). It might confirm the positive results of the work, leading to the expansion of particular activities, or point out negative consequences, in which case a change in objectives is probably needed.
Process evaluation plan
|Questions||Data sources||Tools/ procedures||Timing of data collection||Data analysis||Reporting|
|Fidelity||1. To what extent was information delivered to the school children as planned?||Teachers, school children, parents, interventionists||Observations with checklists||Interventionists weekly reports||Calculate scores based on the percentage school children reached.||Formative-informal feedback to interventionists weekly; summative-summarised by schools and overall|
|Dose delivered||2. How many units of each intervention was provided by the interventionists||Teachers, school children, parents, interventionists||Observations with checklists||Weekly reports||Narrative description of the procedures||Formative-informal feedback to interventionists weekly; summative-summarised by schools and overall|
|Dose received||3. To what extent did the recipients participate in the program? 4. Were they receptive?||Teachers, students, interventionists||Administration of brief satisfaction scales, face to face interviews and focus groups.||Focus groups and amount of learning materials delivered||Teachers and the school children response frequencies.||Formative-informal feedback to interventionists weekly; summative-summarised by schools and overall|
|Reach||5. What percentage of the children was made aware of the impact of food poisoning?||Interventionists. Teachers.||Writing reports of the headcount, sign-in sheets, names on a class roll/rosters.||Taken for each school in which awareness was raised.||Look at the number of children in each school participating in at least 40% of the awareness sessions.||Formative-informal feedback to interventionists weekly; summative-summarised by schools and overall|
|Recruitment||6. Which means were used to reach to the children and to retain them in the program?||Interventionists.||Interventionists document all awareness sessions||Administered at the end of each awareness session||Narrative description of the procedures||Formative-informal feedback to interventionists weekly; summative-summarised by schools and overall|
|Context||7. To what extent did the control group get exposed to the program? Did learning institutions allow common meeting time for awareness creation? And what were the barriers to the implementation?||School teachers, administration, staff and the students.||Interviews bearing open-ended questions that will address barriers to implementation||At the end of each awareness session||Themes identified through quantitative and qualitative analysis||Formative-informal feedback to interventionists weekly; summative-summarised by schools and overall|
Impact evaluation plan
|Goal and Objectives||Key Questions||Study design|
|Goal: the goal of this project is to raise awareness of food poisoning among schoolchildren aged 8-15 in Riyadh, Saudi Arabia by 40% over 3-years (Almutairi, 2010).||How many schoolchildren aged 8-15 years were made aware of food poisoning in Riyadh, Saudi Arabia over the three years?||Quasi-experimental time series (quarterly) surveys in Riyadh, Saudi Arabia.|
|Purpose: This project aims at increasing awareness about food poisoning among school children aged 8-15 in a span of three years||Did the program participants increase their knowledge on causes of food poisoning during the span of the three years?||Time series evaluation (quarterly) will give a real story of the situation; the initial stages will give a picture of how the program is being implemented.|
|Objective 1:Increasing knowledge on food poisoning among school children aged 8-15 in Riyadh over a period of three years. Knowledgeable children will be very much aware of the dangers posed by food poisoning and will be in a better position to take the necessary measures (Almutairi, 2010).||Did the knowledge acquired by the school children make them aware of the dangers posed by food poisoning?||Quasi-experimental-Before and after design-no comparison group-observation applied.|
|Objective 2:Training parents and guardians on food poisoning in selected areas in the city of Riyadh Saudi Arabia (Almutairi, 2010).||Was there a drop in instances of food poisoning following the training of parents and guardians by the program? What were the changes in attitude towards unhygienic food by the children before and after the intervention?||Time-series design- will look for a change over time i.e. before and after the intervention.|
|Objective 3:To reduce the cases of food poisoning among children aged 8-15 by 40% in Riyadh Saudi Arabia.||Were cases of food poisoning reduced after the intervention?||Before and after design-no comparison group-observation applied.|
|Objective 4:Increase the number of children who have access to food poisoning information in Riyadh Saudi Arabia.||Was the number of children who have access to food poisoning information in Riyadh Saudi Arabia increased?||Answering normative questions-a survey to assess the number of children possessing this information at the end of the intervention.|
|Objective 5:Increasing food poisoning information among children in the target group in Riyadh, Saudi Arabia.||Was food poisoning information among children in the target group in Riyadh, Saudi Arabia increased?||Quasi experimental time series survey. Quasi experimental design of before and after intervention in the same area will be a relevant match.|
Almutairi, A. (2010). Raising awareness of food poisoning among schoolchildren aged 8-15 in Riyadh, Saudi Arabia by 40% over 3-years.