I will see you all in just a little bit.
Students will be submitting their logic models this week and should be considering their agency as a whole. The reading from Royse (2023) looks at formative and process evaluations, and we will start class by looking at some of the considerations we should have for process evaluations. During week seven, we will be considering your research question so that you can narrow down exactly what part of the program you are evaluating is being examined. Student will complete their logic models this week. During class, we will discuss how to use our logic models to develop a program description. There will also be a discussion about presentations, and students will be able to complete midterm feedback.
Read
A-01: Class Engagement and Attendance
Attend class. I’d really like for everybody to complete your course evaluation form.
A-02: Chapter Reading Quizzes
Complete W-07 A-02 Chapter Reading Quiz for Royse (2022) Chapter 06 Due by Sunday 3/9, 11:55 PM.
A-04a Individual Weekly Journal Entries
You can find the assignment W-07 A-04a Journal Entry 03 Due by Sunday 3/9, 11:55 PM.
A-04c: Agency Logic Model
Meta: Points 100 pts (10% of student’s final grade); Deadline Sunday 03/02/25 03/09/25 at 11:55 PM; Completion via a forum post on MyHeritage; Locations Assignment Submission, Submission Forum, and Syllabus Handout.
Purpose: Developing a logic model is an essential part of program evaluation. Groups will include the logic model in the executive summary and presentation. They will submit it as a forum post, and during class, they will engage in peer review. This process will help groups formulate a superior final product.
Task: Group members will interview staff working at their evaluation agency. The logic model looks at how a program is implemented through understanding the program’s resources, staff activities, program processes, and outcomes (often framed as immediate, intermediate, and long-range). Royse (2022) provides some context to this in chapter six.
Success: The logic model will be submitted by group members onto the forum. See Appendix B for the rubric. Grades are assigned based on the content of the logic model. Feedback for this assignment will be completed by mid-term grades submission, due by the faculty on Wednesday 03/26/25 at 5:00 PM.
Appendices B. Agency Logic Model Rubric
The Agency Logic Model Rubric evaluates student-using a student-developed rubric developed during 2024. It focuses on visual clarity, resources, staff activities, program processes, and outcomes. Visual/clarity assesses the identification of components. Resources evaluate the identification of agency resources. Staff activities review descriptions of agency services. Program processes assess descriptions of intended agency services. Short-term outcomes evaluate the definition of expected changes, including the target audience, time frame, and desired level of change. Immediate-term outcomes review data collection and connection to program goals. Long-term outcomes assess the identification of data, outcomes, and implementations.
Description | Initial | Emerging | Developed | Highly Developed |
---|---|---|---|---|
Visual/Clarity | Unable to identify the components | Able to identify 3 of the components | Able to identify 4 of the components | Able to identify all of the components. The chart is easy to read and visually appealing |
Resources | No identification of resources | Limited or unclear identification of resources | The majority of resources were identified | Complete understanding of resources identified |
Staff Activities | Minimal to no description of staff services provided by the agency | Seldom description of the staff services provided by the agency | Partial description of most of the staff services provided by the agency | A clear description of all staff services provided by the agency |
Program Processes | Minimal to no description of the intended service(s) of the agency | Seldom a description of half of the intended service(s) of the agency | Partial description of most of the intended service(s) of the agency | Clear description of the intended service(s) of the agency |
Short-Term Outcomes | Limited or no data collected. Brief and unclear statements | Some data was collected, but it is very brief with little detail | Defines the expected change in the program | Specifies the target audience, time frame, and desired level of change |
Immediate Term Outcomes | Did not develop data collection or incomplete | It shows some connection to activities but needs clarification | Explains how the changes were implemented to the program’s goals | Identifies relevant data collection methods to track the progress of program evaluation |
Long-Term Outcomes | Vague or no data and outcomes identified | The outcome has been identified, but it is brief and unclear. The data is somewhat relevant to the outcome | Describes new implementations and long-term outcome goals; minor additions are needed to develop the logic model’s long-term outcomes | Implementations and Long-term outcomes are identified and specified in depth under each category based on program-needed change(s) at the agency |
You can find your midterm course evaluation form.
We will do an activity using a tool from the Canadian community solutions Evaluation Resources website.
We will be using O’Leary (2018) book on research questions. I really liked the little quick fix series for breaking down some parts of research. You can find the series online.
All of the presentations for this class can be found at https://presentations.jacobrcampbell.com. This week’s slides are Spring 2025 SOWK 460w Week 07 - Building the Foundation of a Program Evaluation.
I post all of the lecture videos in MyHeritage so you can view them.
Reference
Royse, D. (2023). Program evaluation: A practical guide for social work and the helping professions. Cognella Academic Publishing.
O’Leary, Z. (2018). Little Quick Fix: Research question. Sage Publications.