Nav R. Ghimire, PhD
Associate Director
LOGIC MODEL
&
PROGRAM EVALUATION
Orientation Class of 2022
The USAID LogFrame of the 1967 - historical precedent
Bennett's hierarchy (1975) - forerunner of today's logic model
Evaluation: Promise and Performance by Joseph S. Wholey (1979)
- first time used the term “Logic Model”
Logic Model Framework - UW-Extension in 1995:
- to respond the GPRA (1993) - focus on results and Link investments to results,
not just activities
Reminds CIPP (Contxt, Input, Process, Product) evaluation model - by Daniel
Stufflebeam (1960)
(Source: Taylor-Powell, 2008)
History of Logic Model Framework
A simplified picture of a program or educational intervention
that shows a
Logical relationships among the:
resources,
activities,
changes in clients
What is a Logic Model
Program planning and implementation
Communication – what your program is (and in not about)
Consensus Building – with program stakeholders
Form a basis for Evaluation
Purpose of a Logic Model Framework
Logic Model Evaluation Model
Logic Model is a Program Development Framework
BUT
–
Describes program initiative & expected achievements
– Facilitates effective evaluation
The Logic Model: Different Looks
Can be a graphic,
table,
flow chart,
narrative
But, fundamentally, the logic model is a way to communicate what
your program is about
The Logic Model
2 3
4
5 6
1
Effectiveness
Efficiency
How SO What ?
Evaluation
Planning
Focus
Focus
Process
Outcome
How and with Whom
What you want to achieve ?
Problem
Logic Model Components
Situation: problems a community is facing, that needs solution.
Inputs: resources needed to offer a program to solve problems.
Activities: actions that are needed to meet your program objectives.
Participants: members of a community who we reach via activities.
Outcome(s): characteristics of the participants that are expected to
change as a result of program.
Outputs: the tangible and direct product of activities + participation,
often expressed in numbers.
Understanding of:
the need or problem
the nature and extent of the need or problem
the causes of the problem and the social, economic, political
and policy contexts
the current and past efforts to address the need or problem and
lessons learned from these efforts
(Adapted from: Hunter, D.E.K. Program Life-Cycles at the Edna McConnell Clark Foundation)
Situation
What you do:
• Workshops
• Meetings
• Services
• Videos
• Blog posts
• Brochures
• Factsheets
• Curriculum
• Counseling
• Evaluation activity
• Working with media
Examples of outputs
Participation/Who you reach:
• Participants
• Clients
• Agencies
• Decision-makers
• Customers
• Satisfaction (some identify this
as a short-term outcome)
• Awareness
• Knowledge
• Perceptions
• Attitudes
• Skills
• Opinions
• Aspirations
• Motivations
• Behavioral intention
• Behavior
• Practice
Examples of outcomes
• Short term outcomes: Gaining individual participants knowledge and
skills
• Medium term outcomes: Increased ability of participants to apply the
learned skills, and adopt and adapt (increased confidence) to the
skills in their individuals lives, farms, and homes.
• Long-term impact: Benefit to family, groups, and community as a
result of a number of program participants applying the learned
skills and community members following it too.
Program’s Rationale for Logic Model
Continuation of existing program
Expansion of existing program
Existing program with modifications
New program
Program Rational Cond…
Logic Model Timeframe
– A program cycle
– A calendar year
– A grant period
– The time you believe it will take to show meaningful results
Logic Model Scope ( County-wide, Multi-county, Statewide)
– Geographic area
– Service area
– Client population
Example of a Logic Model
Intended impact?
To reduce parents stress while raising their children
To improve parent child relationships
Situation:
Parents reported that they were having difficulty
parenting and felt stressed as a result
Parent Education Program – Logic Model
Staff
Money
Partners
Assess
parent ed
programs
Design &
deliver
evidence-
based
program
of 8
sessions
Parents
increase
knowledge of
child dev
Parents better
understanding
their own
parenting style
Parents use
effective
parenting
practices
Improved
child-
parent
relations
Research
INPUTS OUTPUTS OUTCOMES
Facilitate
support
groups
Parents gain
skills in new
ways to parent
Parents
identify
appropriate
actions to
take
Parents
of 4-7
year
olds
attend
Reduced
stress
Parents gain
confidence in
their abilities
Strong
families
Inputs are the resources dedicated to conduct the program?
Resources:
Staff - Family Living Educator / Child Welfare Officer
Partner - Child Welfare / Health and Human Services / Court
Money - Program budget / Grant
Research base - Strengthening Families Program
- Star Parenting
- Triple P-Positive parenting
Materials – Packets, flyers, brochure, other logistics
Time - 8 weeks of two-hour class
Activities: What is the Program doing?
Think for a second about details:
Outreach
• Develop and distribute flyers
• Meet with community agencies
• Write articles for local newspapers
• Develop press packet
• Identify media contacts
• Send press packet out to media contacts
Training
• Hire curriculum development team
• Develop training curriculum
• Recruit training team
• Recruit participants
• Provide training sessions
Outputs = Activities + Participation
Specific to Implementation
# of people trained
# of courses delivered
# of trainings offered
# of training hours
# of people certified
# of people competing the training
Specific to Program Assessment
% participant satisfaction
Specific to Marketing Strategy
# of fliers & brochures
# of social media sites and threads
# of Webcasts / Podcasts / web posts
# of website hits/responses
# of hits/responses to promotional messages
# of News releases
# of posters (signage in general)
Specific to Curriculum
Goals and objectives
Courses offered
Curriculum designed
Learning delivery:
• workshops
• training
• hands-on experience
• group discussions
Outcomes
Medium-term:
Behavior / Action / Practices Change
• Parents identify appropriate actions to take for parenting
• Parents use effective parenting practices
Long-term:
Change in Conditions
• Parents reduced stress while parenting their kids
• Improved child-parent relations
• Develop strong families
Short-term:
Knowledge and Skills Gain
• Parents increase knowledge of child development process
• Parents increase understanding about their own parenting style
• Parents gain skills in new ways to parenting
• Parents gain confidence in their parenting abilities
Outcome Statements Contd…
Who/what, Change/desired effect, in what, by when, Assessment
Who/what Change/
desired effect
In what By when Assessment
Parents
attending
parenting
program
Gain knowledge Child development process
Own parenting style
New ways of parenting
By the end of
parenting class
End of session
evaltion Pre-and-
post-test
Parents
attending
parenting
program
Take action Use effective parenting
practices
Within 3 months after
the program finishes
Follow-up
evaluation at 6
months
Parents
attending
parenting
program
Change conditions Improved child-parent
relations
Reduced level of stress while
parenting
Within 6 months Follow-up
evaluation at 6
months with
request to write
stories, Focus group
interview
Limitations of the Logic Model ?
Represents” reality; it is NOT a reality
Linear nature fails to reflect/capture the program complexity
Causal attribution is questionable – does not prove the program caused the
observed outcome, mainly long-term outcome
It does not list the program objectives; program implementation, outcomes and
evaluation design are linked to program objectives
Does not talk about the gap analysis
Does not reflect unintended outcomes (positive or negative)
Logic Model Resources
Online course on developing logic models and evaluation plans. Offered by University
of Wisconsin, Extension and designed for the beginner. (www1.uwex.edu/ces/lmcourse/)
Logic Model Overview. Also from University of Wisconsin, includes links to
workbooks, PowerPoint presentations, etc.
(www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html)
W.K.Kellogg Foundation Logic Model Development Guide. Clear and concise
discussion of the use of logic models. (https://www.wkkf.org/resource-
directory/resource/2006/02/wk-kellogg-foundation-logic-model-development-guide)
Logic Model Tools. A comprehensive list provided by the CDC.
(https://www.cdc.gov/eval/resources/index.htm)
Innovation Network’s Workstation: an online workstation with evaluation and
planning tools designed specifically for nonprofit organizations. (www.innonet.org)
Community Tool Box. ctb.ku.edu/tools/en/sub_section_examples_1877.htm
Logic Model Resources
National Center for Community-Based Child Abuse Prevention
http://friendsnrc.org/evaluation-toolkit/menu-of-outcomes-and-
indicators
Developing an Effective Evaluation Plan (CDC)
http://www.cdc.gov/obesity/downloads/CDC-Evaluation-Workbook-
508.pdf
The Evaluation Flash Cards
• http://www.betterevaluation.org/en/resources/guide/evaluation_flash_
cards
Useful Links
Measuring Outcomes of Financial Capability Programs:
Success Measures Tools for Practitioners
http://www.successmeasures.org/sites/all/files/FinancialCa
pabilityOnlineFinalOct2011.pdf
SNAP-Ed Evaluation Framework Interpretive Guide
https://snaped.fns.usda.gov/snap/EvaluationFramework/SN
AP-EdEvaluationFrameworkInterpretiveGuide.pdf
Schmidt, T. ( 2013). Turn strategy into action. Paper presented at the ASP National Conference,
Atlanta, GA: April 22-24.
Watson, Y. (2012). Picturing your program: An introduction to logic modeling.
U.S. Office of Personnel Management.
Taylor-Powell, E., & Henert, E. (2008) Developing a logic model: Teaching and
training guide. Madison, WI: University of Wisconsin Extension, Cooperative Extension,
Program Development and Evaluation. http://www.uwex.edu/ces/pdande
Watkins, R., & Kavale, J. (2014). Needs: Defining what you are assessing. In J. W. Altschuld & R.
Watkins (Eds.), Needs assessment: Trends and a view toward the future. New Directions
for Evaluation, 144, 19–31.
References Used in this Presentation
