Skip to main content
Public Health Workforce Training
Link to beginning section of Advanced Program Evaluation

Recap

ShapeTracker Intervention Stakeholders

  • Commissioner Middleton County (MC)
  • Middleton County (MC) Health Department (HD) ShapeTracker (ST) team
  • MC HD Information Technology staff
  • MC HD marketing/communications staff
  • Other MC HD staff
  • CDC
  • Group that developed ST for CDC
  • MC community members
  • Wellness advocates in MC
  • Obesity prevention programs in MC
  • Healthy eating related resources in MC
  • Exercise resources in MC
  • Smartphone providers in MC
  • California communities that implemented ST
  • Smartphone companies
  • MC government

Logic Model

Inputs Activities Outputs Short-term Outcomes Intermediate Outcomes Long-term Outcomes
ShapeTracker App Mobilize local resources and customize ST for MC # of times ST app downloaded in MC Decrease perceived barriers to healthy eating and physical activity Increase healthy eating in MC Reduce obesity in MC
Funding from HD and CDC Market ST in MC # of MC residents actively using ST Increase self-monitoring of healthy eating and physical activity Increase physical activity in MC Reduce obesity related health problems in MC
Team of experienced staff Keep app updated and maintain content Amount of use for different ST functions Increase self-efficacy for healthy eating and physical activity    
High smart phone use in MC community Provide technical assistance to users User satisfaction with ST Increase social supprt for healthy eating and physical activity    
Marketing & communication resources in HD   # of friends referred to ST      
IT resources in HD   # of MC residents actively using ST long-term      
Local obesity prevention resources in MC          

ShapeTracker Intervention Evaluation Questions

Process Questions
  1. Was a broad range of local resources successfully engaged in the project?
  2. Was ST successfully disseminated to a broad segment of MC community?
  3. What proportion of MC residents have:
    • downloaded the app?
    • became active users of the app?
    • became active long-term users of the app?
  4. For those who stopped using ST, why did they discontinue?
  5. How much are ST users using different functions in ST?
  6. How satisfied are MC residents with the ST app and its specific features?
Outcome Questions
  1. Does use of ST increase:
    • self-monitoring of healthy eating and physical activity?
    • self-efficacy for healthy eating and physical activity?
    • social support for healthy eating and physical activity?
  2. Does ST decrease perceived barriers to healthy eating and physical activity?
  3. Does use of ST increase healthy eating and physical activity among county residents?
  4. Does use of ST lead to lower BMI among those who are obese or overweight?
  5. Does use of ST help those with normal BMI prevent overweight?

The evaluation questions we have chosen to address in our evaluation plan.

We have covered a lot of information for our Evaluation Plan today. To recap, here are the sections again:

  1. Purpose of Evaluation
  2. Project Setting and Stakeholders
  3. Project Intervention
  4. Logic Model
  5. Evaluation Questions
  6. Evaluation Design
  7. Data Analysis Plan
  8. Limitations and Feasibility
  9. Dissemination Plan

Most of what we discussed today focused on the design for outcome evaluation, which is the “centerpiece” of the evaluation plan. But as we saw, all other sections of the plan relate to the evaluation design. It is especially important to keep in mind that throughout the evaluation planning process you should revisit the Stakeholders, Logic Model and Evaluation Questions.

The sections of the plan roughly correspond with steps in the CDC Program Evaluation Framework:

Evaluation Plan Section:

Purpose of Evaluation
Project Setting and Stakeholders

Step in CDC Framework:

1. Engage stakeholders

Evaluation Plan Section:

Project Intervention
Logic Model

Step in CDC Framework:

2. Describe the program

Evaluation Plan Section:

Evaluation Questions

Step in CDC Framework:

3. Focus the evaluation design

Evaluation Plan Section:

Evaluation Design

Step in CDC Framework:

4. Gather credible evidence

Evaluation Plan Section:

Data Analysis Plan
Limitations and Feasibility

Step in CDC Framework:

5. Justify Conclusions

Evaluation Plan Section:

Dissemination Plan

Step in CDC Framework:

6. Ensure use and share lessons learned

That concludes our session today. Thanks for helping the ShapeTracker team work on their evaluation plan and figure out their evaluation design! Good luck with your own evaluation projects!