Health Policy and Management Fieldwork I: HPM 9289

Defining/framing the problem and context

The resources on this guide are helpful for thinking through these questions:

1. What is the real problem (cause) to be solved, and not the symptoms nor the proposed solution? Or is there an opportunity under consideration?
2. Why is there a need for a solution or the information and analyses to make a decision? Use data and/or relevant policy-related information, if possible, to explain the need for the project.
3. What is the magnitude and scope of the need, problem, or opportunity (tangible and intangible costs, data/statistics on persons, organizations or places affected or at risk, etc.)?
4. Is the problem or challenges technical or adaptive or both?
5. Who are the stakeholders?  Briefly, describe the key stakeholders. Who are potential supporters of your project? Who will be against it or will feel some loss? What are their power and influence on the success of your project?
6. Describe the collaborative partnerships needed for the project to be successful. Explain whether partnerships have already been established and what partners bring to the project. If collaborative partnerships are not needed, explain why
7. Who will benefit (beneficiaries)?  Summarize how the project will promote equity among vulnerable and/or underserved populations.
8. What is the context?  Describe the political and socioeconomic contexts that the project will operate in and the related factors or determinants of equity that it will act upon.
9. What decisions will be made or action taken, by whom, and who is involved in this process?

Equity, Ethics, and Culture

Course readings

Evaluation Types

Evaluations can take many forms and occur at different stage of a program, including: 

Before the program starts or at the start

1. Needs assessment – Who needs what services or support? 
2. Targeting assessment – Is the program reaching who it intended to reach? 

Implementation

1. Process Assessment/Evaluation - Is the program being implemented as it was planned? 
2. Monitoring – Ongoing collection of data to track performance, process and/or outputs 
3. Performance Measurement   
4. Fiscal accountability – Are the implementing organizations stewarding the money properly? 

Mid-term/End of project

1. Impact evaluation – Did the program “work”? Did it have its intended impact? 
2. Cost-benefit, cost effectiveness – Was the program worth it? 

How it was done/Equity

1. Participatory evaluation 
2. Advocacy evaluation    

Learn more at Sage Research Methods Online

Interventions

Prevention Institute: Tools

• CDC Developing Program Goals and Measurable Objectives
• CDC Writing SMART objectives
• University of Wisconsin’s Program Development and Evaluation elaborates on creating and developing logic models with templates.

SMARTER goals

Theory of Change

• The Community Builder’s Approach to Theory of Change: A Practical Guide to Theory Development (The Aspen Institute’s Roundtable on Community Change).
• Theories of Change and Logic Models: Telling Them Apart 
• Theory of Change: A Practical Tool for Action, Results and Learning (Annie E. Casey Foundation)
• Logic Model and Theory of Change (Community Toolbox)
• Global Family Research Project  and Archives and Evaluation Exchange publications and resources for family, children and school programs.
  • Theory of change
  • Logic model and 7 other outcome models
• Measuring Program Outcomes (United Way)

Logic Models and Evaluation Frameworks

• The U.S. Centers for Disease Control Evaluation Group provides links to a variety of logic model resources and assessment and evaluation tools. 
  • Logic models and Evaluation logic models
  • Evaluation resources
  • Public Health Programs study guide
  • Logic Model Magic Tutorial

• American Evaluation Association
  • E-library “logic model” search results
  • Tara Gregory on Using Storytelling to Help Organizations Develop Logic Models discusses techniques to facilitate creative discussion while still attending to the elements in a traditional logic model.
• Evaluation Guidebook for Projects Funded by S.T.O.P. Formula Grants under the Violence Against Women Act  (Chapter 2 logic model)

Quantitative Methods and Analysis

Qualitative Methods for Data Collection and Analysis