17.3 Program Planning Cycle, SMART Objectives, and Types of Evaluation

Program planning and evaluation questions test whether you can move from a community's nutrition problem to measurable objectives and then judge whether a program worked. This section gives the overall cycle; the next chapter adds detail on needs assessment, priority setting, and interventions.

The Public Health Program Planning Cycle

In public health nutrition, planning sustainable community interventions follows a systematic, cyclical problem-solving framework:

Public Health Program Planning Cycle:

Step 1: Community Needs Assessment (Identify health problems & determinants)
        │
        ▼
Step 2: Problem Prioritization (Rank problems using Hanlon/Prioritization matrix)
        │
        ▼
Step 3: Setting SMART Objectives (Specific, Measurable, Achievable, Relevant, Time-bound)
        │
        ▼
Step 4: Strategy & Intervention Design (Evidence-based program & BCC curriculum)
        │
        ▼
Step 5: Program Implementation (Workplans, training, logistics, resource delivery)
        │
        ▼
Step 6: Monitoring & Comprehensive Evaluation (Process, Outcome, Impact, Economic)
        │
        └───────────────────> Feeds back into Step 1 for next programming cycle

Formulating SMART Program Objectives

Program objectives must be formulated with operational precision, adhering to SMART criteria:

• Specific: States precisely what will change, in which population, and in what geographic jurisdiction.
• Measurable: Quantifiable metric allowing objective empirical verification.
• Achievable: Realistic within available financial, human, and logistical resources.
• Relevant: Directly addresses the prioritized community nutritional problem.
• Time-bound: Designates an unambiguous terminal target date.

Example of a Non-SMART Objective: "To improve the vegetable intake and health of children in the municipality."

Example of a Valid SMART Objective: "To increase the proportion of mothers practicing exclusive breastfeeding from 42% to 65% in Barangay Sta. Maria by December 31, 2028."

---

Typology of Program Evaluation

Evaluation is the systematic investigation of the merit, worth, operational efficiency, and clinical significance of a nutrition intervention.

Evaluation Taxonomy in Public Health Nutrition:

1. Formative Evaluation ─────> Conducted during development (pilot tests, pre-testing materials)
2. Process Evaluation ───────> Conducted during execution (fidelity, reach, dose delivered/received)
3. Summative Evaluation:
   ├─ Outcome Evaluation ────> Short-to-intermediate effects (knowledge, attitudes, dietary behaviors)
   └─ Impact Evaluation ─────> Long-term terminal outcomes (stunting, micronutrient status, mortality)
4. Economic Evaluation ──────> Efficiency analysis (Cost-Effectiveness Analysis vs Cost-Benefit Analysis)

1. Formative Evaluation

• When Conducted: During the initial design and pilot-testing phases, before full community rollout.
• Purpose: Assess feasibility, acceptability, literacy comprehension, and cultural appropriateness of intervention materials.
• Common Methods: Focus Group Discussions (FGDs) with local mothers, Key Informant Interviews (KIIs) with midwives, readability index testing of nutrition pamphlets, and pilot cooking demonstrations.

2. Process / Implementation Evaluation

• When Conducted: Continuously throughout program execution.
• Purpose: Monitor whether activities are being delivered as intended according to the operational manual.
• Core Dimensions:
  • Fidelity: The extent to which the intervention was delivered strictly adhering to protocol.
  • Reach / Coverage: The proportion of the intended target demographic that actively participated in the intervention.
  • Dose Delivered: The number of educational sessions, cooking demos, or food rations provided by program implementers.
  • Dose Received: The extent to which target participants engaged with, attended, or consumed the provided interventions.

3. Summative Evaluation: Outcome vs. Impact Evaluation

4. Economic Evaluation: Cost-Effectiveness vs. Cost-Benefit Analysis

Nutrition planners must assess economic efficiency to justify municipal resource allocation:

• Cost-Effectiveness Analysis (CEA):
  • Methodology: Compares program costs in monetary currency (Philippine Pesos) against health benefits quantified in natural, non-monetary health units.
  • Typical Metrics: Cost per case of childhood stunting averted; cost per case of severe acute malnutrition cured; cost per Disability-Adjusted Life Year (DALY) saved.
  • Utility: Enables direct comparison between alternative health interventions addressing the same condition (e.g., comparing home-fortification micronutrient powders vs. biofortified crops).
• Cost-Benefit Analysis (CBA):

  • Methodology: Quantifies both program costs and all resulting health benefits in monetary units (Philippine Pesos).

  • Decision Metric: Benefit-Cost Ratio (BCR):

    $\text{BCR} = \frac{\text{Total Monetized Economic Benefits (PHP)}}{\text{Total Program Costs (PHP)}}$

  • Interpretation: A program is economically viable and yields a positive return on investment if $\text{BCR} > 1.0$. For example, an IYCF intervention with a BCR of $15.0$ indicates that every $\text{PHP }1.00$ invested generates $\text{PHP }15.00$ in preserved future economic productivity and averted healthcare expenses.

---

Applied Public Health Nutrition Scenario

Designing an IYCF Behavior Change Program: Municipality of San Gabriel

In San Gabriel, baseline surveys reveal an exclusive breastfeeding rate of only 28% and a high prevalence of early childhood stunting (32%). An MNAO designs a 2-year Behavior Change Communication (BCC) program utilizing community mother-support groups (Nanay Bayanihan):

Program Planning Execution:
1. Theoretical Framework: Integrates the Transtheoretical Model and Social Cognitive Theory.
   - Precontemplative mothers receive awareness counseling regarding colostrum value.
   - Contemplative mothers attend participatory cooking demos (Modeling & Behavioral Capacity).
2. Formative Phase: Pre-testing illustrated IYCF flipcharts in the local dialect to ensure
   comprehension among low-literacy caregivers.
3. Process Indicators:
   - Reach: 88% of registered pregnant women in the municipality enrolled.
   - Fidelity: 92% of scheduled mother-support sessions completed according to the manual.
4. Outcome Evaluation (At 12 Months):
   - Exclusive breastfeeding rate increased from 28% to 54%.
   - Minimum dietary diversity among infants 6-23 months improved by 35%.
5. Impact Evaluation (At 3 Years):
   - Under-five stunting rate decreased from 32% to 24%.
   - Reduction in infant hospital admissions for acute gastroenteritis by 40%.