7.6 Digital Media, Message Testing, and Evaluation
Key Takeaways
- Digital channels should be selected for audience reach, access, trust, privacy, and communication objective.
- Pretesting can identify confusion, stigma, weak calls to action, and channel barriers before full launch.
- Digital metrics such as clicks and impressions do not automatically prove behavior change.
- Communication evaluation should connect reach, comprehension, engagement, and outcomes.
Choosing channels and learning before launch
Digital media can support reminders, education, peer connection, service navigation, and rapid updates. Channels may include websites, email, text messages, social platforms, video, webinars, patient portals, apps, podcasts, or online ads. The CHES decision is not whether digital media is modern. The decision is whether a channel fits the audience, objective, privacy needs, resources, and evaluation plan.
Before launch, check whether the message is:
- Noticeable and understandable to the intended audience.
- Credible, respectful, and linked to a clear action.
- Accessible and safe for the channel being used.
Reach is not the same as access. A social platform may have many users, but the intended audience may not use it for health information. A patient portal may be secure, but it may miss people who have not activated accounts. Text messaging may be effective for reminders, but messages must be short, private enough for shared phones, and linked to a clear action.
Trust differs by channel. A message from a local clinic may be trusted in one community. A message from a government account may be trusted in another, or may face skepticism. Community organizations can extend reach and credibility when they already have relationships with the audience. The exam may test whether you choose a messenger and channel based on trust rather than popularity.
Privacy and consent matter. Digital health communication can reveal sensitive information if messages appear on shared devices or public screens. A reminder that says "Your HIV appointment is tomorrow" may create harm if someone else sees it. A more private reminder may say, "You have an appointment at 2 p.m. tomorrow. Call this number with questions." Follow organizational policy and applicable privacy rules.
Pretesting is a small-scale check before full release. Methods include intercept interviews, cognitive interviews, A/B tests, usability tasks, readability review, and pilot posting with feedback. The goal is to learn whether the audience notices the message, understands it, finds it credible, sees the action, and can use the channel.
Pretesting should include people similar to the intended audience. Staff review is useful for accuracy, but staff are not a substitute for audience testing. A flyer can be medically accurate and still fail because the call to action is hidden. A video can be appealing and still fail because captions are missing or the first seconds do not state the benefit.
Digital metrics need careful interpretation. Impressions show that content was displayed. Reach estimates how many people may have seen it. Click-through rates show interaction. Completion rates show whether people finished a video or module. Comments may reveal questions or misinformation. None of these alone proves behavior change.
Evaluation should connect communication objectives to measures. If the objective is awareness, recall and recognition may matter. If the objective is appointment scheduling, completed appointments matter more than likes. If the objective is skill use, demonstration or self-efficacy may be measured. Process data can still be valuable because poor reach may explain weak outcomes.
For CHES exam items, do not choose a channel just because it is digital. Look for the audience profile, communication objective, and constraints. The best answer may be a mix of text reminders, community radio, printed materials, and partner outreach. Strong communication planning tests messages, protects privacy, ensures accessibility, and evaluates whether the message moved people toward the intended action.
A clinic wants to remind patients about sensitive appointments. Many patients share phones with family members. Which message is most privacy-protective?
Which metric best matches a communication objective to increase completed screening appointments?
What is the main purpose of pretesting a new message?