11.5 Training Needs Analysis, Program Evaluation, & Technical Documentation
Key Takeaways
- ACI's outline asks the CHTM to base training needs on cost, ROI, operations, technical requirements, competency, customer requirements, resources, and asset inventory.
- A training needs analysis works at three levels: the organization, the task, and the individual.
- The Kirkpatrick model evaluates training at four levels — reaction, learning, behavior, and results — and Phillips adds a fifth level for return on investment.
- HTM training effectiveness is measured with operational data such as failure rates, total time to repair, competency results, and user satisfaction.
- CMS surveyors confirm that manufacturer recommendations, such as operation and maintenance manuals, are available, so HTM should secure manuals at purchase and control them in a document library.
Training Needs Analysis, Program Evaluation, & Technical Documentation
Training budgets are limited, and factory courses can cost thousands of dollars per person. ACI's Education & Training outline asks the CHTM to analyze training needs "based on cost, ROI, operations, technical requirements, competency, customer requirements, resources, asset inventory," to evaluate training effectiveness by "cost, failure rates, total time to repair, staff competencies/skill set, user satisfaction," to manage training and development across safety, soft skills, technical skills, regulatory requirements, internal policies, and orientation, and to assure availability of training manuals — service manuals, operations manuals, training media, and other materials. Sections 11.1–11.4 cover competency assessment, career ladders, clinical user training, and cross-department education; this section covers the planning and measurement behind them.
1. Training Needs Analysis (TNA)
A TNA compares what staff need to know and do with what they can do today, at three levels:
| Level | Question | HTM data sources |
|---|---|---|
| Organizational | What does the department need to deliver in the next 1–3 years? | Capital plan and incoming technology (asset inventory changes), service strategy (in-sourcing), survey findings, strategic goals |
| Task | What knowledge and skills does each job and device require? | Manufacturer service requirements, job descriptions, competency checklists, regulatory requirements |
| Individual | Who has gaps? | Competency assessments, work order audits, repeat repairs, customer complaints, self-assessments |
Prioritizing training investments. Rank needs by patient-safety risk, the size of the gap, how many devices or staff are affected, and the financial return. Useful questions:
- Will this training let us bring service in-house and cancel or reduce a contract?
- Does new equipment arrive this year that no one can support?
- Do failure trends or use-error calls point to a specific skill gap?
- Is a single technician the only person who can support a critical modality (section 11.2)?
Build or buy? Options include OEM factory schools, AAMI and other association courses, online modules, vendor in-services, and internal training by senior technicians. Match the method to the skill: hands-on troubleshooting needs practice, while regulatory updates may work well online.
2. A Balanced Staff Training Plan
ACI lists six content areas for staff training and professional development:
| Area | Examples for an HTM department |
|---|---|
| Safety | Electrical safety, lockout/tagout, bloodborne pathogens, radiation and laser safety, MRI zones |
| Soft skills | Customer service, communicating with clinicians, conflict resolution, teamwork, SBAR escalation |
| Technical skills | Modality-specific service schools, networking and cybersecurity basics, new-technology training |
| Regulatory / code compliance | CMS and accreditation requirements, NFPA 99, FDA reporting, HIPAA |
| Internal policies and procedures | CMMS documentation standards, recall handling, AEM procedures, on-call rules |
| Orientation and initial training | Assigned mentor, SOP review, facility tour, shop tools and test equipment (section 10.2) |
Schedule the plan across the year, record completion in the learning management system or CMMS, and tie individual plans to career-ladder steps and certifications such as CBET, CRES, and CHTM.
3. Evaluating Training Effectiveness
The Kirkpatrick model evaluates training at four levels, and Phillips adds a fifth:
| Level | Measures | HTM example |
|---|---|---|
| 1 – Reaction | Did participants find it relevant and useful? | Post-course survey |
| 2 – Learning | Did knowledge or skill increase? | Pre- and post-tests; hands-on return demonstration |
| 3 – Behavior | Do people apply it on the job? | Work order audits; supervisor observation; fewer escalations to the vendor |
| 4 – Results | Did outcomes improve? | Lower failure and repeat-repair rates, shorter total time to repair, fewer use-error calls, higher user satisfaction |
| 5 – ROI (Phillips) | Did the benefits exceed the costs? | Avoided vendor calls and contract savings compared with training cost |
Worked ROI example. A $12,000 factory course lets two technicians handle ultrasound probe testing and first-look repairs in-house. Over the next year, the department avoids $30,000 in vendor calls and depot fees.
Net benefit = $30,000 − $12,000 = $18,000. ROI = $18,000 ÷ $12,000 = 150%.
Collect a baseline before training (for example, the previous six months of vendor calls, repair time, and repeat repairs) so the comparison is credible. Watch for other changes happening at the same time that could explain the results.
Operator training effectiveness uses the same logic. After an infusion pump in-service, track "no problem found" calls, alarm-related complaints, and DERS override rates for the trained units against a baseline (section 11.3).
4. Keeping Manuals and Training Materials Available
Why it matters: CMS surveyors check that the hospital has manufacturer recommendations available — operation and maintenance manuals, service records, and recall information — and technicians cannot follow manufacturer procedures they cannot find. FDA requires laser manufacturers to provide maintenance schedules and service instructions, and many other manufacturers supply service documentation only when the purchase contract requires it.
How to manage the technical library:
- Secure documents at purchase: Put service manuals, schematics, operator manuals, training materials, and software tools in the capital contract (section 7.3).
- Link documents to the CMMS: Attach or link the current manual revision to each make and model so technicians open the right version from the work order.
- Control versions: Record revision dates, replace superseded manuals, and file service bulletins and field safety notices with the model.
- Control access: Keep proprietary manuals and service software in a secure repository, as license terms require.
- Support clinical users: Keep operator manuals and quick-reference guides at the point of use (for example, QR codes on devices linking to the intranet) and share in-service recordings for new staff.
- Review annually: Audit a sample of models to confirm that manuals and training materials are present and current, and fix any gaps.
An HTM manager has budget for only one advanced course this year. Which request should rank highest in a training needs analysis?
Six months after a ventilator service course, the HTM manager compares corrective repair time, repeat repairs, and vendor call-outs with the six months before the course. Which Kirkpatrick level is the manager measuring?
During a survey, a CMS surveyor asks for the manufacturer's maintenance recommendations for a sample of devices. HTM finds that manuals for three recently purchased models were never received. What is the best corrective action?
You've completed this section
Continue exploring other exams