10.6 MT Program Audits, Supplier Oversight, and Personnel Performance

10.6 MT Program Audits, Supplier Oversight, and Personnel Performance

The final tasks in the official Level III MT topic list are the oversight tasks: perform MT program audits, evaluate MT personnel performance, and manage MT qualification/certification programs. They exist because everything else in this guide degrades silently. Baths drift, lamps dim, inspectors get faster than they should, procedures fall behind code revisions, and nobody reports it — because nobody is asked.

---

Three Different Audits, Frequently Confused

A programme that passes a system audit and fails a process audit is the normal failure mode: the paperwork is complete and the practice has drifted away from it. A Level III who only reads files will never find it.

---

Conducting a Process Audit That Finds Real Problems

1. Audit against the specific requirement, not general good practice. Build the checklist from the governing documents, quoting the requirement and its paragraph — ASME Section V T-765.2 concentration checks at least every eight hours, T-765.3 contamination check at least once per week, T-766 Ketos ring check at least once per week, T-762.2(a) yoke verification prior to use each day, T-777.2 UV-A measurement prior to use and whenever the power source is interrupted or changed.
2. Take your own readings. Measure the UV-A irradiance, the ambient white light, and the bath concentration yourself, next to the technician's logged values. Divergence between the log and the meter is the single most productive audit finding in MT.
3. Watch a whole examination, start to finish. Sequence errors show up only in real time: wet particles applied after the shot rather than before, dry powder dusted after the current is released, prods dragged while energized, the second orthogonal shot skipped on a rushed lot.
4. Read logs for the wrong kind of perfection. Identical daily values, values recorded in advance, entries in one handwriting for a shift that had three operators, and readings that never fail are contamination indicators in the data.
5. Trace one part end to end. Pick a serialized part and follow it from purchase-order requirement to technique sheet to examination record to indication map to disposition to demagnetization and cleaning record. Breaks in that chain are where audits earn their cost.
6. Write findings as requirement, evidence, and gap. "Bath concentration low" is not a finding. "T-765.2 requires concentration checks at least every eight hours; the log for 14 September shows one entry for a 16-hour two-shift day, and the sample drawn during the audit read 0.06 mL against a 0.1 to 0.4 mL requirement" is.
7. Close the loop. A finding without a documented root cause, corrective action, responsible owner, due date, and later verification of effectiveness is a finding that will recur at the next audit.

---

Evaluating MT Personnel Performance

Certification says a person was qualified on a date. Performance evaluation asks whether they still are.

• Annual proficiency evaluation. NAS 410 makes this explicit for aerospace, requiring hands-on practical evaluation or documented technical audit of each inspector annually. Even outside aerospace it is the cheapest defence a Level III has.
• Blind sample seeding. Introduce parts containing documented subtle flaws — shallow grinding cracks, tight thermal fatigue cracks — into the normal production flow. Measure both detection rate and false-call rate; an inspector with perfect detection and a 30% false-call rate is as expensive as one who misses flaws.
• Re-inspection agreement. Independently re-examine a sample of accepted and rejected parts and track agreement with the original disposition, by inspector and by part family.
• Interpretation panels. Periodically have several inspectors evaluate the same indication set independently and compare. Systematic disagreement on non-relevant indications is a training signal, not a discipline signal.
• Vision currency. Annual near-vision and colour-perception examinations are a hard gate; an expired vision record invalidates the certification until it is restored.
• Objective production signals. Escapes found by downstream methods, customer returns, re-inspection requests, and scrap driven by over-rejection all belong in the evaluation.

Certification Lifecycle Consequences

---

Supplier and Subcontractor Oversight

The employer's Level III owns the technical adequacy of outsourced MT. A workable oversight cycle is:

1. Qualify before award — written practice, procedures, personnel and vision records, calibration traceability, process-control logs, and a witnessed demonstration on representative hardware for critical work.
2. Flow requirements down in writing — the subcontract must carry the resolved, most-restrictive parameter set, not a bare reference to "MT per applicable standards."
3. Surveil during performance — periodic on-site process audits, receiving re-inspection at a defined sampling rate, and review of the supplier's own process-control data.
4. Manage outside Level III services — where the Level III function itself is contracted in, the written practice must define the administrative relationship, the scope of delegated authority, and confirm that the outside Level III's qualifications were audited and accepted by management.
5. Feed findings back into the approved-supplier decision — a supplier whose findings recur without effective corrective action should lose approval, not receive a fourth corrective action request.

For context on the external scrutiny a programme faces: ASNT's own Level III examinations are ANAB-accredited, aerospace primes commonly require Nadcap NDT audits, and customer quality audits routinely set a documentation bar above the technical codes. A Level III who audits to the code alone will still be surprised by an external audit.