11.1 Scholarly Inquiry Processes

Scholarly Inquiry Processes for Nursing Professional Development

Quick Answer: Match study design to the question, interpret data as a critical consumer, appraise level and quality of evidence, and correctly separate research (new generalizable knowledge + IRB), EBP (best evidence + expertise + values), and QI (local process improvement with cycles). Use those distinctions when designing education, competency, and policy.

Why Domain IV Matters for NPD (Even at 6%)

Evidence-Based Practice and Research is only about 6% of scored items (roughly seven questions), but it is high leverage for real practice. NPD specialists decide what goes into orientation, annual competency, simulation, and policy-linked education. Applying weak studies, confusing a QI project with research, or skipping appraisal can waste staff time—or worse, hardwire unsafe practice.

On the exam, stems often look like leadership or education questions: a manager wants a house-wide class “because a study said so,” a unit wants to survey staff without IRB thinking, or a committee debates whether a journal article is strong enough to change a competency criterion. Your job is to choose the answer that shows design literacy, appraisal, and correct research–EBP–QI framing.

Study Designs Overview

Qualitative, quantitative, and mixed methods

Exam cue: If the question is “how many,” “does X change Y,” or “which group scored higher,” think quantitative. If it is “what does it feel like,” “why do staff resist,” or “how do preceptors make sense of failure,” think qualitative. Mixed methods fit when one method alone cannot answer the practice question.

Experimental vs observational (quantitative lens)

Experimental and quasi-experimental designs involve an intervention and comparison in a controlled or semi-controlled way:

• True experiment / RCT: Random assignment to intervention vs control (or comparison). Strongest for causal claims when well done, but often hard in education settings (contamination across shifts, ethics of withholding needed training).
• Quasi-experimental: Intervention without full randomization (e.g., Unit A gets new simulation bundle; Unit B is historical or concurrent control). Common in NPD practice evaluation.
• Pre/post (single group): Measure before and after education. Useful for local learning outcomes, weak for proving the education alone caused system-wide outcome change (many confounders).

Observational designs describe or associate without assigning an intervention as in a trial:

• Cohort: Follow groups over time (e.g., new grads in a residency vs historical cohort).
• Case-control: Compare those with an outcome to those without (less common in education research).
• Cross-sectional: Snapshot at one time (e.g., one-time survey of competency confidence).
• Descriptive / correlational: Describe variables or relationships without claiming strong causation.

NPD scenario: Leadership asks, “Did our new central-line simulation reduce CLABSI?” A pure pre/post education score cannot answer infection outcomes. A quasi-experimental design with process audits, infection data, and concurrent unit comparison is stronger. An RCT withholding CLABSI education is usually unethical. Exam answers that claim “proof of causation” from a single post-test smile sheet are wrong.

Qualitative designs NPD should recognize

• Phenomenology: Lived experience (e.g., night-shift nurses learning a new EHR during go-live).
• Grounded theory: How a social process unfolds (e.g., how float staff learn unit norms).
• Ethnography / focused ethnography: Culture and practice in context (unit routines that undermine taught policy).
• Content or thematic analysis of open responses: Often used in course evaluations and needs assessments.

Qualitative work does not produce p-values as its main product; credibility rests on transparent methods, sampling strategy, and rigorous analysis—not on “N = 500.”

Data Collection and Interpretation Basics for NPD Consumers

NPD specialists rarely need to run multivariate regression on the exam. They do need to spot whether data support a practice or education change.

Collection methods you will see

1. Surveys / knowledge tests — Feasible, often overused; watch response rate, biased items, and testing to the slides rather than practice.
2. Observation / audit — Stronger for skill and process fidelity (hand hygiene, alarm setup, time-out technique).
3. Simulation performance metrics — Checklists, time to critical action, team behaviors; great for Ability, limited as sole proof of bedside outcomes.
4. EHR and quality data — Outcome and process indicators (falls, restraint, documentation, barcode compliance).
5. Interviews / focus groups — Depth for barriers, culture, and design feedback.
6. Administrative learning data — LMS completion, CE attendance, orientation timeline metrics (necessary but never sufficient alone).

Interpretation concepts (consumer level)

• Validity: Does the tool measure what it claims? (A 10-item quiz may not measure safe pump programming.)
• Reliability: Are results consistent? (Inter-rater agreement on competency checklists matters.)
• Sample and setting fit: Was the study done with similar learners, acuity, and resources? A large academic ICU trial may not transfer to a critical-access hospital’s orientation model.
• Statistical vs practical significance: A tiny score gain can be “significant” with a huge sample yet meaningless for competency policy.
• Bias and confounders: Hawthorne effect, volunteer bias, concurrent policy/equipment changes, staffing shifts during the “education intervention.”
• Outcome hierarchy for education: Reaction → learning → behavior/practice → results/outcomes (classic evaluation thinking). Higher levels need stronger designs and longer follow-up.

Hospital scenario: misread data

After a falls e-learning module, knowledge scores rise from 72% to 91% (p < 0.01). Falls with injury do not change. NPD correctly reports learning improved and refuses to claim the module “fixed falls.” Next steps: observe rounding and alarm use, fix equipment barriers, redesign night-shift workflow, and re-measure process and outcome data. Exam cue: improved test scores ≠ improved practice or outcomes.

Appraising Levels of Evidence and Common Tools (Conceptual)

NPD uses evidence hierarchies as a starting map, not a religion. Typical nursing/education-friendly framing (wording varies by model):

1. Systematic reviews / meta-analyses of high-quality studies
2. Well-designed RCTs / strong experimental studies
3. Quasi-experimental and controlled quality studies
4. Cohort, case-control, correlational studies
5. Descriptive quantitative, qualitative studies, case reports
6. Expert opinion, manufacturer guidance, consensus statements (still useful when higher evidence is thin—label them honestly)

Quality matters as much as level. A poorly done RCT can be less useful than a rigorous multi-site qualitative study for understanding why staff abandon a protocol.

Conceptual appraisal tools NPD should know by name/purpose

You are not expected to recite every checklist item from memory, but you should know why tools exist:

• Critical appraisal checklists (e.g., CASP-style tools, Joanna Briggs–type tools, specialty nursing appraisal guides): structured questions on validity, results, and applicability.
• AGREE-type thinking for guidelines: Is the guideline rigorous, transparent, and applicable to your setting?
• Melnyk / evidence-hierarchy pyramids and PICOT framing: Clarify the clinical or education question before searching.
• Johns Hopkins / Iowa / other EBP models (conceptual): Provide steps from problem through appraisal to translation—NPD often owns education pieces of the model.

Appraisal questions every educator should ask:

1. What was the question and design?
2. Who was studied, and does that match our staff/patients/learners?
3. Were methods strong enough for the claim being made?
4. Are results clinically and educationally meaningful?
5. What resources, training, and system supports are needed to implement?
6. What could go wrong if we teach this as “required practice” tomorrow?

Hospital scenario: evidence for competency criteria

A vendor claims a new smart-pump training video “reduces medication errors by 40%.” Appraisal finds a single-site pre/post study with no control for concurrent pharmacy library changes and self-reported errors only. NPD does not reject the product automatically—but refuses to set house-wide competency criteria solely on that claim. Plan: pilot with observation-based validation, partner with pharmacy/quality on hard data, and update competency only after local evidence supports safety and feasibility.

Research vs EBP vs QI — Purpose and IRB Considerations

This triad is classic Domain IV material. Confusing them is a common exam and practice trap.

Practical IRB literacy for NPD

• IRB (Institutional Review Board) protects human subjects in research: risks, consent, privacy, justice.
• When NPD must pause and ask: Surveys marketed as “research,” multi-site data collection for a thesis, comparing interventions to produce generalizable education science, recording identifiable learner data for external presentation beyond operations.
• When operations-style QI is usual: Tracking orientation completion, auditing checklist use after a policy change, PDSA on class scheduling, local competency pass rates for internal improvement—with appropriate privacy and leadership approval.
• Gray zone: Publishing QI externally, using student researchers, or expanding a local project into a multi-hospital study—seek QI vs research determination early. Do not invent your own exemption.
• Ethics still apply to QI: Minimize burden, protect dignity, avoid coercive “mandatory research,” and secure data.

Worked distinctions (exam-ready)

1. Research: An NPD doctoral student randomizes units to spaced-repetition microlearning vs standard LMS modules to test knowledge retention at 90 days and plans multi-site publication → research protocol + IRB.
2. EBP: A shared-governance team appraises literature and guidelines on early mobility, adopts a bundle suited to their ICU, and NPD designs competency and simulation to implement the chosen practice → EBP translation + education.
3. QI: Fall rates rise on nights; team runs PDSAs on purposeful rounding script and alarm defaults, measures weekly process audits, NPD supports just-in-time education for night shift → local QI.

NPD role as critical consumer (not only project owner)

Even when NPD is not the principal investigator, educators:

• Help staff form answerable questions (PICOT for clinical; analogous education questions for learning design).
• Search and screen literature with librarians or EBP mentors.
• Appraise before hardwiring content into orientation.
• Refuse “single article = new mandatory policy” without quality check.
• Model intellectual honesty: uncertainty, conflicting evidence, and need for local adaptation.

Integrating Inquiry into Daily NPD Work

1. Needs assessment uses inquiry methods (data + voice of learner/patient).
2. Curriculum design cites evidence for methods (simulation for psychomotor/high-risk skills; spaced practice for retention) when available.
3. Competency criteria reflect standards, guidelines, and local risk—not vendor marketing alone.
4. Evaluation plans pre-specify what success looks like at learning, practice, and outcome levels.
5. Partnerships with quality, IRB, library, and clinical experts keep Domain IV work rigorous.

Common Exam Traps

• Calling a staff satisfaction survey with publication intent “just QI” to avoid IRB.
• Treating qualitative studies as “not real evidence.”
• Claiming causation from pre/post knowledge scores alone.
• Equating hierarchy level with automatic adoption without applicability appraisal.
• Using education research jargon without protecting learners as human subjects when the project is true research.

Master these inquiry foundations so Section 11.2 can focus on translation and dissemination—moving sound evidence into practice, curricula, and professional sharing without losing scientific integrity.