8.4 Research Instrumentation, Data Gathering, Tabulation and Analysis

Key Takeaways

  • Social Work Research 2 sub-topic C.1 carries seven items on instrumentation, data gathering, tabulation and analysis.
  • Instrument development runs from operational definition through item writing, expert content validation, pre-testing and reliability estimation.
  • Gender-sensitive data collection requires sex-disaggregated items, non-leading wording, private settings and same-sex interviewer options where appropriate.
  • Data processing follows editing, coding, classification, tabulation and then analysis; errors introduced at editing propagate to every later step.
  • Quantitative data analysis matches the level of measurement, while qualitative analysis proceeds through transcription, coding, categorisation and thematic interpretation.
Last updated: September 2026

8.4 Research Instrumentation, Data Gathering, Tabulation and Analysis

Blueprint anchor. TOS topic C. SOCIAL WORK RESEARCH 2 carries 10 items, of which sub-topic C.1 (7 items) covers ways of research instrumentation, data gathering, data tabulation and data analysis — including an explicit competency on collecting data in a gender-sensitive manner.


1. Building a Research Instrument

StepTaskFailure if skipped
1. Operational definitionState how each construct will be observed and measuredItems that do not measure the stated variable
2. Item constructionWrite clear, single-barrelled, non-leading items at the respondent's reading levelAmbiguity and response bias
3. Response formatChoose checklist, Likert scale, ranking, open-ended or scenario formatData that cannot answer the question
4. Content validationSubmit to subject-matter experts for relevance and coverage reviewMissing dimensions of the construct
5. Pre-test / pilotAdminister to a small comparable group; time it; debriefDiscovering fatal wording problems after full fielding
6. Reliability estimationTest-retest, split-half, internal consistency, or inter-rater agreementNo evidence the instrument measures consistently
7. Revision and finalisationAmend, renumber, produce the final field version and manualInterviewers improvising in the field

Item-Writing Rules

  • One idea per item; avoid double-barrelled questions ("Are the staff courteous and prompt?").
  • Avoid leading wording ("Do you agree that the programme has helped your family?").
  • Avoid negatives and double negatives.
  • Avoid technical jargon and untranslated English in a Filipino-language instrument; back-translate to check fidelity.
  • Provide mutually exclusive and exhaustive response categories.
  • Place sensitive items after rapport-building items, never first.

2. Validity and Reliability of Instruments

ConceptQuestionEvidence
Face validityDoes it look appropriate?Judgement of respondents and readers
Content validityDoes it cover the whole construct?Expert panel review against a specification
Criterion validityDoes it agree with an accepted measure?Correlation with a criterion instrument
Construct validityDoes it behave as theory predicts?Expected relationships with other variables
Test-retest reliabilityStable over time?Correlation across two administrations
Internal consistencyDo items hang together?Item-total correlations; coefficient alpha
Inter-rater reliabilityDo different raters agree?Agreement between independent raters

An instrument may be reliable without being valid — consistently measuring the wrong thing — but it cannot be valid without being reliable.


3. Gender-Sensitive and Culturally Grounded Data Gathering

The TOS names gender-sensitive data collection explicitly. In practice this means:

  • Disaggregate by sex at the point of collection; a variable not collected disaggregated cannot be disaggregated later.
  • Ask about control, not only access — who decides how income is used, not only whether income exists.
  • Count unpaid care work, which household income questions systematically miss.
  • Interview privately. Asking a woman about household decision-making in front of her husband produces a measurement artefact.
  • Offer a same-sex interviewer for sensitive topics, and never interview a survivor of violence in the presence of the alleged perpetrator.
  • Avoid gendered assumptions in wording — "household head" defaults to men in many respondents' understanding; ask about roles instead.

Indigenous Filipino methods recognised in Philippine social work research are pagtatanong-tanong (iterative, unobtrusive questioning woven into ordinary conversation), pakikipagkuwentuhan (shared storytelling), pakikiramdam (attuned sensing of what is unsaid) and pakikisama and pakikipagpalagayang-loob as relational preconditions of honest disclosure. These are not informal shortcuts; they are the culturally valid route to data that a formal questionnaire administered by a stranger will not obtain.


4. Data Processing: From Raw Returns to Tables

  1. Editing. Check every return for completeness, legibility, consistency and range. Resolve contradictions by callback where possible; never silently invent values.
  2. Coding. Assign numerical codes to categories; build a codebook recording every variable name, code, label and missing-value convention.
  3. Classification. Group data into meaningful classes and intervals.
  4. Tabulation. Produce frequency tables and cross-tabulations. Every table needs a number, a title stating variables and population, clear column and row heads, a total, and the base (n).
  5. Data cleaning. Re-check for out-of-range values, impossible combinations and duplicate records before analysis.

[!IMPORTANT] Where errors are actually made. Most defective agency research fails at editing and coding, not at statistics. An unedited return with a missing sex field silently becomes a case excluded from every disaggregated table, quietly biasing the result. Editing discipline is the highest-return habit in applied social work research.


5. Analysing the Data

Quantitative analysis follows the level of measurement:

DataDescriptionRelationship or difference
NominalFrequency, percentage, modeChi-square
OrdinalMedian, percentile, frequencySpearman rho; rank-based tests
Interval / ratioMean, standard deviationt-test, ANOVA, Pearson r

Qualitative analysis proceeds through: transcription → immersion and repeated reading → open coding → grouping codes into categories → abstracting categories into themes → interpretation against the framework. Rigour is protected by an audit trail, a second coder where feasible, member checking with participants, and reporting disconfirming cases rather than only supportive quotations.

Data return. In participatory work, analysis is not complete until the findings have been returned to the community in accessible form — pagsasauli ng datos. Extractive research that takes data and never returns it is an ethical failure regardless of methodological quality.


6. Worked Practice Application

A municipal office fields a 40-item household survey on service access. After collection, the analyst finds: 18 returns with no sex recorded; a satisfaction item worded "Do you agree that our staff are courteous and efficient?"; incomes recorded in three different formats; and interviews of married women that were conducted with the husband present.

Defects and remedies.

DefectTypeRemedy
Missing sex on 18 returnsEditing failure at field levelCallback where identifiable; report the missing count openly; retrain enumerators on completeness checks before leaving the household
Double-barrelled, leading satisfaction itemInstrument construction failureSplit into two items and remove "Do you agree that"; the existing responses cannot be salvaged and must be reported as unusable
Inconsistent income formatsCoding failureEstablish one unit and period in the codebook; re-code from raw returns, not from the entered data
Husband present during women's interviewsGender-sensitivity failureRe-interview privately where feasible; flag affected cases in the limitations section

Reporting. The final report states the response rate, the missing-data count by variable, the unusable item, and the interview-setting limitation. Disclosing these does not weaken the study — concealing them would make it professionally indefensible, and an item that offers "omit the problematic cases quietly" is offering research misconduct.

Test Your Knowledge

A survey item reads: "Do you agree that our staff are courteous and efficient?" What are the two defects in this single item?

A
B
C
D
Test Your Knowledge

Eighteen returns arrive with the sex field blank. What is the correct professional handling?

A
B
C
D
Test Your Knowledge

Which statement about validity and reliability is correct?

A
B
C
D