8.4 Research Instrumentation, Data Gathering, Tabulation and Analysis
Key Takeaways
- Social Work Research 2 sub-topic C.1 carries seven items on instrumentation, data gathering, tabulation and analysis.
- Instrument development runs from operational definition through item writing, expert content validation, pre-testing and reliability estimation.
- Gender-sensitive data collection requires sex-disaggregated items, non-leading wording, private settings and same-sex interviewer options where appropriate.
- Data processing follows editing, coding, classification, tabulation and then analysis; errors introduced at editing propagate to every later step.
- Quantitative data analysis matches the level of measurement, while qualitative analysis proceeds through transcription, coding, categorisation and thematic interpretation.
8.4 Research Instrumentation, Data Gathering, Tabulation and Analysis
Blueprint anchor. TOS topic C. SOCIAL WORK RESEARCH 2 carries 10 items, of which sub-topic C.1 (7 items) covers ways of research instrumentation, data gathering, data tabulation and data analysis — including an explicit competency on collecting data in a gender-sensitive manner.
1. Building a Research Instrument
| Step | Task | Failure if skipped |
|---|---|---|
| 1. Operational definition | State how each construct will be observed and measured | Items that do not measure the stated variable |
| 2. Item construction | Write clear, single-barrelled, non-leading items at the respondent's reading level | Ambiguity and response bias |
| 3. Response format | Choose checklist, Likert scale, ranking, open-ended or scenario format | Data that cannot answer the question |
| 4. Content validation | Submit to subject-matter experts for relevance and coverage review | Missing dimensions of the construct |
| 5. Pre-test / pilot | Administer to a small comparable group; time it; debrief | Discovering fatal wording problems after full fielding |
| 6. Reliability estimation | Test-retest, split-half, internal consistency, or inter-rater agreement | No evidence the instrument measures consistently |
| 7. Revision and finalisation | Amend, renumber, produce the final field version and manual | Interviewers improvising in the field |
Item-Writing Rules
- One idea per item; avoid double-barrelled questions ("Are the staff courteous and prompt?").
- Avoid leading wording ("Do you agree that the programme has helped your family?").
- Avoid negatives and double negatives.
- Avoid technical jargon and untranslated English in a Filipino-language instrument; back-translate to check fidelity.
- Provide mutually exclusive and exhaustive response categories.
- Place sensitive items after rapport-building items, never first.
2. Validity and Reliability of Instruments
| Concept | Question | Evidence |
|---|---|---|
| Face validity | Does it look appropriate? | Judgement of respondents and readers |
| Content validity | Does it cover the whole construct? | Expert panel review against a specification |
| Criterion validity | Does it agree with an accepted measure? | Correlation with a criterion instrument |
| Construct validity | Does it behave as theory predicts? | Expected relationships with other variables |
| Test-retest reliability | Stable over time? | Correlation across two administrations |
| Internal consistency | Do items hang together? | Item-total correlations; coefficient alpha |
| Inter-rater reliability | Do different raters agree? | Agreement between independent raters |
An instrument may be reliable without being valid — consistently measuring the wrong thing — but it cannot be valid without being reliable.
3. Gender-Sensitive and Culturally Grounded Data Gathering
The TOS names gender-sensitive data collection explicitly. In practice this means:
- Disaggregate by sex at the point of collection; a variable not collected disaggregated cannot be disaggregated later.
- Ask about control, not only access — who decides how income is used, not only whether income exists.
- Count unpaid care work, which household income questions systematically miss.
- Interview privately. Asking a woman about household decision-making in front of her husband produces a measurement artefact.
- Offer a same-sex interviewer for sensitive topics, and never interview a survivor of violence in the presence of the alleged perpetrator.
- Avoid gendered assumptions in wording — "household head" defaults to men in many respondents' understanding; ask about roles instead.
Indigenous Filipino methods recognised in Philippine social work research are pagtatanong-tanong (iterative, unobtrusive questioning woven into ordinary conversation), pakikipagkuwentuhan (shared storytelling), pakikiramdam (attuned sensing of what is unsaid) and pakikisama and pakikipagpalagayang-loob as relational preconditions of honest disclosure. These are not informal shortcuts; they are the culturally valid route to data that a formal questionnaire administered by a stranger will not obtain.
4. Data Processing: From Raw Returns to Tables
- Editing. Check every return for completeness, legibility, consistency and range. Resolve contradictions by callback where possible; never silently invent values.
- Coding. Assign numerical codes to categories; build a codebook recording every variable name, code, label and missing-value convention.
- Classification. Group data into meaningful classes and intervals.
- Tabulation. Produce frequency tables and cross-tabulations. Every table needs a number, a title stating variables and population, clear column and row heads, a total, and the base (n).
- Data cleaning. Re-check for out-of-range values, impossible combinations and duplicate records before analysis.
[!IMPORTANT] Where errors are actually made. Most defective agency research fails at editing and coding, not at statistics. An unedited return with a missing sex field silently becomes a case excluded from every disaggregated table, quietly biasing the result. Editing discipline is the highest-return habit in applied social work research.
5. Analysing the Data
Quantitative analysis follows the level of measurement:
| Data | Description | Relationship or difference |
|---|---|---|
| Nominal | Frequency, percentage, mode | Chi-square |
| Ordinal | Median, percentile, frequency | Spearman rho; rank-based tests |
| Interval / ratio | Mean, standard deviation | t-test, ANOVA, Pearson r |
Qualitative analysis proceeds through: transcription → immersion and repeated reading → open coding → grouping codes into categories → abstracting categories into themes → interpretation against the framework. Rigour is protected by an audit trail, a second coder where feasible, member checking with participants, and reporting disconfirming cases rather than only supportive quotations.
Data return. In participatory work, analysis is not complete until the findings have been returned to the community in accessible form — pagsasauli ng datos. Extractive research that takes data and never returns it is an ethical failure regardless of methodological quality.
6. Worked Practice Application
A municipal office fields a 40-item household survey on service access. After collection, the analyst finds: 18 returns with no sex recorded; a satisfaction item worded "Do you agree that our staff are courteous and efficient?"; incomes recorded in three different formats; and interviews of married women that were conducted with the husband present.
Defects and remedies.
| Defect | Type | Remedy |
|---|---|---|
| Missing sex on 18 returns | Editing failure at field level | Callback where identifiable; report the missing count openly; retrain enumerators on completeness checks before leaving the household |
| Double-barrelled, leading satisfaction item | Instrument construction failure | Split into two items and remove "Do you agree that"; the existing responses cannot be salvaged and must be reported as unusable |
| Inconsistent income formats | Coding failure | Establish one unit and period in the codebook; re-code from raw returns, not from the entered data |
| Husband present during women's interviews | Gender-sensitivity failure | Re-interview privately where feasible; flag affected cases in the limitations section |
Reporting. The final report states the response rate, the missing-data count by variable, the unusable item, and the interview-setting limitation. Disclosing these does not weaken the study — concealing them would make it professionally indefensible, and an item that offers "omit the problematic cases quietly" is offering research misconduct.
A survey item reads: "Do you agree that our staff are courteous and efficient?" What are the two defects in this single item?
Eighteen returns arrive with the sex field blank. What is the correct professional handling?
Which statement about validity and reliability is correct?