Data quality · shape analysis
When observer differences mimic a biological signal
An initial group comparison appeared interpretable, but measurements had been collected by different observers. A raw group effect could therefore reflect who measured the specimen rather than the structure being studied.
I redesigned the tests around the conditional question—group effect after accounting for observer—and controlled the resulting family of comparisons with false-discovery-rate correction. A landmark-participation table then localized where any remaining distance effect was concentrated.
The methodological threat became part of the model instead of a sentence in the limitations. The student could distinguish evidence about the research question from evidence about the measurement process.
Behind the analytical decision
Design checks
- Test the research effect only after conditioning on observer identity.
- Control the family of PC and distance tests instead of selecting an isolated low p-value.
- Localise any surviving effect to contributing landmark pairs.
Validation
The revised analysis compared conditional group tests, false-discovery-rate-adjusted evidence and anatomical participation tables before interpreting a pattern.
Handover
A reproducible analysis sequence and a review table that separated measurement effects from biological interpretation.