Research desktop workflow 2026–present

Automated 3D Landmarking Pipeline

I built this workflow to propose pelvic landmarks from CT and 3D scans, so anatomists can focus on checking the placements.

Across 39 adult pelves, 83% of automatically placed landmarks fell within 2 mm of expert-corrected placements and 97% within 4 mm. Shape analysis closely agreed with the expert-corrected analysis (about 5% measurement error).

114 specimens in 4 h 34 min in one automated batch, before anatomical review.

20-second batch demo. Three synthetic templates landmark one target. The app shows which results need review and offers CSV exports.

Three landmarking experiments

These are three separate experiments, each against its own reference. The fusion evaluation describes the latest research configuration.

Registration benchmark
11.38 → 5.86 mm mean landmark error, from one deformable template to 12-template consensus.
13 annotated specimens · 156 leave-one-out registrations · hand-placed references
Landmark and shape agreement
83% within 2 mm and 97% within 4 mm of expert-corrected placements.
39 adult pelves · about 5% shape measurement error
Surface sample-size experiment
2.53 mm mean distance with 20 annotated training and template cases, 0.21 mm above the full surface reference.
12 held-out cases · observer-corrected references · registration and DiffusionNet

How it works

TotalSegmentator produces bone masks from CT. I transfer landmarks from multiple templates with PyTorch/CUDA and fuse them with predictions from a 3D U-Net and DiffusionNet I trained. The app checks units and orientation, then flags disagreements for anatomical review.

Registration benchmark

In the leave-one-out benchmark, mean error was 13.48 mm with rigid single-template registration, 11.38 mm with deformable refinement and 5.86 mm with 12-template consensus.

At 3,000 points and 150 iterations, the deformable step took 118.7 s in NumPy, 50.6 s in PyTorch on CPU and about 2 s on an RTX 4080 SUPER.

Synthetic source and target outlines before and after deformable registration, with transferred landmarks
The public torch-cpd example fits the synthetic outlines and transfers landmarks that were held out of the fit.

Run the synthetic registration example.

15 November 2026 · Unpublished analysis

How closely did the landmarks and shape analysis agree?

Across 2,496 landmarks on 39 adult pelves, 82.5% were within 2 mm of the reference and 96.6% were within 4 mm. Shape measurement error was 5.2% in a Procrustes ANOVA of the automatic and reference configurations.

The 39 cases were held out of training and the template library. The expert established the reference by correcting earlier automated placements. An independent evaluation would start with landmarks placed from scratch.

Compare pointwise distances by method
Discrepancy from corrected references across 2,496 landmark distances
MethodMean (mm)Median (mm)Count >10 mm
Three-method fusion 1.33 0.8710
Registration + surface model 1.74 1.2810
DiffusionNet surface model 1.86 1.4310
3D U-Net on CT 1.95 1.604
ALPACA registration 3.86 3.08109

Fusion had the lowest mean. The CT model alone had fewer distances over 10 mm.

4–5 November 2026 · Separate exploratory experiment

How far can 20 annotated cases take you?

With 20 annotated training and template cases, surface registration plus DiffusionNet averaged 2.53 mm on 12 held-out cases, 0.21 mm above the full surface configuration (2.32 mm with 24 templates and 83 training cases).

The surface method’s mean distance falls as the number of annotated cases increases, approaching the full reference configuration.
Each point uses the same cases for training DiffusionNet and supplying the registration templates. Whiskers show the minimum and maximum across repeated draws. The 64-case point and full reference are single configurations.
View exact chart values and draw counts
Surface registration plus DiffusionNet on 12 held-out cases
Annotated casesDrawsMean (mm)Draw range (mm)
522.97 2.90–3.05
1022.73 2.70–2.75
2032.53 2.51–2.54
4022.39 2.38–2.41
6412.33 —
Full reference12.32—

The CT model averaged 5.72 mm at 20 cases in its one 12,000-step run, and 4.30 mm in a longer run at the same sample size.

What if fewer landmarks are annotated per case?

In a single draw at 20 cases, teaching DiffusionNet only 40 landmarks changed the mean by −0.02 mm compared with teaching all 64 and scoring both models on the same 40 landmarks. Teaching only 10 increased the mean by 0.62 mm on the matched 10 landmarks. Both were subsets of the same pelvic protocol.

This was one 64-landmark protocol on female pelves with one observer. Test cases were excluded from training and templates, had been seen in earlier development and were scored against observer-corrected references.

Source data for both November evaluations: The Free Access Decedent Database funded by the National Institute of Justice grant number 2016-DN-BX-0144.