NIMBLE Benchmark Console

—

These are targets and gates, not results. No figure is published here until its phase gate passes on a locked hold-out set, reported with a 95% confidence interval. Everything currently reads AWAITING because the pipelines that would produce it are still in build.

Gates passed

0 / 6

diagnostic + quantification

System metrics

0 / 5

uniqueness proof

Modalities

5

in one pipeline, planned

Cohort

520

subjects · 3 timepoints

Split

subject

grouped, enforced in code

To v1.0

28 wk

10 phases

Evaluation scope

fixed cohort
Subjects
520
planned
Timepoints
3
per subject
Split
subject
grouped, enforced
Hold-out
locked
1 open / release

Planned class balance

  • Cognitively normal18035%
  • Mild cognitive impairment20038%
  • Alzheimer's disease14027%

Modality coverage

planned
  • T1 MRI100%03
  • fMRI62%03
  • PET71%03
  • EEG44%04
  • Clinical100%05

Share of the planned cohort expected to carry each modality. Fusion must handle the missing remainder explicitly.

Build schedule

28 weeks
  • 00Repo remediation
  • 01Core contracts
  • 02Benchmark harness
  • 03Imaging pipeline
  • 04EEG pipeline
  • 05Fusion + models
  • 06Simulation
  • 07Hardware / live
  • 08Console
  • 09v1.0 release
WK 1WK 14WK 28

Methodology guards

non-negotiable
  • Subject-level splits

    02

    No subject in train and test, across any timepoint. Asserted in code.

  • Locked hold-out

    02

    Opened once per release. All tuning on a separate development set.

  • Bootstrap CI

    02

    Every figure published with a 95% confidence interval.

  • Provenance record

    01

    Git sha, config hash, library versions and RNG seed on every run.

Benchmark register

6 / 6
IDTaskTargetPhaseGate
BM-01AD vs Cognitively NormalAccuracy88–93%05AWAITING
BM-02MCI vs NormalAccuracy75–85%05AWAITING
BM-03Progression — converter vs stableAccuracy70–78%05AWAITING
BM-04EEG-based AD detectionAccuracy80–90%04AWAITING
BM-05Hippocampal volumeVolume error< 4%03AWAITING
BM-06Segmentation qualityDice coefficient≥ 0.8503AWAITING

All acceptance bands

targets only
  • BM-01 AD vs Cognitively NormalAWAITING
    0target 88–93%100%
  • BM-02 MCI vs NormalAWAITING
    0target 75–85%100%
  • BM-03 Progression — converter vs stableAWAITING
    0target 70–78%100%
  • BM-04 EEG-based AD detectionAWAITING
    0target 80–90%100%
  • BM-05 Hippocampal volumeAWAITING
    0target < 4%8%
  • BM-06 Segmentation qualityAWAITING
    0.60target ≥ 0.851.00

The cyan rule on each band is the floor a release must clear. A measured value appears only once its phase gate passes; until then the band stays empty rather than showing a provisional number.

Task analysis

BM-01

Metric

Accuracy

Target

88–93%

Gate phase

05

Status

AWAITING

Multi-modal fusion; AUC must clear 0.90 on the locked hold-out.

Acceptance band

0target 88–93%100%
CORONAL · SCHEMATIC
  • Gated regions
  • Lateral ventricles
  • Amygdala
  • HippocampusLEAD
  • Entorhinal cortexLEAD
  • Lead regions carry the volumetry gate — hippocampal volume error under 4% against FreeSurfer, Dice above 0.85.

System & uniqueness metrics

measured, not asserted
  • SYS-01

    Source-switch cost

    0 code / 1 config line

    Architecture quality

    01 · 07
  • SYS-02

    Multi-modal fusion count

    5 modalities

    Core uniqueness

    05
  • SYS-03

    End-to-end latency

    p50 / p95 published

    Real-time readiness

    07 · 08
  • SYS-04

    Reproducibility

    Byte-identical re-run

    Scientific credibility

    01 · 09
  • SYS-05

    Full-subject processing

    Wall-clock, stated hardware

    Practical usability

    03 · 09