Can mouse MRI predict glioblastoma treatment response?

Ten treated mice supplied the decisive comparison

The underlying cohort contained 18 C57BL/6 mice implanted with GL261 glioblastoma cells. Eight untreated controls contributed 36 MRI examinations. Five temozolomide-treated mice had an initial response followed by relapse and contributed 84 examinations; five treated mice had complete regression and long-term survival and contributed 49. The classification analysis excluded the controls and compared the five relapsing with the five cured animals.

The paper reports 298 examination-level samples for its modelling analysis because individual imaging sessions contained multiple images. That number must not be mistaken for the number of independent subjects. Images from one mouse are correlated. The authors explicitly identify 10 treated animals as the effective independent sample and use grouped leave-one-animal-out cross-validation so that all examinations from the held-out mouse remain outside a training fold.

For radiomics, 1,218 candidate features were extracted from manually segmented regions. Imputation, variance and correlation filtering, statistical selection, scaling, oversampling and model fitting were performed within each training fold. An average of about 22 features survived. This design addresses an important leakage risk, although feature selection and hyperparameter choices in such a tiny dataset can still produce unstable estimates that require external replication.[1]

Deep learning performed better on examinations

At the examination level, radiomics plus XGBoost reached an area under the receiver operating characteristic curve of 0.770, with a 95% bootstrap confidence interval from 0.703 to 0.832. Its sensitivity for cured examinations was 0.545 and its positive predictive value was 0.444. A frozen EfficientNet feature extractor followed by XGBoost reached an AUC of 0.801. Fine-tuning the final 50 network layers produced the strongest examination-level AUC, 0.868, with a reported 95% interval from 0.810 to 0.918, sensitivity of 0.818 and positive predictive value of 0.491.

At the animal level, majority voting produced AUCs of 0.92 for radiomics, 0.92 for the frozen feature extractor and 0.88 for the fine-tuned model. All three correctly identified all five relapsing mice. The fine-tuned model identified four of five cured mice; the other approaches identified three. With only five animals in either outcome group, one changed classification moves sensitivity by 20 percentage points. Those animal-level figures are therefore descriptive rather than a stable clinical estimate.

The authors also divided scans into early, middle and late windows. Fine-tuned EfficientNet AUC rose from 0.788 in the early window to 1.000 in the late window. That trend is plausible because treatment effects become more visible with time, but the windows reuse data from the same small group. A perfect late-window result does not establish perfect prediction in a new mouse, let alone an early warning tool for patients.[1]

Subject-aware validation helps, but does not create an external test

Keeping each mouse wholly inside either training or testing is the correct safeguard against an easy form of leakage. Training augmentation and oversampling were also confined to training partitions, and the authors used a fixed seed and deterministic computation. However, the held-out mouse was supplied to the neural-network training process as validation data for monitoring, although the paper says it did not influence early stopping or checkpoint selection because every fold ran for 20 epochs and used final weights. Future work should keep an untouched external cohort entirely outside model development and monitoring.

The network processed individual time points, not each animal’s sequence as a temporal model. Its attention maps often included tumour and surrounding tissue, but Grad-CAM is a visualisation of model sensitivity rather than proof of a biological mechanism. The radiomic features that differed between outcome groups are similarly hypothesis-generating. Several illustrated trajectories rest on five cured and five relapsing animals and were not established as repeatable biomarkers.[1]

What this means for patients now

The immediate effect on patient care is none. The mice carried one implanted tumour model, received a specific temozolomide schedule and were scanned on a 7-tesla preclinical instrument at one centre. Human glioblastoma varies across molecular subtypes, treatments, scanners and clinical histories. People also undergo surgery, radiotherapy and combined regimens that can change images in ways this experiment did not represent.

The result is useful as a methods signal: standard T2-weighted imaging may contain response information worth testing, and learned image features may capture more of it than one engineered-feature pipeline. A credible translational path would require preregistered studies in independent animal models, then multi-centre patient cohorts with prospectively defined time points, clinically relevant comparators, calibration, subgroup analysis and decision-impact testing. Any clinical system would also need to show whether it changes treatment safely rather than merely ranking outcomes after the fact.[1]

Funding and what would change the assessment

The work was supported by Spanish national research grants, the Generalitat de Catalunya and Instituto de Salud Carlos III. The authors declared no competing interests and say data may be requested from the corresponding author. Animal procedures were approved by the Universitat Autònoma de Barcelona ethics committee under two named protocols and followed Spanish and European animal-protection rules.

Confidence would rise if an independent team reproduced the result on more animals, different tumour models, scanners and treatment regimens, with a locked model and untouched external test set. For relevance to people, the essential evidence is prospective multi-centre validation against expert assessment and patient outcomes. Until then, the careful conclusion is that deep learning separated two outcomes in a very small preclinical cohort—not that AI can predict a person’s glioblastoma response.[1]