Can coursework show how students used AI without relying on detection?
A two-course study made AI use, checking and revision more inspectable. Independent practical tests did not show a clear learning gain.
The short version
- What happened
- At one Chinese institution, 34 anatomy-and-physiology students received a traceable-assessment redesign and 33 students formed an intact comparison class; a second microscopy course included 15 students in six groups.
- Who it affects
- Students may be judged more fairly when assessment asks them to show what AI contributed, which claims they checked and why they revised their work, rather than treating an unreliable detector score as proof.
- What remains unproven
- One institution and one main professional course
Keep in mind
One institution and one main professional course
One intact class per condition with no random assignment
Teachers were involved in design and assessment
Feedback and revision support were bundled with traceability features
No clear difference on independent practical tests
No long-term retention or transfer beyond the courses
Source analysis · 1 linked source. Primary analysed source date: 26 October 2026.
Keep following the evidence
Join The Impact Brief founding list for selected AI reports, their effect on people and the evidence limits. Read a sample first.
Read the full report · 3 min The evidence, methods, implications and limitations
The redesign collected evidence of use instead of guessing from the final answer
A peer-reviewed study replaced final-product-only assessment with a trail of AI-use statements, verification logs, attribution evidence, teacher checkpoints and explanations of revision. The main setting was an anatomy-and-physiology course at one Chinese biomedical-engineering programme: 34 students were in the redesign class and 33 in an intact comparison class. A smaller modern-microscopy adaptation involved 15 students working in six groups. There was no participant attrition.
Across three laboratory reports, the redesign class averaged 21.59 points compared with 17.91 out of 30, a mean difference of 3.68 points (95% CI 1.80–5.56; d = 0.96). Of that difference, 3.29 points were concentrated in disclosure and citation, verification and reflection—the dimensions deliberately changed by the redesign. AI-use statement uptake rose from 88.2% to 91.2% across implementation phases, while verification-log completeness rose from 1.44 to 1.74 on the study's scale.[1]
More visible work is not the same as better subject learning
The clearest independent check was the objective structured practical examination, or OSPE. Neither comparison was statistically significant: the first differed by 0.35 points (95% CI −0.10 to 0.80; p = 0.127) and the second by 0.19 points (95% CI −0.20 to 0.57; p = 0.334). An ethics-focused assessment also favoured the redesign class, but it was aligned with the redesign itself and cannot demonstrate broader ethical learning.
This was action research using one intact class per condition, not random assignment. Class membership was completely confounded with the condition, teachers helped design and assess the intervention, and checkpoints, feedback and revision opportunities changed together. Six exploratory traceability contrasts also lost statistical significance after correction for multiple testing. For teachers, the defensible conclusion is narrow but useful: process evidence can make AI-supported work easier to inspect. Confidence in learning effects needs multi-institution randomised or matched designs, blinded assessment, retention tests and transfer to new disciplinary tasks.[1]
The distinction that matters
What the assessments could—and could not—show
The strongest result concerned traceability, while the more independent practical outcome remained uncertain.
Course reports
Included AI-use and verification evidence
Higher design-aligned scores
Ethics task
Near-transfer assessment aligned to redesign
Not independent proof
OSPE practical tests
More independent subject-performance measure
No significant difference
Watch the background, then check the evidence
Illustrative photo · not a video frame
UNESCO · 8 min 30 sec · Background explainer
Teacher to Teacher: Is AI reshaping education for the better?
YouTube loads only when you choose; playback starts when you press play.
A conversation about how teachers can guide AI use while preserving pupils’ judgement. Watch for the difference between helping a learner think and supplying an answer.
Evidence check: Teachers’ perspectives provide context. They do not establish that a particular AI tool improves learning outcomes.
Published 2025-01-23. Source checked 14 October 2026. Check captions on the publisher’s video page.
Read the education evidencePhoto: Vitaly Gariev / Unsplash · Licence
Continue the story
Read next
Continue exploring higher education: compare the finding and its evidence limits.
Seven in ten US students said AI made take-home work unfair—what does the survey prove?
A weighted survey of 1,003 US college students found widespread concern about take-home assessment and self-taught AI skills. It measures beliefs and self-reports, not cheating rates or learning outcomes.
Read the next reportExplore the full source and evidence record
What this means for people
- Students may be judged more fairly when assessment asks them to show what AI contributed, which claims they checked and why they revised their work, rather than treating an unreliable detector score as proof.
Global context
The study took place in one Chinese biomedical-engineering programme during autumn 2024. Assessment rules, class sizes, permitted AI use and privacy requirements differ across institutions and countries.
What the evidence does not yet show
- One institution and one main professional course
- One intact class per condition with no random assignment
- Teachers were involved in design and assessment
- Feedback and revision support were bundled with traceability features
- No clear difference on independent practical tests
- No long-term retention or transfer beyond the courses
What to watch next
- Randomised or carefully matched multi-institution studies
- Blinded marking of independent disciplinary tasks
- Retention and transfer after the course ends
- Workload and privacy costs of collecting process evidence
- Whether students produce logs for genuine checking rather than compliance
Living evidence record
Impact record IAI-08M6ICU
Evidence stage
Studied
Confidence
Supported
Reporting basis
Source analysis
Independent or research support
Present
Record status
Monitoring
Last checked
26 October 2026
Source trail
1 direct source across 1 source type.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Single-source reporting disclosure
This record analyses one direct source. It can establish what Humanities and Social Sciences Communications published or reported, but it is not independent corroboration of every performance claim or predicted outcome. The confidence label will change only when broader evidence is added.
Evidence trail
Sources used for this report
Links checked 26 October 2026
Research question, topics and regions
Whether traceable assessment artefacts make students' use, verification and revision of generative-AI-supported coursework more inspectable
Topics: Assessment · Higher education · AI literacy · Academic integrity
Regions: Asia
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.