What do 394 higher-education studies show about generative AI?
A peer-reviewed scoping review finds that universities mostly used generative AI for feedback, tutoring and writing. The evidence is substantial but still dominated by surveys and short-term measures, with little attention to equity or learning processes.
The short version
3 key points
- 1.The authors searched EBSCOhost and Web of Science in January 2026, screened 2,264 unique records and included 394 empirical studies of enacted, task-anchored generative-AI use.
- 2.Feedback or tutoring and writing support dominated. Surveys appeared in 269 studies, while learning-process evidence such as logs, observation and expert ratings was much less common.
- 3.The review maps a field rather than estimating whether AI works: it did not assess study quality, pool effect sizes or establish long-term learning gains.
The answer: widespread classroom use, but not a verdict that AI improves learning
The strongest finding is about what universities have studied, not whether generative AI raises attainment. Across 394 empirical studies, the most common enacted uses were feedback or tutoring and writing support. Researchers most often targeted engagement, usability, critical thinking, subject knowledge, academic performance, writing quality and AI literacy. Self-regulated learning, ethics, creativity, feedback quality and equity were less visible.
That distinction matters for teachers and university leaders. A large literature can still be unable to answer a simple causal question if it combines different tools, courses, outcomes and study designs. This review is a map of that terrain. It shows where experimentation and measurement have concentrated, but it does not calculate an average learning effect or show that a particular chatbot, course design or policy works across institutions.
The paper therefore cuts through two opposing headlines. The evidence base is no longer merely speculative: hundreds of studies examined actual course-related use. But the existence of 394 studies is not 394 replications of one intervention. The safer conclusion is that higher education has accumulated substantial experience with bounded tasks while evidence about durable learning, unequal effects and the learning process remains thinner.[1]
How the reviewers reached 394 studies
The authors followed the PRISMA extension for scoping reviews. In January 2026 they searched EBSCOhost and Web of Science Core Collection for English-language, peer-reviewed journal articles published from November 2022 through December 2025. The search returned 2,778 records. After 514 duplicates were removed, 2,264 unique records went through title and abstract screening, and 523 articles reached full-text review.
Inclusion required original empirical research in higher education with generative AI embedded in an authentic teaching or learning activity: an assignment, assessment, feedback cycle, instructional intervention or instructor-led class activity. The team excluded output-only benchmark studies, opinion and review articles, work outside higher education, and perception surveys where no enacted course use was documented. Full-text assessment produced 394 included studies.
Three researchers reviewed the full texts and resolved borderline cases by consensus. They jointly calibrated coding on ten included studies, then recorded study design, participant focus, tool, use case, targeted outcomes, assessment methods, stakeholder perceptions and governance indicators. This is a transparent and appropriately broad method for describing a fast-moving field, although it does not provide the risk-of-bias assessment expected from a review trying to estimate effectiveness.[1]
Most research examined students and familiar academic tasks
Mixed-methods research was the largest design group, with 213 studies or 54% of the corpus. Another 109 studies were quantitative and 72 qualitative. Participant focus was heavily tilted toward students: 352 studies focused on students, 15 on instructors, 26 on both, and one on several stakeholder groups. That imbalance limits how confidently the literature can describe staff workload, assessment validity or institutional implementation.
Feedback and tutoring appeared most often across tool categories. Writing support was the other major activity, followed by language learning or translation, lesson planning, assessment or grading, general academic help, programming or debugging, content creation, simulation and reflection. The pattern suggests that universities have mainly fitted generative AI into existing tasks rather than reorganised curriculum around new human-machine roles.
The paper's cross-tabulations make that concentration concrete. Feedback or tutoring was linked to 51 studies targeting engagement, 46 targeting achievement, 45 targeting usability, 45 targeting subject knowledge and 37 targeting critical thinking. Writing support was linked most often to writing quality, in 50 studies. Those are counts of coded studies, not pooled effect estimates; a study appearing in a category may report benefit, harm, mixed findings or no meaningful difference.[1]
Measurement leant heavily on surveys and end products
Across the 394 studies, the reviewers recorded 891 assessment-method codes because one study could use several methods. Survey scales appeared in 269 studies, or 68.3%. Tests, quizzes or rubrics appeared in 185 studies, artifact analysis in 167 and interviews or focus groups in 143. Analytics or logs appeared in 76 studies, observation in 30 and expert ratings in only 13.
Surveys are legitimate tools for measuring experience, motivation and perceived usefulness. Rubrics and artifact analysis can show whether a submitted product meets defined criteria. Neither automatically reveals how a learner reasoned, checked an answer, revised a prompt or transferred knowledge to an unfamiliar task. A polished essay or higher satisfaction rating can coexist with weaker independent understanding.
For practitioners, the gap is practical rather than academic. If a university wants students to develop critical thinking or self-regulation, it should measure the process: attempts, revisions, source checking, error correction and performance after AI access ends. The review found those process-sensitive approaches were comparatively uncommon, leaving prompting, feedback uptake, verification and over-reliance only partly visible.[1]
Students and instructors were mostly ambivalent, for different reasons
Among 315 student-related perception cases, 228 or 72.4% were coded as mixed, 85 as positive and two as negative. Among 35 instructor-related cases, 28 or 80% were mixed and seven positive. These categories summarise how studies reported views; they are not a representative opinion poll of all students or staff.
Student themes most often concerned learning and skill development, engagement and reliability or usability. Instructor themes centred more on pedagogy and assessment, efficiency and workload, professional learning, reliability, ethics and integrity. A student may value faster drafting or feedback while an instructor worries that the same shortcut makes it harder to judge independent understanding. Both positions can be rational within the same course.
Governance also looked less developed than general concern. The review coded 151 studies as recommending institutional policy and 148 as mentioning ethics or policy, but only 52 as reporting instructor-level rules in the enacted learning context; 43 mentioned none. A warning in a policy document is not the same as a course rule that tells students what assistance is permitted, how to disclose it and which work must remain unaided.[1]
Equity received too little direct attention
Equity, inclusion and access were among the less frequently targeted outcomes. Equity themes appeared in 18 student-perception cases and three instructor cases, while privacy and data security appeared in 18 student cases and two instructor cases. Low frequency does not show that inequity is absent; it shows that the reviewed research rarely made it a central measured outcome.
That blind spot matters because access to paid models, device quality, language support, disability accommodations, discipline-specific norms and AI literacy can change who benefits. A tool that improves the average product may still widen a gap if some students receive better models, know how to verify outputs or can afford repeated use. Conversely, well-designed language or accessibility support may help students whom conventional instruction underserves.
Universities testing generative AI should therefore report results by relevant student groups where sample size and privacy allow, document which model tier was used and provide an equivalent route for students who cannot or do not wish to use it. Equity should be a planned outcome, not a paragraph added after a pilot is complete.[1]
What teachers and university leaders can act on now
Treat generative AI as an instructional-design decision, not a software switch. Start with the learning goal, specify the role AI may play, preserve a route to human feedback and decide what evidence will demonstrate independent understanding. In writing, that might mean retaining drafts, source checks and a short oral explanation. In programming, it might mean debugging logs plus an unaided transfer task.
Teachers also need explicit, local rules. Students should know whether idea generation, editing, code completion or full drafting is allowed; how use must be disclosed; what data must not be entered; and when an output must be checked against a primary source. Institutions should support that work with staff development and discipline-sensitive guidance rather than one generic statement for every course.
Evaluation should extend beyond satisfaction and immediate grades. Useful measures include retention after AI access ends, transfer to new problems, the quality of revisions, error detection, time spent by staff correcting outputs, and outcomes by prior attainment or access. The review was supported by two Social Sciences and Humanities Research Council of Canada grants, and the authors declared no competing interests.[1]
Evidence limits and what would change the assessment
The review searched two large databases but limited inclusion to English-language, peer-reviewed journal articles through December 2025. It may miss studies in other languages, conference proceedings, newer 2026 work and evidence not indexed in those databases. Coding compressed complex courses into categories, and multi-label assessment methods were counted at study level rather than matched one-to-one with every claimed outcome.
Most importantly, the authors did not assess study quality or calculate effect sizes. This article cannot tell a dean that generative AI raises marks by a particular amount, or that mixed perceptions imply an acceptable risk-benefit balance. Its value is diagnostic: it shows a literature concentrated on familiar tasks and relatively easy-to-collect measures while process, governance and equity evidence lag.
Confidence that generative AI improves meaningful learning would rise with preregistered, multi-institution studies using common comparators, independent assessments, longer follow-up and transparent model versions. Stronger evidence would connect particular course designs to retention, transfer, staff workload and unequal effects. Until then, the review supports careful, measurable experimentation—not a blanket mandate to adopt or ban generative AI.[1]
What this means for people
- Students are already encountering AI mainly through feedback, tutoring and writing, but current research says less about whether they retain knowledge or can perform independently later.
- Teachers need course-level rules, time to inspect errors and assessments that still reveal individual understanding; broad institutional warnings do not supply those details.
- University leaders should measure access, language, disability and prior-attainment effects rather than treating an average satisfaction or grade result as evidence of equal benefit.
Global context
The authors are based at Canadian universities, but the 394-study corpus maps international higher-education research indexed in two major databases. Because only English-language peer-reviewed journal articles were included and regional counts do not establish representativeness, the review should not be read as a complete global census.
What the evidence does not yet show
- The scoping review mapped studies but did not assess their quality or pool effect sizes.
- Only English-language, peer-reviewed journal articles indexed in EBSCOhost or Web of Science through December 2025 were eligible.
- Most included research focused on students; only 15 studies focused on instructors and 26 on both groups.
- Surveys and short-term measures were common, while logs, observation and expert ratings were comparatively rare.
- Study-level categories cannot show whether every reported use or outcome was beneficial, harmful or null.
What to watch next
- Preregistered multi-institution studies with common comparators
- Retention and transfer after AI support is removed
- Direct measurement of prompting, revision, verification and over-reliance
- Staff workload and assessment validity
- Effects by access, language, disability and prior attainment
Living evidence record
Impact record IAI-0V260KO
Evidence stage
Studied
Confidence
Supported
Reporting basis
Source analysis
Independent or research support
Present
Record status
Monitoring
Last checked
15 October 2026
Source trail
1 direct source across 1 source type.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Single-source reporting disclosure
This record analyses one direct source. It can establish what International Journal of Educational Technology in Higher Education published or reported, but it is not independent corroboration of every performance claim or predicted outcome. The confidence label will change only when broader evidence is added.
Evidence trail
Sources used for this report
Links checked 15 October 2026
Research question, topics and regions
How generative AI has been used and evaluated in authentic higher-education teaching and learning
Topics: Higher education · Generative AI · Assessment · Teaching · Equity · Governance
Regions: Canada · Global higher education
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Watch the background, then check the evidence
UNESCO
AI-generated illustration · not a video frame
YouTube loads only when you choose. Press play in the player to start. If playback is unavailable, use “Watch on YouTube” below.
Education & human agency · Background explainer
Published 2025-01-23 · 8 min 30 sec
Teacher to Teacher: Is AI reshaping education for the better?
A conversation about how teachers can guide AI use while preserving pupils’ judgement. Watch for the difference between helping a learner think and supplying an answer.
Evidence check: Teachers’ perspectives provide context. They do not establish that a particular AI tool improves learning outcomes.
Source checked 14 October 2026. Check available captions on the publisher’s video page.
The Impact Brief · Free
Keep following the stories that matter to you.
Get our weekday briefing on what changed and why it matters. Choose your topics below.
Continue the story
There’s more to this story
Education
Does open AI access still let teachers see student judgement?
In one 33-manuscript university course, structural writing clustered near the top while evidence use and theoretical interpretation still varied. The case supports assessment redesign, not a claim that AI improved learning.
7 min · 1 source
Education
Can expert checks make AI study materials useful?
A two-cohort economics-course study associated tutor-verified AI materials with fewer marks below a UK degree boundary, but the design cannot isolate verification, rule out cohort differences or prove that use caused the result. It is an unreviewed preprint.
8 min · 1 source
Education
Are Kurdistan universities ready to govern generative AI?
Not visibly, according to a peer-reviewed audit of 30 university websites. Twenty-one institutions were in the study's lowest readiness stage and only two showed direct public GenAI guidance—but the audit measured published evidence in June 2026, not confidential policy or actual classroom practice.
9 min · 2 sources
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.