The evidence

GAiDFLY is built for one thing: students who own their strategic reasoning. That takes practice until the reasoning holds up under challenge, and faculty who can see that it does.

The need

A polished paper no longer tells faculty whether the student did the thinking. AI did not lower the bar for strategic judgment. It raised it, then hid whether the student cleared it.

The evidence that strategy education has to change keeps mounting, and it points at one gap. Written work has stopped reliably showing who did the thinking. AI prose is fluent and technically accurate. The oral exam, as most programs run it, tests coverage, and AI covers well. The harder problem is deeper than detection. Strategy programs now have to produce leaders who work with AI as a matter of course: people who use AI’s expanding capability to search, simulate, and test more frames than one person could alone, and who still own the goals, the frame, and the final judgment. That ownership is built through friction. The struggle to define a problem before a structure arrives, the first attempt at an argument that does not hold together, the claim that fails under challenge in seminar. Those are the events that form judgment, and AI removes them as readily as it removes the clerical work around them. The finished product still matters. It just carries less of the evidence, and something else has to carry the rest.

  • A standard oral exam can be passed without judgment. In February 2026, Army War College faculty gave ChatGPT, Gemini, Claude, and Grok the college’s real ninety-minute oral comprehensive exam, with no access to the curriculum, and all four passed. What separated them from a student was the examiners’ impromptu follow-up: pushed past the prepared ground, the models retrieved rather than constructed, misjudged their own performance, and gave way. The exam only measures ownership at the point where the examiner pushes.
  • Faculty have stopped trusting the paper. A senior war-studies professor at Marine Corps University reports that AI use on papers cannot be monitored, that an AI taught his rubric matched his grades on thirty papers, and that he no longer grades the paper as evidence of the student’s thinking.
  • Students mistake fluency for their own thinking. Researchers studying student AI use describe epistemic confinement: the student believes they are thinking independently while the frame doing the work was never theirs.
  • Students cannot see where AI stops being reliable. In a field experiment with 758 consultants, AI raised quality on tasks inside its competence and made people 19 points less likely to be right on a task just outside it. The boundary was not visible in advance.
  • Confidence does not track correctness. A review of 22 studies found that how much people trust an AI does not predict whether they can tell its right advice from its wrong advice.
  • An AI that gives answers weakens the student. Nearly a thousand high-school students with a plain AI tutor scored higher in practice and 17 percent lower than students with no AI once it was removed. A version that refused to give answers avoided most of the harm.
  • Judgment and machine output have to check each other. When the Marine Corps Command and Staff College gave planning teams an AI model, the gains faded unless the team was reorganized so that human judgment and machine output tested each other.
  • Spoken argument shows more. In nearly a thousand student debates with an AI adversary, students who debated by voice explored a wider range of ideas than those who typed. Evaluators who hear a person they disagree with judge them more thoughtful than evaluators who read the same words.

GAiDFLY uses AI to build the capability the evidence says matters most: a student who can take a position, defend it under questioning, know where their own understanding runs out, and revise without handing the frame away. It puts the AI on the examiner’s side of the table. The student argues a position out loud and the AI pushes back the way a good examiner does, with new information, a counter to something they got right, and a question past where they prepared. This is AI supplying the friction that the rest of a student’s AI use removes. It is also the work they will do after they graduate, and most of it is spoken: briefing a commander, defending a recommendation to a skeptical colleague.

Faculty get more than a record. The debrief shows them, for each student and across the course, which positions held under pressure, where the reasoning gave way, and what changed between the opening argument and the closing one. That tells them where to spend seminar time, what to push on in the real oral exam, and which students are performing fluency rather than owning the frame. They set the question, they read the evidence, and they keep the verdict.

The bottleneck

The most reliable way to verify that a student owns an argument is likely oral defense, sustained questioning by someone who has read the work. It is also the least scalable thing faculty do. One examiner, one student, one hour. GAiDFLY takes the thousand hours of sparring and leaves the verdict with the humans. Every student gets the experience of being tested and challenged, as often as they need it. Faculty get a way to see, across a whole course, how each student held up under that pressure, which no seminar schedule allows.

The method

A GAiDFLY session follows a very old shape. The student commits to a position and argues it first, so the frame stays theirs. GAiDFLY then argues the other side, one short challenge at a time. Arguing both sides of a hard question is an old exercise. An anonymous Greek text called the Dissoi Logoi laid out paired cases for and against, and Roman rhetorical schooling made arguing in utramque partem, on either side, a standard drill.

GAiDFLY’s probing moves come from the Socratic elenchus, the cross-examination that tests whether a speaker’s own commitments hold together. The short turns are Socrates’ rule too. In Plato’s Protagoras he refuses to go on unless the long speeches stop, because only short exchanges can be examined.

The session ends with the student, not the examiner. They say where they have come out and restate their case as they would argue it tomorrow. GAiDFLY does not decide who won. In Plato’s terms it practices dialectic, argument in service of testing, and leaves eristic, argument in service of winning, alone. The judgment stays with the student and their instructor.

What the debrief does

After the session GAiDFLY writes a debrief for student and instructor: the ideas explored, the pressure points and how the student handled them, and what changed between the opening argument and the closing restatement. Scoring is not the point. The exercise is, and the evidence it leaves behind. The debrief reports what happened so the student can see their own reasoning and the faculty member can judge it. GAiDFLY assigns no grade. The standard of proof stays human.

Where GAiDFLY comes from

The Irreducible Officer

Jack Shaw · Judgment Lab, June 2026

Our own argument, and the one GAiDFLY is built to answer. AI can analyze and recommend inside a frame, but someone outside the system has to set that frame and stay accountable for it, and a finished product improved by AI no longer shows whether the student did. The essay asks faculty to look for three kinds of evidence instead: the student naming their frame and assumptions before they submit, defending which AI output they accepted and rejected under live questioning, and carrying the same discipline to a changed case. A GAiDFLY session is built to produce the second kind.

From the war colleges

Can AI Pass the US Army War College?

Kevin M. Boyce, John A. Nagl, and Kristan J. Wheaton · US Army War College Press, April 2026

In February 2026, faculty panels at the Army War College gave ChatGPT, Gemini, Claude, and Grok the real 90-minute oral comprehensive exam, with no access to the curriculum. Every model passed. The authors’ own conclusion is the one we build on. The impromptu follow-up questioning exposed differences no static benchmark shows, and the models still could not supply the judgment the exam exists to measure.

Your Oral Exam Won’t Save You

Kristan J. Wheaton · Sources and Methods, May 2026

Wheaton’s follow-up asks what an oral exam should test once AI can pass it. Most oral exams verify coverage, which AI does well. Only a boundary-finding exam shows whether a person can think under pressure. He lists how the models fell short. They retrieved instead of constructing, talked too much, misjudged their own performance, and conceded as soon as they were pushed. GAiDFLY’s adversary is built to do the opposite of that last one. It pushes, and keeps pushing, so the student practices holding a position before the day it counts.

Peering into the Future of Artificial Intelligence in the Military Classroom

James Lacey · War on the Rocks, April 2025

Lacey holds the Horner chair of war studies at Marine Corps University. His conclusion about the student paper is blunt. It is impossible to monitor or control AI use effectively, so he has stopped grading the paper as evidence of the student’s thinking. He also reports that an AI taught his rubric matched his grades on thirty papers. We cite him for the diagnosis, not the remedies. GAiDFLY takes the other road. The student still has to argue the position, out loud, with no AI between them and the question.

Human-Machine Planning: AI Lessons from the Marine Command and General Staff College

Joseph O. Chapa and Sofia Cantu · War on the Rocks, October 2025

In the 2024–25 academic year the Marine Corps Command and Staff College gave some students a language-model tool in four of its five planning exercises. Students reached for it early, during mission analysis, and when working outside their own expertise, and the flashes of insight faded unless the planning team itself was reorganized so that human judgment and machine output checked each other. The evidence is surveys and usage logs rather than a controlled trial. We cite it for the structural lesson: the gain came from the design of the human work around the tool, not from access to it.

Studies

Voice-based debate with an AI adversary is associated with increased divergent ideation

N. M. Jain and D. J. Wang · Columbia Business School working paper, 2026 · arXiv:2603.27073

In 2026, researchers at Columbia Business School released a working paper analyzing nearly a thousand student debates with an AI adversary. Students who debated by voice explored a wider range of ideas than students who typed. The study is correlational and measures the breadth of ideas, not the quality of the argument. We present it as exactly that, and as one reason the session is spoken.

Generative AI without guardrails can harm learning: Evidence from high school mathematics

Hamsa Bastani, Osbert Bastani, Alp Sungu, Haosen Ge, Özge Kabakcı, and Rei Mariman · Proceedings of the National Academy of Sciences 122(26), 2025

A field experiment with nearly a thousand high-school students. Those given a plain ChatGPT-style tutor did 48 percent better on practice problems, then 17 percent worse than students with no AI at all once it was taken away. A second version, prompted never to give answers and to ask the student what they would try next, avoided most of the harm. An AI that hands over answers teaches the student to need it. An AI that pushes back does the opposite, and that is the design choice at the center of GAiDFLY.

The Humanizing Voice: Speech Reveals, and Text Conceals, a More Thoughtful Mind in the Midst of Disagreement

Juliana Schroeder, Michael Kardas, and Nicholas Epley · Psychological Science 28(12), 2017

Evaluators who heard someone they disagreed with judged that person more thoughtful, more competent, and more human than evaluators who read the same words as text. The study was about persuasion between people, and we do not claim more for it than that. But it is the older, independent reason the session is spoken. Voice carries the thinking in a way a page does not, and the record faculty receive comes from a student who had to say it.

Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality

Fabrizio Dell’Acqua, Ethan Mollick, and colleagues · Harvard Business School working paper, 2023

A preregistered field experiment with 758 consultants at Boston Consulting Group. On tasks inside the model’s competence, consultants with AI produced work rated about 40 percent higher in quality. On a task designed to sit just outside it, consultants with AI were 19 percentage points less likely to reach the right answer than consultants without. The authors call the boundary a jagged frontier because it is not visible from the outside. Knowing where it runs is a skill, and one a student has to practice against pushback rather than read about.

“AI enhanced my critical thinking”: Investigating the paradox of student perceptions and cognitive offloading in GenAI use

W. W. Chow, S. Peng, A. Atiq, V. Truong, and M. Guo · Pacific Journal of Technology Enhanced Learning, 2026

The study introduces epistemic confinement: a student reports that AI sharpened their thinking while the analytic boundaries they worked inside were set by the model. The student believes they are reasoning independently; the frame doing the work was never theirs. This is the failure a finished paper cannot reveal and a live challenge can, because a borrowed frame does not survive a question it did not anticipate.

From Trust to Appropriate Reliance: Measurement Constructs in Human-AI Decision-Making

Muhammad Raees and Konstantinos Papangelis · arXiv preprint, 2026

A systematic review of 22 studies, screened from 729. Its finding is that how much people say they trust an AI does not predict appropriate reliance, meaning whether they accept its advice when it is right and refuse it when it is wrong. Trust is a feeling. Reliance is an act, and it can be taught and assessed. A GAiDFLY session asks the student to hold or yield on each point under challenge, which is reliance made visible. The paper is a preprint and we weight it accordingly.