Practical AI for Teaching

Session 1 — an introduction to generative AI

Claes Bäckman

Leibniz Institute for Financial Research SAFE

Three messages: AI is here, the workflow matters more than the model, and verification is key.

  • The tools changed. Chat gave way to agents that read files, run code and iterate. The tool you tried in 2023 is not the tool of today.
  • The workflow is the value. The agent’s leverage comes from context (your files), standing instructions, and reusable skills — not from raw model IQ.
  • Judging the output is the new job, for you and for your students. Silent errors and confident statements with no backing are what to look out for, in your own work and in what students hand in.

Workshop synthesis, drawing on Mollick (2026), Velikov (2026) and Korinek (2025).

Six topics this morning, hands-on this afternoon

1Fundamentals and toolsHow the tools evolved, and Copilot compared with the rest.
2Supervision and assessmentAI support for theses, what detectors can do, an AI-written thesis.
3Teaching in generalProtect what must be learned, then teach more.
4SkillsThesis feedback as a skill. Writing and updating your own.
5Replication and codingA student's replication package, and how to check the code.
6RisksHallucination, copyright and plagiarism.

Afternoon. Hands-on with your own materials: feedback on a thesis, a skill built from your own rubric, a replication package, a course update.

Live example: an agent starts a thesis now, and we check on it in section 2

I want to write a paper on AI exposure and house prices in Denmark. My hypothesis is that areas with greater AI exposure have faster house price growth. You can download data using the DST API document here: https://www.dst.dk/en/Statistik/hjaelp-til-statistikbanken/api I first want you to make a plan for how you would do this, including how to get the data and how to analyze it, and then we will iterate on the plan. Afterwards I want you to write up the results in a paper.

1 · Fundamentals and tools

Three generations in four years: chat, reasoning, agents

A brief example on developments since 2023

Can you give me a summary of the paper by Olga Balakina, Charlotte Christiansen, and Malene Kallestrup-Lamb? Don’t use web search

On PhD-level science questions, models are now above expert level

GPQA Diamond accuracy by model release date, 264 results; each dot is one model. Dashed lines: random guessing (25 percent) and expert human level (about 70 percent). Epoch AI, CC-BY.

Models differ

But the frontier is jagged

Who uses Copilot Chat or ChatGPT? Who has used an agent, such as Claude Code or GitHub Copilot in VS Code?

An LLM predicts the next token, over and over, very well

A token is a word or a piece of a word, about four characters of English. That is the whole training objective: given the text so far, predict the next token. Press the button.

So it is a prediction machine, not a lookup machine

Not a database

It does not look facts up. It generates text that is plausible given what it has seen.

Not a calculator

It predicts what an answer looks like. The arithmetic is right when the pattern is common, and the tools in section 6 exist because of this.

Not connected to your files

Or to the live web, unless the tool around it adds that. Out of the box it knows nothing about your course.

An invented citation is a sequence of plausible tokens. “Smith and Jones (2019)” is very plausible.

A very well-read, very fast colleague who has read almost everything but remembers none of it precisely, has no access to your files, will never admit to not knowing, and is unapologetic about being wrong.

Different tools

Copilot Chat

often licensed

Microsoft's chat tool for staff and students, which many universities recommend for its data protection

ChatGPT

check with IT

For staff, through the university's IT department; often not for students

GitHub Copilot

separate

An agent in VS Code; it reads the same skill files as Claude Code

Claude Pro

$20 / month

Claude Code, what session 2 runs on. Probably not on your university's list: your own material only, never student workSession 2

Check your university’s list of approved AI services. Claude’s tiers as of August 2026; Max, at $100–200 a month, is for heavy use.

Copilot Chat sees only what you paste, Claude Code the whole project folder

Copilot Chat Codex
Where it runs On Microsoft’s servers: browser, Teams, Outlook In a project folder on your computer, from VS Code
Sees your files Only what you paste or upload Any file in the folder, read when the task needs it
Runs code At most Python in Microsoft’s sandbox, not on your machine Python, MATLAB or LaTeX on your computer, after asking you
Standing instructions and skills Custom instructions and memory. Skills from October to November 2026, if your IT department allows AGENTS.md in the folder, read at every start. Skills in .codex/skills, run with $name
University status Often licensed by the university, with enterprise data protection Available through ChatGPT Edu

Chat runs in a sandbox; an agent runs on your computer

Chat (Copilot Chat, ChatGPT, Claude.ai)

  • Runs on the provider’s server, walled off from your machine
  • Sees only what you paste or upload
  • Gives text back; you move it where it belongs
  • Answers get generic when the paste is thin

When to use: brainstorming, polishing one paragraph, quick lookups.

An agent (Claude Code, Codex, GitHub Copilot)

  • Runs in a folder on your computer
  • Can read any file in the project, and edit it
  • Runs code, shell commands, search, web, MCP tools
  • Output is grounded in your files and lands in them

When to use: any task that touches more than one file or needs to execute code.

But the two are converging

What chat borrowed from agents

Claude and ChatGPT both have projects: upload files, set standing instructions, keep a memory per project. That is the context half of what an agent has, in a chat window.

Both apps now contain an agent: the Code and Cowork tabs in the Claude app, Codex inside ChatGPT.

What chat still lacks

The loop. Projects hold context; they do not read your folder, write files, or run code and fix what broke.

The agent is a loop: prompt, model, tool, result, repeat

Your prompt goes to the model together with the context: CLAUDE.md, a file of standing instructions the agent reads every session, plus the folder listing and the conversation so far.

The model decides which tool to call. The harness runs it and puts the result back into the conversation. Repeat until the task is done, or the agent asks you a question.

Stylised trace of the course-page session. After Korinek (2025); figure adapted from Velikov (2026). All six tools are in the appendix.

Context is a budget

Everything the model conditions on has to fit in one window: the standing instructions, the tool definitions, the conversation, and every file it reads. Drag the slider to the right.

Context improves AI tools tremendously, and the goal is to provide the right context.

Chat: you paste it. Projects: you upload it once. An agent: it goes and reads it.

Five prompting rules: specific, iterate, correct early, verify, restart

1Specific“Feedback on the hypotheses in section 2, against the rubric”, not “feedback on this thesis”.
2IterateTen to twenty turns, not one. Each turn adds context.
3Correct earlyIf the first answer is off, fix it now, or restart.
4VerifyRun the code. Re-read the passage. Check the citation.
5RestartThirty turns or a shifted task: a fresh session.

2 · Supervision and assessment of theses

Students already use AI for assessed work, mostly without guidance

94% of UK undergraduates use generative AI to support assessed work

48% say their teaching staff help them build the AI skills they need

35% of students in Sweden used ChatGPT regularly in spring 2023, five months after its release

Higher Education Policy Institute and Kortext (2026), 1,054 UK undergraduates, December 2025. Malmström et al. (2023), 5,894 students in Sweden, April–May 2023, recruited through social media and student organisations.

The research plan for the AI and house prices project: question, data, design and what could go wrong

  • Question. Did house prices grow faster after ChatGPT in Danish municipalities whose residents hold AI-exposed jobs?
  • Data. 14 tables from Statistics Denmark and house prices from Finans Danmark, for 98 municipalities.
  • Design. Exposure from ILO occupation scores, fixed before 2022, and an event study that compares municipalities within a province.
  • Threats. The urban trend, the 2022 rate shock, the 2024 property-tax reform, remote work.
From the plan, in the agent’s words

“RAS301 counts jobs located in a municipality and RAS302 counts employed residents. The table titles do not say this, so I checked the counts. In 2024 RAS301 records 464,753 employed in Copenhagen and RAS302 records 395,027.”

The research plan in the thesis example, sections 1–5. The live session on screen is at an earlier stage of the same prompt.

Five minutes of my time and 30–45 minutes of the agent’s: the data, a map and a first regression

5 min of my time: the prompt and a few replies

30–45 min of the agent working on its own

≈ 0 extra cost beyond the subscription

In the folder. Nine scripts in Python and Stata and one file that runs them in order, data from Statistics Denmark, Finans Danmark and the ILO, four figures, three tables, and the plan with the results written up.

AI exposure of employed residents in Denmark’s 98 municipalities, from the thesis example. Time and cost from the run.

The agent reports the bad news itself: the gap between exposed and unexposed areas predates ChatGPT

“The raw association predates ChatGPT.”

“Within provinces there is no association yet.”

High-exposure municipalities gained about 20 log points on low-exposure ones between 2015 and 2021. Within provinces the estimate after ChatGPT is 0.8 log points, with a standard error of 1.0.

The agent’s summary of its own results, research plan section 9. House prices per m² by tercile of AI exposure, relative to 2022Q3.

Efforts underway to automate research

  • Project APE has automated 1,000 policy-evaluation papers.
  • Alejandro López-Lira built a system that finds a problem, generates a theory, verifies it adversarially and writes a publication-ready paper.
  • Novy-Marx and Velikov (2026) describe how academic research could be automated with LLMs, and what that does to the literature.

For a supervisor: a document that looks like a thesis is no longer evidence of the work behind it.

Are we there yet?