Talk one of four · 19 October 20261 / 20
Hands
and feet
From language model to agent
AI in Systems Engineering · week 7 · Andrew Dunn
Part 0 · Meta2 / 20
- BackgroundModeling and simulation, built on software, statistics and platform engineering
- Systems engineeringPractised under Dr. Rapp
- RolePost-sales engineering at GitLab, since leaving public service last year · gitlab.com/andunn
- ResearchMethods for evaluating how language models perform when handed a meta model, on SysML v2 · gitlab.com/nomograph
Part 0 · Meta3 / 20
Three weeks, one climb
- Week 7 · Hands and feet people and a new tool, on an everyday task
- Week 8 · The ladder and the meter what the model is shown, and how you score what comes back
- Week 9 · Structure over the trove systems engineering and meta-modelling over a pile of information
Each week: talk → walkthrough (alone, about twenty minutes) → lesson (build it)
Part 0 · Meta4 / 20
Today’s question
What turns a language model into something that does work for you?
Part I · The wordsWord 1 of 12
Language model
You type words, words come back.
Part I · The wordsWord 2 of 12
Context window
Everything the model sees this turn. Nothing else exists for it.
Part I · The wordsWord 3 of 12
System prompt
Standing instructions placed ahead of every conversation.
Part I · The wordsWord 4 of 12
It forgets
A new conversation starts with a fresh window.
Part I · The wordsWord 5 of 12
Tool
Something the program will do when the model asks: read or write a file, search, run a command.
Part I · The wordsWord 6 of 12
Tool call
The request and its result, both written into the window as text.
Part I · The wordsWord 7 of 12
Loop
Read, call, result, read again, until it answers.
Part I · The wordsWord 8 of 12
Harness
The program around the model: runs the loop, holds the tools, decides what is allowed.
Part I · The wordsWord 9 of 12
Agent
A model in a harness, with tools, in a loop. Tools are its hands, the loop its feet.
Part II · What it meansWord 10 of 12
Memory system
Plain files the harness reads before anything else.
Part II · What it meansWord 11 of 12
Every change carries a name
The memory system is under git: what changed, when, and by whom, and you can take it back.
Part II · What it meansWord 12 of 12
The loop stops for a person
A fixed point where a person decides, before anything is written.
Part II · What it means17 / 20
Where the model works
Today most of us carry text to a chat window by hand. The harnesses moved the model to where the work is.
Part III · Your turn18 / 20
Part III · Your turn19 / 20
Part III · Your turn20 / 20