Talk one of four · 19 October 20261 / 20

Hands
and feet

From language model to agent

AI in Systems Engineering · week 7 · Andrew Dunn

Part 0 · Meta2 / 20

Andrew Dunn

Building tools, infrastructure and systems that let someone do work they couldn’t do before.

andrew.dunn.dev/activity

andrew@dunn.dev

  1. BackgroundModeling and simulation, built on software, statistics and platform engineering
  2. Systems engineeringPractised under Dr. Rapp
  3. RolePost-sales engineering at GitLab, since leaving public service last year · gitlab.com/andunn
  4. ResearchMethods for evaluating how language models perform when handed a meta model, on SysML v2 · gitlab.com/nomograph
Part 0 · Meta3 / 20

Three weeks, one climb

  1. Week 7 · Hands and feet people and a new tool, on an everyday task
  2. Week 8 · The ladder and the meter what the model is shown, and how you score what comes back
  3. Week 9 · Structure over the trove systems engineering and meta-modelling over a pile of information

Each week: talk → walkthrough (alone, about twenty minutes) → lesson (build it)

Part 0 · Meta4 / 20

Today’s question

What turns a language model into something that does work for you?

Part I · The wordsWord 1 of 12

Language model

You type words, words come back.

Part I · The wordsWord 2 of 12

Context window

Everything the model sees this turn. Nothing else exists for it.

Part I · The wordsWord 3 of 12

System prompt

Standing instructions placed ahead of every conversation.

Part I · The wordsWord 4 of 12

It forgets

A new conversation starts with a fresh window.

Part I · The wordsWord 5 of 12

Tool

Something the program will do when the model asks: read or write a file, search, run a command.

Part I · The wordsWord 6 of 12

Tool call

The request and its result, both written into the window as text.

Part I · The wordsWord 7 of 12

Loop

Read, call, result, read again, until it answers.

Part I · The wordsWord 8 of 12

Harness

The program around the model: runs the loop, holds the tools, decides what is allowed.

Part I · The wordsWord 9 of 12

Agent

A model in a harness, with tools, in a loop. Tools are its hands, the loop its feet.

Part II · What it meansWord 10 of 12

Memory system

Plain files the harness reads before anything else.

Part II · What it meansWord 11 of 12

Every change carries a name

The memory system is under git: what changed, when, and by whom, and you can take it back.

Part II · What it meansWord 12 of 12

The loop stops for a person

A fixed point where a person decides, before anything is written.

Part II · What it means17 / 20

Where the model works

Today most of us carry text to a chat window by hand. The harnesses moved the model to where the work is.

Part III · Your turn18 / 20

Read the walkthrough first

One mistake, followed through, in six short chapters.

andrew.dunn.dev/guides/hands-and-feet/

QR code for andrew.dunn.dev/guides/hands-and-feet/
Part III · Your turn19 / 20

Build it

Everything from today, built for real on the dinner problem.

andrew.dunn.dev/lessons/larder/

QR code for andrew.dunn.dev/lessons/larder/
Part III · Your turn20 / 20