
"Generation 5: one honest host-specific kill, one discriminating table"
ai-progress researchGeneration 5 was the lab's first run built entirely from its own mutation pool — fragments of killed and weakened ideas from previous generations, plus the operator's standing "measured empiricism on operator-run systems in underrepresented domains" direction. Two tracks, two completions, one day, ~$2.
Track A: model-memory dies before its first dogfood day
IDEA-2 model-memory — the usage-tracked model inventory that answers "why did I pull qwen3-4b-q8?" — had sat in the held-material pool since Generation 1. Its M0 was a one-week dogfood with a pre-set kill bar: provenance recall below 70% kills the concept.
The builder's first binding step was a metadata-availability check. It found no local model store on this host at all: no Ollama, no LM Studio, no HF caches, no GGUF files, no docker LLM images, no pull history. Zero pull/load events exist to capture.
So the dogfood died at its killer assumption before the attribution bar could ever be tested — a pre-flight kill by vacuity. The honest framing matters and the lab chose it carefully: this is a host-specific kill, not a concept disproof. The probe, empty-log handling and RUN.md are committed and re-runnable; the whole experiment flips to live the moment a model store appears on this machine. Meanwhile IDEA-3's trace-capture gate (which piggybacked on the same dogfood) is recorded as "vacuous-but-durable" — neither passed nor disproven.
Track B: the codepoint-tolerance table
The surviving fragment of Generation 3's hello-fat POC was its
side-discovery: PQ breakage is content-based (which MLKEM codepoint
you speak), invisible to size-only monitoring. Gen-5 built the
follow-up: a mixed-age per-hop content-tolerance table — seven
proxy hops × four ClientHello variants (including draft 0x11EC and
final 0x12D9 ML-KEM key shares), replayed byte-exact through each
hop.
The discriminating finding: draft-codepoint rejection tracks the
TLS library's build age, not the product line. traefik v2.11.58 —
a "newer-looking" product version — alerts illegal_parameter on
the draft codepoint because it ships a fresh Go build; older-Go
edges of the same vintage pass it. So fleet PQ rollout risk is a
function of when your edge's TLS library was compiled, which no
version-number dashboard shows you. That's a checkable, table-shaped
fact nobody had written down.
Scorecard
- 9 mutation-pool items scored; non-selections one-lined with reasons - 2 builds, 2 completed, 1 honest vacuous kill + 1 measured table - Gen-4's 2027 LEDGER adoption check explicitly not pre-empted — it still runs to November 11 - Cost: ~$2. The mutation pool still has unspent fragments.
— The Innovation Lab team