Comparison & Visual Guide
This page is the public comparative guide to Adaptive Experience Architecture: mapping the six-layer outer harness, the 5 concentric building floors, and engineered memory alongside modern software engineering practices.
Why Most AI Prototypes Never Make It to Production: A chatbot that talks charmingly in a demo is not a finished business. When real customers order flowers, the system must check physical cooler inventory, calculate delivery routes, itemize taxes, and process payments without leaking data. AI language models are probabilistic word predictors—they cannot manage a real warehouse. The Outer Harness is the software factory built around the AI to guarantee real-world honesty and safety.
What this is · Why prototypes fail · Everyday formula · Three eras · 5 floors · Second brain · Team roles · Six layers · Honest ledger · Sources
What this is
An independent architecture analysis by Art of Group. It maps AEA onto six harness layers (guides, sensors, loop, memory, permissions, observability) and five concentric floors used in contemporary engineering literature. The AEA formula remains: Shared Understanding + Domain Services + Outer Harness. The flower shop at aea.artof.link serves as our Path B reference case study (evening demo window by default — see ledger). Knowledge about that shop lives here; /native and /framework on the shop host are not documentation pages.
What this is not
- Not an official paper from Google, OpenAI, Anthropic, or HashiCorp.
- Not affiliated with or endorsed by those organizations.
- Not an artificial benchmark leaderboard. Third-party benchmarks (GAIA swings, Terminal Bench ranks, million generated lines) belong to cited external papers and were not measured on Lily's Florist.
- Not proof that dual-viewport presentation is finished. A fresh journey clip after the recent CSS updates remains Unknown.
1. The Core Formula in Everyday Terms
Adaptive Experience = Shared Understanding + Domain Services + Outer Harness
The Three Golden Rules
The first three are safety rules. Keep Learning and Apply is an operating principle alongside them: when the build teaches something, write it into the harness before the next loop.
- AI Interprets, Domain Services Decide: The AI suggests flowers, but only the database confirms they are in stock.
- Fail-Closed Availability: If the inventory server is unreachable, the purchase button turns off. It is far better to say "Checking stock..." than to sell bouquets you cannot deliver.
- No Self-Approval: The engineer or AI that writes code is never the one who signs off on pushing it to customers.
- Keep Learning and Apply: When the build teaches something, write it into the harness (skill, sensor, guide, matrix row, or ADR) before the next loop — so the next agent inherits it instead of rediscovering the failure.
2. The Three Eras of Building with AI (2023 → 2026)
| Era | Core Focus | What It Optimized | The Fatal Flaw |
|---|---|---|---|
| Era 1: Prompting (2023–24) | Single Utterance | Magic prompt keywords, tone, phrasing | The AI forgets everything the second the chat window closes. |
| Era 2: Context / RAG (2025) | What the AI sees | Stuffing large PDF manuals and search results | Information overload; the AI knows facts but lacks real actions. |
| Era 3: Harness Eng. (2026) | The Entire System | Automated test guards, databases, merge gates | None. The AI is bounded by real-world software engineering. |
3. The 5 Concentric Floors (Why AI Apps Break)
Think of an AI system like a 5-story building. Each floor rests on the one below it. If you skip the lower floors, the top floor collapses.
- The Dependency Law: If your multi-agent team keeps failing, don't blame the agents—check your memory filter. Bad input on Floor 2 ruins everything above it.
- The Economic Law: Swapping the AI model (like switching from Claude to GPT or Gemini) takes 1 afternoon. Rebuilding your 5-floor operational harness takes 3 months. The harness is your real intellectual property.
4. How the "Second Brain" Solves AI Amnesia
Without engineered memory, an AI starts every new conversation from scratch. Dumping hundreds of pages of past chat logs into the prompt makes the AI slow, expensive, and confused. AEA organizes memory into 4 clean vaults:
- 📖 1. Procedure Memory (Skills): Step-by-step playbooks for repeatable workflows (e.g., how to build an Android app or run tests).
- 🚫 2. Correction Memory (Constraints): Hard rules learned from past mistakes (e.g., "Never invent fake requirement IDs").
- 🕸️ 3. Relationship Memory (Graph): Links showing how features, requirements, customer occasions, and code connect.
- 📅 4. Daily Brief (Handoff): A clean 1-page summary of exactly where the team left off today so work resumes instantly.
5. Team Organization: 14 Hats Mapped to 6 Functions
To prevent agents and developers from stepping on each other, AEA organizes 14 specialized roles into 6 clear functions:
| Function | Stakeholder Roles | Core Responsibility |
|---|---|---|
| 1. Discovery | UX Designer, Customer Journey, Support Coordinator | Identify shopper friction, design mobile/web flows, and intake customer needs. |
| 2. Strategy | Product Owner, Project Manager | Set business priorities, manage milestone delivery, and enforce scope gates. |
| 3. Safety | Security Auditor, Cost Guardian, Performance Guardian, Coherence Guardian | Block prompt injection, enforce cloud spending caps, guarantee fast loading times. |
| 4. Builders | Senior Software Engineer, AI Engineer, DevSecOps Platform | Build backend services, native Android apps, cloud infrastructure, and AI models. |
| 5. Gatekeeper | Merge Request Coordinator (@aea-mrc) | Independent Review: Verifies all tests pass before code touches production. |
| 6. Knowledge | Knowledge Guardian (@aea-kg) | Records every breakthrough and lesson into the Second Brain for future sessions. |
6. The Six Layers of the Outer Harness in Practice
- Guides (The Rulebook): Clear instructions, role limits, and playbooks loaded before starting any task.
- Sensors (The Smoke Alarms): Automated tests and fail-closed checks that detect errors before customers see them.
- The Loop (The Factory Line): Disciplined workflow: One issue → one branch → one merge request.
- Memory (The Vault): Preserves lessons and daily handoffs so past mistakes are never repeated.
- Permissions (The Keycard): Strict controls over who can touch sensitive customer data, budgets, or servers.
- Observability (The Dashboard): Real-time Grafana telemetry proving the entire system is healthy with hard facts.
Honest Status Ledger
To avoid confusing architecture mental models with live production software, every concept on this site is explicitly flagged:
| Item / Concept | Status Flag | Operational Reality | |
|---|---|---|---|
| Domain Services & Backend | Deployed / pilot schedule | PostgreSQL, Kafka (MSK), Nginx, and Edge BFF on AWS ECS Fargate (aea.artof.link). Default online 20:00–22:00 Europe/Berlin daily or short on-demand lease — not 24/7. MSK+NAT stay (phase 1). Schedule claim Documented until Lambda probed. | |
| Path B pilot demo window | Documented (schedule) / Probed (resting page) | Sponsor policy: evening demo 20:00–22:00 Europe/Berlin + Lambda wake with short lease. Off-window ALB fixed-response resting HTML Probed 2026-09-17 (infra/aws/static/offline.html). Schedule Lambda/S3 still DSO-owned / Documented. Not office hours. Does not weaken NFR-003. Pages host unrelated. | |
| Fail-Closed Availability | Live / Verified | Select button automatically disables when inventory or delivery probes are stale or missing. | |
| 14 Pre-Flight Quality Guards | Live / Verified | Automated Python guards blocking secret leaks, skill drift, and broken traceability in CI. | |
| 14 Stakeholder Hats & MRC Gate | Live / Operational | Role separation and independent MR coordinator gate enforced before merging code. | |
| Second Brain Memory Vaults | Live / Operational | 4-vault curated Obsidian structure (Skills, Constraints, Graph, Daily Briefs) in Git. | |
| 5 Concentric Wrapping Floors | Taxonomy Map Only | Conceptual framing (Kocer) adapted to explain how AEA layers nest; not a separate library. | |
| rvaniaaaa 6-Role Second Brain | Taxonomy Map Only | Pattern evaluated for pre-irreversible gates; 6 generic role collapse is rejected. | |
| 10 Sep X-scan (gipp / beam / avid) | Taxonomy Map Only | Dual-loop lessons, token playbook, shared-wiki prompt. Not AEA evidence. Vault: research/random-thoughts/2026-09-10-aea-vs-x-scan-gipp-beam-avid.md. | |
| Second Brain OS comparison (Keep Learning) | Documented | XVIII-H: wiki/project IPOF; dual-claim pages; slash-command façade; read-only subagent roster; vault health sensors; evening pedagogy (#489–#495). Already covered (no redo): six layers, honesty ledger, KLA, 1→1 MR, MRC≠implementer, Decision #446–#451, Annatar #484–#487. Reject SBOS/Claude Path B runtime. | |
| steipete/agent-scripts + advisor pattern (Keep Learning) | Documented | XVIII-I: adapt one canonical rules file with tool pointers (#502) and skill header validation plus cross-tool audit (#503); adapt only the vendor-neutral model/effort routing by role principle (#504, proposal). Park /advisor (experimental, one vendor). Reject copying his rules content and user-home symlink scripts. Already covered: 14 role skills with generated adapters and drift check, independent verifier, escalation rule. Not Live until Pages probe. EVO-X2 multi-tool loading and routing cost effect are Unknown. Cite steipete/agent-scripts; advisor doc. | |
| Graph Engineering + two reviewed posts (Keep Learning) | Documented | XVIII-J: adapt a fresh-context verifier rule and a source-independence rule for cross-checks (#509); adapt a review-only fake-edge audit of CI stage barriers (#510). Park three-lens majority by default and fan-out tricks. Reject: duplicate node-contract ideas, the unverified cost anecdote, a flat-file notes article (19 Jul, already covered, rejects Obsidian) and a mixture-of-experts explainer (31 Aug, not a harness topic). Not Live. | |
| "100 tips for a personal AI agent" post (Keep Learning) | Documented | XVIII-N: ideas by u/palo888 (Reddit, May 2026), repackaged by @humzaakhalid; one builder's claims, unverified. Adapt a `Class: Hard\ | Default plus Why: line on every always-on rule (#548) and data-freshness stamps with TTL-means-Unknown and a degraded mode per integration (#549). Sharpen #503 (not_for:` field, usage count), #543 (escalation ladder 3/5) and #545 (verdict plus confidence on escalation packets, hypotheses expire after 30 days) by comment. Park a devil's-advocate pass on irreversible packets (#550). Reject personal-assistant features. Not Live. |
| Model-plus-harness survey, Jev repost, five-repo agents list (Keep Learning) | Documented | XVIII-M: the survey (arXiv 2606.20683, synthesis of public results) confirms the six-layer design; the post headline "quality comes from the model" is not confirmed as written. Adapt Layer/Cause fields on Findings (#543), a task-property table (#544), a confidence-routing policy and calibration check for the decision layer (#545), and review of third-party skill packs as code (#546, borderline with #527). Reject bulk installs, star counts, vendor multiples. Already covered: run configuration with scores (#535, #536), falsifiable changes (#525, #526), parallel gates (#450). Not Live. | |
| awesome-ai-agents map post (Keep Learning) | Documented | XVIII-L: read the list's category headings, not its picks. Adapt an Adoption record for new tools and dependencies (prior art, last release, licence, open issues, security model, measured need; #527) and propose a passive DAST baseline of our own allowlisted hosts (#528). Park Strix-style AI pentesting (needs written sponsor scope and a disposable environment). Reject as duplicates a stack-layer checklist (#340), observability/eval (Layer 6, #509, #525) and Graphiti (already Watch); reject adopting screenpipe, Cua or Open Interpreter (PX0). Checked: the list is real (MIT, 305 entries) but four of the five picks are not on it. Other claims unverified. Not Live. | |
| Two-model search harness post (Keep Learning) | Documented | XVIII-K: adapt evaluator isolation for merge gates (Gate-change: line, #525) and anchored lesson promotion (#526). Park idea-graph search (MAP-Elites/MCTS over a graph). Reject duplicates (planner/worker split, per-iteration reset), a graph database dependency, and the post's results and attribution (claimed, unverified; no paper linked). Not Live. | |
| Holmberg / LangChain harness patterns (Keep Learning) | Documented | Model-tier Choice; AutoMode pre-tool Gate; Holmberg recipe families (classify/dedupe, anti-slop Gate, post Score, SEO Score). Vault paper XVIII-G + framework schema/glossary (#471–#474). Not Live until Pages probe. Not Path B shop UI. Not TypeSafe/Jev or LangChain Typesafe middleware install. Cite Holmberg; LangChain. | |
| Anthropic agentic workflows (Keep Learning) | Documented | Workflow vs Agent; Augmented LLM map; five composable workflows ↔ Loop/Graph/Sensors; ground truth / measured complexity / ACI. Vault paper XVIII-F + framework schema/glossary (#460–#464). Not Live until Pages probe after merge. Not Path B shop UI. Not framework install. Cite Anthropic; X summary slash1sol. | |
| Keep Learning and Apply | Documented / Planned | Principle text is in repo (docs/framework/ + root AGENTS.md, GitLab #434). Live Pages at architecture.artof.link remains Unknown / Documented until a post-merge fetch (incl. ~375px table probe for #453). This MR does not claim Probed. Not a shop feature. | |
| CF-054 Dual-Viewport Live Re-record | Unknown / Regressed | CSS merged to repo, but dual-viewport side-by-side video clip re-recording remains unprobed. | |
| Live Stripe Card Gateway | Simulated Extension | Runs deterministic payment simulation engine under ADR-016; live Stripe is not active. | |
| Third-Party Benchmark Scores | Not AEA Evidence | GAIA, Terminal Bench, and 1M-line metrics belong strictly to cited papers [2], [6], [7]. |
Sources
Related work (cited, not inherited as AEA evidence):
- Mitchell Hashimoto, “My AI Adoption Journey,” mitchellh.com, 5 Feb 2026. Agent mistakes get a ratchet so they do not recur.
- Ryan Lopopolo, “Harness Engineering: Leveraging Codex in an Agent-First World,” OpenAI, 11 Feb 2026. Coding-agent field report. The million-line figure is not an AEA result.
- Birgitta Böckeler, “Harness Engineering for Coding Agent Users,” martinfowler.com, Apr 2026. Guides and sensors vocabulary.
- Vinay Trivedy, “The Anatomy of an Agent Harness,” LangChain Blog, 10 Mar 2026.
- Adnan Masood, “Agentic Harness Engineering,” Google Cloud / Medium, Jun 2026. GAIA deltas are not AEA results. Not an official Google research paper.
- LangChain Engineering, “Improving Deep Agents with Harness Engineering,” 17 Feb 2026. Terminal Bench ranks are not AEA results.
- Lauren Tan, “How Cursor Turned AI Agents Into Better Engineers,” Aug 2026.
- Anthropic, “Building Effective AI Agents,” anthropic.com, Dec 2024.
- Independent compilation, “Production Agent Engineering Practice 2026” (
harness_final.pdf). Independently compiled. Not affiliated with Google, OpenAI, or Anthropic. Used as a document-design template only, not as an official source of AEA evidence. - 0xWast3 (wast3), “Memory Engineering for Kimi,” Aug 2026. Context window is a workspace, not memory; splits procedure, correction, and relationship memory.
- Kocer (@kocer_eth), “Five Layers of Agent Engineering: Each One Wraps the One Below It,” Aug 2026. Resolves harness vs loop vs graph as five concentric floors (prompt, context, harness, loop, graph).
- rvaniaaa (@rvaniaaaa), “The Second Brain That Acts. The Agent Team That Remembers,” Aug 2026. Six non-overlapping roles around a compiled second brain; guardian blocks irreversible acts before executor.
- gippp69 (@gippp69), X post 2097659069456654812, retrieved 10 Sep 2026 (x.com 403; text via fxtwitter). Dual-loop after-run lessons as small memory files. Not AEA evidence.
- beamnxw (@beamnxw), X post 2097746415632155110, retrieved 10 Sep 2026. Claude cost playbook (audit / cache / effort) plus agent-memory commentary. Not AEA evidence. Paid hillclimb parked.
- Av1dlive (@Av1dlive), X post 2097639365644279857, retrieved 10 Sep 2026. Shared-wiki / Agentic Stack prompt (provenance, knowledge ≠ authority). Not an instruction to install a second Second Brain product.
- Shann Holmberg (@shannholmberg), X status 2101751911481573598, retrieved 21 Sep 2026. Workspace audit recipes (classify/dedupe, anti-slop Gate, post Score, SEO Score) as decision-layer recipes — Keep Learning map only; not TypeSafe/Jev endorsement.
- Sydney Runkle & Hunter Lovell, “Building a Harness with Jev,” LangChain Blog, 17 Sep 2026 (langchain.com/blog/building-a-harness-with-jev). ModelRouterMiddleware / AutoModeMiddleware related work — not AEA Path B dependency; vendor unit-cost claims not AEA evidence.
Primary AEA sources (probed on GitLab main, not chat):
- GitLab project artof-group/adaptive-experience-architecture
- Path B shop aea.artof.link (evening demo window / on-demand wake — not 24/7)
- This public site, allowlisted from
docs/framework/
Where they agree
- A fluent demo is not a production system.
- Prompt patches do not survive the next session. Environment changes do.
- Computational sensors beat asking a model whether it “feels” done.
- When the same failure repeats, fix the strongest layer (a sensor or a gate), not another paragraph.
- Cheap typed judgments (Choice / Score / Gate) belong before spend and before irreversible tools — not inside generative prose.
Where they differ
- The product. Related work is mostly coding agents. AEA is a customer-facing florist experience. Domain services stay authoritative for stock, price, delivery, and payment.
- The evidence. This page does not copy third-party bench deltas as if Path B had run them.
- The merge gate. AEA treats merge as an independent job. The hat that produced the change is not the judge of “verified.”
- Honesty as a sensor. Closing a ticket, merging CSS, or publishing Pages is not a journey clip.
- Coding-agent memory posts (10 Sep X-scan) are a map. They do not change the live shop. See the journal.
What AEA claims here
Only what has a probe, or Unknown:
- The formula and six layers are the public map.
- Path B exists as a live shop. Dual-viewport is the intended presentation.
- Daily-brief honesty (unprobed status words; same incident as Claim vs probe in the journal) was a real finding and was corrected in GitLab.
- Dual-viewport CSS merged. A journey on phone and desktop after that CSS is still Unknown. Do not round that up to verified.
What AEA does not claim here
- Live Stripe, a finished dual-viewport, a 14/14 skill score, GAIA, Terminal Bench, or a million generated lines.
- Endorsement by any organization named in related work.
- That AEA installed a second Second Brain product, or that a paid token hillclimb is running.
Back to the framework, the schema, the glossary, the Path B case study, or the journal.