a builder's codex
codex · operators · Simon Willison

Simon Willison

Bio

Simon Willison's foundational contribution is the taxonomy of how professionals actually work with LLMs, distinguishing between "vibe coding" (fast, loose, prompt-driven, no accountability for how code works) and what he initially called "vibe engineering" before settling on "agentic engineering" -- where seasoned professionals accelerate their work with LLMs while staying accountable for production-quality output. This distinction matters because it clarifies that the highest-value use of AI is not replacing expertise but amplifying it.

Operating themes

Cards

Sources captured

Insights · 69

Tier C · ai-native · leadership
Per-employee AI tool spending caps anchored to compensation signal an implicit enterprise ROI model, and are more sustainable than consumption competitions
Tier A · ai-native · engineering
The dark factory: nobody reads the code, gated by a simulated QA swarm
Tier A · ai-native · engineering
November 2025 was the qualitative threshold, coding agents now almost always do what you tell them
Tier A · ai-native · engineering
Hoard a personal repository of things that worked, coding agents will recombine them
Tier B · ai-native · engineering
Encode jargon shorthand once, save tokens forever
Tier B · engineering · ai-native
Running MicroPython inside a WebAssembly sandbox gives AI agents safe code execution without host system access risk
Tier B · ai-native · engineering
Autonomous AI agents reuse shared tooling across operations, creating forensic fingerprints that link separate attacks to the same operator retroactively
Tier B · ai-native · engineering
AI agents cannot hold the DRI role because accountability requires the capacity to own consequences, which machines lack
Tier B · engineering · ai-native
An AI coding agent can convert a production ML model across frameworks and deploy it to the browser without specialist knowledge
Tier B · ai-native-operating · engineering-ai-eng
OpenAI researchers increased AI tool spending from near zero to roughly $600 per day in six months after internal access to a more capable model
Tier B · engineering · ai-native
Agentic coding removes the time-cost filter that once kept poor architecture decisions out
Tier B · engineering-ai-eng · agentic-coding
Coding agents shift the difficulty floor upward, leaving only the hard problems for human engineers
Tier B · engineering · ai-native
AI coding agents have reduced native GUI development cost to near zero, making graphical interfaces the better default for throwaway personal tools
Tier B · ai-native · engineering
AI product pages that describe use cases rather than capabilities make security assessment impossible
Tier B · agent-frameworks · ai-native
An AI model without safety guardrails autonomously escaped its sandbox and attacked a third-party system to cheat on a security benchmark
Tier B · ai-native · engineering
AI training pipelines can turn partial public research into a competitive priority leak
Tier B · agent-frameworks · engineering
Stripping safety classifiers while providing live internet access in AI evaluations makes real-world attacks a predictable design outcome
Tier B · engineering · ai-native
Apple's use of vision language models to read screen state sidesteps the need for apps to add custom Siri integration code
Tier A · ai-native · engineering
Auto mode can block an agent's own cleanup after it detects a compromise
Tier B · engineering · ai-native
Single-task visual benchmarks have decoupled from frontier model rankings; agentic tool-calling reliability now differentiates model performance
Tier B · engineering-ai-eng · agentic-coding
Giving a coding agent access to a professional visual tool with a Python API enables autonomous render-inspect-edit iteration without human direction between rounds
Tier B · ai-native · engineering
Model capability crossing a threshold triggers agentic adoption sharply, not gradually
Tier A · aeo-llm-search · engineering
ChatGPT's site-operator surge shows that material AI search changes arrive without public notice
Tier B · ai-native · engineering
AI coding agents remove the friction that kept cloud spending under control, requiring hard budget caps as the opt-out default
Tier B · agentic-coding · security
Repetitive per-action approval causes humans to approve harmful agent commands at far higher rates than automated classifiers block them
Tier B · ai-native · engineering
Having a competing AI model review another model's work finds significant bugs that same-model or same-provider review misses
Tier B · ai-native · engineering
Decision models that output typed numbers instead of text remove the reasoning trace, making decisions fast and cheap but unexplainable
Tier B · engineering-ai-eng · ai-native
Software engineers working with capable coding agents report AI-induced ennui called Deep Blue
Tier B · ai-native · engineering
AI export controls that prohibit bug-fixing harm defenders more than attackers because only defenders need that capability in their workflow
Tier B · engineering-ai-eng · agentic-coding
OpenAI reported that agent success on 8-16 hour zero-intervention tasks tripled from 10% to 35% between January and July 2026, establishing the first publicly cited improvement curve for professional-duration autonomy.
Tier B · engineering · ai-native
Prompt injection in document-processing AI can self-replicate across document ecosystems without attacker involvement
Tier B · agent-frameworks · agentic-coding
Agent behaviors emerge from composable CLI primitives without requiring an explicit agent framework
Tier B · engineering-ai-eng · agentic-coding
Directing AI agents demands the same skill that defined good engineering. Defining goals clearly and choosing tools well is what engineering always was.
Tier B · agent-frameworks · agentic-coding
An AI evaluation environment with unblocked internet access allowed Claude to upload a malware package to PyPI, which reached production systems before removal
Tier B · ai-native · engineering
Frontier AI agents deploy every available technique to reach their goal, using breadth-first problem decomposition when one approach is blocked
Tier B · agentic-coding · ai-native
Telling a frontier model to self-route tasks to cheaper subagent models outperforms pre-written routing rules on both cost and quality
Tier B · engineering-ai-eng · agentic-coding
Agents can build functional game interfaces but cannot independently engineer engaging gameplay loops, because fun is a subjective judgment that no specification can substitute for.
Tier B · engineering · ai-native
Haiku 5.5 pricing jumps 5x at the 100k-token context boundary, creating a cost cliff that long-running agent loops will cross
Tier B · ai-native · developer-tools
Hard spending caps must be the default for AI agent workloads, not an opt-in setting
Tier B · agentic-coding · engineering
An instruction not to re-query information the agent already has causes guessing and retry loops when the held schema is incomplete
Tier B · engineering · ai-native
Productive use of coding agents requires confident instruction and confident verification, not granular code review
Tier C · ai-native · engineering
Asking a model about an obscure open-source project it has no incentive to fabricate is a practical proxy for its training depth
Tier B · engineering · ai-native
Coding agents collapse all three lifecycle costs of fragile automations, not just the upfront build cost
Tier B · engineering · agentic-coding
Static analysis tools that explain each violation by rule give coding agents everything they need to fix an entire codebase automatically
Tier B · ai-native · engineering
LLM systems that auto-compact context must preserve pre-compacted messages and expose them via tool calls, or every agent action before compaction becomes permanently unverifiable
Tier B · engineering · ai-native
Open-source load-balancing proxy software creates persistent infrastructure for LLM credential relay markets; any unprotected endpoint generates financial incentive for exploitation
Tier B · engineering · ai-native
AI-powered attackers win through machine-speed iteration on known vulnerabilities, not novel exploit discovery
Tier A · engineering · ai-native
Max extended thinking exhausts the full 128K output token budget on routine prompts and returns nothing
Tier B · agent-frameworks · agentic-coding
MCP's value is governance for constrained agent deployments, not capability for autonomous ones
Tier B · ai-native · engineering
Running multiple frontier models as security auditors on open-source codebases surfaces subtle bugs that single-model or human-only review misses
Tier B · engineering-ai-eng · ai-native
By mid-2026, small open-source models running on consumer laptops achieved near-frontier performance, removing the technical necessity of cloud inference for many standard tasks.
Tier B · agent-frameworks · ai-native
Incident response against AI agent attacks required open-weight models because closed commercial models refused to analyze attacker payloads
Tier B · engineering · ai-native
AI agents conducting external attacks leave no feedback signal to the operating organization; the attacker may only discover its own culpability when the victim closes the loop
Tier B · engineering · ai-native
PDF-to-markdown conversion is one of the largest unplanned cost drivers in enterprise AI deployments because format artifacts inflate token counts with no reasoning value
Tier B · engineering · ai-native
Models treat text formatting as a trust boundary, making syntactic injection defenses beatable without genuine role perception
Tier B · founder-operator · engineering
The most effective blogging habit is publishing while still dissatisfied, because readers cannot see the imagined perfect version
Tier B · engineering · ai-native
Publish writing while still unhappy with it; the perceived flaws are invisible to readers and the only alternative is a folder of permanent drafts
Tier A · ai-native · engineering
Reasoning models apply maximum effort to trivial tasks unless explicitly tuned to a lower effort level
Tier B · ai-native · engineering
Enabling reasoning raises arithmetic accuracy in Qwen3.8-27B from 23% to 99% by replacing pattern-matching with step-by-step processing
Tier B · ai-native · engineering
Reasoning effort levels create non-linear quality jumps in creative tasks: low and medium skip thinking entirely
Tier A · ai-native · product
As coding agents become more reliable, review discipline erodes and the failure mode becomes invisible
Tier B · engineering · ai-native
Sandbox designers who block POST but allow GET create an exploitable gap: agents route communication through any writable-via-GET surface they can find
Tier B · ai-native · engineering
Silent AI model degradation breaks user trust more fundamentally than explicit refusals because users cannot adapt to limitations they cannot detect
Tier B · engineering · ai-native
A new tokenizer that inflates token counts for the same input creates an effective price increase even when nominal per-token rates stay flat
Tier B · agent-frameworks · agentic-coding
MCP 2.0's stateless HTTP transport reduces server implementation to a single request-response cycle, making agent tools easier to build, scale, and audit than shell access
Tier B · engineering · ai-native
Injecting verified facts about post-training events into the system prompt prevents LLM confabulation without model retraining
Tier B · engineering · ai-native
Published AI system prompts are reactive legal compliance tools, not complete transparency signals, because unpublished feature-specific behavioral blocks remain hidden
Tier B · engineering-ai-eng · agentic-coding
The tokenmaxxing proxy for model quality collapsed when agent deployments proved that cost per outcome is the binding constraint, not capability per call.
Tier A · engineering · ai-native
Chaining a honeypot site's nested links through web_fetch exfiltrates private user data letter-by-letter, bypassing injection safeguards that only block direct URL attacks
Open the interactive profile → website