AIâs trillion-dollar opportunity: Context graphs
đhttps://foundationcapital.com/context-graphs-ais-trillion-dollar-opportunity/
The last era of enterprise software produced giants by becoming systems of record: the place where data and workflows âofficially live.â Think CRM, ERP, HRISâtools that define what happened inside a business.
AI agents wonât replace those systems. Theyâll sit on top as the new interface: you ask, they act, they coordinate. But for agents to work reliably, they need more than clean APIs and better governance. They need the missing layer that actually runs most companies day to day: decision traces.
The missing layer: decision traces
In real operations, the important moments rarely look like a tidy workflow. They look like:
an exception approved âjust this onceâ
a policy override after a call with a key client
a discount that breaks the rule but matches precedent
a risk review that happens in chat, not in the tool
And thatâs the problem: the system of record usually stores the outcome (â20% discountâ), but not the rationale (why it was allowed, what evidence supported it, who signed off, what precedent existed).
So when we say âagents in real workflows,â the biggest blocker isnât missing data. Itâs missing reasoning artifactsâthe context humans rely on every day but donât consistently capture as structured data.
What a context graph is
A context graph is the accumulated structure of those decision traces over time. Itâs not a modelâs chain-of-thought. Itâs something more practical: a persistent, queryable record of why decisions happened and why they were allowed. If systems of record are the ledger of state, context graphs become the ledger of judgment.
How it gets built (and why it compounds)
The context graph emerges when the agent orchestration layer is instrumented so that every run emits a trace, for example:
what inputs were pulled (tickets, contract terms, usage, prior cases)
which policies were evaluated
what exceptions were invoked
who approved (or what rule authorized)
what was written back to each system
Imagine an agent proposing a discount above the policy limit. It gathers evidence across systems (support incidents, escalation history, renewal risk, prior approvals), routes the exception to the right approver, then records the full trace. The CRM may only keep â20% discount,â but the context graph keeps the story.
That story is valuable immediately (auditability, debugging), and it becomes more valuable over time because repeated exceptions turn into searchable precedent. Even with human-in-the-loop, the trace library compounds into a durable asset.
Why incumbents struggle to build it
Incumbent platforms are structurally disadvantaged for two reasons:
They optimize for current state, not decision context. Theyâre designed to store âwhat is,â not âwhy we did it.â
They often donât sit in the execution path across systems. A CRM âagent add-onâ inherits the CRMâs limits; it can record the final field updates, but not the full decision-time world state and rationale across tools.
Meanwhile, data platforms typically sit in the read path (ETL after the fact). They can tell you what changed, but not the context that disappeared at commit time. Capturing decision traces requires being present at the moment decisions are made and executed, across systems. Thatâs where âsystems of agentsâ have an advantage.
Three paths for startups
If youâre building in this space, there are three clean strategic routes:
Replace the system of record with an AI-native one (hard, but possible during major platform shifts).
Replace a module where exceptions and approvals concentrate, syncing final state back to incumbents.
Start as orchestration, evolve into a new system of recordâwhere the durable product is the decision trace itself, and the business comes to you to answer: âwhy did we do that?â
Where to look: signals that context graphs matter
Two signals reliably point to opportunity:
High headcount doing manual coordination/reconciliation (a sign the logic is too complex for traditional automation)
Exception-heavy decisions where precedent matters and âit dependsâ is the real rule.
A third signal is especially powerful: glue functions that exist at the intersection of systemsâRevOps, DevOps, SecOps. These roles exist precisely because no single tool captures cross-functional context. Automate the workflow and you can also capture the decision traces those teams implicitly generate every day.
The takeaway
Systems of record arenât going away. But the next major platform opportunity may be the system that captures what they donât: how decisions actually get made.
A context graph turns invisible judgment into durable dataâmaking autonomy safer, workflows more auditable, and edge cases learnable. The trillion-dollar category is a new âsystem of recordâ for decisionsâwhere the why is stored, searched, and reused.

