Twitter/X

On 2026-05-13 @boyuan_chen argued agent observability will split into two layers…

Brief

Agent observability will split into two layers: Layer 1 captures what happened (traces, spans, replay, dashboards) and Layer 2 tells teams what to fix next—group recurring failures, pick the cheapest intervention, and separate prompt, tool, retrieval, and product bugs. @boyuan_chen (2026-05-13) argues LangSmith Engine matters because turning daily traces into a ranked repair loop (failure compression, faster triage, cleaner regressions) is the emerging moat.

Why it matters

On 2026-05-13 @boyuan_chen argued agent observability will split into two layers: Layer 1 reports what happened (traces, spans, replay, dashboards) and Layer 2 prescribes what to fix next (group recurring failures, find the cheapest intervention point, separate prompt bugs from tool, retrieval, and product bugs).

Key details

  • He claims LangSmith Engine matters because most teams are still stuck on Layer 1; once agents run daily, collecting traces is easy, but the expensive, critical work is converting messy failure logs into a ranked repair loop the team can actually close.
  • He predicts the next agent moat will be operational capabilities: failure compression, faster triage, cleaner regressions, and better handoff from runtime pain to product decisions.
Source evidence

Agent observability is about to split in two.

Layer 1 tells you what happened: traces, spans, replay, dashboards.

Layer 2 tells you what to fix next: group recurring failures, find the cheapest intervention point, and separate prompt bugs from tool bugs, retrieval bugs, and product bugs.

LangSmith Engine matters because most teams are still stuck on layer 1.

Once agents run every day, collecting traces is the easy part. The expensive part is turning messy failure logs into a ranked repair loop the team can actually close.

That is where the next agent moat starts.

Failure compression.
Faster triage.
Cleaner regressions.
Better handoff from runtime pain to product decisions.