Laminar (YC S24) – RL-trained model that finds errors in agent traces

Hi HN, we’re Robert and Din from Laminar (https://laminar.sh). We’ve been building open-source observability for AI agents since 2024. Recently, we released flow-1, a model trained with RL to find errors in agent traces. On our benchmark (https://laminar.sh/blog/flow-1), it matches GPT-6-sol in detection quality while being 23x cheaper. This makes it affordable to analyze every production agent trace, without sampling.Here’s a one-minute walkthrough: https://youtu.be/KJa3h6ZJNLQWe also put together a post with example traces and analyses from flow-1 and other models: https://laminar.sh/blog/flow-1-in-actionAgent observability is crowded, so instead of a bullet list of how Laminar differs from X, we’ll explain how we’re solving agent observability from first principles.Agents now run for many steps and fail implicitly. An agent can click the wrong button or cite the wrong document while every call completes successfully. These errors are the most useful ones to catch and understand. To find them, you need to understand what the agent was trying to do and inspect its LLM calls and tool results. Simply looking at the final agent output is not enough.Collecting traces alone doesn’t solve this. A lot of agent observability platforms are still data collectors at their core. You can end up paying to store traces that nobody has time to read or extract value from.Using another LLM to inspect traces is THE solution, but capable models are expensive at scale and cheaper ones often miss errors or flag unrelated things.So we built our model to solve exactly this problem. We finetuned a small OSS model and then post trained it with RL on thousands of synthetic investigations of realistic agent workflows in software, legal, customer support, etc. We got a model that is both good at agent trace analysis and very cheap to run.flow-1 runs inside a harness we call Signals. It acts as a coding agent, treating an agent tr

Hacker NewsToolAISource
0Sign in to voteCopy link

FL score

82

out of 100

Verdict

BUILD

high confidence

Competition

No competitor data yet

Trend

No signal yet

Laminar offers a reinforcement learning-trained model that detects subtle errors in AI agent traces more cheaply and accurately than existing solutions.

The pain

AI agents often fail silently in multi-step workflows, making it hard to detect errors by just looking at final outputs or raw traces, causing costly undiagnosed failures.

The gap

Current observability tools either collect data without actionable insights or rely on expensive large models that are too costly to run at scale for every trace.

Build angle

By fine-tuning a smaller open-source model with reinforcement learning on synthetic agent workflows, the team built a specialized, affordable error detection model integrated into a usable harness.

Strengths

  • Clear and painful problem in AI agent observability
  • Cost advantage over large LLMs for trace analysis
  • Technical moat from RL training on synthetic realistic workflows
  • Working product with benchmarked performance

Risks

  • Competitive landscape with many observability tools
  • Uncertainty about broad market willingness to pay
  • Challenges in scaling and integrating into diverse agent platforms
  • Dependence on synthetic data quality for model accuracy

Questions about this idea?

FlyBot reads the scoring and gives you a second opinion on “Laminar (YC S24) – RL-trained model that finds errors in agent traces”.

Open FlyBot